Aug 09 10:11:43 user nova-compute[72362]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 09 10:11:45 user nova-compute[72362]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=72362) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 09 10:11:45 user nova-compute[72362]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=72362) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 09 10:11:45 user nova-compute[72362]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=72362) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 09 10:11:45 user nova-compute[72362]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 09 10:11:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:11:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:11:46 user nova-compute[72362]: INFO nova.virt.driver [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 09 10:11:46 user nova-compute[72362]: INFO nova.compute.provider_config [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] Acquiring lock "singleton_lock" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] Acquired lock "singleton_lock" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] Releasing lock "singleton_lock" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] Full set of CONF: {{(pid=72362) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] ******************************************************************************** {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] Configuration options gathered from: {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] ================================================================================ {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] allow_resize_to_same_host      = True {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] arq_binding_timeout            = 300 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] backdoor_port                  = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] backdoor_socket                = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] block_device_allocate_retries  = 300 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] block_device_allocate_retries_interval = 5 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cert                           = self.pem {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] compute_monitors               = [] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] config_dir                     = [] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] config_drive_format            = iso9660 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] config_source                  = [] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] console_host                   = user {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] control_exchange               = nova {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cpu_allocation_ratio           = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] daemon                         = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] debug                          = True {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] default_access_ip_network_name = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] default_availability_zone      = nova {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] default_ephemeral_format       = ext4 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] default_schedule_zone          = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] disk_allocation_ratio          = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] enable_new_services            = True {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] enabled_apis                   = ['osapi_compute'] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] enabled_ssl_apis               = [] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] flat_injected                  = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] force_config_drive             = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] force_raw_images               = True {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] graceful_shutdown_timeout      = 5 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] heal_instance_info_cache_interval = 60 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] host                           = user {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] instance_build_timeout         = 0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] instance_delete_interval       = 300 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] instance_name_template         = instance-%08x {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] instance_usage_audit           = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] instance_usage_audit_period    = month {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] internal_service_availability_zone = internal {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] key                            = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] live_migration_retry_count     = 30 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] log_config_append              = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] log_dir                        = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] log_file                       = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] log_options                    = True {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] log_rotate_interval            = 1 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] log_rotate_interval_type       = days {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] log_rotation_type              = none {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] long_rpc_timeout               = 1800 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] max_concurrent_builds          = 10 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] max_concurrent_live_migrations = 1 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] max_concurrent_snapshots       = 5 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] max_local_block_devices        = 3 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] max_logfile_count              = 30 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] max_logfile_size_mb            = 200 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] maximum_instance_delete_attempts = 5 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] metadata_listen                = 0.0.0.0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] metadata_listen_port           = 8775 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] metadata_workers               = 3 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] migrate_max_retries            = -1 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] mkisofs_cmd                    = genisoimage {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] my_ip                          = 10.0.0.210 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] network_allocate_retries       = 0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] osapi_compute_listen_port      = 8774 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] osapi_compute_unique_server_name_scope =  {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] osapi_compute_workers          = 3 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] password_length                = 12 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] periodic_enable                = True {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] periodic_fuzzy_delay           = 60 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] pointer_model                  = ps2mouse {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] preallocate_images             = none {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] publish_errors                 = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] pybasedir                      = /opt/stack/nova {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] ram_allocation_ratio           = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] rate_limit_burst               = 0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] rate_limit_except_level        = CRITICAL {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] rate_limit_interval            = 0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] reboot_timeout                 = 0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] reclaim_instance_interval      = 0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] record                         = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] reimage_timeout_per_gb         = 60 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] report_interval                = 120 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] rescue_timeout                 = 0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] reserved_host_cpus             = 0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] reserved_host_disk_mb          = 0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] reserved_host_memory_mb        = 512 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] reserved_huge_pages            = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] resize_confirm_window          = 0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] resize_fs_using_block_device   = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] resume_guests_state_on_host_boot = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] rpc_response_timeout           = 60 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] run_external_periodic_tasks    = True {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] running_deleted_instance_action = reap {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] running_deleted_instance_poll_interval = 1800 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] running_deleted_instance_timeout = 0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] scheduler_instance_sync_interval = 120 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] service_down_time              = 720 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] servicegroup_driver            = db {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] shelved_offload_time           = 0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] shelved_poll_interval          = 3600 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] shutdown_timeout               = 0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] source_is_ipv6                 = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] ssl_only                       = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] state_path                     = /opt/stack/data/nova {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] sync_power_state_interval      = 600 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] sync_power_state_pool_size     = 1000 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] syslog_log_facility            = LOG_USER {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] tempdir                        = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] timeout_nbd                    = 10 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] transport_url                  = **** {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] update_resources_interval      = 0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] use_cow_images                 = True {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] use_eventlog                   = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] use_journal                    = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] use_json                       = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] use_rootwrap_daemon            = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] use_stderr                     = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] use_syslog                     = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vcpu_pin_set                   = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vif_plugging_is_fatal          = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vif_plugging_timeout           = 0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] virt_mkfs                      = [] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] volume_usage_poll_interval     = 0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] watch_log_file                 = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] web                            = /usr/share/spice-html5 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_concurrency.disable_process_locking = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] api.auth_strategy              = keystone {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] api.compute_link_prefix        = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] api.dhcp_domain                = novalocal {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] api.enable_instance_password   = True {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] api.glance_link_prefix         = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] api.instance_list_per_project_cells = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] api.list_records_by_skipping_down_cells = True {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] api.local_metadata_per_cell    = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] api.max_limit                  = 1000 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] api.metadata_cache_expiration  = 15 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] api.neutron_default_tenant_id  = default {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] api.use_forwarded_for          = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] api.use_neutron_default_nets   = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] api.vendordata_dynamic_targets = [] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] api.vendordata_jsonfile_path   = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cache.backend                  = dogpile.cache.memcached {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cache.backend_argument         = **** {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cache.config_prefix            = cache.oslo {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cache.dead_timeout             = 60.0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cache.debug_cache_backend      = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cache.enable_retry_client      = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cache.enable_socket_keepalive  = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cache.enabled                  = True {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cache.expiration_time          = 600 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cache.hashclient_retry_attempts = 2 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cache.memcache_dead_retry      = 300 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cache.memcache_password        =  {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cache.memcache_sasl_enabled    = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cache.memcache_username        =  {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cache.proxies                  = [] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cache.retry_attempts           = 2 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cache.retry_delay              = 0.0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cache.socket_keepalive_count   = 1 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cache.socket_keepalive_idle    = 1 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cache.socket_keepalive_interval = 1 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cache.tls_allowed_ciphers      = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cache.tls_cafile               = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cache.tls_certfile             = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cache.tls_enabled              = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cache.tls_keyfile              = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cinder.auth_section            = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cinder.auth_type               = password {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cinder.cafile                  = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cinder.certfile                = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cinder.collect_timing          = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cinder.cross_az_attach         = True {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cinder.debug                   = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cinder.endpoint_template       = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cinder.http_retries            = 3 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cinder.insecure                = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cinder.keyfile                 = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cinder.os_region_name          = RegionOne {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cinder.split_loggers           = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cinder.timeout                 = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] compute.cpu_dedicated_set      = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] compute.cpu_shared_set         = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] compute.image_type_exclude_list = [] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] compute.max_concurrent_disk_ops = 0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] compute.max_disk_devices_to_attach = -1 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] compute.resource_provider_association_refresh = 300 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] compute.shutdown_retry_interval = 10 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] conductor.workers              = 3 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] console.allowed_origins        = [] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] console.ssl_ciphers            = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] console.ssl_minimum_version    = default {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] consoleauth.token_ttl          = 600 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cyborg.cafile                  = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cyborg.certfile                = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cyborg.collect_timing          = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cyborg.connect_retries         = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cyborg.connect_retry_delay     = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cyborg.endpoint_override       = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cyborg.insecure                = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cyborg.keyfile                 = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cyborg.max_version             = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cyborg.min_version             = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cyborg.region_name             = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cyborg.service_name            = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cyborg.service_type            = accelerator {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cyborg.split_loggers           = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cyborg.status_code_retries     = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cyborg.status_code_retry_delay = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cyborg.timeout                 = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] cyborg.version                 = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] database.backend               = sqlalchemy {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] database.connection            = **** {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] database.connection_debug      = 0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] database.connection_parameters =  {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] database.connection_recycle_time = 3600 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] database.connection_trace      = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] database.db_inc_retry_interval = True {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] database.db_max_retries        = 20 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] database.db_max_retry_interval = 10 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] database.db_retry_interval     = 1 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] database.max_overflow          = 50 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] database.max_pool_size         = 5 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] database.max_retries           = 10 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] database.mysql_enable_ndb      = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] database.mysql_wsrep_sync_wait = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] database.pool_timeout          = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] database.retry_interval        = 10 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] database.slave_connection      = **** {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] database.sqlite_synchronous    = True {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] api_database.backend           = sqlalchemy {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] api_database.connection        = **** {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] api_database.connection_debug  = 0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] api_database.connection_parameters =  {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] api_database.connection_recycle_time = 3600 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] api_database.connection_trace  = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] api_database.db_inc_retry_interval = True {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] api_database.db_max_retries    = 20 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] api_database.db_max_retry_interval = 10 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] api_database.db_retry_interval = 1 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] api_database.max_overflow      = 50 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] api_database.max_pool_size     = 5 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] api_database.max_retries       = 10 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] api_database.mysql_enable_ndb  = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] api_database.pool_timeout      = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] api_database.retry_interval    = 10 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] api_database.slave_connection  = **** {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] api_database.sqlite_synchronous = True {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] devices.enabled_mdev_types     = [] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] ephemeral_storage_encryption.enabled = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] glance.api_servers             = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] glance.cafile                  = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] glance.certfile                = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] glance.collect_timing          = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] glance.connect_retries         = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] glance.connect_retry_delay     = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] glance.debug                   = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] glance.default_trusted_certificate_ids = [] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] glance.enable_certificate_validation = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] glance.enable_rbd_download     = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] glance.endpoint_override       = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] glance.insecure                = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] glance.keyfile                 = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] glance.max_version             = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] glance.min_version             = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] glance.num_retries             = 3 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] glance.rbd_ceph_conf           =  {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] glance.rbd_connect_timeout     = 5 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] glance.rbd_pool                =  {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] glance.rbd_user                =  {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] glance.region_name             = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] glance.service_name            = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] glance.service_type            = image {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] glance.split_loggers           = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] glance.status_code_retries     = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] glance.status_code_retry_delay = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] glance.timeout                 = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] glance.verify_glance_signatures = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] glance.version                 = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] guestfs.debug                  = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] hyperv.config_drive_cdrom      = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] hyperv.config_drive_inject_password = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] hyperv.enable_instance_metrics_collection = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] hyperv.enable_remotefx         = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] hyperv.instances_path_share    =  {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] hyperv.iscsi_initiator_list    = [] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] hyperv.limit_cpu_features      = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] hyperv.power_state_check_timeframe = 60 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] hyperv.use_multipath_io        = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] hyperv.volume_attach_retry_count = 10 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] hyperv.vswitch_name            = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] mks.enabled                    = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] image_cache.manager_interval   = 2400 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] image_cache.precache_concurrency = 1 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] image_cache.remove_unused_base_images = True {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] image_cache.subdirectory_name  = _base {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] ironic.api_max_retries         = 60 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] ironic.api_retry_interval      = 2 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] ironic.auth_section            = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] ironic.auth_type               = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] ironic.cafile                  = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] ironic.certfile                = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] ironic.collect_timing          = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] ironic.connect_retries         = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] ironic.connect_retry_delay     = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] ironic.endpoint_override       = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] ironic.insecure                = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] ironic.keyfile                 = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] ironic.max_version             = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] ironic.min_version             = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] ironic.partition_key           = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] ironic.peer_list               = [] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] ironic.region_name             = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] ironic.serial_console_state_timeout = 10 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] ironic.service_name            = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] ironic.service_type            = baremetal {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] ironic.split_loggers           = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] ironic.status_code_retries     = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] ironic.status_code_retry_delay = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] ironic.timeout                 = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] ironic.version                 = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] key_manager.fixed_key          = **** {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] barbican.barbican_api_version  = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] barbican.barbican_endpoint     = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] barbican.barbican_endpoint_type = public {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] barbican.barbican_region_name  = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] barbican.cafile                = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] barbican.certfile              = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] barbican.collect_timing        = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] barbican.insecure              = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] barbican.keyfile               = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] barbican.number_of_retries     = 60 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] barbican.retry_delay           = 1 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] barbican.send_service_user_token = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] barbican.split_loggers         = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] barbican.timeout               = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] barbican.verify_ssl            = True {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] barbican.verify_ssl_path       = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] barbican_service_user.auth_section = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] barbican_service_user.auth_type = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] barbican_service_user.cafile   = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] barbican_service_user.certfile = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] barbican_service_user.collect_timing = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] barbican_service_user.insecure = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] barbican_service_user.keyfile  = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] barbican_service_user.split_loggers = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] barbican_service_user.timeout  = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vault.approle_role_id          = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vault.approle_secret_id        = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vault.cafile                   = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vault.certfile                 = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vault.collect_timing           = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vault.insecure                 = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vault.keyfile                  = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vault.kv_mountpoint            = secret {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vault.kv_version               = 2 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vault.namespace                = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vault.root_token_id            = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vault.split_loggers            = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vault.ssl_ca_crt_file          = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vault.timeout                  = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vault.use_ssl                  = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] keystone.cafile                = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] keystone.certfile              = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] keystone.collect_timing        = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] keystone.connect_retries       = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] keystone.connect_retry_delay   = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] keystone.endpoint_override     = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] keystone.insecure              = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] keystone.keyfile               = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] keystone.max_version           = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] keystone.min_version           = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] keystone.region_name           = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] keystone.service_name          = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] keystone.service_type          = identity {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] keystone.split_loggers         = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] keystone.status_code_retries   = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] keystone.status_code_retry_delay = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] keystone.timeout               = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] keystone.version               = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.connection_uri         =  {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.cpu_mode               = custom {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: WARNING oslo_config.cfg [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.cpu_power_governor_high = performance {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.cpu_power_governor_low = powersave {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.cpu_power_management   = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.device_detach_attempts = 8 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.device_detach_timeout  = 20 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.disk_cachemodes        = [] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.disk_prefix            = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.enabled_perf_events    = [] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.file_backed_memory     = 0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.gid_maps               = [] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.hw_disk_discard        = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.hw_machine_type        = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.images_rbd_glance_store_name =  {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.images_rbd_pool        = rbd {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.images_type            = default {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.images_volume_group    = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.inject_key             = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.inject_partition       = -2 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.inject_password        = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.iscsi_iface            = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.iser_use_multipath     = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.live_migration_bandwidth = 0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.live_migration_downtime = 500 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.live_migration_inbound_addr = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.live_migration_permit_post_copy = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.live_migration_scheme  = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.live_migration_timeout_action = abort {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.live_migration_tunnelled = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: WARNING oslo_config.cfg [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 09 10:11:46 user nova-compute[72362]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 09 10:11:46 user nova-compute[72362]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 09 10:11:46 user nova-compute[72362]: and ``live_migration_inbound_addr`` respectively.
Aug 09 10:11:46 user nova-compute[72362]: ).  Its value may be silently ignored in the future.
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.live_migration_with_native_tls = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.max_queues             = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.nfs_mount_options      = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.num_memory_encrypted_guests = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.num_pcie_ports         = 0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.pmem_namespaces        = [] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.quobyte_client_cfg     = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.rbd_secret_uuid        = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.rbd_user               = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.remote_filesystem_transport = ssh {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.rescue_image_id        = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.rescue_kernel_id       = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.rescue_ramdisk_id      = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.rx_queue_size          = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.smbfs_mount_options    =  {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.snapshot_compression   = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.snapshot_image_format  = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.sparse_logical_volumes = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.swtpm_enabled          = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.swtpm_group            = tss {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.swtpm_user             = tss {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.sysinfo_serial         = unique {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.tb_cache_size          = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.tx_queue_size          = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.uid_maps               = [] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.use_virtio_for_bridges = True {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.virt_type              = kvm {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.volume_clear           = zero {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.volume_clear_size      = 0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.volume_use_multipath   = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.vzstorage_cache_path   = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.vzstorage_mount_user   = stack {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] neutron.auth_section           = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] neutron.auth_type              = password {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] neutron.cafile                 = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] neutron.certfile               = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] neutron.collect_timing         = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] neutron.connect_retries        = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] neutron.connect_retry_delay    = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] neutron.default_floating_pool  = public {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] neutron.endpoint_override      = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] neutron.extension_sync_interval = 600 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] neutron.http_retries           = 3 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] neutron.insecure               = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] neutron.keyfile                = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] neutron.max_version            = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] neutron.min_version            = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] neutron.ovs_bridge             = br-int {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] neutron.physnets               = [] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] neutron.region_name            = RegionOne {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] neutron.service_metadata_proxy = True {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] neutron.service_name           = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] neutron.service_type           = network {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] neutron.split_loggers          = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] neutron.status_code_retries    = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] neutron.status_code_retry_delay = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] neutron.timeout                = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] neutron.version                = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] notifications.bdms_in_notifications = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] notifications.default_level    = INFO {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] notifications.notification_format = unversioned {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] notifications.notify_on_state_change = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] pci.alias                      = [] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] pci.device_spec                = [] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] pci.report_in_placement        = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] placement.auth_section         = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] placement.auth_type            = password {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] placement.cafile               = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] placement.certfile             = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] placement.collect_timing       = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] placement.connect_retries      = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] placement.connect_retry_delay  = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] placement.default_domain_id    = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] placement.default_domain_name  = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] placement.domain_id            = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] placement.domain_name          = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] placement.endpoint_override    = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] placement.insecure             = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] placement.keyfile              = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] placement.max_version          = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] placement.min_version          = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] placement.password             = **** {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] placement.project_domain_id    = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] placement.project_domain_name  = Default {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] placement.project_id           = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] placement.project_name         = service {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] placement.region_name          = RegionOne {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] placement.service_name         = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] placement.service_type         = placement {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] placement.split_loggers        = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] placement.status_code_retries  = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] placement.status_code_retry_delay = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] placement.system_scope         = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] placement.timeout              = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] placement.trust_id             = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] placement.user_domain_id       = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] placement.user_domain_name     = Default {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] placement.user_id              = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] placement.username             = placement {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] placement.version              = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] quota.cores                    = 20 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] quota.count_usage_from_placement = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] quota.injected_file_content_bytes = 10240 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] quota.injected_file_path_length = 255 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] quota.injected_files           = 5 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] quota.instances                = 10 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] quota.key_pairs                = 100 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] quota.metadata_items           = 128 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] quota.ram                      = 51200 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] quota.recheck_quota            = True {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] quota.server_group_members     = 10 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] quota.server_groups            = 10 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] rdp.enabled                    = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] scheduler.image_metadata_prefilter = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] scheduler.max_attempts         = 3 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] scheduler.max_placement_results = 1000 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] scheduler.query_placement_for_availability_zone = True {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] scheduler.query_placement_for_image_type_support = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] scheduler.workers              = 3 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] filter_scheduler.host_subset_size = 1 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] filter_scheduler.isolated_hosts = [] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] filter_scheduler.isolated_images = [] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] filter_scheduler.pci_in_placement = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] filter_scheduler.track_instance_changes = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] metrics.required               = True {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] metrics.weight_multiplier      = 1.0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] metrics.weight_setting         = [] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] serial_console.enabled         = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] serial_console.port_range      = 10000:20000 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] serial_console.serialproxy_port = 6083 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] service_user.auth_section      = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] service_user.auth_type         = password {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] service_user.cafile            = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] service_user.certfile          = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] service_user.collect_timing    = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] service_user.insecure          = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] service_user.keyfile           = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] service_user.send_service_user_token = True {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] service_user.split_loggers     = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] service_user.timeout           = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] spice.agent_enabled            = True {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] spice.enabled                  = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] spice.html5proxy_port          = 6082 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] spice.image_compression        = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] spice.jpeg_compression         = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] spice.playback_compression     = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] spice.server_listen            = 127.0.0.1 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] spice.streaming_mode           = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] spice.zlib_compression         = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] upgrade_levels.baseapi         = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] upgrade_levels.cert            = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] upgrade_levels.compute         = auto {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] upgrade_levels.conductor       = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] upgrade_levels.scheduler       = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vendordata_dynamic_auth.auth_section = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vendordata_dynamic_auth.auth_type = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vendordata_dynamic_auth.cafile = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vendordata_dynamic_auth.certfile = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vendordata_dynamic_auth.insecure = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vendordata_dynamic_auth.keyfile = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vendordata_dynamic_auth.timeout = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vmware.api_retry_count         = 10 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vmware.ca_file                 = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vmware.cache_prefix            = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vmware.cluster_name            = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vmware.connection_pool_size    = 10 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vmware.console_delay_seconds   = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vmware.datastore_regex         = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vmware.host_ip                 = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vmware.host_password           = **** {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vmware.host_port               = 443 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vmware.host_username           = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vmware.insecure                = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vmware.integration_bridge      = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vmware.maximum_objects         = 100 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vmware.pbm_default_policy      = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vmware.pbm_enabled             = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vmware.pbm_wsdl_location       = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vmware.serial_port_proxy_uri   = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vmware.serial_port_service_uri = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vmware.task_poll_interval      = 0.5 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vmware.use_linked_clone        = True {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vmware.vnc_keymap              = en-us {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vmware.vnc_port                = 5900 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vmware.vnc_port_total          = 10000 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vnc.auth_schemes               = ['none'] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vnc.enabled                    = True {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vnc.novncproxy_port            = 6080 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vnc.server_listen              = 0.0.0.0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vnc.vencrypt_ca_certs          = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vnc.vencrypt_client_cert       = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vnc.vencrypt_client_key        = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] workarounds.disable_rootwrap   = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] workarounds.enable_numa_live_migration = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] workarounds.libvirt_disable_apic = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] wsgi.client_socket_timeout     = 900 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] wsgi.default_pool_size         = 1000 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] wsgi.keep_alive                = True {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] wsgi.max_header_line           = 16384 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] wsgi.ssl_ca_file               = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] wsgi.ssl_cert_file             = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] wsgi.ssl_key_file              = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] wsgi.tcp_keepidle              = 600 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] zvm.ca_file                    = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] zvm.cloud_connector_url        = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] zvm.reachable_timeout          = 300 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_policy.enforce_new_defaults = True {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_policy.enforce_scope      = True {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_policy.policy_default_rule = default {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] profiler.connection_string     = messaging:// {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] profiler.enabled               = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] profiler.es_doc_type           = notification {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] profiler.es_scroll_size        = 10000 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] profiler.es_scroll_time        = 2m {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] profiler.filter_error_trace    = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] profiler.hmac_keys             = **** {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] profiler.sentinel_service_name = mymaster {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] profiler.socket_timeout        = 0.1 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] profiler.trace_requests        = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] profiler.trace_sqlalchemy      = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] profiler_jaeger.process_tags   = {} {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] profiler_jaeger.service_name_prefix = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] profiler_otlp.service_name_prefix = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] remote_debug.host              = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] remote_debug.port              = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_messaging_notifications.retry = -1 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_limit.auth_section        = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_limit.auth_type           = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_limit.cafile              = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_limit.certfile            = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_limit.collect_timing      = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_limit.connect_retries     = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_limit.connect_retry_delay = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_limit.endpoint_id         = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_limit.endpoint_override   = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_limit.insecure            = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_limit.keyfile             = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_limit.max_version         = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_limit.min_version         = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_limit.region_name         = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_limit.service_name        = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_limit.service_type        = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_limit.split_loggers       = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_limit.status_code_retries = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_limit.status_code_retry_delay = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_limit.timeout             = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_limit.valid_interfaces    = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_limit.version             = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_reports.file_event_handler = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] oslo_reports.log_dir           = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vif_plug_ovs_privileged.group  = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] vif_plug_ovs_privileged.user   = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] os_vif_linux_bridge.flat_interface = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] os_vif_ovs.isolate_vif         = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] os_vif_ovs.per_port_bridge     = False {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] os_brick.lock_path             = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] privsep_osbrick.capabilities   = [21] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] privsep_osbrick.group          = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] privsep_osbrick.helper_command = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] privsep_osbrick.user           = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] nova_sys_admin.group           = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] nova_sys_admin.helper_command  = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] nova_sys_admin.user            = None {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG oslo_service.service [None req-33bc922b-5a7c-4294-b594-cc8561d5b9e6 None None] ******************************************************************************** {{(pid=72362) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Aug 09 10:11:46 user nova-compute[72362]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 09 10:11:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Starting native event thread {{(pid=72362) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Starting green dispatch thread {{(pid=72362) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Starting connection event dispatch thread {{(pid=72362) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Connecting to libvirt: qemu:///system {{(pid=72362) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f34ecff8b20> {{(pid=72362) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 09 10:11:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f34ecff8b20> {{(pid=72362) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 09 10:11:46 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Connection event '1' reason 'None'
Aug 09 10:11:46 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 09 10:11:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.mount [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Initialising _HostMountState generation 0 {{(pid=72362) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 09 10:11:53 user nova-compute[72362]: INFO nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Libvirt host capabilities <capabilities>
Aug 09 10:11:53 user nova-compute[72362]:   <host>
Aug 09 10:11:53 user nova-compute[72362]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 09 10:11:53 user nova-compute[72362]:     <cpu>
Aug 09 10:11:53 user nova-compute[72362]:       <arch>x86_64</arch>
Aug 09 10:11:53 user nova-compute[72362]:       <model>IvyBridge-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <vendor>Intel</vendor>
Aug 09 10:11:53 user nova-compute[72362]:       <microcode version='1070'/>
Aug 09 10:11:53 user nova-compute[72362]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 09 10:11:53 user nova-compute[72362]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature name='ss'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature name='vmx'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature name='pcid'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature name='osxsave'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature name='hypervisor'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature name='arat'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature name='tsc_adjust'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature name='md-clear'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature name='stibp'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature name='arch-capabilities'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature name='ssbd'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature name='invtsc'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature name='rsba'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature name='skip-l1dfl-vmentry'/>
Aug 09 10:11:53 user nova-compute[72362]:       <pages unit='KiB' size='4'/>
Aug 09 10:11:53 user nova-compute[72362]:       <pages unit='KiB' size='2048'/>
Aug 09 10:11:53 user nova-compute[72362]:     </cpu>
Aug 09 10:11:53 user nova-compute[72362]:     <power_management>
Aug 09 10:11:53 user nova-compute[72362]:       <suspend_mem/>
Aug 09 10:11:53 user nova-compute[72362]:       <suspend_disk/>
Aug 09 10:11:53 user nova-compute[72362]:       <suspend_hybrid/>
Aug 09 10:11:53 user nova-compute[72362]:     </power_management>
Aug 09 10:11:53 user nova-compute[72362]:     <iommu support='no'/>
Aug 09 10:11:53 user nova-compute[72362]:     <migration_features>
Aug 09 10:11:53 user nova-compute[72362]:       <live/>
Aug 09 10:11:53 user nova-compute[72362]:       <uri_transports>
Aug 09 10:11:53 user nova-compute[72362]:         <uri_transport>tcp</uri_transport>
Aug 09 10:11:53 user nova-compute[72362]:         <uri_transport>rdma</uri_transport>
Aug 09 10:11:53 user nova-compute[72362]:       </uri_transports>
Aug 09 10:11:53 user nova-compute[72362]:     </migration_features>
Aug 09 10:11:53 user nova-compute[72362]:     <topology>
Aug 09 10:11:53 user nova-compute[72362]:       <cells num='2'>
Aug 09 10:11:53 user nova-compute[72362]:         <cell id='0'>
Aug 09 10:11:53 user nova-compute[72362]:           <memory unit='KiB'>8140616</memory>
Aug 09 10:11:53 user nova-compute[72362]:           <pages unit='KiB' size='4'>2035154</pages>
Aug 09 10:11:53 user nova-compute[72362]:           <pages unit='KiB' size='2048'>0</pages>
Aug 09 10:11:53 user nova-compute[72362]:           <distances>
Aug 09 10:11:53 user nova-compute[72362]:             <sibling id='0' value='10'/>
Aug 09 10:11:53 user nova-compute[72362]:             <sibling id='1' value='20'/>
Aug 09 10:11:53 user nova-compute[72362]:           </distances>
Aug 09 10:11:53 user nova-compute[72362]:           <cpus num='6'>
Aug 09 10:11:53 user nova-compute[72362]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 09 10:11:53 user nova-compute[72362]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 09 10:11:53 user nova-compute[72362]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 09 10:11:53 user nova-compute[72362]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 09 10:11:53 user nova-compute[72362]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 09 10:11:53 user nova-compute[72362]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 09 10:11:53 user nova-compute[72362]:           </cpus>
Aug 09 10:11:53 user nova-compute[72362]:         </cell>
Aug 09 10:11:53 user nova-compute[72362]:         <cell id='1'>
Aug 09 10:11:53 user nova-compute[72362]:           <memory unit='KiB'>8255068</memory>
Aug 09 10:11:53 user nova-compute[72362]:           <pages unit='KiB' size='4'>2063767</pages>
Aug 09 10:11:53 user nova-compute[72362]:           <pages unit='KiB' size='2048'>0</pages>
Aug 09 10:11:53 user nova-compute[72362]:           <distances>
Aug 09 10:11:53 user nova-compute[72362]:             <sibling id='0' value='20'/>
Aug 09 10:11:53 user nova-compute[72362]:             <sibling id='1' value='10'/>
Aug 09 10:11:53 user nova-compute[72362]:           </distances>
Aug 09 10:11:53 user nova-compute[72362]:           <cpus num='6'>
Aug 09 10:11:53 user nova-compute[72362]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 09 10:11:53 user nova-compute[72362]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 09 10:11:53 user nova-compute[72362]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 09 10:11:53 user nova-compute[72362]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 09 10:11:53 user nova-compute[72362]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 09 10:11:53 user nova-compute[72362]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 09 10:11:53 user nova-compute[72362]:           </cpus>
Aug 09 10:11:53 user nova-compute[72362]:         </cell>
Aug 09 10:11:53 user nova-compute[72362]:       </cells>
Aug 09 10:11:53 user nova-compute[72362]:     </topology>
Aug 09 10:11:53 user nova-compute[72362]:     <cache>
Aug 09 10:11:53 user nova-compute[72362]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 09 10:11:53 user nova-compute[72362]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 09 10:11:53 user nova-compute[72362]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 09 10:11:53 user nova-compute[72362]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 09 10:11:53 user nova-compute[72362]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 09 10:11:53 user nova-compute[72362]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 09 10:11:53 user nova-compute[72362]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 09 10:11:53 user nova-compute[72362]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 09 10:11:53 user nova-compute[72362]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 09 10:11:53 user nova-compute[72362]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 09 10:11:53 user nova-compute[72362]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 09 10:11:53 user nova-compute[72362]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 09 10:11:53 user nova-compute[72362]:     </cache>
Aug 09 10:11:53 user nova-compute[72362]:     <secmodel>
Aug 09 10:11:53 user nova-compute[72362]:       <model>apparmor</model>
Aug 09 10:11:53 user nova-compute[72362]:       <doi>0</doi>
Aug 09 10:11:53 user nova-compute[72362]:     </secmodel>
Aug 09 10:11:53 user nova-compute[72362]:     <secmodel>
Aug 09 10:11:53 user nova-compute[72362]:       <model>dac</model>
Aug 09 10:11:53 user nova-compute[72362]:       <doi>0</doi>
Aug 09 10:11:53 user nova-compute[72362]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 09 10:11:53 user nova-compute[72362]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 09 10:11:53 user nova-compute[72362]:     </secmodel>
Aug 09 10:11:53 user nova-compute[72362]:   </host>
Aug 09 10:11:53 user nova-compute[72362]:   <guest>
Aug 09 10:11:53 user nova-compute[72362]:     <os_type>hvm</os_type>
Aug 09 10:11:53 user nova-compute[72362]:     <arch name='alpha'>
Aug 09 10:11:53 user nova-compute[72362]:       <wordsize>64</wordsize>
Aug 09 10:11:53 user nova-compute[72362]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='4'>clipper</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <domain type='qemu'/>
Aug 09 10:11:53 user nova-compute[72362]:     </arch>
Aug 09 10:11:53 user nova-compute[72362]:     <features>
Aug 09 10:11:53 user nova-compute[72362]:       <cpuselection/>
Aug 09 10:11:53 user nova-compute[72362]:       <deviceboot/>
Aug 09 10:11:53 user nova-compute[72362]:       <disksnapshot default='on' toggle='no'/>
Aug 09 10:11:53 user nova-compute[72362]:     </features>
Aug 09 10:11:53 user nova-compute[72362]:   </guest>
Aug 09 10:11:53 user nova-compute[72362]:   <guest>
Aug 09 10:11:53 user nova-compute[72362]:     <os_type>hvm</os_type>
Aug 09 10:11:53 user nova-compute[72362]:     <arch name='armv6l'>
Aug 09 10:11:53 user nova-compute[72362]:       <wordsize>32</wordsize>
Aug 09 10:11:53 user nova-compute[72362]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>integratorcp</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>borzoi</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>spitz</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2'>nuri</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2'>musca-b1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>versatileab</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>kzm</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2'>musca-a</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2'>smdkc210</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>sx1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>z2</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>tosa</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='4'>sabrelite</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>realview-eb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>n810</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>n800</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>versatilepb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>terrier</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>mainstone</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='4'>midway</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>musicpal</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>microbit</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>cubieboard</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>verdex</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>netduino2</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='4'>raspi2b</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>cheetah</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='4'>highbank</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>akita</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>connex</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>collie</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>raspi0</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <domain type='qemu'/>
Aug 09 10:11:53 user nova-compute[72362]:     </arch>
Aug 09 10:11:53 user nova-compute[72362]:     <features>
Aug 09 10:11:53 user nova-compute[72362]:       <cpuselection/>
Aug 09 10:11:53 user nova-compute[72362]:       <deviceboot/>
Aug 09 10:11:53 user nova-compute[72362]:       <disksnapshot default='on' toggle='no'/>
Aug 09 10:11:53 user nova-compute[72362]:     </features>
Aug 09 10:11:53 user nova-compute[72362]:   </guest>
Aug 09 10:11:53 user nova-compute[72362]:   <guest>
Aug 09 10:11:53 user nova-compute[72362]:     <os_type>hvm</os_type>
Aug 09 10:11:53 user nova-compute[72362]:     <arch name='armv7l'>
Aug 09 10:11:53 user nova-compute[72362]:       <wordsize>32</wordsize>
Aug 09 10:11:53 user nova-compute[72362]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>integratorcp</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>borzoi</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>spitz</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2'>nuri</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2'>musca-b1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>versatileab</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>kzm</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2'>musca-a</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2'>smdkc210</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>sx1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>z2</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>tosa</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='4'>sabrelite</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>realview-eb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>n810</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>n800</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>versatilepb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>terrier</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>mainstone</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='4'>midway</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>musicpal</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>microbit</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>cubieboard</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>verdex</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>netduino2</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='4'>raspi2b</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>cheetah</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='4'>highbank</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>akita</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>connex</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>collie</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>raspi0</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <domain type='qemu'/>
Aug 09 10:11:53 user nova-compute[72362]:     </arch>
Aug 09 10:11:53 user nova-compute[72362]:     <features>
Aug 09 10:11:53 user nova-compute[72362]:       <cpuselection/>
Aug 09 10:11:53 user nova-compute[72362]:       <deviceboot/>
Aug 09 10:11:53 user nova-compute[72362]:       <disksnapshot default='on' toggle='no'/>
Aug 09 10:11:53 user nova-compute[72362]:     </features>
Aug 09 10:11:53 user nova-compute[72362]:   </guest>
Aug 09 10:11:53 user nova-compute[72362]:   <guest>
Aug 09 10:11:53 user nova-compute[72362]:     <os_type>hvm</os_type>
Aug 09 10:11:53 user nova-compute[72362]:     <arch name='aarch64'>
Aug 09 10:11:53 user nova-compute[72362]:       <wordsize>64</wordsize>
Aug 09 10:11:53 user nova-compute[72362]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>integratorcp</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>borzoi</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>spitz</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2'>nuri</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2'>musca-b1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>versatileab</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>kzm</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2'>musca-a</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2'>smdkc210</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>sx1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>z2</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>tosa</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='4'>sabrelite</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>realview-eb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>n810</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>n800</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>versatilepb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>terrier</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>mainstone</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='4'>midway</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>musicpal</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>microbit</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>cubieboard</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>verdex</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>netduino2</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='4'>raspi3b</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='4'>raspi2b</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>cheetah</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='4'>highbank</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>akita</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>connex</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>collie</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>raspi0</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <domain type='qemu'/>
Aug 09 10:11:53 user nova-compute[72362]:     </arch>
Aug 09 10:11:53 user nova-compute[72362]:     <features>
Aug 09 10:11:53 user nova-compute[72362]:       <acpi default='on' toggle='yes'/>
Aug 09 10:11:53 user nova-compute[72362]:       <cpuselection/>
Aug 09 10:11:53 user nova-compute[72362]:       <deviceboot/>
Aug 09 10:11:53 user nova-compute[72362]:       <disksnapshot default='on' toggle='no'/>
Aug 09 10:11:53 user nova-compute[72362]:     </features>
Aug 09 10:11:53 user nova-compute[72362]:   </guest>
Aug 09 10:11:53 user nova-compute[72362]:   <guest>
Aug 09 10:11:53 user nova-compute[72362]:     <os_type>hvm</os_type>
Aug 09 10:11:53 user nova-compute[72362]:     <arch name='cris'>
Aug 09 10:11:53 user nova-compute[72362]:       <wordsize>32</wordsize>
Aug 09 10:11:53 user nova-compute[72362]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <domain type='qemu'/>
Aug 09 10:11:53 user nova-compute[72362]:     </arch>
Aug 09 10:11:53 user nova-compute[72362]:     <features>
Aug 09 10:11:53 user nova-compute[72362]:       <cpuselection/>
Aug 09 10:11:53 user nova-compute[72362]:       <deviceboot/>
Aug 09 10:11:53 user nova-compute[72362]:       <disksnapshot default='on' toggle='no'/>
Aug 09 10:11:53 user nova-compute[72362]:     </features>
Aug 09 10:11:53 user nova-compute[72362]:   </guest>
Aug 09 10:11:53 user nova-compute[72362]:   <guest>
Aug 09 10:11:53 user nova-compute[72362]:     <os_type>hvm</os_type>
Aug 09 10:11:53 user nova-compute[72362]:     <arch name='i686'>
Aug 09 10:11:53 user nova-compute[72362]:       <wordsize>32</wordsize>
Aug 09 10:11:53 user nova-compute[72362]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>x-remote</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>isapc</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>microvm</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <domain type='qemu'/>
Aug 09 10:11:53 user nova-compute[72362]:       <domain type='kvm'/>
Aug 09 10:11:53 user nova-compute[72362]:     </arch>
Aug 09 10:11:53 user nova-compute[72362]:     <features>
Aug 09 10:11:53 user nova-compute[72362]:       <pae/>
Aug 09 10:11:53 user nova-compute[72362]:       <nonpae/>
Aug 09 10:11:53 user nova-compute[72362]:       <acpi default='on' toggle='yes'/>
Aug 09 10:11:53 user nova-compute[72362]:       <apic default='on' toggle='no'/>
Aug 09 10:11:53 user nova-compute[72362]:       <cpuselection/>
Aug 09 10:11:53 user nova-compute[72362]:       <deviceboot/>
Aug 09 10:11:53 user nova-compute[72362]:       <disksnapshot default='on' toggle='no'/>
Aug 09 10:11:53 user nova-compute[72362]:     </features>
Aug 09 10:11:53 user nova-compute[72362]:   </guest>
Aug 09 10:11:53 user nova-compute[72362]:   <guest>
Aug 09 10:11:53 user nova-compute[72362]:     <os_type>hvm</os_type>
Aug 09 10:11:53 user nova-compute[72362]:     <arch name='m68k'>
Aug 09 10:11:53 user nova-compute[72362]:       <wordsize>32</wordsize>
Aug 09 10:11:53 user nova-compute[72362]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>an5206</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>q800</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>next-cube</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <domain type='qemu'/>
Aug 09 10:11:53 user nova-compute[72362]:     </arch>
Aug 09 10:11:53 user nova-compute[72362]:     <features>
Aug 09 10:11:53 user nova-compute[72362]:       <cpuselection/>
Aug 09 10:11:53 user nova-compute[72362]:       <deviceboot/>
Aug 09 10:11:53 user nova-compute[72362]:       <disksnapshot default='on' toggle='no'/>
Aug 09 10:11:53 user nova-compute[72362]:     </features>
Aug 09 10:11:53 user nova-compute[72362]:   </guest>
Aug 09 10:11:53 user nova-compute[72362]:   <guest>
Aug 09 10:11:53 user nova-compute[72362]:     <os_type>hvm</os_type>
Aug 09 10:11:53 user nova-compute[72362]:     <arch name='microblaze'>
Aug 09 10:11:53 user nova-compute[72362]:       <wordsize>32</wordsize>
Aug 09 10:11:53 user nova-compute[72362]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <domain type='qemu'/>
Aug 09 10:11:53 user nova-compute[72362]:     </arch>
Aug 09 10:11:53 user nova-compute[72362]:     <features>
Aug 09 10:11:53 user nova-compute[72362]:       <cpuselection/>
Aug 09 10:11:53 user nova-compute[72362]:       <deviceboot/>
Aug 09 10:11:53 user nova-compute[72362]:       <disksnapshot default='on' toggle='no'/>
Aug 09 10:11:53 user nova-compute[72362]:     </features>
Aug 09 10:11:53 user nova-compute[72362]:   </guest>
Aug 09 10:11:53 user nova-compute[72362]:   <guest>
Aug 09 10:11:53 user nova-compute[72362]:     <os_type>hvm</os_type>
Aug 09 10:11:53 user nova-compute[72362]:     <arch name='microblazeel'>
Aug 09 10:11:53 user nova-compute[72362]:       <wordsize>32</wordsize>
Aug 09 10:11:53 user nova-compute[72362]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <domain type='qemu'/>
Aug 09 10:11:53 user nova-compute[72362]:     </arch>
Aug 09 10:11:53 user nova-compute[72362]:     <features>
Aug 09 10:11:53 user nova-compute[72362]:       <cpuselection/>
Aug 09 10:11:53 user nova-compute[72362]:       <deviceboot/>
Aug 09 10:11:53 user nova-compute[72362]:       <disksnapshot default='on' toggle='no'/>
Aug 09 10:11:53 user nova-compute[72362]:     </features>
Aug 09 10:11:53 user nova-compute[72362]:   </guest>
Aug 09 10:11:53 user nova-compute[72362]:   <guest>
Aug 09 10:11:53 user nova-compute[72362]:     <os_type>hvm</os_type>
Aug 09 10:11:53 user nova-compute[72362]:     <arch name='mips'>
Aug 09 10:11:53 user nova-compute[72362]:       <wordsize>32</wordsize>
Aug 09 10:11:53 user nova-compute[72362]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='16'>malta</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>mipssim</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <domain type='qemu'/>
Aug 09 10:11:53 user nova-compute[72362]:     </arch>
Aug 09 10:11:53 user nova-compute[72362]:     <features>
Aug 09 10:11:53 user nova-compute[72362]:       <cpuselection/>
Aug 09 10:11:53 user nova-compute[72362]:       <deviceboot/>
Aug 09 10:11:53 user nova-compute[72362]:       <disksnapshot default='on' toggle='no'/>
Aug 09 10:11:53 user nova-compute[72362]:     </features>
Aug 09 10:11:53 user nova-compute[72362]:   </guest>
Aug 09 10:11:53 user nova-compute[72362]:   <guest>
Aug 09 10:11:53 user nova-compute[72362]:     <os_type>hvm</os_type>
Aug 09 10:11:53 user nova-compute[72362]:     <arch name='mipsel'>
Aug 09 10:11:53 user nova-compute[72362]:       <wordsize>32</wordsize>
Aug 09 10:11:53 user nova-compute[72362]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='16'>malta</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>mipssim</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <domain type='qemu'/>
Aug 09 10:11:53 user nova-compute[72362]:     </arch>
Aug 09 10:11:53 user nova-compute[72362]:     <features>
Aug 09 10:11:53 user nova-compute[72362]:       <cpuselection/>
Aug 09 10:11:53 user nova-compute[72362]:       <deviceboot/>
Aug 09 10:11:53 user nova-compute[72362]:       <disksnapshot default='on' toggle='no'/>
Aug 09 10:11:53 user nova-compute[72362]:     </features>
Aug 09 10:11:53 user nova-compute[72362]:   </guest>
Aug 09 10:11:53 user nova-compute[72362]:   <guest>
Aug 09 10:11:53 user nova-compute[72362]:     <os_type>hvm</os_type>
Aug 09 10:11:53 user nova-compute[72362]:     <arch name='mips64'>
Aug 09 10:11:53 user nova-compute[72362]:       <wordsize>64</wordsize>
Aug 09 10:11:53 user nova-compute[72362]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='16'>malta</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>mipssim</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>pica61</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>magnum</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <domain type='qemu'/>
Aug 09 10:11:53 user nova-compute[72362]:     </arch>
Aug 09 10:11:53 user nova-compute[72362]:     <features>
Aug 09 10:11:53 user nova-compute[72362]:       <cpuselection/>
Aug 09 10:11:53 user nova-compute[72362]:       <deviceboot/>
Aug 09 10:11:53 user nova-compute[72362]:       <disksnapshot default='on' toggle='no'/>
Aug 09 10:11:53 user nova-compute[72362]:     </features>
Aug 09 10:11:53 user nova-compute[72362]:   </guest>
Aug 09 10:11:53 user nova-compute[72362]:   <guest>
Aug 09 10:11:53 user nova-compute[72362]:     <os_type>hvm</os_type>
Aug 09 10:11:53 user nova-compute[72362]:     <arch name='mips64el'>
Aug 09 10:11:53 user nova-compute[72362]:       <wordsize>64</wordsize>
Aug 09 10:11:53 user nova-compute[72362]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='16'>malta</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>mipssim</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>pica61</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>magnum</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='16'>boston</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <domain type='qemu'/>
Aug 09 10:11:53 user nova-compute[72362]:     </arch>
Aug 09 10:11:53 user nova-compute[72362]:     <features>
Aug 09 10:11:53 user nova-compute[72362]:       <cpuselection/>
Aug 09 10:11:53 user nova-compute[72362]:       <deviceboot/>
Aug 09 10:11:53 user nova-compute[72362]:       <disksnapshot default='on' toggle='no'/>
Aug 09 10:11:53 user nova-compute[72362]:     </features>
Aug 09 10:11:53 user nova-compute[72362]:   </guest>
Aug 09 10:11:53 user nova-compute[72362]:   <guest>
Aug 09 10:11:53 user nova-compute[72362]:     <os_type>hvm</os_type>
Aug 09 10:11:53 user nova-compute[72362]:     <arch name='ppc'>
Aug 09 10:11:53 user nova-compute[72362]:       <wordsize>32</wordsize>
Aug 09 10:11:53 user nova-compute[72362]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>g3beige</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>mac99</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='32'>ppce500</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>pegasos2</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>sam460ex</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>bamboo</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>40p</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>ref405ep</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>taihu</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <domain type='qemu'/>
Aug 09 10:11:53 user nova-compute[72362]:     </arch>
Aug 09 10:11:53 user nova-compute[72362]:     <features>
Aug 09 10:11:53 user nova-compute[72362]:       <cpuselection/>
Aug 09 10:11:53 user nova-compute[72362]:       <deviceboot/>
Aug 09 10:11:53 user nova-compute[72362]:       <disksnapshot default='on' toggle='no'/>
Aug 09 10:11:53 user nova-compute[72362]:     </features>
Aug 09 10:11:53 user nova-compute[72362]:   </guest>
Aug 09 10:11:53 user nova-compute[72362]:   <guest>
Aug 09 10:11:53 user nova-compute[72362]:     <os_type>hvm</os_type>
Aug 09 10:11:53 user nova-compute[72362]:     <arch name='ppc64'>
Aug 09 10:11:53 user nova-compute[72362]:       <wordsize>64</wordsize>
Aug 09 10:11:53 user nova-compute[72362]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2048'>powernv9</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>taihu</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2048'>powernv10</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='32'>ppce500</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>40p</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>pegasos2</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>bamboo</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>g3beige</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>mac99</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>sam460ex</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>ref405ep</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2048'>powernv8</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <domain type='qemu'/>
Aug 09 10:11:53 user nova-compute[72362]:     </arch>
Aug 09 10:11:53 user nova-compute[72362]:     <features>
Aug 09 10:11:53 user nova-compute[72362]:       <cpuselection/>
Aug 09 10:11:53 user nova-compute[72362]:       <deviceboot/>
Aug 09 10:11:53 user nova-compute[72362]:       <disksnapshot default='on' toggle='no'/>
Aug 09 10:11:53 user nova-compute[72362]:     </features>
Aug 09 10:11:53 user nova-compute[72362]:   </guest>
Aug 09 10:11:53 user nova-compute[72362]:   <guest>
Aug 09 10:11:53 user nova-compute[72362]:     <os_type>hvm</os_type>
Aug 09 10:11:53 user nova-compute[72362]:     <arch name='ppc64le'>
Aug 09 10:11:53 user nova-compute[72362]:       <wordsize>64</wordsize>
Aug 09 10:11:53 user nova-compute[72362]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2048'>powernv9</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>taihu</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2048'>powernv10</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='32'>ppce500</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>40p</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>pegasos2</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>bamboo</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>g3beige</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>mac99</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>sam460ex</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>ref405ep</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2048'>powernv8</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <domain type='qemu'/>
Aug 09 10:11:53 user nova-compute[72362]:     </arch>
Aug 09 10:11:53 user nova-compute[72362]:     <features>
Aug 09 10:11:53 user nova-compute[72362]:       <cpuselection/>
Aug 09 10:11:53 user nova-compute[72362]:       <deviceboot/>
Aug 09 10:11:53 user nova-compute[72362]:       <disksnapshot default='on' toggle='no'/>
Aug 09 10:11:53 user nova-compute[72362]:     </features>
Aug 09 10:11:53 user nova-compute[72362]:   </guest>
Aug 09 10:11:53 user nova-compute[72362]:   <guest>
Aug 09 10:11:53 user nova-compute[72362]:     <os_type>hvm</os_type>
Aug 09 10:11:53 user nova-compute[72362]:     <arch name='riscv32'>
Aug 09 10:11:53 user nova-compute[72362]:       <wordsize>32</wordsize>
Aug 09 10:11:53 user nova-compute[72362]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='8'>spike</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>opentitan</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='5'>sifive_u</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>sifive_e</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='8'>virt</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <domain type='qemu'/>
Aug 09 10:11:53 user nova-compute[72362]:     </arch>
Aug 09 10:11:53 user nova-compute[72362]:     <features>
Aug 09 10:11:53 user nova-compute[72362]:       <cpuselection/>
Aug 09 10:11:53 user nova-compute[72362]:       <deviceboot/>
Aug 09 10:11:53 user nova-compute[72362]:       <disksnapshot default='on' toggle='no'/>
Aug 09 10:11:53 user nova-compute[72362]:     </features>
Aug 09 10:11:53 user nova-compute[72362]:   </guest>
Aug 09 10:11:53 user nova-compute[72362]:   <guest>
Aug 09 10:11:53 user nova-compute[72362]:     <os_type>hvm</os_type>
Aug 09 10:11:53 user nova-compute[72362]:     <arch name='riscv64'>
Aug 09 10:11:53 user nova-compute[72362]:       <wordsize>64</wordsize>
Aug 09 10:11:53 user nova-compute[72362]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='8'>spike</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='5'>sifive_u</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>shakti_c</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>sifive_e</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='8'>virt</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <domain type='qemu'/>
Aug 09 10:11:53 user nova-compute[72362]:     </arch>
Aug 09 10:11:53 user nova-compute[72362]:     <features>
Aug 09 10:11:53 user nova-compute[72362]:       <cpuselection/>
Aug 09 10:11:53 user nova-compute[72362]:       <deviceboot/>
Aug 09 10:11:53 user nova-compute[72362]:       <disksnapshot default='on' toggle='no'/>
Aug 09 10:11:53 user nova-compute[72362]:     </features>
Aug 09 10:11:53 user nova-compute[72362]:   </guest>
Aug 09 10:11:53 user nova-compute[72362]:   <guest>
Aug 09 10:11:53 user nova-compute[72362]:     <os_type>hvm</os_type>
Aug 09 10:11:53 user nova-compute[72362]:     <arch name='s390x'>
Aug 09 10:11:53 user nova-compute[72362]:       <wordsize>64</wordsize>
Aug 09 10:11:53 user nova-compute[72362]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <domain type='qemu'/>
Aug 09 10:11:53 user nova-compute[72362]:     </arch>
Aug 09 10:11:53 user nova-compute[72362]:     <features>
Aug 09 10:11:53 user nova-compute[72362]:       <cpuselection/>
Aug 09 10:11:53 user nova-compute[72362]:       <deviceboot/>
Aug 09 10:11:53 user nova-compute[72362]:       <disksnapshot default='on' toggle='no'/>
Aug 09 10:11:53 user nova-compute[72362]:     </features>
Aug 09 10:11:53 user nova-compute[72362]:   </guest>
Aug 09 10:11:53 user nova-compute[72362]:   <guest>
Aug 09 10:11:53 user nova-compute[72362]:     <os_type>hvm</os_type>
Aug 09 10:11:53 user nova-compute[72362]:     <arch name='sh4'>
Aug 09 10:11:53 user nova-compute[72362]:       <wordsize>32</wordsize>
Aug 09 10:11:53 user nova-compute[72362]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>shix</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>r2d</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <domain type='qemu'/>
Aug 09 10:11:53 user nova-compute[72362]:     </arch>
Aug 09 10:11:53 user nova-compute[72362]:     <features>
Aug 09 10:11:53 user nova-compute[72362]:       <cpuselection/>
Aug 09 10:11:53 user nova-compute[72362]:       <deviceboot/>
Aug 09 10:11:53 user nova-compute[72362]:       <disksnapshot default='on' toggle='no'/>
Aug 09 10:11:53 user nova-compute[72362]:     </features>
Aug 09 10:11:53 user nova-compute[72362]:   </guest>
Aug 09 10:11:53 user nova-compute[72362]:   <guest>
Aug 09 10:11:53 user nova-compute[72362]:     <os_type>hvm</os_type>
Aug 09 10:11:53 user nova-compute[72362]:     <arch name='sh4eb'>
Aug 09 10:11:53 user nova-compute[72362]:       <wordsize>64</wordsize>
Aug 09 10:11:53 user nova-compute[72362]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>shix</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>r2d</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <domain type='qemu'/>
Aug 09 10:11:53 user nova-compute[72362]:     </arch>
Aug 09 10:11:53 user nova-compute[72362]:     <features>
Aug 09 10:11:53 user nova-compute[72362]:       <cpuselection/>
Aug 09 10:11:53 user nova-compute[72362]:       <deviceboot/>
Aug 09 10:11:53 user nova-compute[72362]:       <disksnapshot default='on' toggle='no'/>
Aug 09 10:11:53 user nova-compute[72362]:     </features>
Aug 09 10:11:53 user nova-compute[72362]:   </guest>
Aug 09 10:11:53 user nova-compute[72362]:   <guest>
Aug 09 10:11:53 user nova-compute[72362]:     <os_type>hvm</os_type>
Aug 09 10:11:53 user nova-compute[72362]:     <arch name='sparc'>
Aug 09 10:11:53 user nova-compute[72362]:       <wordsize>32</wordsize>
Aug 09 10:11:53 user nova-compute[72362]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>SS-5</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='4'>SS-20</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>LX</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>SS-4</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='4'>SS-10</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>Voyager</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <domain type='qemu'/>
Aug 09 10:11:53 user nova-compute[72362]:     </arch>
Aug 09 10:11:53 user nova-compute[72362]:     <features>
Aug 09 10:11:53 user nova-compute[72362]:       <cpuselection/>
Aug 09 10:11:53 user nova-compute[72362]:       <deviceboot/>
Aug 09 10:11:53 user nova-compute[72362]:       <disksnapshot default='on' toggle='no'/>
Aug 09 10:11:53 user nova-compute[72362]:     </features>
Aug 09 10:11:53 user nova-compute[72362]:   </guest>
Aug 09 10:11:53 user nova-compute[72362]:   <guest>
Aug 09 10:11:53 user nova-compute[72362]:     <os_type>hvm</os_type>
Aug 09 10:11:53 user nova-compute[72362]:     <arch name='sparc64'>
Aug 09 10:11:53 user nova-compute[72362]:       <wordsize>64</wordsize>
Aug 09 10:11:53 user nova-compute[72362]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>sun4u</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>niagara</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>sun4v</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <domain type='qemu'/>
Aug 09 10:11:53 user nova-compute[72362]:     </arch>
Aug 09 10:11:53 user nova-compute[72362]:     <features>
Aug 09 10:11:53 user nova-compute[72362]:       <cpuselection/>
Aug 09 10:11:53 user nova-compute[72362]:       <deviceboot/>
Aug 09 10:11:53 user nova-compute[72362]:       <disksnapshot default='on' toggle='no'/>
Aug 09 10:11:53 user nova-compute[72362]:     </features>
Aug 09 10:11:53 user nova-compute[72362]:   </guest>
Aug 09 10:11:53 user nova-compute[72362]:   <guest>
Aug 09 10:11:53 user nova-compute[72362]:     <os_type>hvm</os_type>
Aug 09 10:11:53 user nova-compute[72362]:     <arch name='x86_64'>
Aug 09 10:11:53 user nova-compute[72362]:       <wordsize>64</wordsize>
Aug 09 10:11:53 user nova-compute[72362]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>x-remote</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='1'>isapc</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>microvm</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <domain type='qemu'/>
Aug 09 10:11:53 user nova-compute[72362]:       <domain type='kvm'/>
Aug 09 10:11:53 user nova-compute[72362]:     </arch>
Aug 09 10:11:53 user nova-compute[72362]:     <features>
Aug 09 10:11:53 user nova-compute[72362]:       <acpi default='on' toggle='yes'/>
Aug 09 10:11:53 user nova-compute[72362]:       <apic default='on' toggle='no'/>
Aug 09 10:11:53 user nova-compute[72362]:       <cpuselection/>
Aug 09 10:11:53 user nova-compute[72362]:       <deviceboot/>
Aug 09 10:11:53 user nova-compute[72362]:       <disksnapshot default='on' toggle='no'/>
Aug 09 10:11:53 user nova-compute[72362]:     </features>
Aug 09 10:11:53 user nova-compute[72362]:   </guest>
Aug 09 10:11:53 user nova-compute[72362]:   <guest>
Aug 09 10:11:53 user nova-compute[72362]:     <os_type>hvm</os_type>
Aug 09 10:11:53 user nova-compute[72362]:     <arch name='xtensa'>
Aug 09 10:11:53 user nova-compute[72362]:       <wordsize>32</wordsize>
Aug 09 10:11:53 user nova-compute[72362]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='4'>sim</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='32'>kc705</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='32'>ml605</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='32'>virt</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='32'>lx200</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='32'>lx60</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <domain type='qemu'/>
Aug 09 10:11:53 user nova-compute[72362]:     </arch>
Aug 09 10:11:53 user nova-compute[72362]:     <features>
Aug 09 10:11:53 user nova-compute[72362]:       <cpuselection/>
Aug 09 10:11:53 user nova-compute[72362]:       <deviceboot/>
Aug 09 10:11:53 user nova-compute[72362]:       <disksnapshot default='on' toggle='no'/>
Aug 09 10:11:53 user nova-compute[72362]:     </features>
Aug 09 10:11:53 user nova-compute[72362]:   </guest>
Aug 09 10:11:53 user nova-compute[72362]:   <guest>
Aug 09 10:11:53 user nova-compute[72362]:     <os_type>hvm</os_type>
Aug 09 10:11:53 user nova-compute[72362]:     <arch name='xtensaeb'>
Aug 09 10:11:53 user nova-compute[72362]:       <wordsize>32</wordsize>
Aug 09 10:11:53 user nova-compute[72362]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='4'>sim</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='32'>kc705</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='32'>ml605</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='32'>virt</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='32'>lx200</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='32'>lx60</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 09 10:11:53 user nova-compute[72362]:       <domain type='qemu'/>
Aug 09 10:11:53 user nova-compute[72362]:     </arch>
Aug 09 10:11:53 user nova-compute[72362]:     <features>
Aug 09 10:11:53 user nova-compute[72362]:       <cpuselection/>
Aug 09 10:11:53 user nova-compute[72362]:       <deviceboot/>
Aug 09 10:11:53 user nova-compute[72362]:       <disksnapshot default='on' toggle='no'/>
Aug 09 10:11:53 user nova-compute[72362]:     </features>
Aug 09 10:11:53 user nova-compute[72362]:   </guest>
Aug 09 10:11:53 user nova-compute[72362]: </capabilities>
Aug 09 10:11:53 user nova-compute[72362]: 
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=72362) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=72362) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=72362) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72362) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72362) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=72362) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72362) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=72362) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=72362) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=72362) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=72362) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Getting domain capabilities for i686 via machine types: {'pc', 'ubuntu-q35', 'q35', 'ubuntu'} {{(pid=72362) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 09 10:11:53 user nova-compute[72362]: <domainCapabilities>
Aug 09 10:11:53 user nova-compute[72362]:   <path>/usr/bin/qemu-system-i386</path>
Aug 09 10:11:53 user nova-compute[72362]:   <domain>kvm</domain>
Aug 09 10:11:53 user nova-compute[72362]:   <machine>pc-i440fx-6.2</machine>
Aug 09 10:11:53 user nova-compute[72362]:   <arch>i686</arch>
Aug 09 10:11:53 user nova-compute[72362]:   <vcpu max='255'/>
Aug 09 10:11:53 user nova-compute[72362]:   <iothreads supported='yes'/>
Aug 09 10:11:53 user nova-compute[72362]:   <os supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:     <enum name='firmware'/>
Aug 09 10:11:53 user nova-compute[72362]:     <loader supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 09 10:11:53 user nova-compute[72362]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 09 10:11:53 user nova-compute[72362]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 09 10:11:53 user nova-compute[72362]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 09 10:11:53 user nova-compute[72362]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='type'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>rom</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>pflash</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='readonly'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>yes</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>no</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='secure'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>no</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </loader>
Aug 09 10:11:53 user nova-compute[72362]:   </os>
Aug 09 10:11:53 user nova-compute[72362]:   <cpu>
Aug 09 10:11:53 user nova-compute[72362]:     <mode name='host-passthrough' supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='hostPassthroughMigratable'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>off</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </mode>
Aug 09 10:11:53 user nova-compute[72362]:     <mode name='maximum' supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='maximumMigratable'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>on</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>off</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </mode>
Aug 09 10:11:53 user nova-compute[72362]:     <mode name='host-model' supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <vendor>Intel</vendor>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='ss'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='vmx'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='pcid'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='hypervisor'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='arat'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='umip'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='md-clear'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='stibp'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='ssbd'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='ibpb'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='ibrs'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='amd-stibp'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='disable' name='erms'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='disable' name='lm'/>
Aug 09 10:11:53 user nova-compute[72362]:     </mode>
Aug 09 10:11:53 user nova-compute[72362]:     <mode name='custom' supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>qemu64</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>qemu32</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>phenom</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>pentium3</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>pentium2</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>pentium</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>n270</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>kvm64</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>kvm32</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>coreduo</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>core2duo</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>athlon</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Westmere-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Westmere</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Snowridge</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Skylake-Server</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Skylake-Client</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>SandyBridge</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Penryn</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Opteron_G5</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Opteron_G4</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Opteron_G3</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Opteron_G2</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Opteron_G1</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Nehalem-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Nehalem</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>IvyBridge</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Icelake-Server</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Haswell</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>EPYC-Rome</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>EPYC-Milan</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>EPYC</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Dhyana</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Cooperlake</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Conroe</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Broadwell</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>486</model>
Aug 09 10:11:53 user nova-compute[72362]:     </mode>
Aug 09 10:11:53 user nova-compute[72362]:   </cpu>
Aug 09 10:11:53 user nova-compute[72362]:   <memoryBacking supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:     <enum name='sourceType'>
Aug 09 10:11:53 user nova-compute[72362]:       <value>file</value>
Aug 09 10:11:53 user nova-compute[72362]:       <value>anonymous</value>
Aug 09 10:11:53 user nova-compute[72362]:       <value>memfd</value>
Aug 09 10:11:53 user nova-compute[72362]:     </enum>
Aug 09 10:11:53 user nova-compute[72362]:   </memoryBacking>
Aug 09 10:11:53 user nova-compute[72362]:   <devices>
Aug 09 10:11:53 user nova-compute[72362]:     <disk supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='diskDevice'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>disk</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>cdrom</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>floppy</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>lun</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='bus'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>ide</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>fdc</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>scsi</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>usb</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>sata</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='model'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio-transitional</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio-non-transitional</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </disk>
Aug 09 10:11:53 user nova-compute[72362]:     <graphics supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='type'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>sdl</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>vnc</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>spice</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>egl-headless</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </graphics>
Aug 09 10:11:53 user nova-compute[72362]:     <video supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='modelType'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>vga</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>cirrus</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>vmvga</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>qxl</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>none</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>bochs</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>ramfb</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </video>
Aug 09 10:11:53 user nova-compute[72362]:     <hostdev supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='mode'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>subsystem</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='startupPolicy'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>default</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>mandatory</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>requisite</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>optional</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='subsysType'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>usb</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>pci</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>scsi</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='capsType'/>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='pciBackend'/>
Aug 09 10:11:53 user nova-compute[72362]:     </hostdev>
Aug 09 10:11:53 user nova-compute[72362]:     <rng supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='model'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio-transitional</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio-non-transitional</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='backendModel'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>random</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>egd</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>builtin</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </rng>
Aug 09 10:11:53 user nova-compute[72362]:     <filesystem supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='driverType'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>path</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>handle</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtiofs</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </filesystem>
Aug 09 10:11:53 user nova-compute[72362]:     <tpm supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='model'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>tpm-tis</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>tpm-crb</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='backendModel'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>passthrough</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>emulator</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </tpm>
Aug 09 10:11:53 user nova-compute[72362]:   </devices>
Aug 09 10:11:53 user nova-compute[72362]:   <features>
Aug 09 10:11:53 user nova-compute[72362]:     <gic supported='no'/>
Aug 09 10:11:53 user nova-compute[72362]:     <vmcoreinfo supported='yes'/>
Aug 09 10:11:53 user nova-compute[72362]:     <genid supported='yes'/>
Aug 09 10:11:53 user nova-compute[72362]:     <backingStoreInput supported='yes'/>
Aug 09 10:11:53 user nova-compute[72362]:     <backup supported='yes'/>
Aug 09 10:11:53 user nova-compute[72362]:     <sev supported='no'/>
Aug 09 10:11:53 user nova-compute[72362]:   </features>
Aug 09 10:11:53 user nova-compute[72362]: </domainCapabilities>
Aug 09 10:11:53 user nova-compute[72362]:  {{(pid=72362) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 09 10:11:53 user nova-compute[72362]: <domainCapabilities>
Aug 09 10:11:53 user nova-compute[72362]:   <path>/usr/bin/qemu-system-i386</path>
Aug 09 10:11:53 user nova-compute[72362]:   <domain>kvm</domain>
Aug 09 10:11:53 user nova-compute[72362]:   <machine>pc-q35-jammy</machine>
Aug 09 10:11:53 user nova-compute[72362]:   <arch>i686</arch>
Aug 09 10:11:53 user nova-compute[72362]:   <vcpu max='288'/>
Aug 09 10:11:53 user nova-compute[72362]:   <iothreads supported='yes'/>
Aug 09 10:11:53 user nova-compute[72362]:   <os supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:     <enum name='firmware'/>
Aug 09 10:11:53 user nova-compute[72362]:     <loader supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 09 10:11:53 user nova-compute[72362]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 09 10:11:53 user nova-compute[72362]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 09 10:11:53 user nova-compute[72362]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 09 10:11:53 user nova-compute[72362]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='type'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>rom</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>pflash</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='readonly'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>yes</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>no</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='secure'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>no</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </loader>
Aug 09 10:11:53 user nova-compute[72362]:   </os>
Aug 09 10:11:53 user nova-compute[72362]:   <cpu>
Aug 09 10:11:53 user nova-compute[72362]:     <mode name='host-passthrough' supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='hostPassthroughMigratable'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>off</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </mode>
Aug 09 10:11:53 user nova-compute[72362]:     <mode name='maximum' supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='maximumMigratable'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>on</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>off</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </mode>
Aug 09 10:11:53 user nova-compute[72362]:     <mode name='host-model' supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <vendor>Intel</vendor>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='ss'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='vmx'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='pcid'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='hypervisor'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='arat'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='umip'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='md-clear'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='stibp'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='ssbd'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='ibpb'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='ibrs'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='amd-stibp'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='disable' name='erms'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='disable' name='lm'/>
Aug 09 10:11:53 user nova-compute[72362]:     </mode>
Aug 09 10:11:53 user nova-compute[72362]:     <mode name='custom' supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>qemu64</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>qemu32</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>phenom</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>pentium3</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>pentium2</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>pentium</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>n270</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>kvm64</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>kvm32</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>coreduo</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>core2duo</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>athlon</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Westmere-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Westmere</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Snowridge</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Skylake-Server</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Skylake-Client</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>SandyBridge</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Penryn</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Opteron_G5</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Opteron_G4</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Opteron_G3</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Opteron_G2</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Opteron_G1</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Nehalem-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Nehalem</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>IvyBridge</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Icelake-Server</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Haswell</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>EPYC-Rome</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>EPYC-Milan</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>EPYC</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Dhyana</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Cooperlake</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Conroe</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Broadwell</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>486</model>
Aug 09 10:11:53 user nova-compute[72362]:     </mode>
Aug 09 10:11:53 user nova-compute[72362]:   </cpu>
Aug 09 10:11:53 user nova-compute[72362]:   <memoryBacking supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:     <enum name='sourceType'>
Aug 09 10:11:53 user nova-compute[72362]:       <value>file</value>
Aug 09 10:11:53 user nova-compute[72362]:       <value>anonymous</value>
Aug 09 10:11:53 user nova-compute[72362]:       <value>memfd</value>
Aug 09 10:11:53 user nova-compute[72362]:     </enum>
Aug 09 10:11:53 user nova-compute[72362]:   </memoryBacking>
Aug 09 10:11:53 user nova-compute[72362]:   <devices>
Aug 09 10:11:53 user nova-compute[72362]:     <disk supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='diskDevice'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>disk</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>cdrom</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>floppy</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>lun</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='bus'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>fdc</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>scsi</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>usb</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>sata</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='model'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio-transitional</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio-non-transitional</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </disk>
Aug 09 10:11:53 user nova-compute[72362]:     <graphics supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='type'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>sdl</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>vnc</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>spice</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>egl-headless</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </graphics>
Aug 09 10:11:53 user nova-compute[72362]:     <video supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='modelType'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>vga</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>cirrus</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>vmvga</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>qxl</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>none</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>bochs</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>ramfb</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </video>
Aug 09 10:11:53 user nova-compute[72362]:     <hostdev supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='mode'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>subsystem</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='startupPolicy'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>default</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>mandatory</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>requisite</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>optional</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='subsysType'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>usb</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>pci</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>scsi</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='capsType'/>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='pciBackend'/>
Aug 09 10:11:53 user nova-compute[72362]:     </hostdev>
Aug 09 10:11:53 user nova-compute[72362]:     <rng supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='model'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio-transitional</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio-non-transitional</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='backendModel'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>random</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>egd</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>builtin</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </rng>
Aug 09 10:11:53 user nova-compute[72362]:     <filesystem supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='driverType'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>path</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>handle</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtiofs</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </filesystem>
Aug 09 10:11:53 user nova-compute[72362]:     <tpm supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='model'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>tpm-tis</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>tpm-crb</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='backendModel'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>passthrough</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>emulator</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </tpm>
Aug 09 10:11:53 user nova-compute[72362]:   </devices>
Aug 09 10:11:53 user nova-compute[72362]:   <features>
Aug 09 10:11:53 user nova-compute[72362]:     <gic supported='no'/>
Aug 09 10:11:53 user nova-compute[72362]:     <vmcoreinfo supported='yes'/>
Aug 09 10:11:53 user nova-compute[72362]:     <genid supported='yes'/>
Aug 09 10:11:53 user nova-compute[72362]:     <backingStoreInput supported='yes'/>
Aug 09 10:11:53 user nova-compute[72362]:     <backup supported='yes'/>
Aug 09 10:11:53 user nova-compute[72362]:     <sev supported='no'/>
Aug 09 10:11:53 user nova-compute[72362]:   </features>
Aug 09 10:11:53 user nova-compute[72362]: </domainCapabilities>
Aug 09 10:11:53 user nova-compute[72362]:  {{(pid=72362) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 09 10:11:53 user nova-compute[72362]: <domainCapabilities>
Aug 09 10:11:53 user nova-compute[72362]:   <path>/usr/bin/qemu-system-i386</path>
Aug 09 10:11:53 user nova-compute[72362]:   <domain>kvm</domain>
Aug 09 10:11:53 user nova-compute[72362]:   <machine>pc-q35-6.2</machine>
Aug 09 10:11:53 user nova-compute[72362]:   <arch>i686</arch>
Aug 09 10:11:53 user nova-compute[72362]:   <vcpu max='288'/>
Aug 09 10:11:53 user nova-compute[72362]:   <iothreads supported='yes'/>
Aug 09 10:11:53 user nova-compute[72362]:   <os supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:     <enum name='firmware'/>
Aug 09 10:11:53 user nova-compute[72362]:     <loader supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 09 10:11:53 user nova-compute[72362]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 09 10:11:53 user nova-compute[72362]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 09 10:11:53 user nova-compute[72362]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 09 10:11:53 user nova-compute[72362]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='type'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>rom</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>pflash</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='readonly'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>yes</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>no</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='secure'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>no</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </loader>
Aug 09 10:11:53 user nova-compute[72362]:   </os>
Aug 09 10:11:53 user nova-compute[72362]:   <cpu>
Aug 09 10:11:53 user nova-compute[72362]:     <mode name='host-passthrough' supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='hostPassthroughMigratable'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>off</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </mode>
Aug 09 10:11:53 user nova-compute[72362]:     <mode name='maximum' supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='maximumMigratable'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>on</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>off</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </mode>
Aug 09 10:11:53 user nova-compute[72362]:     <mode name='host-model' supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <vendor>Intel</vendor>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='ss'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='vmx'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='pcid'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='hypervisor'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='arat'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='umip'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='md-clear'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='stibp'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='ssbd'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='ibpb'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='ibrs'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='amd-stibp'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='disable' name='erms'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='disable' name='lm'/>
Aug 09 10:11:53 user nova-compute[72362]:     </mode>
Aug 09 10:11:53 user nova-compute[72362]:     <mode name='custom' supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>qemu64</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>qemu32</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>phenom</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>pentium3</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>pentium2</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>pentium</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>n270</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>kvm64</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>kvm32</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>coreduo</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>core2duo</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>athlon</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Westmere-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Westmere</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Snowridge</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Skylake-Server</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Skylake-Client</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>SandyBridge</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Penryn</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Opteron_G5</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Opteron_G4</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Opteron_G3</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Opteron_G2</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Opteron_G1</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Nehalem-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Nehalem</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>IvyBridge</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Icelake-Server</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Haswell</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>EPYC-Rome</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>EPYC-Milan</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>EPYC</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Dhyana</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Cooperlake</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Conroe</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Broadwell</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>486</model>
Aug 09 10:11:53 user nova-compute[72362]:     </mode>
Aug 09 10:11:53 user nova-compute[72362]:   </cpu>
Aug 09 10:11:53 user nova-compute[72362]:   <memoryBacking supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:     <enum name='sourceType'>
Aug 09 10:11:53 user nova-compute[72362]:       <value>file</value>
Aug 09 10:11:53 user nova-compute[72362]:       <value>anonymous</value>
Aug 09 10:11:53 user nova-compute[72362]:       <value>memfd</value>
Aug 09 10:11:53 user nova-compute[72362]:     </enum>
Aug 09 10:11:53 user nova-compute[72362]:   </memoryBacking>
Aug 09 10:11:53 user nova-compute[72362]:   <devices>
Aug 09 10:11:53 user nova-compute[72362]:     <disk supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='diskDevice'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>disk</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>cdrom</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>floppy</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>lun</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='bus'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>fdc</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>scsi</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>usb</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>sata</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='model'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio-transitional</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio-non-transitional</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </disk>
Aug 09 10:11:53 user nova-compute[72362]:     <graphics supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='type'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>sdl</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>vnc</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>spice</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>egl-headless</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </graphics>
Aug 09 10:11:53 user nova-compute[72362]:     <video supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='modelType'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>vga</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>cirrus</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>vmvga</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>qxl</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>none</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>bochs</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>ramfb</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </video>
Aug 09 10:11:53 user nova-compute[72362]:     <hostdev supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='mode'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>subsystem</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='startupPolicy'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>default</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>mandatory</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>requisite</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>optional</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='subsysType'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>usb</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>pci</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>scsi</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='capsType'/>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='pciBackend'/>
Aug 09 10:11:53 user nova-compute[72362]:     </hostdev>
Aug 09 10:11:53 user nova-compute[72362]:     <rng supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='model'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio-transitional</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio-non-transitional</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='backendModel'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>random</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>egd</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>builtin</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </rng>
Aug 09 10:11:53 user nova-compute[72362]:     <filesystem supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='driverType'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>path</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>handle</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtiofs</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </filesystem>
Aug 09 10:11:53 user nova-compute[72362]:     <tpm supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='model'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>tpm-tis</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>tpm-crb</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='backendModel'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>passthrough</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>emulator</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </tpm>
Aug 09 10:11:53 user nova-compute[72362]:   </devices>
Aug 09 10:11:53 user nova-compute[72362]:   <features>
Aug 09 10:11:53 user nova-compute[72362]:     <gic supported='no'/>
Aug 09 10:11:53 user nova-compute[72362]:     <vmcoreinfo supported='yes'/>
Aug 09 10:11:53 user nova-compute[72362]:     <genid supported='yes'/>
Aug 09 10:11:53 user nova-compute[72362]:     <backingStoreInput supported='yes'/>
Aug 09 10:11:53 user nova-compute[72362]:     <backup supported='yes'/>
Aug 09 10:11:53 user nova-compute[72362]:     <sev supported='no'/>
Aug 09 10:11:53 user nova-compute[72362]:   </features>
Aug 09 10:11:53 user nova-compute[72362]: </domainCapabilities>
Aug 09 10:11:53 user nova-compute[72362]:  {{(pid=72362) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 09 10:11:53 user nova-compute[72362]: <domainCapabilities>
Aug 09 10:11:53 user nova-compute[72362]:   <path>/usr/bin/qemu-system-i386</path>
Aug 09 10:11:53 user nova-compute[72362]:   <domain>kvm</domain>
Aug 09 10:11:53 user nova-compute[72362]:   <machine>pc-i440fx-jammy</machine>
Aug 09 10:11:53 user nova-compute[72362]:   <arch>i686</arch>
Aug 09 10:11:53 user nova-compute[72362]:   <vcpu max='255'/>
Aug 09 10:11:53 user nova-compute[72362]:   <iothreads supported='yes'/>
Aug 09 10:11:53 user nova-compute[72362]:   <os supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:     <enum name='firmware'/>
Aug 09 10:11:53 user nova-compute[72362]:     <loader supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 09 10:11:53 user nova-compute[72362]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 09 10:11:53 user nova-compute[72362]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 09 10:11:53 user nova-compute[72362]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 09 10:11:53 user nova-compute[72362]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='type'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>rom</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>pflash</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='readonly'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>yes</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>no</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='secure'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>no</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </loader>
Aug 09 10:11:53 user nova-compute[72362]:   </os>
Aug 09 10:11:53 user nova-compute[72362]:   <cpu>
Aug 09 10:11:53 user nova-compute[72362]:     <mode name='host-passthrough' supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='hostPassthroughMigratable'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>off</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </mode>
Aug 09 10:11:53 user nova-compute[72362]:     <mode name='maximum' supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='maximumMigratable'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>on</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>off</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </mode>
Aug 09 10:11:53 user nova-compute[72362]:     <mode name='host-model' supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <vendor>Intel</vendor>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='ss'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='vmx'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='pcid'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='hypervisor'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='arat'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='umip'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='md-clear'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='stibp'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='ssbd'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='ibpb'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='ibrs'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='amd-stibp'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='disable' name='erms'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='disable' name='lm'/>
Aug 09 10:11:53 user nova-compute[72362]:     </mode>
Aug 09 10:11:53 user nova-compute[72362]:     <mode name='custom' supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>qemu64</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>qemu32</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>phenom</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>pentium3</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>pentium2</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>pentium</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>n270</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>kvm64</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>kvm32</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>coreduo</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>core2duo</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>athlon</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Westmere-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Westmere</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Snowridge</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Skylake-Server</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Skylake-Client</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>SandyBridge</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Penryn</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Opteron_G5</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Opteron_G4</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Opteron_G3</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Opteron_G2</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Opteron_G1</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Nehalem-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Nehalem</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>IvyBridge</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Icelake-Server</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Haswell</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>EPYC-Rome</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>EPYC-Milan</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>EPYC</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Dhyana</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Cooperlake</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Conroe</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Broadwell</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>486</model>
Aug 09 10:11:53 user nova-compute[72362]:     </mode>
Aug 09 10:11:53 user nova-compute[72362]:   </cpu>
Aug 09 10:11:53 user nova-compute[72362]:   <memoryBacking supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:     <enum name='sourceType'>
Aug 09 10:11:53 user nova-compute[72362]:       <value>file</value>
Aug 09 10:11:53 user nova-compute[72362]:       <value>anonymous</value>
Aug 09 10:11:53 user nova-compute[72362]:       <value>memfd</value>
Aug 09 10:11:53 user nova-compute[72362]:     </enum>
Aug 09 10:11:53 user nova-compute[72362]:   </memoryBacking>
Aug 09 10:11:53 user nova-compute[72362]:   <devices>
Aug 09 10:11:53 user nova-compute[72362]:     <disk supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='diskDevice'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>disk</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>cdrom</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>floppy</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>lun</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='bus'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>ide</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>fdc</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>scsi</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>usb</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>sata</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='model'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio-transitional</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio-non-transitional</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </disk>
Aug 09 10:11:53 user nova-compute[72362]:     <graphics supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='type'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>sdl</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>vnc</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>spice</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>egl-headless</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </graphics>
Aug 09 10:11:53 user nova-compute[72362]:     <video supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='modelType'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>vga</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>cirrus</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>vmvga</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>qxl</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>none</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>bochs</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>ramfb</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </video>
Aug 09 10:11:53 user nova-compute[72362]:     <hostdev supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='mode'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>subsystem</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='startupPolicy'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>default</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>mandatory</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>requisite</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>optional</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='subsysType'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>usb</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>pci</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>scsi</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='capsType'/>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='pciBackend'/>
Aug 09 10:11:53 user nova-compute[72362]:     </hostdev>
Aug 09 10:11:53 user nova-compute[72362]:     <rng supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='model'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio-transitional</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio-non-transitional</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='backendModel'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>random</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>egd</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>builtin</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </rng>
Aug 09 10:11:53 user nova-compute[72362]:     <filesystem supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='driverType'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>path</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>handle</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtiofs</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </filesystem>
Aug 09 10:11:53 user nova-compute[72362]:     <tpm supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='model'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>tpm-tis</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>tpm-crb</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='backendModel'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>passthrough</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>emulator</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </tpm>
Aug 09 10:11:53 user nova-compute[72362]:   </devices>
Aug 09 10:11:53 user nova-compute[72362]:   <features>
Aug 09 10:11:53 user nova-compute[72362]:     <gic supported='no'/>
Aug 09 10:11:53 user nova-compute[72362]:     <vmcoreinfo supported='yes'/>
Aug 09 10:11:53 user nova-compute[72362]:     <genid supported='yes'/>
Aug 09 10:11:53 user nova-compute[72362]:     <backingStoreInput supported='yes'/>
Aug 09 10:11:53 user nova-compute[72362]:     <backup supported='yes'/>
Aug 09 10:11:53 user nova-compute[72362]:     <sev supported='no'/>
Aug 09 10:11:53 user nova-compute[72362]:   </features>
Aug 09 10:11:53 user nova-compute[72362]: </domainCapabilities>
Aug 09 10:11:53 user nova-compute[72362]:  {{(pid=72362) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=72362) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72362) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72362) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=72362) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=72362) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=72362) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=72362) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=72362) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=72362) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=72362) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=72362) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=72362) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=72362) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=72362) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=72362) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=72362) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=72362) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=72362) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72362) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72362) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72362) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=72362) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72362) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72362) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=72362) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=72362) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=72362) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=72362) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=72362) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=72362) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=72362) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=72362) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=72362) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=72362) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=72362) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=72362) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=72362) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=72362) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'ubuntu-q35', 'q35', 'ubuntu'} {{(pid=72362) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 09 10:11:53 user nova-compute[72362]: <domainCapabilities>
Aug 09 10:11:53 user nova-compute[72362]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 09 10:11:53 user nova-compute[72362]:   <domain>kvm</domain>
Aug 09 10:11:53 user nova-compute[72362]:   <machine>pc-i440fx-6.2</machine>
Aug 09 10:11:53 user nova-compute[72362]:   <arch>x86_64</arch>
Aug 09 10:11:53 user nova-compute[72362]:   <vcpu max='255'/>
Aug 09 10:11:53 user nova-compute[72362]:   <iothreads supported='yes'/>
Aug 09 10:11:53 user nova-compute[72362]:   <os supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:     <enum name='firmware'>
Aug 09 10:11:53 user nova-compute[72362]:       <value>efi</value>
Aug 09 10:11:53 user nova-compute[72362]:     </enum>
Aug 09 10:11:53 user nova-compute[72362]:     <loader supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='type'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>rom</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>pflash</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='readonly'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>yes</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>no</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='secure'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>no</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </loader>
Aug 09 10:11:53 user nova-compute[72362]:   </os>
Aug 09 10:11:53 user nova-compute[72362]:   <cpu>
Aug 09 10:11:53 user nova-compute[72362]:     <mode name='host-passthrough' supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='hostPassthroughMigratable'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>on</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>off</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </mode>
Aug 09 10:11:53 user nova-compute[72362]:     <mode name='maximum' supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='maximumMigratable'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>on</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>off</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </mode>
Aug 09 10:11:53 user nova-compute[72362]:     <mode name='host-model' supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <vendor>Intel</vendor>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='ss'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='vmx'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='pcid'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='hypervisor'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='arat'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='umip'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='md-clear'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='stibp'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='ssbd'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='invtsc'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='ibpb'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='ibrs'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='amd-stibp'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='rsba'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='pschange-mc-no'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='disable' name='erms'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 10:11:53 user nova-compute[72362]:     </mode>
Aug 09 10:11:53 user nova-compute[72362]:     <mode name='custom' supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>qemu64</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>qemu32</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>phenom</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>pentium3</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>pentium2</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>pentium</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>n270</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>kvm64</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>kvm32</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>coreduo</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>core2duo</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>athlon</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>Westmere-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>Westmere</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Snowridge</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Skylake-Server</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Skylake-Client</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>SandyBridge</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>Penryn</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Opteron_G5</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Opteron_G4</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Opteron_G3</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Opteron_G2</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>Opteron_G1</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>Nehalem</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>IvyBridge</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Icelake-Server</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Haswell</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>EPYC-Rome</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>EPYC-Milan</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>EPYC</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Dhyana</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Cooperlake</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>Conroe</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Broadwell</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>486</model>
Aug 09 10:11:53 user nova-compute[72362]:     </mode>
Aug 09 10:11:53 user nova-compute[72362]:   </cpu>
Aug 09 10:11:53 user nova-compute[72362]:   <memoryBacking supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:     <enum name='sourceType'>
Aug 09 10:11:53 user nova-compute[72362]:       <value>file</value>
Aug 09 10:11:53 user nova-compute[72362]:       <value>anonymous</value>
Aug 09 10:11:53 user nova-compute[72362]:       <value>memfd</value>
Aug 09 10:11:53 user nova-compute[72362]:     </enum>
Aug 09 10:11:53 user nova-compute[72362]:   </memoryBacking>
Aug 09 10:11:53 user nova-compute[72362]:   <devices>
Aug 09 10:11:53 user nova-compute[72362]:     <disk supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='diskDevice'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>disk</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>cdrom</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>floppy</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>lun</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='bus'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>ide</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>fdc</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>scsi</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>usb</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>sata</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='model'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio-transitional</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio-non-transitional</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </disk>
Aug 09 10:11:53 user nova-compute[72362]:     <graphics supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='type'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>sdl</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>vnc</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>spice</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>egl-headless</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </graphics>
Aug 09 10:11:53 user nova-compute[72362]:     <video supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='modelType'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>vga</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>cirrus</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>vmvga</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>qxl</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>none</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>bochs</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>ramfb</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </video>
Aug 09 10:11:53 user nova-compute[72362]:     <hostdev supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='mode'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>subsystem</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='startupPolicy'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>default</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>mandatory</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>requisite</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>optional</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='subsysType'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>usb</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>pci</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>scsi</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='capsType'/>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='pciBackend'/>
Aug 09 10:11:53 user nova-compute[72362]:     </hostdev>
Aug 09 10:11:53 user nova-compute[72362]:     <rng supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='model'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio-transitional</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio-non-transitional</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='backendModel'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>random</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>egd</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>builtin</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </rng>
Aug 09 10:11:53 user nova-compute[72362]:     <filesystem supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='driverType'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>path</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>handle</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtiofs</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </filesystem>
Aug 09 10:11:53 user nova-compute[72362]:     <tpm supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='model'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>tpm-tis</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>tpm-crb</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='backendModel'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>passthrough</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>emulator</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </tpm>
Aug 09 10:11:53 user nova-compute[72362]:   </devices>
Aug 09 10:11:53 user nova-compute[72362]:   <features>
Aug 09 10:11:53 user nova-compute[72362]:     <gic supported='no'/>
Aug 09 10:11:53 user nova-compute[72362]:     <vmcoreinfo supported='yes'/>
Aug 09 10:11:53 user nova-compute[72362]:     <genid supported='yes'/>
Aug 09 10:11:53 user nova-compute[72362]:     <backingStoreInput supported='yes'/>
Aug 09 10:11:53 user nova-compute[72362]:     <backup supported='yes'/>
Aug 09 10:11:53 user nova-compute[72362]:     <sev supported='no'/>
Aug 09 10:11:53 user nova-compute[72362]:   </features>
Aug 09 10:11:53 user nova-compute[72362]: </domainCapabilities>
Aug 09 10:11:53 user nova-compute[72362]:  {{(pid=72362) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 09 10:11:53 user nova-compute[72362]: <domainCapabilities>
Aug 09 10:11:53 user nova-compute[72362]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 09 10:11:53 user nova-compute[72362]:   <domain>kvm</domain>
Aug 09 10:11:53 user nova-compute[72362]:   <machine>pc-q35-jammy</machine>
Aug 09 10:11:53 user nova-compute[72362]:   <arch>x86_64</arch>
Aug 09 10:11:53 user nova-compute[72362]:   <vcpu max='288'/>
Aug 09 10:11:53 user nova-compute[72362]:   <iothreads supported='yes'/>
Aug 09 10:11:53 user nova-compute[72362]:   <os supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:     <enum name='firmware'>
Aug 09 10:11:53 user nova-compute[72362]:       <value>efi</value>
Aug 09 10:11:53 user nova-compute[72362]:     </enum>
Aug 09 10:11:53 user nova-compute[72362]:     <loader supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 09 10:11:53 user nova-compute[72362]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 09 10:11:53 user nova-compute[72362]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='type'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>rom</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>pflash</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='readonly'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>yes</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>no</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='secure'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>yes</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>no</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </loader>
Aug 09 10:11:53 user nova-compute[72362]:   </os>
Aug 09 10:11:53 user nova-compute[72362]:   <cpu>
Aug 09 10:11:53 user nova-compute[72362]:     <mode name='host-passthrough' supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='hostPassthroughMigratable'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>on</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>off</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </mode>
Aug 09 10:11:53 user nova-compute[72362]:     <mode name='maximum' supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='maximumMigratable'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>on</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>off</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </mode>
Aug 09 10:11:53 user nova-compute[72362]:     <mode name='host-model' supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <vendor>Intel</vendor>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='ss'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='vmx'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='pcid'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='hypervisor'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='arat'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='umip'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='md-clear'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='stibp'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='ssbd'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='invtsc'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='ibpb'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='ibrs'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='amd-stibp'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='rsba'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='pschange-mc-no'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='disable' name='erms'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 10:11:53 user nova-compute[72362]:     </mode>
Aug 09 10:11:53 user nova-compute[72362]:     <mode name='custom' supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>qemu64</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>qemu32</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>phenom</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>pentium3</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>pentium2</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>pentium</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>n270</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>kvm64</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>kvm32</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>coreduo</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>core2duo</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>athlon</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>Westmere-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>Westmere</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Snowridge</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Skylake-Server</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Skylake-Client</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>SandyBridge</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>Penryn</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Opteron_G5</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Opteron_G4</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Opteron_G3</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Opteron_G2</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>Opteron_G1</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>Nehalem</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>IvyBridge</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Icelake-Server</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Haswell</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>EPYC-Rome</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>EPYC-Milan</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>EPYC</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Dhyana</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Cooperlake</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>Conroe</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Broadwell</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>486</model>
Aug 09 10:11:53 user nova-compute[72362]:     </mode>
Aug 09 10:11:53 user nova-compute[72362]:   </cpu>
Aug 09 10:11:53 user nova-compute[72362]:   <memoryBacking supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:     <enum name='sourceType'>
Aug 09 10:11:53 user nova-compute[72362]:       <value>file</value>
Aug 09 10:11:53 user nova-compute[72362]:       <value>anonymous</value>
Aug 09 10:11:53 user nova-compute[72362]:       <value>memfd</value>
Aug 09 10:11:53 user nova-compute[72362]:     </enum>
Aug 09 10:11:53 user nova-compute[72362]:   </memoryBacking>
Aug 09 10:11:53 user nova-compute[72362]:   <devices>
Aug 09 10:11:53 user nova-compute[72362]:     <disk supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='diskDevice'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>disk</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>cdrom</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>floppy</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>lun</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='bus'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>fdc</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>scsi</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>usb</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>sata</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='model'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio-transitional</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio-non-transitional</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </disk>
Aug 09 10:11:53 user nova-compute[72362]:     <graphics supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='type'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>sdl</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>vnc</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>spice</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>egl-headless</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </graphics>
Aug 09 10:11:53 user nova-compute[72362]:     <video supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='modelType'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>vga</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>cirrus</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>vmvga</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>qxl</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>none</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>bochs</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>ramfb</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </video>
Aug 09 10:11:53 user nova-compute[72362]:     <hostdev supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='mode'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>subsystem</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='startupPolicy'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>default</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>mandatory</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>requisite</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>optional</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='subsysType'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>usb</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>pci</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>scsi</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='capsType'/>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='pciBackend'/>
Aug 09 10:11:53 user nova-compute[72362]:     </hostdev>
Aug 09 10:11:53 user nova-compute[72362]:     <rng supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='model'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio-transitional</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio-non-transitional</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='backendModel'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>random</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>egd</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>builtin</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </rng>
Aug 09 10:11:53 user nova-compute[72362]:     <filesystem supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='driverType'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>path</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>handle</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtiofs</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </filesystem>
Aug 09 10:11:53 user nova-compute[72362]:     <tpm supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='model'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>tpm-tis</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>tpm-crb</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='backendModel'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>passthrough</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>emulator</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </tpm>
Aug 09 10:11:53 user nova-compute[72362]:   </devices>
Aug 09 10:11:53 user nova-compute[72362]:   <features>
Aug 09 10:11:53 user nova-compute[72362]:     <gic supported='no'/>
Aug 09 10:11:53 user nova-compute[72362]:     <vmcoreinfo supported='yes'/>
Aug 09 10:11:53 user nova-compute[72362]:     <genid supported='yes'/>
Aug 09 10:11:53 user nova-compute[72362]:     <backingStoreInput supported='yes'/>
Aug 09 10:11:53 user nova-compute[72362]:     <backup supported='yes'/>
Aug 09 10:11:53 user nova-compute[72362]:     <sev supported='no'/>
Aug 09 10:11:53 user nova-compute[72362]:   </features>
Aug 09 10:11:53 user nova-compute[72362]: </domainCapabilities>
Aug 09 10:11:53 user nova-compute[72362]:  {{(pid=72362) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 09 10:11:53 user nova-compute[72362]: <domainCapabilities>
Aug 09 10:11:53 user nova-compute[72362]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 09 10:11:53 user nova-compute[72362]:   <domain>kvm</domain>
Aug 09 10:11:53 user nova-compute[72362]:   <machine>pc-q35-6.2</machine>
Aug 09 10:11:53 user nova-compute[72362]:   <arch>x86_64</arch>
Aug 09 10:11:53 user nova-compute[72362]:   <vcpu max='288'/>
Aug 09 10:11:53 user nova-compute[72362]:   <iothreads supported='yes'/>
Aug 09 10:11:53 user nova-compute[72362]:   <os supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:     <enum name='firmware'>
Aug 09 10:11:53 user nova-compute[72362]:       <value>efi</value>
Aug 09 10:11:53 user nova-compute[72362]:     </enum>
Aug 09 10:11:53 user nova-compute[72362]:     <loader supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 09 10:11:53 user nova-compute[72362]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 09 10:11:53 user nova-compute[72362]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='type'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>rom</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>pflash</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='readonly'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>yes</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>no</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='secure'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>yes</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>no</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </loader>
Aug 09 10:11:53 user nova-compute[72362]:   </os>
Aug 09 10:11:53 user nova-compute[72362]:   <cpu>
Aug 09 10:11:53 user nova-compute[72362]:     <mode name='host-passthrough' supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='hostPassthroughMigratable'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>on</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>off</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </mode>
Aug 09 10:11:53 user nova-compute[72362]:     <mode name='maximum' supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='maximumMigratable'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>on</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>off</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </mode>
Aug 09 10:11:53 user nova-compute[72362]:     <mode name='host-model' supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <vendor>Intel</vendor>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='ss'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='vmx'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='pcid'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='hypervisor'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='arat'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='umip'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='md-clear'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='stibp'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='ssbd'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='invtsc'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='ibpb'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='ibrs'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='amd-stibp'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='rsba'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='pschange-mc-no'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='disable' name='erms'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 10:11:53 user nova-compute[72362]:     </mode>
Aug 09 10:11:53 user nova-compute[72362]:     <mode name='custom' supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>qemu64</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>qemu32</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>phenom</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>pentium3</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>pentium2</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>pentium</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>n270</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>kvm64</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>kvm32</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>coreduo</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>core2duo</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>athlon</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>Westmere-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>Westmere</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Snowridge</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Skylake-Server</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Skylake-Client</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>SandyBridge</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>Penryn</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Opteron_G5</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Opteron_G4</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Opteron_G3</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Opteron_G2</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>Opteron_G1</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>Nehalem</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>IvyBridge</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Icelake-Server</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Haswell</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>EPYC-Rome</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>EPYC-Milan</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>EPYC</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Dhyana</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Cooperlake</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>Conroe</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Broadwell</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>486</model>
Aug 09 10:11:53 user nova-compute[72362]:     </mode>
Aug 09 10:11:53 user nova-compute[72362]:   </cpu>
Aug 09 10:11:53 user nova-compute[72362]:   <memoryBacking supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:     <enum name='sourceType'>
Aug 09 10:11:53 user nova-compute[72362]:       <value>file</value>
Aug 09 10:11:53 user nova-compute[72362]:       <value>anonymous</value>
Aug 09 10:11:53 user nova-compute[72362]:       <value>memfd</value>
Aug 09 10:11:53 user nova-compute[72362]:     </enum>
Aug 09 10:11:53 user nova-compute[72362]:   </memoryBacking>
Aug 09 10:11:53 user nova-compute[72362]:   <devices>
Aug 09 10:11:53 user nova-compute[72362]:     <disk supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='diskDevice'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>disk</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>cdrom</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>floppy</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>lun</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='bus'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>fdc</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>scsi</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>usb</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>sata</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='model'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio-transitional</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio-non-transitional</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </disk>
Aug 09 10:11:53 user nova-compute[72362]:     <graphics supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='type'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>sdl</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>vnc</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>spice</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>egl-headless</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </graphics>
Aug 09 10:11:53 user nova-compute[72362]:     <video supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='modelType'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>vga</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>cirrus</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>vmvga</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>qxl</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>none</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>bochs</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>ramfb</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </video>
Aug 09 10:11:53 user nova-compute[72362]:     <hostdev supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='mode'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>subsystem</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='startupPolicy'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>default</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>mandatory</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>requisite</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>optional</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='subsysType'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>usb</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>pci</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>scsi</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='capsType'/>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='pciBackend'/>
Aug 09 10:11:53 user nova-compute[72362]:     </hostdev>
Aug 09 10:11:53 user nova-compute[72362]:     <rng supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='model'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio-transitional</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio-non-transitional</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='backendModel'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>random</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>egd</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>builtin</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </rng>
Aug 09 10:11:53 user nova-compute[72362]:     <filesystem supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='driverType'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>path</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>handle</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtiofs</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </filesystem>
Aug 09 10:11:53 user nova-compute[72362]:     <tpm supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='model'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>tpm-tis</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>tpm-crb</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='backendModel'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>passthrough</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>emulator</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </tpm>
Aug 09 10:11:53 user nova-compute[72362]:   </devices>
Aug 09 10:11:53 user nova-compute[72362]:   <features>
Aug 09 10:11:53 user nova-compute[72362]:     <gic supported='no'/>
Aug 09 10:11:53 user nova-compute[72362]:     <vmcoreinfo supported='yes'/>
Aug 09 10:11:53 user nova-compute[72362]:     <genid supported='yes'/>
Aug 09 10:11:53 user nova-compute[72362]:     <backingStoreInput supported='yes'/>
Aug 09 10:11:53 user nova-compute[72362]:     <backup supported='yes'/>
Aug 09 10:11:53 user nova-compute[72362]:     <sev supported='no'/>
Aug 09 10:11:53 user nova-compute[72362]:   </features>
Aug 09 10:11:53 user nova-compute[72362]: </domainCapabilities>
Aug 09 10:11:53 user nova-compute[72362]:  {{(pid=72362) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 09 10:11:53 user nova-compute[72362]: <domainCapabilities>
Aug 09 10:11:53 user nova-compute[72362]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 09 10:11:53 user nova-compute[72362]:   <domain>kvm</domain>
Aug 09 10:11:53 user nova-compute[72362]:   <machine>pc-i440fx-jammy</machine>
Aug 09 10:11:53 user nova-compute[72362]:   <arch>x86_64</arch>
Aug 09 10:11:53 user nova-compute[72362]:   <vcpu max='255'/>
Aug 09 10:11:53 user nova-compute[72362]:   <iothreads supported='yes'/>
Aug 09 10:11:53 user nova-compute[72362]:   <os supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:     <enum name='firmware'>
Aug 09 10:11:53 user nova-compute[72362]:       <value>efi</value>
Aug 09 10:11:53 user nova-compute[72362]:     </enum>
Aug 09 10:11:53 user nova-compute[72362]:     <loader supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='type'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>rom</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>pflash</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='readonly'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>yes</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>no</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='secure'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>no</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </loader>
Aug 09 10:11:53 user nova-compute[72362]:   </os>
Aug 09 10:11:53 user nova-compute[72362]:   <cpu>
Aug 09 10:11:53 user nova-compute[72362]:     <mode name='host-passthrough' supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='hostPassthroughMigratable'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>on</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>off</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </mode>
Aug 09 10:11:53 user nova-compute[72362]:     <mode name='maximum' supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='maximumMigratable'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>on</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>off</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </mode>
Aug 09 10:11:53 user nova-compute[72362]:     <mode name='host-model' supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <vendor>Intel</vendor>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='ss'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='vmx'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='pcid'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='hypervisor'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='arat'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='umip'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='md-clear'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='stibp'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='ssbd'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='invtsc'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='ibpb'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='ibrs'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='amd-stibp'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='rsba'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='require' name='pschange-mc-no'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='disable' name='erms'/>
Aug 09 10:11:53 user nova-compute[72362]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 10:11:53 user nova-compute[72362]:     </mode>
Aug 09 10:11:53 user nova-compute[72362]:     <mode name='custom' supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>qemu64</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>qemu32</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>phenom</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>pentium3</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>pentium2</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>pentium</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>n270</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>kvm64</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>kvm32</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>coreduo</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>core2duo</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>athlon</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>Westmere-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>Westmere</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Snowridge</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Skylake-Server</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Skylake-Client</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>SandyBridge</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>Penryn</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Opteron_G5</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Opteron_G4</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Opteron_G3</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Opteron_G2</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>Opteron_G1</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>Nehalem</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>IvyBridge</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Icelake-Server</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Haswell</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>EPYC-Rome</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>EPYC-Milan</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>EPYC</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Dhyana</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Cooperlake</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>Conroe</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='no'>Broadwell</model>
Aug 09 10:11:53 user nova-compute[72362]:       <model usable='yes'>486</model>
Aug 09 10:11:53 user nova-compute[72362]:     </mode>
Aug 09 10:11:53 user nova-compute[72362]:   </cpu>
Aug 09 10:11:53 user nova-compute[72362]:   <memoryBacking supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:     <enum name='sourceType'>
Aug 09 10:11:53 user nova-compute[72362]:       <value>file</value>
Aug 09 10:11:53 user nova-compute[72362]:       <value>anonymous</value>
Aug 09 10:11:53 user nova-compute[72362]:       <value>memfd</value>
Aug 09 10:11:53 user nova-compute[72362]:     </enum>
Aug 09 10:11:53 user nova-compute[72362]:   </memoryBacking>
Aug 09 10:11:53 user nova-compute[72362]:   <devices>
Aug 09 10:11:53 user nova-compute[72362]:     <disk supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='diskDevice'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>disk</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>cdrom</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>floppy</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>lun</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='bus'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>ide</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>fdc</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>scsi</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>usb</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>sata</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='model'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio-transitional</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio-non-transitional</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </disk>
Aug 09 10:11:53 user nova-compute[72362]:     <graphics supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='type'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>sdl</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>vnc</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>spice</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>egl-headless</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </graphics>
Aug 09 10:11:53 user nova-compute[72362]:     <video supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='modelType'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>vga</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>cirrus</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>vmvga</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>qxl</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>none</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>bochs</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>ramfb</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </video>
Aug 09 10:11:53 user nova-compute[72362]:     <hostdev supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='mode'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>subsystem</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='startupPolicy'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>default</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>mandatory</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>requisite</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>optional</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='subsysType'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>usb</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>pci</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>scsi</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='capsType'/>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='pciBackend'/>
Aug 09 10:11:53 user nova-compute[72362]:     </hostdev>
Aug 09 10:11:53 user nova-compute[72362]:     <rng supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='model'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio-transitional</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtio-non-transitional</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='backendModel'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>random</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>egd</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>builtin</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </rng>
Aug 09 10:11:53 user nova-compute[72362]:     <filesystem supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='driverType'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>path</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>handle</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>virtiofs</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </filesystem>
Aug 09 10:11:53 user nova-compute[72362]:     <tpm supported='yes'>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='model'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>tpm-tis</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>tpm-crb</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:       <enum name='backendModel'>
Aug 09 10:11:53 user nova-compute[72362]:         <value>passthrough</value>
Aug 09 10:11:53 user nova-compute[72362]:         <value>emulator</value>
Aug 09 10:11:53 user nova-compute[72362]:       </enum>
Aug 09 10:11:53 user nova-compute[72362]:     </tpm>
Aug 09 10:11:53 user nova-compute[72362]:   </devices>
Aug 09 10:11:53 user nova-compute[72362]:   <features>
Aug 09 10:11:53 user nova-compute[72362]:     <gic supported='no'/>
Aug 09 10:11:53 user nova-compute[72362]:     <vmcoreinfo supported='yes'/>
Aug 09 10:11:53 user nova-compute[72362]:     <genid supported='yes'/>
Aug 09 10:11:53 user nova-compute[72362]:     <backingStoreInput supported='yes'/>
Aug 09 10:11:53 user nova-compute[72362]:     <backup supported='yes'/>
Aug 09 10:11:53 user nova-compute[72362]:     <sev supported='no'/>
Aug 09 10:11:53 user nova-compute[72362]:   </features>
Aug 09 10:11:53 user nova-compute[72362]: </domainCapabilities>
Aug 09 10:11:53 user nova-compute[72362]:  {{(pid=72362) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=72362) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=72362) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=72362) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=72362) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Checking secure boot support for host arch (x86_64) {{(pid=72362) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Checking secure boot support for host arch (x86_64) {{(pid=72362) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Checking secure boot support for host arch (x86_64) {{(pid=72362) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 09 10:11:53 user nova-compute[72362]: INFO nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Secure Boot support detected
Aug 09 10:11:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] cpu compare xml: <cpu match="exact">
Aug 09 10:11:53 user nova-compute[72362]:   <model>Nehalem</model>
Aug 09 10:11:53 user nova-compute[72362]: </cpu>
Aug 09 10:11:53 user nova-compute[72362]:  {{(pid=72362) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 09 10:11:53 user nova-compute[72362]: INFO nova.virt.node [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Generated node identity 6a678ae9-d474-4dd0-a246-9ae5a9a7108d
Aug 09 10:11:53 user nova-compute[72362]: INFO nova.virt.node [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Wrote node identity 6a678ae9-d474-4dd0-a246-9ae5a9a7108d to /opt/stack/data/nova/compute_id
Aug 09 10:11:53 user nova-compute[72362]: WARNING nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Compute nodes ['6a678ae9-d474-4dd0-a246-9ae5a9a7108d'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 09 10:11:54 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 09 10:11:54 user nova-compute[72362]: WARNING nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 09 10:11:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:11:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:11:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:11:54 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 10:11:54 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:11:54 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:11:54 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Hypervisor/Node resource view: name=user free_ram=10895MB free_disk=26.24091339111328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 10:11:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:11:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:11:54 user nova-compute[72362]: WARNING nova.compute.resource_tracker [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] No compute node record for user:6a678ae9-d474-4dd0-a246-9ae5a9a7108d: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 6a678ae9-d474-4dd0-a246-9ae5a9a7108d could not be found.
Aug 09 10:11:54 user nova-compute[72362]: INFO nova.compute.resource_tracker [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Compute node record created for user:user with uuid: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d
Aug 09 10:11:54 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 10:11:54 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 10:11:54 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [req-66593381-6f55-4ad5-a1db-e52aeefc77b9] Created resource provider record via placement API for resource provider with UUID 6a678ae9-d474-4dd0-a246-9ae5a9a7108d and name user.
Aug 09 10:11:54 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=72362) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 09 10:11:54 user nova-compute[72362]: INFO nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] kernel doesn't support AMD SEV
Aug 09 10:11:54 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Updating inventory in ProviderTree for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 10:11:54 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:11:54 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Libvirt baseline CPU <cpu>
Aug 09 10:11:54 user nova-compute[72362]:   <arch>x86_64</arch>
Aug 09 10:11:54 user nova-compute[72362]:   <model>Nehalem</model>
Aug 09 10:11:54 user nova-compute[72362]:   <vendor>Intel</vendor>
Aug 09 10:11:54 user nova-compute[72362]:   <topology sockets="6" cores="1" threads="1"/>
Aug 09 10:11:54 user nova-compute[72362]: </cpu>
Aug 09 10:11:54 user nova-compute[72362]:  {{(pid=72362) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 09 10:11:54 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Updated inventory for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 09 10:11:54 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Updating resource provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d generation from 0 to 1 during operation: update_inventory {{(pid=72362) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 09 10:11:54 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Updating inventory in ProviderTree for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 10:11:55 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Updating resource provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d generation from 1 to 2 during operation: update_traits {{(pid=72362) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 09 10:11:55 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 10:11:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.616s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:11:55 user nova-compute[72362]: DEBUG nova.service [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Creating RPC server for service compute {{(pid=72362) start /opt/stack/nova/nova/service.py:182}}
Aug 09 10:11:55 user nova-compute[72362]: DEBUG nova.service [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Join ServiceGroup membership for this service compute {{(pid=72362) start /opt/stack/nova/nova/service.py:199}}
Aug 09 10:11:55 user nova-compute[72362]: DEBUG nova.servicegroup.drivers.db [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=72362) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 09 10:12:21 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:12:21 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:12:45 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:12:45 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:12:45 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 10:12:45 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Rebuilding the list of instances to heal {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 10:12:46 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Didn't find any instances for network info cache update. {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 10:12:46 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:12:46 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:12:46 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:12:46 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:12:46 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:12:46 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:12:46 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 10:12:46 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:12:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:12:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:12:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:12:46 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 10:12:46 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:12:46 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:12:46 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=10286MB free_disk=26.02520751953125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 10:12:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:12:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:12:46 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 10:12:46 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 10:12:46 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:12:46 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:12:46 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 10:12:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.178s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:13:46 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:13:46 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:13:46 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:13:46 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:13:46 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:13:46 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:13:46 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:13:47 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:13:47 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 10:13:47 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Rebuilding the list of instances to heal {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 10:13:47 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Didn't find any instances for network info cache update. {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 10:13:47 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:13:47 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 10:13:47 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:13:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:13:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:13:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:13:48 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 10:13:48 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:13:48 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:13:48 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=10249MB free_disk=26.069839477539062GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 10:13:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:13:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:13:48 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 10:13:48 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 10:13:48 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:13:48 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:13:48 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 10:13:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.149s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:14:46 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:14:46 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:14:47 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:14:47 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:14:47 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:14:47 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:14:47 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 10:14:48 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:14:48 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:14:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:14:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:14:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:14:48 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 10:14:49 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:14:49 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:14:49 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=10248MB free_disk=25.84430694580078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 10:14:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:14:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:14:49 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 10:14:49 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 10:14:49 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:14:49 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:14:49 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 10:14:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.146s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:14:50 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:14:50 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 10:14:50 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Rebuilding the list of instances to heal {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 10:14:50 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Didn't find any instances for network info cache update. {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 10:15:46 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:15:47 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:15:47 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:15:48 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:15:48 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 10:15:48 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:15:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:15:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:15:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:15:49 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 10:15:49 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:15:49 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:15:49 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=9510MB free_disk=25.866657257080078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 10:15:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:15:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:15:49 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 10:15:49 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 10:15:49 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:15:49 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:15:49 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 10:15:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.133s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:15:50 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:15:50 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:15:50 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:15:50 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:15:51 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:15:51 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 10:15:51 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Rebuilding the list of instances to heal {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 10:15:51 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Didn't find any instances for network info cache update. {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 10:15:56 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Acquiring lock "1e2e53b4-3a00-4725-840d-215f6609c951" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:15:56 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Lock "1e2e53b4-3a00-4725-840d-215f6609c951" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:15:56 user nova-compute[72362]: DEBUG nova.compute.manager [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Starting instance... {{(pid=72362) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 10:15:57 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:15:57 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:15:57 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:15:57 user nova-compute[72362]: INFO nova.compute.claims [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Claim successful on node user
Aug 09 10:15:57 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:15:57 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:15:57 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.427s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:15:57 user nova-compute[72362]: DEBUG nova.compute.manager [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Start building networks asynchronously for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 10:15:57 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Acquiring lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:15:57 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:15:57 user nova-compute[72362]: DEBUG nova.compute.manager [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Allocating IP information in the background. {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 10:15:57 user nova-compute[72362]: DEBUG nova.network.neutron [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] allocate_for_instance() {{(pid=72362) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 10:15:57 user nova-compute[72362]: DEBUG nova.compute.manager [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Starting instance... {{(pid=72362) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 10:15:57 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 10:15:57 user nova-compute[72362]: DEBUG nova.compute.manager [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Start building block device mappings for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 10:15:57 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:15:57 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:15:57 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:15:57 user nova-compute[72362]: INFO nova.compute.claims [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Claim successful on node user
Aug 09 10:15:58 user nova-compute[72362]: DEBUG nova.compute.manager [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Start spawning the instance on the hypervisor. {{(pid=72362) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 10:15:58 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:15:58 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Creating image(s)
Aug 09 10:15:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Acquiring lock "/opt/stack/data/nova/instances/1e2e53b4-3a00-4725-840d-215f6609c951/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:15:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Lock "/opt/stack/data/nova/instances/1e2e53b4-3a00-4725-840d-215f6609c951/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:15:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Lock "/opt/stack/data/nova/instances/1e2e53b4-3a00-4725-840d-215f6609c951/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:15:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Acquiring lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:15:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:15:58 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:15:58 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:15:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.338s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:15:58 user nova-compute[72362]: DEBUG nova.compute.manager [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Start building networks asynchronously for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 10:15:58 user nova-compute[72362]: DEBUG nova.policy [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e4e5357e1c9c4f64879b505362ebd8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcec0d088b642ef9262d53297d51240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72362) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 10:15:58 user nova-compute[72362]: DEBUG nova.compute.manager [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Allocating IP information in the background. {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 10:15:58 user nova-compute[72362]: DEBUG nova.network.neutron [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] allocate_for_instance() {{(pid=72362) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 10:15:58 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 10:15:58 user nova-compute[72362]: DEBUG nova.compute.manager [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Start building block device mappings for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 10:15:58 user nova-compute[72362]: DEBUG nova.compute.manager [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Start spawning the instance on the hypervisor. {{(pid=72362) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 10:15:58 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:15:58 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Creating image(s)
Aug 09 10:15:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Acquiring lock "/opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:15:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lock "/opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:15:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lock "/opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:15:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Acquiring lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:15:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4.part --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:15:59 user nova-compute[72362]: DEBUG nova.policy [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9ffd407a36c74b8ea1bc88b98366876e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5438525a82b4ab08734e363ab1f80ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72362) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 10:15:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4.part --force-share --output=json" returned: 0 in 0.139s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:15:59 user nova-compute[72362]: DEBUG nova.virt.images [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] a08d1a11-49eb-4212-a351-e11ee9553b95 was qcow2, converting to raw {{(pid=72362) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 10:15:59 user nova-compute[72362]: DEBUG nova.privsep.utils [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72362) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 10:15:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4.part /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4.converted {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:15:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4.part /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4.converted" returned: 0 in 0.239s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:15:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4.converted --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:15:59 user nova-compute[72362]: DEBUG nova.network.neutron [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Successfully created port: e2fc4479-6950-479a-bf81-12149601afab {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:15:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4.converted --force-share --output=json" returned: 0 in 0.182s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:15:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.737s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:15:59 user nova-compute[72362]: INFO oslo.privsep.daemon [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpqeswdhbp/privsep.sock']
Aug 09 10:15:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 1.174s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:15:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:15:59 user sudo[81938]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpqeswdhbp/privsep.sock
Aug 09 10:15:59 user sudo[81938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 09 10:16:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Acquiring lock "ca002e73-ddf7-4452-82b6-0d831d984756" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Lock "ca002e73-ddf7-4452-82b6-0d831d984756" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:00 user nova-compute[72362]: DEBUG nova.compute.manager [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Starting instance... {{(pid=72362) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 10:16:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:00 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:16:00 user nova-compute[72362]: INFO nova.compute.claims [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Claim successful on node user
Aug 09 10:16:00 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:16:00 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:16:01 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.652s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:01 user nova-compute[72362]: DEBUG nova.compute.manager [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Start building networks asynchronously for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 10:16:01 user nova-compute[72362]: DEBUG nova.compute.manager [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Allocating IP information in the background. {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 10:16:01 user nova-compute[72362]: DEBUG nova.network.neutron [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] allocate_for_instance() {{(pid=72362) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 10:16:01 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 10:16:01 user nova-compute[72362]: DEBUG nova.compute.manager [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Start building block device mappings for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 10:16:01 user nova-compute[72362]: DEBUG nova.compute.manager [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Start spawning the instance on the hypervisor. {{(pid=72362) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 10:16:01 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:16:01 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Creating image(s)
Aug 09 10:16:01 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Acquiring lock "/opt/stack/data/nova/instances/ca002e73-ddf7-4452-82b6-0d831d984756/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:01 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Lock "/opt/stack/data/nova/instances/ca002e73-ddf7-4452-82b6-0d831d984756/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:01 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Lock "/opt/stack/data/nova/instances/ca002e73-ddf7-4452-82b6-0d831d984756/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:01 user sudo[81938]: pam_unix(sudo:session): session closed for user root
Aug 09 10:16:01 user nova-compute[72362]: INFO oslo.privsep.daemon [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Spawned new privsep daemon via rootwrap
Aug 09 10:16:01 user nova-compute[72362]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 09 10:16:01 user nova-compute[72362]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 09 10:16:01 user nova-compute[72362]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 09 10:16:01 user nova-compute[72362]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81945
Aug 09 10:16:01 user nova-compute[72362]: WARNING oslo_privsep.priv_context [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] privsep daemon already running
Aug 09 10:16:01 user nova-compute[72362]: WARNING oslo_privsep.priv_context [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] privsep daemon already running
Aug 09 10:16:01 user nova-compute[72362]: DEBUG nova.policy [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8a4feca60bf046c6bfdd136c25ecbee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd000751b939e4805abb861b91d698b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72362) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 10:16:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.161s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:01 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Acquiring lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:01 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:01 user nova-compute[72362]: DEBUG nova.network.neutron [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Successfully created port: ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:16:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.142s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:01 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Acquiring lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.176s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:01 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Acquiring lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.147s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/1e2e53b4-3a00-4725-840d-215f6609c951/disk 1073741824 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/1e2e53b4-3a00-4725-840d-215f6609c951/disk 1073741824" returned: 0 in 0.044s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:01 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:01 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.183s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.132s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/ca002e73-ddf7-4452-82b6-0d831d984756/disk 1073741824 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.195s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:02 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1e2e53b4-3a00-4725-840d-215f6609c951/disk. size=1073741824 {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 10:16:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e2e53b4-3a00-4725-840d-215f6609c951/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/ca002e73-ddf7-4452-82b6-0d831d984756/disk 1073741824" returned: 0 in 0.058s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.404s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e2e53b4-3a00-4725-840d-215f6609c951/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:02 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Cannot resize image /opt/stack/data/nova/instances/1e2e53b4-3a00-4725-840d-215f6609c951/disk to a smaller size. {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 10:16:02 user nova-compute[72362]: DEBUG nova.objects.instance [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Lazy-loading 'migration_context' on Instance uuid 1e2e53b4-3a00-4725-840d-215f6609c951 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:16:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.128s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:02 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ca002e73-ddf7-4452-82b6-0d831d984756/disk. size=1073741824 {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 10:16:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca002e73-ddf7-4452-82b6-0d831d984756/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:02 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Created local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 10:16:02 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Ensure instance console log exists: /opt/stack/data/nova/instances/1e2e53b4-3a00-4725-840d-215f6609c951/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:16:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.152s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/disk 1073741824 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/disk 1073741824" returned: 0 in 0.048s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca002e73-ddf7-4452-82b6-0d831d984756/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:02 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Cannot resize image /opt/stack/data/nova/instances/ca002e73-ddf7-4452-82b6-0d831d984756/disk to a smaller size. {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 10:16:02 user nova-compute[72362]: DEBUG nova.objects.instance [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Lazy-loading 'migration_context' on Instance uuid ca002e73-ddf7-4452-82b6-0d831d984756 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:16:02 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Created local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 10:16:02 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Ensure instance console log exists: /opt/stack/data/nova/instances/ca002e73-ddf7-4452-82b6-0d831d984756/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:16:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.146s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:02 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/disk. size=1073741824 {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 10:16:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:02 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Cannot resize image /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/disk to a smaller size. {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 10:16:02 user nova-compute[72362]: DEBUG nova.objects.instance [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lazy-loading 'migration_context' on Instance uuid 0e8a7668-1635-4cbc-8c09-ece19ff67d4f {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:16:02 user nova-compute[72362]: DEBUG nova.network.neutron [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Successfully updated port: e2fc4479-6950-479a-bf81-12149601afab {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:16:02 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Created local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 10:16:02 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Ensure instance console log exists: /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:16:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Acquiring lock "refresh_cache-1e2e53b4-3a00-4725-840d-215f6609c951" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:16:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Acquired lock "refresh_cache-1e2e53b4-3a00-4725-840d-215f6609c951" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:16:02 user nova-compute[72362]: DEBUG nova.network.neutron [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:16:03 user nova-compute[72362]: DEBUG nova.network.neutron [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:16:03 user nova-compute[72362]: DEBUG nova.compute.manager [req-a940ac0e-aa45-4f37-9321-a803a9230970 req-a7c87f09-d502-447e-8013-0b050a77bb69 service nova] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Received event network-changed-e2fc4479-6950-479a-bf81-12149601afab {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:16:03 user nova-compute[72362]: DEBUG nova.compute.manager [req-a940ac0e-aa45-4f37-9321-a803a9230970 req-a7c87f09-d502-447e-8013-0b050a77bb69 service nova] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Refreshing instance network info cache due to event network-changed-e2fc4479-6950-479a-bf81-12149601afab. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:16:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-a940ac0e-aa45-4f37-9321-a803a9230970 req-a7c87f09-d502-447e-8013-0b050a77bb69 service nova] Acquiring lock "refresh_cache-1e2e53b4-3a00-4725-840d-215f6609c951" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:16:03 user nova-compute[72362]: DEBUG nova.network.neutron [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Successfully created port: 7ce03c91-ff2d-4735-bc98-088dc96293d0 {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:16:03 user nova-compute[72362]: DEBUG nova.network.neutron [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Updating instance_info_cache with network_info: [{"id": "e2fc4479-6950-479a-bf81-12149601afab", "address": "fa:16:3e:38:97:38", "network": {"id": "44e70325-9b00-4919-a808-7e32d3c9c7b8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2093963967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dcec0d088b642ef9262d53297d51240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2fc4479-69", "ovs_interfaceid": "e2fc4479-6950-479a-bf81-12149601afab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:16:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Releasing lock "refresh_cache-1e2e53b4-3a00-4725-840d-215f6609c951" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:16:03 user nova-compute[72362]: DEBUG nova.compute.manager [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Instance network_info: |[{"id": "e2fc4479-6950-479a-bf81-12149601afab", "address": "fa:16:3e:38:97:38", "network": {"id": "44e70325-9b00-4919-a808-7e32d3c9c7b8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2093963967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dcec0d088b642ef9262d53297d51240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2fc4479-69", "ovs_interfaceid": "e2fc4479-6950-479a-bf81-12149601afab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 10:16:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-a940ac0e-aa45-4f37-9321-a803a9230970 req-a7c87f09-d502-447e-8013-0b050a77bb69 service nova] Acquired lock "refresh_cache-1e2e53b4-3a00-4725-840d-215f6609c951" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:16:03 user nova-compute[72362]: DEBUG nova.network.neutron [req-a940ac0e-aa45-4f37-9321-a803a9230970 req-a7c87f09-d502-447e-8013-0b050a77bb69 service nova] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Refreshing network info cache for port e2fc4479-6950-479a-bf81-12149601afab {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:16:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Start _get_guest_xml network_info=[{"id": "e2fc4479-6950-479a-bf81-12149601afab", "address": "fa:16:3e:38:97:38", "network": {"id": "44e70325-9b00-4919-a808-7e32d3c9c7b8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2093963967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dcec0d088b642ef9262d53297d51240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2fc4479-69", "ovs_interfaceid": "e2fc4479-6950-479a-bf81-12149601afab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': 'a08d1a11-49eb-4212-a351-e11ee9553b95'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:16:04 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:16:04 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:16:04 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:16:04 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:16:04 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:16:04 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:16:04 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:16:04 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:16:04 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:16:04 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:16:04 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:16:04 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:16:04 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:16:04 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:16:04 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:16:04 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:16:04 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:16:04 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:16:04 user nova-compute[72362]: DEBUG nova.privsep.utils [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72362) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 10:16:04 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:15:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1049991305',display_name='tempest-DeleteServersTestJSON-server-1049991305',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1049991305',id=1,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3dcec0d088b642ef9262d53297d51240',ramdisk_id='',reservation_id='r-t0ti0hgj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1734726466',owner_user_name='tempest-DeleteServersTestJSON-1734726466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:15:58Z,user_data=None,user_id='e4e5357e1c9c4f64879b505362ebd8c2',uuid=1e2e53b4-3a00-4725-840d-215f6609c951,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2fc4479-6950-479a-bf81-12149601afab", "address": "fa:16:3e:38:97:38", "network": {"id": "44e70325-9b00-4919-a808-7e32d3c9c7b8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2093963967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dcec0d088b642ef9262d53297d51240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2fc4479-69", "ovs_interfaceid": "e2fc4479-6950-479a-bf81-12149601afab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:16:04 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Converting VIF {"id": "e2fc4479-6950-479a-bf81-12149601afab", "address": "fa:16:3e:38:97:38", "network": {"id": "44e70325-9b00-4919-a808-7e32d3c9c7b8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2093963967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dcec0d088b642ef9262d53297d51240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2fc4479-69", "ovs_interfaceid": "e2fc4479-6950-479a-bf81-12149601afab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:16:04 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:97:38,bridge_name='br-int',has_traffic_filtering=True,id=e2fc4479-6950-479a-bf81-12149601afab,network=Network(44e70325-9b00-4919-a808-7e32d3c9c7b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2fc4479-69') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:16:04 user nova-compute[72362]: DEBUG nova.objects.instance [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e2e53b4-3a00-4725-840d-215f6609c951 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:16:04 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:16:04 user nova-compute[72362]:   <uuid>1e2e53b4-3a00-4725-840d-215f6609c951</uuid>
Aug 09 10:16:04 user nova-compute[72362]:   <name>instance-00000001</name>
Aug 09 10:16:04 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:16:04 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:16:04 user nova-compute[72362]:   <metadata>
Aug 09 10:16:04 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:16:04 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:16:04 user nova-compute[72362]:       <nova:name>tempest-DeleteServersTestJSON-server-1049991305</nova:name>
Aug 09 10:16:04 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:16:04</nova:creationTime>
Aug 09 10:16:04 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:16:04 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:16:04 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:16:04 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:16:04 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:16:04 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:16:04 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:16:04 user nova-compute[72362]:       <nova:owner>
Aug 09 10:16:04 user nova-compute[72362]:         <nova:user uuid="e4e5357e1c9c4f64879b505362ebd8c2">tempest-DeleteServersTestJSON-1734726466-project-member</nova:user>
Aug 09 10:16:04 user nova-compute[72362]:         <nova:project uuid="3dcec0d088b642ef9262d53297d51240">tempest-DeleteServersTestJSON-1734726466</nova:project>
Aug 09 10:16:04 user nova-compute[72362]:       </nova:owner>
Aug 09 10:16:04 user nova-compute[72362]:       <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:16:04 user nova-compute[72362]:       <nova:ports>
Aug 09 10:16:04 user nova-compute[72362]:         <nova:port uuid="e2fc4479-6950-479a-bf81-12149601afab">
Aug 09 10:16:04 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 10:16:04 user nova-compute[72362]:         </nova:port>
Aug 09 10:16:04 user nova-compute[72362]:       </nova:ports>
Aug 09 10:16:04 user nova-compute[72362]:     </nova:instance>
Aug 09 10:16:04 user nova-compute[72362]:   </metadata>
Aug 09 10:16:04 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:16:04 user nova-compute[72362]:     <system>
Aug 09 10:16:04 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:16:04 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:16:04 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:16:04 user nova-compute[72362]:       <entry name="serial">1e2e53b4-3a00-4725-840d-215f6609c951</entry>
Aug 09 10:16:04 user nova-compute[72362]:       <entry name="uuid">1e2e53b4-3a00-4725-840d-215f6609c951</entry>
Aug 09 10:16:04 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:16:04 user nova-compute[72362]:     </system>
Aug 09 10:16:04 user nova-compute[72362]:   </sysinfo>
Aug 09 10:16:04 user nova-compute[72362]:   <os>
Aug 09 10:16:04 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:16:04 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:16:04 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:16:04 user nova-compute[72362]:   </os>
Aug 09 10:16:04 user nova-compute[72362]:   <features>
Aug 09 10:16:04 user nova-compute[72362]:     <acpi/>
Aug 09 10:16:04 user nova-compute[72362]:     <apic/>
Aug 09 10:16:04 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:16:04 user nova-compute[72362]:   </features>
Aug 09 10:16:04 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:16:04 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:16:04 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:16:04 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:16:04 user nova-compute[72362]:   </clock>
Aug 09 10:16:04 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:16:04 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:16:04 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:16:04 user nova-compute[72362]:   </cpu>
Aug 09 10:16:04 user nova-compute[72362]:   <devices>
Aug 09 10:16:04 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:16:04 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:16:04 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/1e2e53b4-3a00-4725-840d-215f6609c951/disk"/>
Aug 09 10:16:04 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:16:04 user nova-compute[72362]:     </disk>
Aug 09 10:16:04 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:16:04 user nova-compute[72362]:       <mac address="fa:16:3e:38:97:38"/>
Aug 09 10:16:04 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:16:04 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:16:04 user nova-compute[72362]:       <target dev="tape2fc4479-69"/>
Aug 09 10:16:04 user nova-compute[72362]:     </interface>
Aug 09 10:16:04 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:16:04 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/1e2e53b4-3a00-4725-840d-215f6609c951/console.log" append="off"/>
Aug 09 10:16:04 user nova-compute[72362]:     </serial>
Aug 09 10:16:04 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:16:04 user nova-compute[72362]:     <video>
Aug 09 10:16:04 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:16:04 user nova-compute[72362]:     </video>
Aug 09 10:16:04 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:16:04 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:16:04 user nova-compute[72362]:     </rng>
Aug 09 10:16:04 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:16:04 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:16:04 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:16:04 user nova-compute[72362]:     </memballoon>
Aug 09 10:16:04 user nova-compute[72362]:   </devices>
Aug 09 10:16:04 user nova-compute[72362]: </domain>
Aug 09 10:16:04 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:16:04 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:15:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1049991305',display_name='tempest-DeleteServersTestJSON-server-1049991305',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1049991305',id=1,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3dcec0d088b642ef9262d53297d51240',ramdisk_id='',reservation_id='r-t0ti0hgj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1734726466',owner_user_name='tempest-DeleteServersTestJSON-1734726466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:15:58Z,user_data=None,user_id='e4e5357e1c9c4f64879b505362ebd8c2',uuid=1e2e53b4-3a00-4725-840d-215f6609c951,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2fc4479-6950-479a-bf81-12149601afab", "address": "fa:16:3e:38:97:38", "network": {"id": "44e70325-9b00-4919-a808-7e32d3c9c7b8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2093963967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dcec0d088b642ef9262d53297d51240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2fc4479-69", "ovs_interfaceid": "e2fc4479-6950-479a-bf81-12149601afab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:16:04 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Converting VIF {"id": "e2fc4479-6950-479a-bf81-12149601afab", "address": "fa:16:3e:38:97:38", "network": {"id": "44e70325-9b00-4919-a808-7e32d3c9c7b8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2093963967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dcec0d088b642ef9262d53297d51240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2fc4479-69", "ovs_interfaceid": "e2fc4479-6950-479a-bf81-12149601afab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:16:04 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:97:38,bridge_name='br-int',has_traffic_filtering=True,id=e2fc4479-6950-479a-bf81-12149601afab,network=Network(44e70325-9b00-4919-a808-7e32d3c9c7b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2fc4479-69') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:16:04 user nova-compute[72362]: DEBUG os_vif [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:97:38,bridge_name='br-int',has_traffic_filtering=True,id=e2fc4479-6950-479a-bf81-12149601afab,network=Network(44e70325-9b00-4919-a808-7e32d3c9c7b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2fc4479-69') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:16:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Created schema index Interface.name {{(pid=72362) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 09 10:16:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Created schema index Port.name {{(pid=72362) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 09 10:16:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Created schema index Bridge.name {{(pid=72362) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 09 10:16:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 10:16:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] [POLLOUT] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 10:16:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:16:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:16:04 user nova-compute[72362]: INFO oslo.privsep.daemon [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpv8oeyld4/privsep.sock']
Aug 09 10:16:04 user sudo[81998]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpv8oeyld4/privsep.sock
Aug 09 10:16:04 user sudo[81998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 09 10:16:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:05 user nova-compute[72362]: DEBUG nova.network.neutron [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Successfully updated port: ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:16:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Acquiring lock "refresh_cache-0e8a7668-1635-4cbc-8c09-ece19ff67d4f" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:16:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Acquired lock "refresh_cache-0e8a7668-1635-4cbc-8c09-ece19ff67d4f" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:16:05 user nova-compute[72362]: DEBUG nova.network.neutron [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:16:05 user nova-compute[72362]: DEBUG nova.network.neutron [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:16:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:05 user nova-compute[72362]: DEBUG nova.compute.manager [req-30f07cb8-e253-4325-aaab-bb189e23a635 req-06bd680b-dc29-4e8a-b6d5-09e29e56555d service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Received event network-changed-ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:16:05 user nova-compute[72362]: DEBUG nova.compute.manager [req-30f07cb8-e253-4325-aaab-bb189e23a635 req-06bd680b-dc29-4e8a-b6d5-09e29e56555d service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Refreshing instance network info cache due to event network-changed-ec7889ae-0cbc-41e3-a750-a5cb2b522ce9. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:16:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-30f07cb8-e253-4325-aaab-bb189e23a635 req-06bd680b-dc29-4e8a-b6d5-09e29e56555d service nova] Acquiring lock "refresh_cache-0e8a7668-1635-4cbc-8c09-ece19ff67d4f" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:16:05 user nova-compute[72362]: DEBUG nova.network.neutron [req-a940ac0e-aa45-4f37-9321-a803a9230970 req-a7c87f09-d502-447e-8013-0b050a77bb69 service nova] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Updated VIF entry in instance network info cache for port e2fc4479-6950-479a-bf81-12149601afab. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:16:05 user nova-compute[72362]: DEBUG nova.network.neutron [req-a940ac0e-aa45-4f37-9321-a803a9230970 req-a7c87f09-d502-447e-8013-0b050a77bb69 service nova] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Updating instance_info_cache with network_info: [{"id": "e2fc4479-6950-479a-bf81-12149601afab", "address": "fa:16:3e:38:97:38", "network": {"id": "44e70325-9b00-4919-a808-7e32d3c9c7b8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2093963967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dcec0d088b642ef9262d53297d51240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2fc4479-69", "ovs_interfaceid": "e2fc4479-6950-479a-bf81-12149601afab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:16:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-a940ac0e-aa45-4f37-9321-a803a9230970 req-a7c87f09-d502-447e-8013-0b050a77bb69 service nova] Releasing lock "refresh_cache-1e2e53b4-3a00-4725-840d-215f6609c951" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:16:06 user sudo[81998]: pam_unix(sudo:session): session closed for user root
Aug 09 10:16:06 user nova-compute[72362]: INFO oslo.privsep.daemon [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Spawned new privsep daemon via rootwrap
Aug 09 10:16:06 user nova-compute[72362]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 09 10:16:06 user nova-compute[72362]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 09 10:16:06 user nova-compute[72362]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 09 10:16:06 user nova-compute[72362]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82001
Aug 09 10:16:06 user nova-compute[72362]: DEBUG nova.network.neutron [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Updating instance_info_cache with network_info: [{"id": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "address": "fa:16:3e:16:b7:79", "network": {"id": "446f0622-648e-499f-bbb1-e4c0d89ab4df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-409995858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5438525a82b4ab08734e363ab1f80ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec7889ae-0c", "ovs_interfaceid": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:16:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Releasing lock "refresh_cache-0e8a7668-1635-4cbc-8c09-ece19ff67d4f" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:16:06 user nova-compute[72362]: DEBUG nova.compute.manager [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Instance network_info: |[{"id": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "address": "fa:16:3e:16:b7:79", "network": {"id": "446f0622-648e-499f-bbb1-e4c0d89ab4df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-409995858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5438525a82b4ab08734e363ab1f80ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec7889ae-0c", "ovs_interfaceid": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 10:16:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-30f07cb8-e253-4325-aaab-bb189e23a635 req-06bd680b-dc29-4e8a-b6d5-09e29e56555d service nova] Acquired lock "refresh_cache-0e8a7668-1635-4cbc-8c09-ece19ff67d4f" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:16:06 user nova-compute[72362]: DEBUG nova.network.neutron [req-30f07cb8-e253-4325-aaab-bb189e23a635 req-06bd680b-dc29-4e8a-b6d5-09e29e56555d service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Refreshing network info cache for port ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:16:06 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Start _get_guest_xml network_info=[{"id": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "address": "fa:16:3e:16:b7:79", "network": {"id": "446f0622-648e-499f-bbb1-e4c0d89ab4df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-409995858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5438525a82b4ab08734e363ab1f80ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec7889ae-0c", "ovs_interfaceid": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': 'a08d1a11-49eb-4212-a351-e11ee9553b95'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:16:06 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:16:06 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:16:06 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:16:06 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:16:06 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:16:06 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:16:06 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:16:06 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:16:06 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:16:06 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:16:06 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:16:06 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:16:06 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:16:06 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:16:06 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:16:06 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:16:06 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:16:06 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:16:06 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:15:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-419570951',display_name='tempest-ServerActionsTestOtherB-server-419570951',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-419570951',id=2,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAlSzovB4mzuHqVxORdW0QCnCxzvtrYywTRh5RUAkSVJoqhjnBo5zwvIiDyhRaMXzyUvfprKRDpBxT96lz++BVUa0Y8Z7q5AuzttS0DGZzN7x8fIo5ox8C7rVw5EduEeQ==',key_name='tempest-keypair-2060096321',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5438525a82b4ab08734e363ab1f80ec',ramdisk_id='',reservation_id='r-gepn5vk7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-767949360',owner_user_name='tempest-ServerActionsTestOtherB-767949360-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:15:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ffd407a36c74b8ea1bc88b98366876e',uuid=0e8a7668-1635-4cbc-8c09-ece19ff67d4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "address": "fa:16:3e:16:b7:79", "network": {"id": "446f0622-648e-499f-bbb1-e4c0d89ab4df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-409995858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5438525a82b4ab08734e363ab1f80ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec7889ae-0c", "ovs_interfaceid": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:16:06 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Converting VIF {"id": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "address": "fa:16:3e:16:b7:79", "network": {"id": "446f0622-648e-499f-bbb1-e4c0d89ab4df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-409995858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5438525a82b4ab08734e363ab1f80ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec7889ae-0c", "ovs_interfaceid": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:16:06 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:b7:79,bridge_name='br-int',has_traffic_filtering=True,id=ec7889ae-0cbc-41e3-a750-a5cb2b522ce9,network=Network(446f0622-648e-499f-bbb1-e4c0d89ab4df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec7889ae-0c') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:16:06 user nova-compute[72362]: DEBUG nova.objects.instance [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lazy-loading 'pci_devices' on Instance uuid 0e8a7668-1635-4cbc-8c09-ece19ff67d4f {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:16:06 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:16:06 user nova-compute[72362]:   <uuid>0e8a7668-1635-4cbc-8c09-ece19ff67d4f</uuid>
Aug 09 10:16:06 user nova-compute[72362]:   <name>instance-00000002</name>
Aug 09 10:16:06 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:16:06 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:16:06 user nova-compute[72362]:   <metadata>
Aug 09 10:16:06 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:16:06 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:16:06 user nova-compute[72362]:       <nova:name>tempest-ServerActionsTestOtherB-server-419570951</nova:name>
Aug 09 10:16:06 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:16:06</nova:creationTime>
Aug 09 10:16:06 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:16:06 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:16:06 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:16:06 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:16:06 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:16:06 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:16:06 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:16:06 user nova-compute[72362]:       <nova:owner>
Aug 09 10:16:06 user nova-compute[72362]:         <nova:user uuid="9ffd407a36c74b8ea1bc88b98366876e">tempest-ServerActionsTestOtherB-767949360-project-member</nova:user>
Aug 09 10:16:06 user nova-compute[72362]:         <nova:project uuid="b5438525a82b4ab08734e363ab1f80ec">tempest-ServerActionsTestOtherB-767949360</nova:project>
Aug 09 10:16:06 user nova-compute[72362]:       </nova:owner>
Aug 09 10:16:06 user nova-compute[72362]:       <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:16:06 user nova-compute[72362]:       <nova:ports>
Aug 09 10:16:06 user nova-compute[72362]:         <nova:port uuid="ec7889ae-0cbc-41e3-a750-a5cb2b522ce9">
Aug 09 10:16:06 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 09 10:16:06 user nova-compute[72362]:         </nova:port>
Aug 09 10:16:06 user nova-compute[72362]:       </nova:ports>
Aug 09 10:16:06 user nova-compute[72362]:     </nova:instance>
Aug 09 10:16:06 user nova-compute[72362]:   </metadata>
Aug 09 10:16:06 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:16:06 user nova-compute[72362]:     <system>
Aug 09 10:16:06 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:16:06 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:16:06 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:16:06 user nova-compute[72362]:       <entry name="serial">0e8a7668-1635-4cbc-8c09-ece19ff67d4f</entry>
Aug 09 10:16:06 user nova-compute[72362]:       <entry name="uuid">0e8a7668-1635-4cbc-8c09-ece19ff67d4f</entry>
Aug 09 10:16:06 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:16:06 user nova-compute[72362]:     </system>
Aug 09 10:16:06 user nova-compute[72362]:   </sysinfo>
Aug 09 10:16:06 user nova-compute[72362]:   <os>
Aug 09 10:16:06 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:16:06 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:16:06 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:16:06 user nova-compute[72362]:   </os>
Aug 09 10:16:06 user nova-compute[72362]:   <features>
Aug 09 10:16:06 user nova-compute[72362]:     <acpi/>
Aug 09 10:16:06 user nova-compute[72362]:     <apic/>
Aug 09 10:16:06 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:16:06 user nova-compute[72362]:   </features>
Aug 09 10:16:06 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:16:06 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:16:06 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:16:06 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:16:06 user nova-compute[72362]:   </clock>
Aug 09 10:16:06 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:16:06 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:16:06 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:16:06 user nova-compute[72362]:   </cpu>
Aug 09 10:16:06 user nova-compute[72362]:   <devices>
Aug 09 10:16:06 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:16:06 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:16:06 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/disk"/>
Aug 09 10:16:06 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:16:06 user nova-compute[72362]:     </disk>
Aug 09 10:16:06 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:16:06 user nova-compute[72362]:       <mac address="fa:16:3e:16:b7:79"/>
Aug 09 10:16:06 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:16:06 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:16:06 user nova-compute[72362]:       <target dev="tapec7889ae-0c"/>
Aug 09 10:16:06 user nova-compute[72362]:     </interface>
Aug 09 10:16:06 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:16:06 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/console.log" append="off"/>
Aug 09 10:16:06 user nova-compute[72362]:     </serial>
Aug 09 10:16:06 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:16:06 user nova-compute[72362]:     <video>
Aug 09 10:16:06 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:16:06 user nova-compute[72362]:     </video>
Aug 09 10:16:06 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:16:06 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:16:06 user nova-compute[72362]:     </rng>
Aug 09 10:16:06 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:16:06 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:16:06 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:16:06 user nova-compute[72362]:     </memballoon>
Aug 09 10:16:06 user nova-compute[72362]:   </devices>
Aug 09 10:16:06 user nova-compute[72362]: </domain>
Aug 09 10:16:06 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:16:06 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:15:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-419570951',display_name='tempest-ServerActionsTestOtherB-server-419570951',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-419570951',id=2,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAlSzovB4mzuHqVxORdW0QCnCxzvtrYywTRh5RUAkSVJoqhjnBo5zwvIiDyhRaMXzyUvfprKRDpBxT96lz++BVUa0Y8Z7q5AuzttS0DGZzN7x8fIo5ox8C7rVw5EduEeQ==',key_name='tempest-keypair-2060096321',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5438525a82b4ab08734e363ab1f80ec',ramdisk_id='',reservation_id='r-gepn5vk7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-767949360',owner_user_name='tempest-ServerActionsTestOtherB-767949360-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:15:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ffd407a36c74b8ea1bc88b98366876e',uuid=0e8a7668-1635-4cbc-8c09-ece19ff67d4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "address": "fa:16:3e:16:b7:79", "network": {"id": "446f0622-648e-499f-bbb1-e4c0d89ab4df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-409995858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5438525a82b4ab08734e363ab1f80ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec7889ae-0c", "ovs_interfaceid": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:16:06 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Converting VIF {"id": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "address": "fa:16:3e:16:b7:79", "network": {"id": "446f0622-648e-499f-bbb1-e4c0d89ab4df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-409995858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5438525a82b4ab08734e363ab1f80ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec7889ae-0c", "ovs_interfaceid": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:16:06 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:b7:79,bridge_name='br-int',has_traffic_filtering=True,id=ec7889ae-0cbc-41e3-a750-a5cb2b522ce9,network=Network(446f0622-648e-499f-bbb1-e4c0d89ab4df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec7889ae-0c') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:16:06 user nova-compute[72362]: DEBUG os_vif [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:b7:79,bridge_name='br-int',has_traffic_filtering=True,id=ec7889ae-0cbc-41e3-a750-a5cb2b522ce9,network=Network(446f0622-648e-499f-bbb1-e4c0d89ab4df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec7889ae-0c') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:16:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:16:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:16:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape2fc4479-69, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:16:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape2fc4479-69, col_values=(('external_ids', {'iface-id': 'e2fc4479-6950-479a-bf81-12149601afab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:97:38', 'vm-uuid': '1e2e53b4-3a00-4725-840d-215f6609c951'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:16:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:16:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:06 user nova-compute[72362]: INFO os_vif [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:97:38,bridge_name='br-int',has_traffic_filtering=True,id=e2fc4479-6950-479a-bf81-12149601afab,network=Network(44e70325-9b00-4919-a808-7e32d3c9c7b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2fc4479-69')
Aug 09 10:16:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec7889ae-0c, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:16:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapec7889ae-0c, col_values=(('external_ids', {'iface-id': 'ec7889ae-0cbc-41e3-a750-a5cb2b522ce9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:b7:79', 'vm-uuid': '0e8a7668-1635-4cbc-8c09-ece19ff67d4f'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:16:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:16:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:06 user nova-compute[72362]: INFO os_vif [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:b7:79,bridge_name='br-int',has_traffic_filtering=True,id=ec7889ae-0cbc-41e3-a750-a5cb2b522ce9,network=Network(446f0622-648e-499f-bbb1-e4c0d89ab4df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec7889ae-0c')
Aug 09 10:16:06 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:16:06 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] No VIF found with MAC fa:16:3e:38:97:38, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:16:07 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:16:07 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] No VIF found with MAC fa:16:3e:16:b7:79, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:16:07 user nova-compute[72362]: DEBUG nova.network.neutron [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Successfully updated port: 7ce03c91-ff2d-4735-bc98-088dc96293d0 {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:16:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Acquiring lock "refresh_cache-ca002e73-ddf7-4452-82b6-0d831d984756" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:16:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Acquired lock "refresh_cache-ca002e73-ddf7-4452-82b6-0d831d984756" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:16:07 user nova-compute[72362]: DEBUG nova.network.neutron [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:16:07 user nova-compute[72362]: DEBUG nova.compute.manager [req-fa2f5ec4-fcfb-4194-810b-d1c456d80819 req-df0fef37-f7d1-484e-b32b-02489374637a service nova] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Received event network-changed-7ce03c91-ff2d-4735-bc98-088dc96293d0 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:16:07 user nova-compute[72362]: DEBUG nova.compute.manager [req-fa2f5ec4-fcfb-4194-810b-d1c456d80819 req-df0fef37-f7d1-484e-b32b-02489374637a service nova] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Refreshing instance network info cache due to event network-changed-7ce03c91-ff2d-4735-bc98-088dc96293d0. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:16:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-fa2f5ec4-fcfb-4194-810b-d1c456d80819 req-df0fef37-f7d1-484e-b32b-02489374637a service nova] Acquiring lock "refresh_cache-ca002e73-ddf7-4452-82b6-0d831d984756" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:16:07 user nova-compute[72362]: DEBUG nova.network.neutron [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:16:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:08 user nova-compute[72362]: DEBUG nova.network.neutron [req-30f07cb8-e253-4325-aaab-bb189e23a635 req-06bd680b-dc29-4e8a-b6d5-09e29e56555d service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Updated VIF entry in instance network info cache for port ec7889ae-0cbc-41e3-a750-a5cb2b522ce9. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:16:08 user nova-compute[72362]: DEBUG nova.network.neutron [req-30f07cb8-e253-4325-aaab-bb189e23a635 req-06bd680b-dc29-4e8a-b6d5-09e29e56555d service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Updating instance_info_cache with network_info: [{"id": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "address": "fa:16:3e:16:b7:79", "network": {"id": "446f0622-648e-499f-bbb1-e4c0d89ab4df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-409995858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5438525a82b4ab08734e363ab1f80ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec7889ae-0c", "ovs_interfaceid": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:16:08 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-30f07cb8-e253-4325-aaab-bb189e23a635 req-06bd680b-dc29-4e8a-b6d5-09e29e56555d service nova] Releasing lock "refresh_cache-0e8a7668-1635-4cbc-8c09-ece19ff67d4f" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:16:08 user nova-compute[72362]: DEBUG nova.network.neutron [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Updating instance_info_cache with network_info: [{"id": "7ce03c91-ff2d-4735-bc98-088dc96293d0", "address": "fa:16:3e:57:3a:02", "network": {"id": "f6bb574e-dc90-445b-b678-6e7d825a8437", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-198645654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d000751b939e4805abb861b91d698b6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce03c91-ff", "ovs_interfaceid": "7ce03c91-ff2d-4735-bc98-088dc96293d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:16:08 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Releasing lock "refresh_cache-ca002e73-ddf7-4452-82b6-0d831d984756" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:16:08 user nova-compute[72362]: DEBUG nova.compute.manager [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Instance network_info: |[{"id": "7ce03c91-ff2d-4735-bc98-088dc96293d0", "address": "fa:16:3e:57:3a:02", "network": {"id": "f6bb574e-dc90-445b-b678-6e7d825a8437", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-198645654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d000751b939e4805abb861b91d698b6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce03c91-ff", "ovs_interfaceid": "7ce03c91-ff2d-4735-bc98-088dc96293d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 10:16:08 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-fa2f5ec4-fcfb-4194-810b-d1c456d80819 req-df0fef37-f7d1-484e-b32b-02489374637a service nova] Acquired lock "refresh_cache-ca002e73-ddf7-4452-82b6-0d831d984756" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:16:08 user nova-compute[72362]: DEBUG nova.network.neutron [req-fa2f5ec4-fcfb-4194-810b-d1c456d80819 req-df0fef37-f7d1-484e-b32b-02489374637a service nova] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Refreshing network info cache for port 7ce03c91-ff2d-4735-bc98-088dc96293d0 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:16:08 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Start _get_guest_xml network_info=[{"id": "7ce03c91-ff2d-4735-bc98-088dc96293d0", "address": "fa:16:3e:57:3a:02", "network": {"id": "f6bb574e-dc90-445b-b678-6e7d825a8437", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-198645654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d000751b939e4805abb861b91d698b6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce03c91-ff", "ovs_interfaceid": "7ce03c91-ff2d-4735-bc98-088dc96293d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': 'a08d1a11-49eb-4212-a351-e11ee9553b95'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:16:08 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:16:08 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:16:08 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:16:08 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:16:08 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:16:08 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:16:08 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:16:08 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:16:08 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:16:08 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:16:08 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:16:08 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:16:08 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:16:08 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:16:08 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:16:08 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:16:08 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:16:08 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:16:08 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:15:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-664446229',display_name='tempest-ServersNegativeTestJSON-server-664446229',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-664446229',id=3,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d000751b939e4805abb861b91d698b6c',ramdisk_id='',reservation_id='r-wunisxu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1689094468',owner_user_name='tempest-ServersNegativeTestJSON-1689094468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:16:01Z,user_data=None,user_id='8a4feca60bf046c6bfdd136c25ecbee3',uuid=ca002e73-ddf7-4452-82b6-0d831d984756,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ce03c91-ff2d-4735-bc98-088dc96293d0", "address": "fa:16:3e:57:3a:02", "network": {"id": "f6bb574e-dc90-445b-b678-6e7d825a8437", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-198645654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d000751b939e4805abb861b91d698b6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce03c91-ff", "ovs_interfaceid": "7ce03c91-ff2d-4735-bc98-088dc96293d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:16:08 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Converting VIF {"id": "7ce03c91-ff2d-4735-bc98-088dc96293d0", "address": "fa:16:3e:57:3a:02", "network": {"id": "f6bb574e-dc90-445b-b678-6e7d825a8437", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-198645654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d000751b939e4805abb861b91d698b6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce03c91-ff", "ovs_interfaceid": "7ce03c91-ff2d-4735-bc98-088dc96293d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:16:08 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:3a:02,bridge_name='br-int',has_traffic_filtering=True,id=7ce03c91-ff2d-4735-bc98-088dc96293d0,network=Network(f6bb574e-dc90-445b-b678-6e7d825a8437),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ce03c91-ff') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:16:08 user nova-compute[72362]: DEBUG nova.objects.instance [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Lazy-loading 'pci_devices' on Instance uuid ca002e73-ddf7-4452-82b6-0d831d984756 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:16:09 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:16:09 user nova-compute[72362]:   <uuid>ca002e73-ddf7-4452-82b6-0d831d984756</uuid>
Aug 09 10:16:09 user nova-compute[72362]:   <name>instance-00000003</name>
Aug 09 10:16:09 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:16:09 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:16:09 user nova-compute[72362]:   <metadata>
Aug 09 10:16:09 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:16:09 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:16:09 user nova-compute[72362]:       <nova:name>tempest-ServersNegativeTestJSON-server-664446229</nova:name>
Aug 09 10:16:09 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:16:08</nova:creationTime>
Aug 09 10:16:09 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:16:09 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:16:09 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:16:09 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:16:09 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:16:09 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:16:09 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:16:09 user nova-compute[72362]:       <nova:owner>
Aug 09 10:16:09 user nova-compute[72362]:         <nova:user uuid="8a4feca60bf046c6bfdd136c25ecbee3">tempest-ServersNegativeTestJSON-1689094468-project-member</nova:user>
Aug 09 10:16:09 user nova-compute[72362]:         <nova:project uuid="d000751b939e4805abb861b91d698b6c">tempest-ServersNegativeTestJSON-1689094468</nova:project>
Aug 09 10:16:09 user nova-compute[72362]:       </nova:owner>
Aug 09 10:16:09 user nova-compute[72362]:       <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:16:09 user nova-compute[72362]:       <nova:ports>
Aug 09 10:16:09 user nova-compute[72362]:         <nova:port uuid="7ce03c91-ff2d-4735-bc98-088dc96293d0">
Aug 09 10:16:09 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 10:16:09 user nova-compute[72362]:         </nova:port>
Aug 09 10:16:09 user nova-compute[72362]:       </nova:ports>
Aug 09 10:16:09 user nova-compute[72362]:     </nova:instance>
Aug 09 10:16:09 user nova-compute[72362]:   </metadata>
Aug 09 10:16:09 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:16:09 user nova-compute[72362]:     <system>
Aug 09 10:16:09 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:16:09 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:16:09 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:16:09 user nova-compute[72362]:       <entry name="serial">ca002e73-ddf7-4452-82b6-0d831d984756</entry>
Aug 09 10:16:09 user nova-compute[72362]:       <entry name="uuid">ca002e73-ddf7-4452-82b6-0d831d984756</entry>
Aug 09 10:16:09 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:16:09 user nova-compute[72362]:     </system>
Aug 09 10:16:09 user nova-compute[72362]:   </sysinfo>
Aug 09 10:16:09 user nova-compute[72362]:   <os>
Aug 09 10:16:09 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:16:09 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:16:09 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:16:09 user nova-compute[72362]:   </os>
Aug 09 10:16:09 user nova-compute[72362]:   <features>
Aug 09 10:16:09 user nova-compute[72362]:     <acpi/>
Aug 09 10:16:09 user nova-compute[72362]:     <apic/>
Aug 09 10:16:09 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:16:09 user nova-compute[72362]:   </features>
Aug 09 10:16:09 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:16:09 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:16:09 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:16:09 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:16:09 user nova-compute[72362]:   </clock>
Aug 09 10:16:09 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:16:09 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:16:09 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:16:09 user nova-compute[72362]:   </cpu>
Aug 09 10:16:09 user nova-compute[72362]:   <devices>
Aug 09 10:16:09 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:16:09 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:16:09 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/ca002e73-ddf7-4452-82b6-0d831d984756/disk"/>
Aug 09 10:16:09 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:16:09 user nova-compute[72362]:     </disk>
Aug 09 10:16:09 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:16:09 user nova-compute[72362]:       <mac address="fa:16:3e:57:3a:02"/>
Aug 09 10:16:09 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:16:09 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:16:09 user nova-compute[72362]:       <target dev="tap7ce03c91-ff"/>
Aug 09 10:16:09 user nova-compute[72362]:     </interface>
Aug 09 10:16:09 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:16:09 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/ca002e73-ddf7-4452-82b6-0d831d984756/console.log" append="off"/>
Aug 09 10:16:09 user nova-compute[72362]:     </serial>
Aug 09 10:16:09 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:16:09 user nova-compute[72362]:     <video>
Aug 09 10:16:09 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:16:09 user nova-compute[72362]:     </video>
Aug 09 10:16:09 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:16:09 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:16:09 user nova-compute[72362]:     </rng>
Aug 09 10:16:09 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:16:09 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:16:09 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:16:09 user nova-compute[72362]:     </memballoon>
Aug 09 10:16:09 user nova-compute[72362]:   </devices>
Aug 09 10:16:09 user nova-compute[72362]: </domain>
Aug 09 10:16:09 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:16:09 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:15:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-664446229',display_name='tempest-ServersNegativeTestJSON-server-664446229',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-664446229',id=3,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d000751b939e4805abb861b91d698b6c',ramdisk_id='',reservation_id='r-wunisxu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1689094468',owner_user_name='tempest-ServersNegativeTestJSON-1689094468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:16:01Z,user_data=None,user_id='8a4feca60bf046c6bfdd136c25ecbee3',uuid=ca002e73-ddf7-4452-82b6-0d831d984756,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ce03c91-ff2d-4735-bc98-088dc96293d0", "address": "fa:16:3e:57:3a:02", "network": {"id": "f6bb574e-dc90-445b-b678-6e7d825a8437", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-198645654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d000751b939e4805abb861b91d698b6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce03c91-ff", "ovs_interfaceid": "7ce03c91-ff2d-4735-bc98-088dc96293d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:16:09 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Converting VIF {"id": "7ce03c91-ff2d-4735-bc98-088dc96293d0", "address": "fa:16:3e:57:3a:02", "network": {"id": "f6bb574e-dc90-445b-b678-6e7d825a8437", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-198645654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d000751b939e4805abb861b91d698b6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce03c91-ff", "ovs_interfaceid": "7ce03c91-ff2d-4735-bc98-088dc96293d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:16:09 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:3a:02,bridge_name='br-int',has_traffic_filtering=True,id=7ce03c91-ff2d-4735-bc98-088dc96293d0,network=Network(f6bb574e-dc90-445b-b678-6e7d825a8437),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ce03c91-ff') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:16:09 user nova-compute[72362]: DEBUG os_vif [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:3a:02,bridge_name='br-int',has_traffic_filtering=True,id=7ce03c91-ff2d-4735-bc98-088dc96293d0,network=Network(f6bb574e-dc90-445b-b678-6e7d825a8437),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ce03c91-ff') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:16:09 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:09 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:16:09 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:16:09 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:09 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ce03c91-ff, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:16:09 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7ce03c91-ff, col_values=(('external_ids', {'iface-id': '7ce03c91-ff2d-4735-bc98-088dc96293d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:3a:02', 'vm-uuid': 'ca002e73-ddf7-4452-82b6-0d831d984756'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:16:09 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:09 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:16:09 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:09 user nova-compute[72362]: INFO os_vif [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:3a:02,bridge_name='br-int',has_traffic_filtering=True,id=7ce03c91-ff2d-4735-bc98-088dc96293d0,network=Network(f6bb574e-dc90-445b-b678-6e7d825a8437),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ce03c91-ff')
Aug 09 10:16:09 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:09 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:16:09 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] No VIF found with MAC fa:16:3e:57:3a:02, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:16:09 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:09 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:09 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:09 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:10 user nova-compute[72362]: DEBUG nova.compute.manager [req-b568dc6f-fd08-46ec-8f6d-ccde821731ca req-2d143b3f-f6a0-4bb6-849f-949719e5424d service nova] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Received event network-vif-plugged-e2fc4479-6950-479a-bf81-12149601afab {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:16:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b568dc6f-fd08-46ec-8f6d-ccde821731ca req-2d143b3f-f6a0-4bb6-849f-949719e5424d service nova] Acquiring lock "1e2e53b4-3a00-4725-840d-215f6609c951-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b568dc6f-fd08-46ec-8f6d-ccde821731ca req-2d143b3f-f6a0-4bb6-849f-949719e5424d service nova] Lock "1e2e53b4-3a00-4725-840d-215f6609c951-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b568dc6f-fd08-46ec-8f6d-ccde821731ca req-2d143b3f-f6a0-4bb6-849f-949719e5424d service nova] Lock "1e2e53b4-3a00-4725-840d-215f6609c951-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:10 user nova-compute[72362]: DEBUG nova.compute.manager [req-b568dc6f-fd08-46ec-8f6d-ccde821731ca req-2d143b3f-f6a0-4bb6-849f-949719e5424d service nova] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] No waiting events found dispatching network-vif-plugged-e2fc4479-6950-479a-bf81-12149601afab {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:16:10 user nova-compute[72362]: WARNING nova.compute.manager [req-b568dc6f-fd08-46ec-8f6d-ccde821731ca req-2d143b3f-f6a0-4bb6-849f-949719e5424d service nova] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Received unexpected event network-vif-plugged-e2fc4479-6950-479a-bf81-12149601afab for instance with vm_state building and task_state spawning.
Aug 09 10:16:10 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:10 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:10 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:10 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:10 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:10 user nova-compute[72362]: DEBUG nova.network.neutron [req-fa2f5ec4-fcfb-4194-810b-d1c456d80819 req-df0fef37-f7d1-484e-b32b-02489374637a service nova] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Updated VIF entry in instance network info cache for port 7ce03c91-ff2d-4735-bc98-088dc96293d0. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:16:10 user nova-compute[72362]: DEBUG nova.network.neutron [req-fa2f5ec4-fcfb-4194-810b-d1c456d80819 req-df0fef37-f7d1-484e-b32b-02489374637a service nova] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Updating instance_info_cache with network_info: [{"id": "7ce03c91-ff2d-4735-bc98-088dc96293d0", "address": "fa:16:3e:57:3a:02", "network": {"id": "f6bb574e-dc90-445b-b678-6e7d825a8437", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-198645654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d000751b939e4805abb861b91d698b6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce03c91-ff", "ovs_interfaceid": "7ce03c91-ff2d-4735-bc98-088dc96293d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:16:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-fa2f5ec4-fcfb-4194-810b-d1c456d80819 req-df0fef37-f7d1-484e-b32b-02489374637a service nova] Releasing lock "refresh_cache-ca002e73-ddf7-4452-82b6-0d831d984756" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:16:11 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:11 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:11 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:11 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:11 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:11 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:11 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:12 user nova-compute[72362]: DEBUG nova.compute.manager [req-5e3267d3-c377-4272-9348-726f1979e90b req-64260a29-bd8b-44e9-a1ee-04378bc43653 service nova] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Received event network-vif-plugged-e2fc4479-6950-479a-bf81-12149601afab {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:16:12 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-5e3267d3-c377-4272-9348-726f1979e90b req-64260a29-bd8b-44e9-a1ee-04378bc43653 service nova] Acquiring lock "1e2e53b4-3a00-4725-840d-215f6609c951-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:12 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-5e3267d3-c377-4272-9348-726f1979e90b req-64260a29-bd8b-44e9-a1ee-04378bc43653 service nova] Lock "1e2e53b4-3a00-4725-840d-215f6609c951-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:12 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-5e3267d3-c377-4272-9348-726f1979e90b req-64260a29-bd8b-44e9-a1ee-04378bc43653 service nova] Lock "1e2e53b4-3a00-4725-840d-215f6609c951-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:12 user nova-compute[72362]: DEBUG nova.compute.manager [req-5e3267d3-c377-4272-9348-726f1979e90b req-64260a29-bd8b-44e9-a1ee-04378bc43653 service nova] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] No waiting events found dispatching network-vif-plugged-e2fc4479-6950-479a-bf81-12149601afab {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:16:12 user nova-compute[72362]: WARNING nova.compute.manager [req-5e3267d3-c377-4272-9348-726f1979e90b req-64260a29-bd8b-44e9-a1ee-04378bc43653 service nova] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Received unexpected event network-vif-plugged-e2fc4479-6950-479a-bf81-12149601afab for instance with vm_state building and task_state spawning.
Aug 09 10:16:13 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:13 user nova-compute[72362]: DEBUG nova.compute.manager [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:16:13 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:16:13 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576173.0737343, 1e2e53b4-3a00-4725-840d-215f6609c951 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:16:13 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] VM Resumed (Lifecycle Event)
Aug 09 10:16:13 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Instance spawned successfully.
Aug 09 10:16:13 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 10:16:13 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Found default for hw_cdrom_bus of ide {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:16:13 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Found default for hw_disk_bus of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:16:13 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:16:13 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:16:13 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Found default for hw_video_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:16:13 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Found default for hw_vif_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:16:13 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:16:13 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:16:13 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:16:13 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576173.0825813, 1e2e53b4-3a00-4725-840d-215f6609c951 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:16:13 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] VM Started (Lifecycle Event)
Aug 09 10:16:13 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:16:13 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:16:13 user nova-compute[72362]: INFO nova.compute.manager [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Took 15.35 seconds to spawn the instance on the hypervisor.
Aug 09 10:16:13 user nova-compute[72362]: DEBUG nova.compute.manager [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:16:13 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:16:13 user nova-compute[72362]: INFO nova.compute.manager [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Took 16.49 seconds to build instance.
Aug 09 10:16:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-46e0937f-832f-44c2-95d6-1433703c4f97 tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Lock "1e2e53b4-3a00-4725-840d-215f6609c951" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.722s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:13 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576173.7862563, 0e8a7668-1635-4cbc-8c09-ece19ff67d4f => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:16:13 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] VM Resumed (Lifecycle Event)
Aug 09 10:16:13 user nova-compute[72362]: DEBUG nova.compute.manager [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:16:13 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:16:13 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Instance spawned successfully.
Aug 09 10:16:13 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 10:16:13 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:16:13 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:16:13 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Found default for hw_cdrom_bus of ide {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:16:13 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Found default for hw_disk_bus of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:16:13 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:16:13 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:16:13 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Found default for hw_video_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:16:13 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Found default for hw_vif_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:16:13 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:16:13 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576173.7880247, 0e8a7668-1635-4cbc-8c09-ece19ff67d4f => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:16:13 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] VM Started (Lifecycle Event)
Aug 09 10:16:14 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:16:14 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:16:14 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:14 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:16:14 user nova-compute[72362]: INFO nova.compute.manager [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Took 15.57 seconds to spawn the instance on the hypervisor.
Aug 09 10:16:14 user nova-compute[72362]: DEBUG nova.compute.manager [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:16:14 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576174.2192569, ca002e73-ddf7-4452-82b6-0d831d984756 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:16:14 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] VM Resumed (Lifecycle Event)
Aug 09 10:16:14 user nova-compute[72362]: DEBUG nova.compute.manager [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:16:14 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:16:14 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Instance spawned successfully.
Aug 09 10:16:14 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 10:16:14 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:16:14 user nova-compute[72362]: INFO nova.compute.manager [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Took 16.42 seconds to build instance.
Aug 09 10:16:14 user nova-compute[72362]: DEBUG nova.compute.manager [req-764ef524-f8ae-48dd-b9dc-c8b5acea1316 req-0b97a503-76f9-4253-a732-e6c903db926e service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Received event network-vif-plugged-ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:16:14 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-764ef524-f8ae-48dd-b9dc-c8b5acea1316 req-0b97a503-76f9-4253-a732-e6c903db926e service nova] Acquiring lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:14 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-764ef524-f8ae-48dd-b9dc-c8b5acea1316 req-0b97a503-76f9-4253-a732-e6c903db926e service nova] Lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:14 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-764ef524-f8ae-48dd-b9dc-c8b5acea1316 req-0b97a503-76f9-4253-a732-e6c903db926e service nova] Lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:14 user nova-compute[72362]: DEBUG nova.compute.manager [req-764ef524-f8ae-48dd-b9dc-c8b5acea1316 req-0b97a503-76f9-4253-a732-e6c903db926e service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] No waiting events found dispatching network-vif-plugged-ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:16:14 user nova-compute[72362]: WARNING nova.compute.manager [req-764ef524-f8ae-48dd-b9dc-c8b5acea1316 req-0b97a503-76f9-4253-a732-e6c903db926e service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Received unexpected event network-vif-plugged-ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 for instance with vm_state active and task_state None.
Aug 09 10:16:14 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:16:14 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ea667217-e029-43c6-acb4-50062114ea54 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.571s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:14 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Found default for hw_cdrom_bus of ide {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:16:14 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Found default for hw_disk_bus of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:16:14 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:16:14 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:16:14 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Found default for hw_video_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:16:14 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Found default for hw_vif_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:16:14 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:16:14 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576174.2258182, ca002e73-ddf7-4452-82b6-0d831d984756 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:16:14 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] VM Started (Lifecycle Event)
Aug 09 10:16:14 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:16:14 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:16:14 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:16:14 user nova-compute[72362]: DEBUG nova.compute.manager [req-f1200261-11ce-44ec-9d95-92dfb01291ed req-55d8b120-9a45-4a15-808d-bd2b6ce65667 service nova] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Received event network-vif-plugged-7ce03c91-ff2d-4735-bc98-088dc96293d0 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:16:14 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f1200261-11ce-44ec-9d95-92dfb01291ed req-55d8b120-9a45-4a15-808d-bd2b6ce65667 service nova] Acquiring lock "ca002e73-ddf7-4452-82b6-0d831d984756-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:14 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f1200261-11ce-44ec-9d95-92dfb01291ed req-55d8b120-9a45-4a15-808d-bd2b6ce65667 service nova] Lock "ca002e73-ddf7-4452-82b6-0d831d984756-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:14 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f1200261-11ce-44ec-9d95-92dfb01291ed req-55d8b120-9a45-4a15-808d-bd2b6ce65667 service nova] Lock "ca002e73-ddf7-4452-82b6-0d831d984756-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:14 user nova-compute[72362]: DEBUG nova.compute.manager [req-f1200261-11ce-44ec-9d95-92dfb01291ed req-55d8b120-9a45-4a15-808d-bd2b6ce65667 service nova] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] No waiting events found dispatching network-vif-plugged-7ce03c91-ff2d-4735-bc98-088dc96293d0 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:16:14 user nova-compute[72362]: WARNING nova.compute.manager [req-f1200261-11ce-44ec-9d95-92dfb01291ed req-55d8b120-9a45-4a15-808d-bd2b6ce65667 service nova] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Received unexpected event network-vif-plugged-7ce03c91-ff2d-4735-bc98-088dc96293d0 for instance with vm_state building and task_state spawning.
Aug 09 10:16:14 user nova-compute[72362]: DEBUG nova.compute.manager [req-f1200261-11ce-44ec-9d95-92dfb01291ed req-55d8b120-9a45-4a15-808d-bd2b6ce65667 service nova] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Received event network-vif-plugged-7ce03c91-ff2d-4735-bc98-088dc96293d0 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:16:14 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f1200261-11ce-44ec-9d95-92dfb01291ed req-55d8b120-9a45-4a15-808d-bd2b6ce65667 service nova] Acquiring lock "ca002e73-ddf7-4452-82b6-0d831d984756-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:14 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f1200261-11ce-44ec-9d95-92dfb01291ed req-55d8b120-9a45-4a15-808d-bd2b6ce65667 service nova] Lock "ca002e73-ddf7-4452-82b6-0d831d984756-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:14 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f1200261-11ce-44ec-9d95-92dfb01291ed req-55d8b120-9a45-4a15-808d-bd2b6ce65667 service nova] Lock "ca002e73-ddf7-4452-82b6-0d831d984756-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:14 user nova-compute[72362]: DEBUG nova.compute.manager [req-f1200261-11ce-44ec-9d95-92dfb01291ed req-55d8b120-9a45-4a15-808d-bd2b6ce65667 service nova] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] No waiting events found dispatching network-vif-plugged-7ce03c91-ff2d-4735-bc98-088dc96293d0 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:16:14 user nova-compute[72362]: WARNING nova.compute.manager [req-f1200261-11ce-44ec-9d95-92dfb01291ed req-55d8b120-9a45-4a15-808d-bd2b6ce65667 service nova] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Received unexpected event network-vif-plugged-7ce03c91-ff2d-4735-bc98-088dc96293d0 for instance with vm_state building and task_state spawning.
Aug 09 10:16:14 user nova-compute[72362]: INFO nova.compute.manager [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Took 13.02 seconds to spawn the instance on the hypervisor.
Aug 09 10:16:14 user nova-compute[72362]: DEBUG nova.compute.manager [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:16:14 user nova-compute[72362]: INFO nova.compute.manager [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Took 14.14 seconds to build instance.
Aug 09 10:16:14 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-00a7a904-aa36-4da7-ad2c-ab2ee960825b tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Lock "ca002e73-ddf7-4452-82b6-0d831d984756" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.314s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:15 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:16 user nova-compute[72362]: DEBUG nova.compute.manager [req-5452a8b3-6751-437b-b2f5-a215f40869b8 req-de5cf7fa-56cb-48e0-885b-0e52fba282c2 service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Received event network-vif-plugged-ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:16:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-5452a8b3-6751-437b-b2f5-a215f40869b8 req-de5cf7fa-56cb-48e0-885b-0e52fba282c2 service nova] Acquiring lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-5452a8b3-6751-437b-b2f5-a215f40869b8 req-de5cf7fa-56cb-48e0-885b-0e52fba282c2 service nova] Lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-5452a8b3-6751-437b-b2f5-a215f40869b8 req-de5cf7fa-56cb-48e0-885b-0e52fba282c2 service nova] Lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:16 user nova-compute[72362]: DEBUG nova.compute.manager [req-5452a8b3-6751-437b-b2f5-a215f40869b8 req-de5cf7fa-56cb-48e0-885b-0e52fba282c2 service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] No waiting events found dispatching network-vif-plugged-ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:16:16 user nova-compute[72362]: WARNING nova.compute.manager [req-5452a8b3-6751-437b-b2f5-a215f40869b8 req-de5cf7fa-56cb-48e0-885b-0e52fba282c2 service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Received unexpected event network-vif-plugged-ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 for instance with vm_state active and task_state None.
Aug 09 10:16:16 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:16 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:16 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:16 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:18 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:18 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:18 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:19 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:19 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:19 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:19 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Acquiring lock "ea95226c-40fe-4408-a9f0-5538659261a6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Lock "ea95226c-40fe-4408-a9f0-5538659261a6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:23 user nova-compute[72362]: DEBUG nova.compute.manager [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Starting instance... {{(pid=72362) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 10:16:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:24 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:16:24 user nova-compute[72362]: INFO nova.compute.claims [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Claim successful on node user
Aug 09 10:16:24 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:16:24 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:16:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.465s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:24 user nova-compute[72362]: DEBUG nova.compute.manager [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Start building networks asynchronously for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 10:16:24 user nova-compute[72362]: DEBUG nova.compute.manager [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Allocating IP information in the background. {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 10:16:24 user nova-compute[72362]: DEBUG nova.network.neutron [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] allocate_for_instance() {{(pid=72362) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 10:16:24 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 10:16:24 user nova-compute[72362]: DEBUG nova.compute.manager [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Start building block device mappings for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 10:16:24 user nova-compute[72362]: DEBUG nova.policy [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c6220335c74b4c78a0d1a86efc98ebcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e7ca3484c64611b9573ba0b86592b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72362) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 10:16:25 user nova-compute[72362]: DEBUG nova.compute.manager [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Start spawning the instance on the hypervisor. {{(pid=72362) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 10:16:25 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:16:25 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Creating image(s)
Aug 09 10:16:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Acquiring lock "/opt/stack/data/nova/instances/ea95226c-40fe-4408-a9f0-5538659261a6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Lock "/opt/stack/data/nova/instances/ea95226c-40fe-4408-a9f0-5538659261a6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Lock "/opt/stack/data/nova/instances/ea95226c-40fe-4408-a9f0-5538659261a6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Acquiring lock "8f0c62c9-aa84-4a5b-b909-af5535e87c83" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Lock "8f0c62c9-aa84-4a5b-b909-af5535e87c83" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:25 user nova-compute[72362]: DEBUG nova.compute.manager [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Starting instance... {{(pid=72362) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 10:16:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.177s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Acquiring lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:25 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:16:25 user nova-compute[72362]: INFO nova.compute.claims [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Claim successful on node user
Aug 09 10:16:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.183s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/ea95226c-40fe-4408-a9f0-5538659261a6/disk 1073741824 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/ea95226c-40fe-4408-a9f0-5538659261a6/disk 1073741824" returned: 0 in 0.100s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:25 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Acquiring lock "b17b317a-409e-45ad-ac7c-0c298f4f564b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Lock "b17b317a-409e-45ad-ac7c-0c298f4f564b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:25 user nova-compute[72362]: DEBUG nova.compute.manager [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Starting instance... {{(pid=72362) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 10:16:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.153s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:25 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ea95226c-40fe-4408-a9f0-5538659261a6/disk. size=1073741824 {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 10:16:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea95226c-40fe-4408-a9f0-5538659261a6/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:25 user nova-compute[72362]: DEBUG nova.network.neutron [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Successfully created port: fc1688e4-e2d3-4f8f-be55-4a6793ae4497 {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:16:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea95226c-40fe-4408-a9f0-5538659261a6/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:25 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Cannot resize image /opt/stack/data/nova/instances/ea95226c-40fe-4408-a9f0-5538659261a6/disk to a smaller size. {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 10:16:25 user nova-compute[72362]: DEBUG nova.objects.instance [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Lazy-loading 'migration_context' on Instance uuid ea95226c-40fe-4408-a9f0-5538659261a6 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:16:25 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Created local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 10:16:25 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Ensure instance console log exists: /opt/stack/data/nova/instances/ea95226c-40fe-4408-a9f0-5538659261a6/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:16:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:26 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:16:26 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:16:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.728s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:26 user nova-compute[72362]: DEBUG nova.compute.manager [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Start building networks asynchronously for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 10:16:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.212s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:26 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:16:26 user nova-compute[72362]: INFO nova.compute.claims [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Claim successful on node user
Aug 09 10:16:26 user nova-compute[72362]: DEBUG nova.compute.manager [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Allocating IP information in the background. {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 10:16:26 user nova-compute[72362]: DEBUG nova.network.neutron [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] allocate_for_instance() {{(pid=72362) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 10:16:26 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 10:16:26 user nova-compute[72362]: DEBUG nova.compute.manager [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Start building block device mappings for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 10:16:26 user nova-compute[72362]: DEBUG nova.policy [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2a4c8c5a9e7a41d58f685db501b3940f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29102931855a43efb23963382ca5d4f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72362) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 10:16:26 user nova-compute[72362]: DEBUG nova.compute.manager [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Start spawning the instance on the hypervisor. {{(pid=72362) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 10:16:26 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:16:26 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Creating image(s)
Aug 09 10:16:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Acquiring lock "/opt/stack/data/nova/instances/8f0c62c9-aa84-4a5b-b909-af5535e87c83/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Lock "/opt/stack/data/nova/instances/8f0c62c9-aa84-4a5b-b909-af5535e87c83/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Lock "/opt/stack/data/nova/instances/8f0c62c9-aa84-4a5b-b909-af5535e87c83/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:26 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:26 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:16:26 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:16:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.627s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:26 user nova-compute[72362]: DEBUG nova.compute.manager [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Start building networks asynchronously for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 10:16:26 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.241s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Acquiring lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:26 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:26 user nova-compute[72362]: DEBUG nova.compute.manager [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Allocating IP information in the background. {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 10:16:26 user nova-compute[72362]: DEBUG nova.network.neutron [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] allocate_for_instance() {{(pid=72362) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 10:16:26 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 10:16:26 user nova-compute[72362]: DEBUG nova.compute.manager [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Start building block device mappings for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 10:16:26 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.175s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:26 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/8f0c62c9-aa84-4a5b-b909-af5535e87c83/disk 1073741824 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/8f0c62c9-aa84-4a5b-b909-af5535e87c83/disk 1073741824" returned: 0 in 0.070s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:27 user nova-compute[72362]: DEBUG nova.policy [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9cb836c99dd84cd2a8cddefaca58a3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eadf3da29124620a2ec066a13cbf2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72362) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 10:16:27 user nova-compute[72362]: DEBUG nova.compute.manager [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Start spawning the instance on the hypervisor. {{(pid=72362) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 10:16:27 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:16:27 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Creating image(s)
Aug 09 10:16:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Acquiring lock "/opt/stack/data/nova/instances/b17b317a-409e-45ad-ac7c-0c298f4f564b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Lock "/opt/stack/data/nova/instances/b17b317a-409e-45ad-ac7c-0c298f4f564b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Lock "/opt/stack/data/nova/instances/b17b317a-409e-45ad-ac7c-0c298f4f564b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.182s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:27 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8f0c62c9-aa84-4a5b-b909-af5535e87c83/disk. size=1073741824 {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 10:16:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f0c62c9-aa84-4a5b-b909-af5535e87c83/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.170s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Acquiring lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f0c62c9-aa84-4a5b-b909-af5535e87c83/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:27 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Cannot resize image /opt/stack/data/nova/instances/8f0c62c9-aa84-4a5b-b909-af5535e87c83/disk to a smaller size. {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 10:16:27 user nova-compute[72362]: DEBUG nova.objects.instance [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Lazy-loading 'migration_context' on Instance uuid 8f0c62c9-aa84-4a5b-b909-af5535e87c83 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:16:27 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Created local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 10:16:27 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Ensure instance console log exists: /opt/stack/data/nova/instances/8f0c62c9-aa84-4a5b-b909-af5535e87c83/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:16:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:27 user nova-compute[72362]: DEBUG nova.network.neutron [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Successfully created port: 8b6fe644-7df3-429e-baa8-ab6407034e32 {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:16:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.201s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/b17b317a-409e-45ad-ac7c-0c298f4f564b/disk 1073741824 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/b17b317a-409e-45ad-ac7c-0c298f4f564b/disk 1073741824" returned: 0 in 0.060s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:27 user nova-compute[72362]: DEBUG nova.network.neutron [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Successfully updated port: fc1688e4-e2d3-4f8f-be55-4a6793ae4497 {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:16:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Acquiring lock "refresh_cache-ea95226c-40fe-4408-a9f0-5538659261a6" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:16:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Acquired lock "refresh_cache-ea95226c-40fe-4408-a9f0-5538659261a6" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:16:27 user nova-compute[72362]: DEBUG nova.network.neutron [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:16:27 user nova-compute[72362]: DEBUG nova.compute.manager [req-2d36aa11-7eaa-401f-886d-bdeff2e7d805 req-1f64be60-e1df-49a6-b524-97249e3032d6 service nova] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Received event network-changed-fc1688e4-e2d3-4f8f-be55-4a6793ae4497 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:16:27 user nova-compute[72362]: DEBUG nova.compute.manager [req-2d36aa11-7eaa-401f-886d-bdeff2e7d805 req-1f64be60-e1df-49a6-b524-97249e3032d6 service nova] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Refreshing instance network info cache due to event network-changed-fc1688e4-e2d3-4f8f-be55-4a6793ae4497. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:16:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-2d36aa11-7eaa-401f-886d-bdeff2e7d805 req-1f64be60-e1df-49a6-b524-97249e3032d6 service nova] Acquiring lock "refresh_cache-ea95226c-40fe-4408-a9f0-5538659261a6" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:16:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.206s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:27 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b17b317a-409e-45ad-ac7c-0c298f4f564b/disk. size=1073741824 {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 10:16:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b17b317a-409e-45ad-ac7c-0c298f4f564b/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:27 user nova-compute[72362]: DEBUG nova.network.neutron [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:16:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b17b317a-409e-45ad-ac7c-0c298f4f564b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:27 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Cannot resize image /opt/stack/data/nova/instances/b17b317a-409e-45ad-ac7c-0c298f4f564b/disk to a smaller size. {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 10:16:27 user nova-compute[72362]: DEBUG nova.objects.instance [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Lazy-loading 'migration_context' on Instance uuid b17b317a-409e-45ad-ac7c-0c298f4f564b {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:16:27 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Created local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 10:16:27 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Ensure instance console log exists: /opt/stack/data/nova/instances/b17b317a-409e-45ad-ac7c-0c298f4f564b/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:16:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:28 user nova-compute[72362]: DEBUG nova.network.neutron [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Updating instance_info_cache with network_info: [{"id": "fc1688e4-e2d3-4f8f-be55-4a6793ae4497", "address": "fa:16:3e:31:49:f0", "network": {"id": "c32d66f0-0db4-4c6b-a45d-8c1eb6f4b510", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-858657617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2e7ca3484c64611b9573ba0b86592b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc1688e4-e2", "ovs_interfaceid": "fc1688e4-e2d3-4f8f-be55-4a6793ae4497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:16:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Releasing lock "refresh_cache-ea95226c-40fe-4408-a9f0-5538659261a6" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:16:28 user nova-compute[72362]: DEBUG nova.compute.manager [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Instance network_info: |[{"id": "fc1688e4-e2d3-4f8f-be55-4a6793ae4497", "address": "fa:16:3e:31:49:f0", "network": {"id": "c32d66f0-0db4-4c6b-a45d-8c1eb6f4b510", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-858657617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2e7ca3484c64611b9573ba0b86592b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc1688e4-e2", "ovs_interfaceid": "fc1688e4-e2d3-4f8f-be55-4a6793ae4497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 10:16:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-2d36aa11-7eaa-401f-886d-bdeff2e7d805 req-1f64be60-e1df-49a6-b524-97249e3032d6 service nova] Acquired lock "refresh_cache-ea95226c-40fe-4408-a9f0-5538659261a6" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:16:28 user nova-compute[72362]: DEBUG nova.network.neutron [req-2d36aa11-7eaa-401f-886d-bdeff2e7d805 req-1f64be60-e1df-49a6-b524-97249e3032d6 service nova] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Refreshing network info cache for port fc1688e4-e2d3-4f8f-be55-4a6793ae4497 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:16:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Start _get_guest_xml network_info=[{"id": "fc1688e4-e2d3-4f8f-be55-4a6793ae4497", "address": "fa:16:3e:31:49:f0", "network": {"id": "c32d66f0-0db4-4c6b-a45d-8c1eb6f4b510", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-858657617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2e7ca3484c64611b9573ba0b86592b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc1688e4-e2", "ovs_interfaceid": "fc1688e4-e2d3-4f8f-be55-4a6793ae4497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': 'a08d1a11-49eb-4212-a351-e11ee9553b95'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:16:28 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:16:28 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:16:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:16:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:16:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:16:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:16:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:16:29 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:16:29 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:16:29 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:16:29 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:16:29 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:16:29 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:16:29 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:16:29 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:16:29 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:16:29 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:16:29 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:16:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:16:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-542512523',display_name='tempest-VolumesAdminNegativeTest-server-542512523',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-542512523',id=4,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoX7ZinHGYEXNZ0pSDCITz49RW9Y6hct+6iOxBWojlTkGOxkA/hmrwaEOuG0fl0JmyM8Mm5LwAYVFoRS99ogyYlQTaOMuqXEYekfEQXOqBs2QJU+kq4INZqo503jFGQtg==',key_name='tempest-keypair-1279119124',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b2e7ca3484c64611b9573ba0b86592b5',ramdisk_id='',reservation_id='r-5u8x7soq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-240994046',owner_user_name='tempest-VolumesAdminNegativeTest-240994046-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:16:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6220335c74b4c78a0d1a86efc98ebcb',uuid=ea95226c-40fe-4408-a9f0-5538659261a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc1688e4-e2d3-4f8f-be55-4a6793ae4497", "address": "fa:16:3e:31:49:f0", "network": {"id": "c32d66f0-0db4-4c6b-a45d-8c1eb6f4b510", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-858657617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2e7ca3484c64611b9573ba0b86592b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc1688e4-e2", "ovs_interfaceid": "fc1688e4-e2d3-4f8f-be55-4a6793ae4497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:16:29 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Converting VIF {"id": "fc1688e4-e2d3-4f8f-be55-4a6793ae4497", "address": "fa:16:3e:31:49:f0", "network": {"id": "c32d66f0-0db4-4c6b-a45d-8c1eb6f4b510", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-858657617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2e7ca3484c64611b9573ba0b86592b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc1688e4-e2", "ovs_interfaceid": "fc1688e4-e2d3-4f8f-be55-4a6793ae4497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:16:29 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:49:f0,bridge_name='br-int',has_traffic_filtering=True,id=fc1688e4-e2d3-4f8f-be55-4a6793ae4497,network=Network(c32d66f0-0db4-4c6b-a45d-8c1eb6f4b510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc1688e4-e2') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:16:29 user nova-compute[72362]: DEBUG nova.objects.instance [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Lazy-loading 'pci_devices' on Instance uuid ea95226c-40fe-4408-a9f0-5538659261a6 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:16:29 user nova-compute[72362]: DEBUG nova.network.neutron [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Successfully created port: 76c0daec-94af-49ef-b33c-73925b6fb175 {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:16:29 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:16:29 user nova-compute[72362]:   <uuid>ea95226c-40fe-4408-a9f0-5538659261a6</uuid>
Aug 09 10:16:29 user nova-compute[72362]:   <name>instance-00000004</name>
Aug 09 10:16:29 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:16:29 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:16:29 user nova-compute[72362]:   <metadata>
Aug 09 10:16:29 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:16:29 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:16:29 user nova-compute[72362]:       <nova:name>tempest-VolumesAdminNegativeTest-server-542512523</nova:name>
Aug 09 10:16:29 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:16:28</nova:creationTime>
Aug 09 10:16:29 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:16:29 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:16:29 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:16:29 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:16:29 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:16:29 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:16:29 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:16:29 user nova-compute[72362]:       <nova:owner>
Aug 09 10:16:29 user nova-compute[72362]:         <nova:user uuid="c6220335c74b4c78a0d1a86efc98ebcb">tempest-VolumesAdminNegativeTest-240994046-project-member</nova:user>
Aug 09 10:16:29 user nova-compute[72362]:         <nova:project uuid="b2e7ca3484c64611b9573ba0b86592b5">tempest-VolumesAdminNegativeTest-240994046</nova:project>
Aug 09 10:16:29 user nova-compute[72362]:       </nova:owner>
Aug 09 10:16:29 user nova-compute[72362]:       <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:16:29 user nova-compute[72362]:       <nova:ports>
Aug 09 10:16:29 user nova-compute[72362]:         <nova:port uuid="fc1688e4-e2d3-4f8f-be55-4a6793ae4497">
Aug 09 10:16:29 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 09 10:16:29 user nova-compute[72362]:         </nova:port>
Aug 09 10:16:29 user nova-compute[72362]:       </nova:ports>
Aug 09 10:16:29 user nova-compute[72362]:     </nova:instance>
Aug 09 10:16:29 user nova-compute[72362]:   </metadata>
Aug 09 10:16:29 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:16:29 user nova-compute[72362]:     <system>
Aug 09 10:16:29 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:16:29 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:16:29 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:16:29 user nova-compute[72362]:       <entry name="serial">ea95226c-40fe-4408-a9f0-5538659261a6</entry>
Aug 09 10:16:29 user nova-compute[72362]:       <entry name="uuid">ea95226c-40fe-4408-a9f0-5538659261a6</entry>
Aug 09 10:16:29 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:16:29 user nova-compute[72362]:     </system>
Aug 09 10:16:29 user nova-compute[72362]:   </sysinfo>
Aug 09 10:16:29 user nova-compute[72362]:   <os>
Aug 09 10:16:29 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:16:29 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:16:29 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:16:29 user nova-compute[72362]:   </os>
Aug 09 10:16:29 user nova-compute[72362]:   <features>
Aug 09 10:16:29 user nova-compute[72362]:     <acpi/>
Aug 09 10:16:29 user nova-compute[72362]:     <apic/>
Aug 09 10:16:29 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:16:29 user nova-compute[72362]:   </features>
Aug 09 10:16:29 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:16:29 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:16:29 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:16:29 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:16:29 user nova-compute[72362]:   </clock>
Aug 09 10:16:29 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:16:29 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:16:29 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:16:29 user nova-compute[72362]:   </cpu>
Aug 09 10:16:29 user nova-compute[72362]:   <devices>
Aug 09 10:16:29 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:16:29 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:16:29 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/ea95226c-40fe-4408-a9f0-5538659261a6/disk"/>
Aug 09 10:16:29 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:16:29 user nova-compute[72362]:     </disk>
Aug 09 10:16:29 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:16:29 user nova-compute[72362]:       <mac address="fa:16:3e:31:49:f0"/>
Aug 09 10:16:29 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:16:29 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:16:29 user nova-compute[72362]:       <target dev="tapfc1688e4-e2"/>
Aug 09 10:16:29 user nova-compute[72362]:     </interface>
Aug 09 10:16:29 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:16:29 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/ea95226c-40fe-4408-a9f0-5538659261a6/console.log" append="off"/>
Aug 09 10:16:29 user nova-compute[72362]:     </serial>
Aug 09 10:16:29 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:16:29 user nova-compute[72362]:     <video>
Aug 09 10:16:29 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:16:29 user nova-compute[72362]:     </video>
Aug 09 10:16:29 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:16:29 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:16:29 user nova-compute[72362]:     </rng>
Aug 09 10:16:29 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:16:29 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:16:29 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:16:29 user nova-compute[72362]:     </memballoon>
Aug 09 10:16:29 user nova-compute[72362]:   </devices>
Aug 09 10:16:29 user nova-compute[72362]: </domain>
Aug 09 10:16:29 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:16:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:16:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-542512523',display_name='tempest-VolumesAdminNegativeTest-server-542512523',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-542512523',id=4,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoX7ZinHGYEXNZ0pSDCITz49RW9Y6hct+6iOxBWojlTkGOxkA/hmrwaEOuG0fl0JmyM8Mm5LwAYVFoRS99ogyYlQTaOMuqXEYekfEQXOqBs2QJU+kq4INZqo503jFGQtg==',key_name='tempest-keypair-1279119124',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b2e7ca3484c64611b9573ba0b86592b5',ramdisk_id='',reservation_id='r-5u8x7soq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-240994046',owner_user_name='tempest-VolumesAdminNegativeTest-240994046-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:16:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6220335c74b4c78a0d1a86efc98ebcb',uuid=ea95226c-40fe-4408-a9f0-5538659261a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc1688e4-e2d3-4f8f-be55-4a6793ae4497", "address": "fa:16:3e:31:49:f0", "network": {"id": "c32d66f0-0db4-4c6b-a45d-8c1eb6f4b510", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-858657617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2e7ca3484c64611b9573ba0b86592b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc1688e4-e2", "ovs_interfaceid": "fc1688e4-e2d3-4f8f-be55-4a6793ae4497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:16:29 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Converting VIF {"id": "fc1688e4-e2d3-4f8f-be55-4a6793ae4497", "address": "fa:16:3e:31:49:f0", "network": {"id": "c32d66f0-0db4-4c6b-a45d-8c1eb6f4b510", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-858657617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2e7ca3484c64611b9573ba0b86592b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc1688e4-e2", "ovs_interfaceid": "fc1688e4-e2d3-4f8f-be55-4a6793ae4497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:16:29 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:49:f0,bridge_name='br-int',has_traffic_filtering=True,id=fc1688e4-e2d3-4f8f-be55-4a6793ae4497,network=Network(c32d66f0-0db4-4c6b-a45d-8c1eb6f4b510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc1688e4-e2') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:16:29 user nova-compute[72362]: DEBUG os_vif [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:49:f0,bridge_name='br-int',has_traffic_filtering=True,id=fc1688e4-e2d3-4f8f-be55-4a6793ae4497,network=Network(c32d66f0-0db4-4c6b-a45d-8c1eb6f4b510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc1688e4-e2') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:16:29 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:29 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:16:29 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:16:29 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:29 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc1688e4-e2, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:16:29 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfc1688e4-e2, col_values=(('external_ids', {'iface-id': 'fc1688e4-e2d3-4f8f-be55-4a6793ae4497', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:49:f0', 'vm-uuid': 'ea95226c-40fe-4408-a9f0-5538659261a6'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:16:29 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:29 user nova-compute[72362]: DEBUG nova.network.neutron [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Successfully updated port: 8b6fe644-7df3-429e-baa8-ab6407034e32 {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:16:29 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:16:29 user nova-compute[72362]: INFO os_vif [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:49:f0,bridge_name='br-int',has_traffic_filtering=True,id=fc1688e4-e2d3-4f8f-be55-4a6793ae4497,network=Network(c32d66f0-0db4-4c6b-a45d-8c1eb6f4b510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc1688e4-e2')
Aug 09 10:16:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Acquiring lock "refresh_cache-8f0c62c9-aa84-4a5b-b909-af5535e87c83" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:16:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Acquired lock "refresh_cache-8f0c62c9-aa84-4a5b-b909-af5535e87c83" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:16:29 user nova-compute[72362]: DEBUG nova.network.neutron [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:16:29 user nova-compute[72362]: DEBUG nova.compute.manager [req-b84da024-976d-4642-808c-7a553c986530 req-b4ea178b-ac21-4b0b-800c-6f2f3bd5ef58 service nova] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Received event network-changed-8b6fe644-7df3-429e-baa8-ab6407034e32 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:16:29 user nova-compute[72362]: DEBUG nova.compute.manager [req-b84da024-976d-4642-808c-7a553c986530 req-b4ea178b-ac21-4b0b-800c-6f2f3bd5ef58 service nova] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Refreshing instance network info cache due to event network-changed-8b6fe644-7df3-429e-baa8-ab6407034e32. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:16:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b84da024-976d-4642-808c-7a553c986530 req-b4ea178b-ac21-4b0b-800c-6f2f3bd5ef58 service nova] Acquiring lock "refresh_cache-8f0c62c9-aa84-4a5b-b909-af5535e87c83" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:16:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:16:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] No VIF found with MAC fa:16:3e:31:49:f0, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:16:29 user nova-compute[72362]: DEBUG nova.network.neutron [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:16:29 user nova-compute[72362]: DEBUG nova.network.neutron [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Updating instance_info_cache with network_info: [{"id": "8b6fe644-7df3-429e-baa8-ab6407034e32", "address": "fa:16:3e:63:7f:a8", "network": {"id": "45d52d71-edd6-4126-ba59-31d3c42169b9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1828391472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29102931855a43efb23963382ca5d4f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b6fe644-7d", "ovs_interfaceid": "8b6fe644-7df3-429e-baa8-ab6407034e32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:16:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Releasing lock "refresh_cache-8f0c62c9-aa84-4a5b-b909-af5535e87c83" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:16:29 user nova-compute[72362]: DEBUG nova.compute.manager [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Instance network_info: |[{"id": "8b6fe644-7df3-429e-baa8-ab6407034e32", "address": "fa:16:3e:63:7f:a8", "network": {"id": "45d52d71-edd6-4126-ba59-31d3c42169b9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1828391472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29102931855a43efb23963382ca5d4f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b6fe644-7d", "ovs_interfaceid": "8b6fe644-7df3-429e-baa8-ab6407034e32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 10:16:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b84da024-976d-4642-808c-7a553c986530 req-b4ea178b-ac21-4b0b-800c-6f2f3bd5ef58 service nova] Acquired lock "refresh_cache-8f0c62c9-aa84-4a5b-b909-af5535e87c83" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:16:29 user nova-compute[72362]: DEBUG nova.network.neutron [req-b84da024-976d-4642-808c-7a553c986530 req-b4ea178b-ac21-4b0b-800c-6f2f3bd5ef58 service nova] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Refreshing network info cache for port 8b6fe644-7df3-429e-baa8-ab6407034e32 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:16:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Start _get_guest_xml network_info=[{"id": "8b6fe644-7df3-429e-baa8-ab6407034e32", "address": "fa:16:3e:63:7f:a8", "network": {"id": "45d52d71-edd6-4126-ba59-31d3c42169b9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1828391472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29102931855a43efb23963382ca5d4f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b6fe644-7d", "ovs_interfaceid": "8b6fe644-7df3-429e-baa8-ab6407034e32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': 'a08d1a11-49eb-4212-a351-e11ee9553b95'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:16:29 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:16:29 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:16:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:16:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:16:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:16:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:16:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:16:30 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:16:30 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:16:30 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:16:30 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:16:30 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:16:30 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:16:30 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:16:30 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:16:30 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:16:30 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:16:30 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:16:30 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:16:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-599542738',display_name='tempest-VolumesAssistedSnapshotsTest-server-599542738',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-599542738',id=5,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJa4IUF321zLWRtdC8IMxosX4Q/aIft2JDosU8CGvsEA+O9/Uc+byIdGr6pEsLEFQc3AmI87cJNTXfnAxxhFys1wKqmGE5wyHRycshKQ0zd1ucgzMPs61shRzvK5mWKrfA==',key_name='tempest-keypair-857746219',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29102931855a43efb23963382ca5d4f4',ramdisk_id='',reservation_id='r-kendn900',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1880300106',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1880300106-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:16:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a4c8c5a9e7a41d58f685db501b3940f',uuid=8f0c62c9-aa84-4a5b-b909-af5535e87c83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b6fe644-7df3-429e-baa8-ab6407034e32", "address": "fa:16:3e:63:7f:a8", "network": {"id": "45d52d71-edd6-4126-ba59-31d3c42169b9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1828391472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29102931855a43efb23963382ca5d4f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b6fe644-7d", "ovs_interfaceid": "8b6fe644-7df3-429e-baa8-ab6407034e32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:16:30 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Converting VIF {"id": "8b6fe644-7df3-429e-baa8-ab6407034e32", "address": "fa:16:3e:63:7f:a8", "network": {"id": "45d52d71-edd6-4126-ba59-31d3c42169b9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1828391472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29102931855a43efb23963382ca5d4f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b6fe644-7d", "ovs_interfaceid": "8b6fe644-7df3-429e-baa8-ab6407034e32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:16:30 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:7f:a8,bridge_name='br-int',has_traffic_filtering=True,id=8b6fe644-7df3-429e-baa8-ab6407034e32,network=Network(45d52d71-edd6-4126-ba59-31d3c42169b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b6fe644-7d') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:16:30 user nova-compute[72362]: DEBUG nova.objects.instance [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Lazy-loading 'pci_devices' on Instance uuid 8f0c62c9-aa84-4a5b-b909-af5535e87c83 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:16:30 user nova-compute[72362]: DEBUG nova.network.neutron [req-2d36aa11-7eaa-401f-886d-bdeff2e7d805 req-1f64be60-e1df-49a6-b524-97249e3032d6 service nova] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Updated VIF entry in instance network info cache for port fc1688e4-e2d3-4f8f-be55-4a6793ae4497. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:16:30 user nova-compute[72362]: DEBUG nova.network.neutron [req-2d36aa11-7eaa-401f-886d-bdeff2e7d805 req-1f64be60-e1df-49a6-b524-97249e3032d6 service nova] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Updating instance_info_cache with network_info: [{"id": "fc1688e4-e2d3-4f8f-be55-4a6793ae4497", "address": "fa:16:3e:31:49:f0", "network": {"id": "c32d66f0-0db4-4c6b-a45d-8c1eb6f4b510", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-858657617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2e7ca3484c64611b9573ba0b86592b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc1688e4-e2", "ovs_interfaceid": "fc1688e4-e2d3-4f8f-be55-4a6793ae4497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:16:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-2d36aa11-7eaa-401f-886d-bdeff2e7d805 req-1f64be60-e1df-49a6-b524-97249e3032d6 service nova] Releasing lock "refresh_cache-ea95226c-40fe-4408-a9f0-5538659261a6" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:16:30 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:16:30 user nova-compute[72362]:   <uuid>8f0c62c9-aa84-4a5b-b909-af5535e87c83</uuid>
Aug 09 10:16:30 user nova-compute[72362]:   <name>instance-00000005</name>
Aug 09 10:16:30 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:16:30 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:16:30 user nova-compute[72362]:   <metadata>
Aug 09 10:16:30 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:16:30 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:16:30 user nova-compute[72362]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-599542738</nova:name>
Aug 09 10:16:30 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:16:29</nova:creationTime>
Aug 09 10:16:30 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:16:30 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:16:30 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:16:30 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:16:30 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:16:30 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:16:30 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:16:30 user nova-compute[72362]:       <nova:owner>
Aug 09 10:16:30 user nova-compute[72362]:         <nova:user uuid="2a4c8c5a9e7a41d58f685db501b3940f">tempest-VolumesAssistedSnapshotsTest-1880300106-project-member</nova:user>
Aug 09 10:16:30 user nova-compute[72362]:         <nova:project uuid="29102931855a43efb23963382ca5d4f4">tempest-VolumesAssistedSnapshotsTest-1880300106</nova:project>
Aug 09 10:16:30 user nova-compute[72362]:       </nova:owner>
Aug 09 10:16:30 user nova-compute[72362]:       <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:16:30 user nova-compute[72362]:       <nova:ports>
Aug 09 10:16:30 user nova-compute[72362]:         <nova:port uuid="8b6fe644-7df3-429e-baa8-ab6407034e32">
Aug 09 10:16:30 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 10:16:30 user nova-compute[72362]:         </nova:port>
Aug 09 10:16:30 user nova-compute[72362]:       </nova:ports>
Aug 09 10:16:30 user nova-compute[72362]:     </nova:instance>
Aug 09 10:16:30 user nova-compute[72362]:   </metadata>
Aug 09 10:16:30 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:16:30 user nova-compute[72362]:     <system>
Aug 09 10:16:30 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:16:30 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:16:30 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:16:30 user nova-compute[72362]:       <entry name="serial">8f0c62c9-aa84-4a5b-b909-af5535e87c83</entry>
Aug 09 10:16:30 user nova-compute[72362]:       <entry name="uuid">8f0c62c9-aa84-4a5b-b909-af5535e87c83</entry>
Aug 09 10:16:30 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:16:30 user nova-compute[72362]:     </system>
Aug 09 10:16:30 user nova-compute[72362]:   </sysinfo>
Aug 09 10:16:30 user nova-compute[72362]:   <os>
Aug 09 10:16:30 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:16:30 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:16:30 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:16:30 user nova-compute[72362]:   </os>
Aug 09 10:16:30 user nova-compute[72362]:   <features>
Aug 09 10:16:30 user nova-compute[72362]:     <acpi/>
Aug 09 10:16:30 user nova-compute[72362]:     <apic/>
Aug 09 10:16:30 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:16:30 user nova-compute[72362]:   </features>
Aug 09 10:16:30 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:16:30 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:16:30 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:16:30 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:16:30 user nova-compute[72362]:   </clock>
Aug 09 10:16:30 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:16:30 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:16:30 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:16:30 user nova-compute[72362]:   </cpu>
Aug 09 10:16:30 user nova-compute[72362]:   <devices>
Aug 09 10:16:30 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:16:30 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:16:30 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/8f0c62c9-aa84-4a5b-b909-af5535e87c83/disk"/>
Aug 09 10:16:30 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:16:30 user nova-compute[72362]:     </disk>
Aug 09 10:16:30 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:16:30 user nova-compute[72362]:       <mac address="fa:16:3e:63:7f:a8"/>
Aug 09 10:16:30 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:16:30 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:16:30 user nova-compute[72362]:       <target dev="tap8b6fe644-7d"/>
Aug 09 10:16:30 user nova-compute[72362]:     </interface>
Aug 09 10:16:30 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:16:30 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/8f0c62c9-aa84-4a5b-b909-af5535e87c83/console.log" append="off"/>
Aug 09 10:16:30 user nova-compute[72362]:     </serial>
Aug 09 10:16:30 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:16:30 user nova-compute[72362]:     <video>
Aug 09 10:16:30 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:16:30 user nova-compute[72362]:     </video>
Aug 09 10:16:30 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:16:30 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:16:30 user nova-compute[72362]:     </rng>
Aug 09 10:16:30 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:16:30 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:16:30 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:16:30 user nova-compute[72362]:     </memballoon>
Aug 09 10:16:30 user nova-compute[72362]:   </devices>
Aug 09 10:16:30 user nova-compute[72362]: </domain>
Aug 09 10:16:30 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:16:30 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:16:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-599542738',display_name='tempest-VolumesAssistedSnapshotsTest-server-599542738',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-599542738',id=5,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJa4IUF321zLWRtdC8IMxosX4Q/aIft2JDosU8CGvsEA+O9/Uc+byIdGr6pEsLEFQc3AmI87cJNTXfnAxxhFys1wKqmGE5wyHRycshKQ0zd1ucgzMPs61shRzvK5mWKrfA==',key_name='tempest-keypair-857746219',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29102931855a43efb23963382ca5d4f4',ramdisk_id='',reservation_id='r-kendn900',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1880300106',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1880300106-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:16:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a4c8c5a9e7a41d58f685db501b3940f',uuid=8f0c62c9-aa84-4a5b-b909-af5535e87c83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b6fe644-7df3-429e-baa8-ab6407034e32", "address": "fa:16:3e:63:7f:a8", "network": {"id": "45d52d71-edd6-4126-ba59-31d3c42169b9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1828391472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29102931855a43efb23963382ca5d4f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b6fe644-7d", "ovs_interfaceid": "8b6fe644-7df3-429e-baa8-ab6407034e32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:16:30 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Converting VIF {"id": "8b6fe644-7df3-429e-baa8-ab6407034e32", "address": "fa:16:3e:63:7f:a8", "network": {"id": "45d52d71-edd6-4126-ba59-31d3c42169b9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1828391472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29102931855a43efb23963382ca5d4f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b6fe644-7d", "ovs_interfaceid": "8b6fe644-7df3-429e-baa8-ab6407034e32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:16:30 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:7f:a8,bridge_name='br-int',has_traffic_filtering=True,id=8b6fe644-7df3-429e-baa8-ab6407034e32,network=Network(45d52d71-edd6-4126-ba59-31d3c42169b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b6fe644-7d') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:16:30 user nova-compute[72362]: DEBUG os_vif [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:7f:a8,bridge_name='br-int',has_traffic_filtering=True,id=8b6fe644-7df3-429e-baa8-ab6407034e32,network=Network(45d52d71-edd6-4126-ba59-31d3c42169b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b6fe644-7d') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:16:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:16:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:16:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b6fe644-7d, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:16:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8b6fe644-7d, col_values=(('external_ids', {'iface-id': '8b6fe644-7df3-429e-baa8-ab6407034e32', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:7f:a8', 'vm-uuid': '8f0c62c9-aa84-4a5b-b909-af5535e87c83'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:16:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:16:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:30 user nova-compute[72362]: INFO os_vif [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:7f:a8,bridge_name='br-int',has_traffic_filtering=True,id=8b6fe644-7df3-429e-baa8-ab6407034e32,network=Network(45d52d71-edd6-4126-ba59-31d3c42169b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b6fe644-7d')
Aug 09 10:16:30 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:16:30 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] No VIF found with MAC fa:16:3e:63:7f:a8, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:16:30 user nova-compute[72362]: DEBUG nova.network.neutron [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Successfully updated port: 76c0daec-94af-49ef-b33c-73925b6fb175 {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:16:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Acquiring lock "refresh_cache-b17b317a-409e-45ad-ac7c-0c298f4f564b" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:16:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Acquired lock "refresh_cache-b17b317a-409e-45ad-ac7c-0c298f4f564b" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:16:30 user nova-compute[72362]: DEBUG nova.network.neutron [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:16:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:30 user nova-compute[72362]: DEBUG nova.compute.manager [req-f0c3f384-ff8a-4418-86f0-19026163ab8e req-5aae940f-8d7a-45eb-a3aa-a0c2e1f1de7d service nova] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Received event network-changed-76c0daec-94af-49ef-b33c-73925b6fb175 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:16:30 user nova-compute[72362]: DEBUG nova.compute.manager [req-f0c3f384-ff8a-4418-86f0-19026163ab8e req-5aae940f-8d7a-45eb-a3aa-a0c2e1f1de7d service nova] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Refreshing instance network info cache due to event network-changed-76c0daec-94af-49ef-b33c-73925b6fb175. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:16:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f0c3f384-ff8a-4418-86f0-19026163ab8e req-5aae940f-8d7a-45eb-a3aa-a0c2e1f1de7d service nova] Acquiring lock "refresh_cache-b17b317a-409e-45ad-ac7c-0c298f4f564b" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:16:30 user nova-compute[72362]: DEBUG nova.network.neutron [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:16:30 user nova-compute[72362]: DEBUG nova.network.neutron [req-b84da024-976d-4642-808c-7a553c986530 req-b4ea178b-ac21-4b0b-800c-6f2f3bd5ef58 service nova] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Updated VIF entry in instance network info cache for port 8b6fe644-7df3-429e-baa8-ab6407034e32. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:16:30 user nova-compute[72362]: DEBUG nova.network.neutron [req-b84da024-976d-4642-808c-7a553c986530 req-b4ea178b-ac21-4b0b-800c-6f2f3bd5ef58 service nova] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Updating instance_info_cache with network_info: [{"id": "8b6fe644-7df3-429e-baa8-ab6407034e32", "address": "fa:16:3e:63:7f:a8", "network": {"id": "45d52d71-edd6-4126-ba59-31d3c42169b9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1828391472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29102931855a43efb23963382ca5d4f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b6fe644-7d", "ovs_interfaceid": "8b6fe644-7df3-429e-baa8-ab6407034e32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:16:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b84da024-976d-4642-808c-7a553c986530 req-b4ea178b-ac21-4b0b-800c-6f2f3bd5ef58 service nova] Releasing lock "refresh_cache-8f0c62c9-aa84-4a5b-b909-af5535e87c83" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:16:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:31 user nova-compute[72362]: DEBUG nova.network.neutron [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Updating instance_info_cache with network_info: [{"id": "76c0daec-94af-49ef-b33c-73925b6fb175", "address": "fa:16:3e:0d:a8:5c", "network": {"id": "8cf43717-164f-47a3-859d-66488f6725ea", "bridge": "br-int", "label": "tempest-TestVolumeSwap-365627362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eadf3da29124620a2ec066a13cbf2c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76c0daec-94", "ovs_interfaceid": "76c0daec-94af-49ef-b33c-73925b6fb175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:16:31 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Releasing lock "refresh_cache-b17b317a-409e-45ad-ac7c-0c298f4f564b" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:16:31 user nova-compute[72362]: DEBUG nova.compute.manager [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Instance network_info: |[{"id": "76c0daec-94af-49ef-b33c-73925b6fb175", "address": "fa:16:3e:0d:a8:5c", "network": {"id": "8cf43717-164f-47a3-859d-66488f6725ea", "bridge": "br-int", "label": "tempest-TestVolumeSwap-365627362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eadf3da29124620a2ec066a13cbf2c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76c0daec-94", "ovs_interfaceid": "76c0daec-94af-49ef-b33c-73925b6fb175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 10:16:31 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f0c3f384-ff8a-4418-86f0-19026163ab8e req-5aae940f-8d7a-45eb-a3aa-a0c2e1f1de7d service nova] Acquired lock "refresh_cache-b17b317a-409e-45ad-ac7c-0c298f4f564b" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:16:31 user nova-compute[72362]: DEBUG nova.network.neutron [req-f0c3f384-ff8a-4418-86f0-19026163ab8e req-5aae940f-8d7a-45eb-a3aa-a0c2e1f1de7d service nova] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Refreshing network info cache for port 76c0daec-94af-49ef-b33c-73925b6fb175 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:16:31 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Start _get_guest_xml network_info=[{"id": "76c0daec-94af-49ef-b33c-73925b6fb175", "address": "fa:16:3e:0d:a8:5c", "network": {"id": "8cf43717-164f-47a3-859d-66488f6725ea", "bridge": "br-int", "label": "tempest-TestVolumeSwap-365627362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eadf3da29124620a2ec066a13cbf2c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76c0daec-94", "ovs_interfaceid": "76c0daec-94af-49ef-b33c-73925b6fb175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': 'a08d1a11-49eb-4212-a351-e11ee9553b95'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:16:31 user nova-compute[72362]: DEBUG nova.compute.manager [req-564a7441-1bd4-497f-a8c1-823043f29f0a req-09dd8a00-fa33-46e9-99a4-4e15534adaf2 service nova] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Received event network-vif-plugged-fc1688e4-e2d3-4f8f-be55-4a6793ae4497 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:16:31 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-564a7441-1bd4-497f-a8c1-823043f29f0a req-09dd8a00-fa33-46e9-99a4-4e15534adaf2 service nova] Acquiring lock "ea95226c-40fe-4408-a9f0-5538659261a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:31 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-564a7441-1bd4-497f-a8c1-823043f29f0a req-09dd8a00-fa33-46e9-99a4-4e15534adaf2 service nova] Lock "ea95226c-40fe-4408-a9f0-5538659261a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:31 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-564a7441-1bd4-497f-a8c1-823043f29f0a req-09dd8a00-fa33-46e9-99a4-4e15534adaf2 service nova] Lock "ea95226c-40fe-4408-a9f0-5538659261a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:31 user nova-compute[72362]: DEBUG nova.compute.manager [req-564a7441-1bd4-497f-a8c1-823043f29f0a req-09dd8a00-fa33-46e9-99a4-4e15534adaf2 service nova] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] No waiting events found dispatching network-vif-plugged-fc1688e4-e2d3-4f8f-be55-4a6793ae4497 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:16:31 user nova-compute[72362]: WARNING nova.compute.manager [req-564a7441-1bd4-497f-a8c1-823043f29f0a req-09dd8a00-fa33-46e9-99a4-4e15534adaf2 service nova] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Received unexpected event network-vif-plugged-fc1688e4-e2d3-4f8f-be55-4a6793ae4497 for instance with vm_state building and task_state spawning.
Aug 09 10:16:31 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:16:31 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:16:31 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:16:31 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:16:31 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:16:31 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:16:31 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:16:31 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:16:31 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:16:31 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:16:31 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:16:31 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:16:31 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:16:31 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:16:31 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:16:31 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:16:31 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:16:31 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:16:31 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:16:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1809299077',display_name='tempest-TestVolumeSwap-server-1809299077',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1809299077',id=6,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2Gz8XzDN7Je5NY8tGYVDzF64Yimgs6RHbgxOC5jc5XitNw/UEqfbDiCSmudIZcuCTMrfrI0dJXdCkL9cdctYTZFfc5bZMwGF/evkmd65qtVZXMhhdU2Kqaif1mmANddw==',key_name='tempest-keypair-920893137',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eadf3da29124620a2ec066a13cbf2c8',ramdisk_id='',reservation_id='r-9ua0am2z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1355303837',owner_user_name='tempest-TestVolumeSwap-1355303837-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:16:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9cb836c99dd84cd2a8cddefaca58a3c9',uuid=b17b317a-409e-45ad-ac7c-0c298f4f564b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76c0daec-94af-49ef-b33c-73925b6fb175", "address": "fa:16:3e:0d:a8:5c", "network": {"id": "8cf43717-164f-47a3-859d-66488f6725ea", "bridge": "br-int", "label": "tempest-TestVolumeSwap-365627362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eadf3da29124620a2ec066a13cbf2c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76c0daec-94", "ovs_interfaceid": "76c0daec-94af-49ef-b33c-73925b6fb175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:16:31 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Converting VIF {"id": "76c0daec-94af-49ef-b33c-73925b6fb175", "address": "fa:16:3e:0d:a8:5c", "network": {"id": "8cf43717-164f-47a3-859d-66488f6725ea", "bridge": "br-int", "label": "tempest-TestVolumeSwap-365627362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eadf3da29124620a2ec066a13cbf2c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76c0daec-94", "ovs_interfaceid": "76c0daec-94af-49ef-b33c-73925b6fb175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:16:31 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:a8:5c,bridge_name='br-int',has_traffic_filtering=True,id=76c0daec-94af-49ef-b33c-73925b6fb175,network=Network(8cf43717-164f-47a3-859d-66488f6725ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76c0daec-94') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:16:31 user nova-compute[72362]: DEBUG nova.objects.instance [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Lazy-loading 'pci_devices' on Instance uuid b17b317a-409e-45ad-ac7c-0c298f4f564b {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:16:31 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:16:31 user nova-compute[72362]:   <uuid>b17b317a-409e-45ad-ac7c-0c298f4f564b</uuid>
Aug 09 10:16:31 user nova-compute[72362]:   <name>instance-00000006</name>
Aug 09 10:16:31 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:16:31 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:16:31 user nova-compute[72362]:   <metadata>
Aug 09 10:16:31 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:16:31 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:16:31 user nova-compute[72362]:       <nova:name>tempest-TestVolumeSwap-server-1809299077</nova:name>
Aug 09 10:16:31 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:16:31</nova:creationTime>
Aug 09 10:16:31 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:16:31 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:16:31 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:16:31 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:16:31 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:16:31 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:16:31 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:16:31 user nova-compute[72362]:       <nova:owner>
Aug 09 10:16:31 user nova-compute[72362]:         <nova:user uuid="9cb836c99dd84cd2a8cddefaca58a3c9">tempest-TestVolumeSwap-1355303837-project-member</nova:user>
Aug 09 10:16:31 user nova-compute[72362]:         <nova:project uuid="9eadf3da29124620a2ec066a13cbf2c8">tempest-TestVolumeSwap-1355303837</nova:project>
Aug 09 10:16:31 user nova-compute[72362]:       </nova:owner>
Aug 09 10:16:31 user nova-compute[72362]:       <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:16:31 user nova-compute[72362]:       <nova:ports>
Aug 09 10:16:31 user nova-compute[72362]:         <nova:port uuid="76c0daec-94af-49ef-b33c-73925b6fb175">
Aug 09 10:16:31 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 09 10:16:31 user nova-compute[72362]:         </nova:port>
Aug 09 10:16:31 user nova-compute[72362]:       </nova:ports>
Aug 09 10:16:31 user nova-compute[72362]:     </nova:instance>
Aug 09 10:16:31 user nova-compute[72362]:   </metadata>
Aug 09 10:16:31 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:16:31 user nova-compute[72362]:     <system>
Aug 09 10:16:31 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:16:31 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:16:31 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:16:31 user nova-compute[72362]:       <entry name="serial">b17b317a-409e-45ad-ac7c-0c298f4f564b</entry>
Aug 09 10:16:31 user nova-compute[72362]:       <entry name="uuid">b17b317a-409e-45ad-ac7c-0c298f4f564b</entry>
Aug 09 10:16:31 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:16:31 user nova-compute[72362]:     </system>
Aug 09 10:16:31 user nova-compute[72362]:   </sysinfo>
Aug 09 10:16:31 user nova-compute[72362]:   <os>
Aug 09 10:16:31 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:16:31 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:16:31 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:16:31 user nova-compute[72362]:   </os>
Aug 09 10:16:31 user nova-compute[72362]:   <features>
Aug 09 10:16:31 user nova-compute[72362]:     <acpi/>
Aug 09 10:16:31 user nova-compute[72362]:     <apic/>
Aug 09 10:16:31 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:16:31 user nova-compute[72362]:   </features>
Aug 09 10:16:31 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:16:31 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:16:31 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:16:31 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:16:31 user nova-compute[72362]:   </clock>
Aug 09 10:16:31 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:16:31 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:16:31 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:16:31 user nova-compute[72362]:   </cpu>
Aug 09 10:16:31 user nova-compute[72362]:   <devices>
Aug 09 10:16:31 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:16:31 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:16:31 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/b17b317a-409e-45ad-ac7c-0c298f4f564b/disk"/>
Aug 09 10:16:31 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:16:31 user nova-compute[72362]:     </disk>
Aug 09 10:16:31 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:16:31 user nova-compute[72362]:       <mac address="fa:16:3e:0d:a8:5c"/>
Aug 09 10:16:31 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:16:31 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:16:31 user nova-compute[72362]:       <target dev="tap76c0daec-94"/>
Aug 09 10:16:31 user nova-compute[72362]:     </interface>
Aug 09 10:16:31 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:16:31 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/b17b317a-409e-45ad-ac7c-0c298f4f564b/console.log" append="off"/>
Aug 09 10:16:31 user nova-compute[72362]:     </serial>
Aug 09 10:16:31 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:16:31 user nova-compute[72362]:     <video>
Aug 09 10:16:31 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:16:31 user nova-compute[72362]:     </video>
Aug 09 10:16:31 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:16:31 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:16:31 user nova-compute[72362]:     </rng>
Aug 09 10:16:31 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:16:31 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:16:31 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:16:31 user nova-compute[72362]:     </memballoon>
Aug 09 10:16:31 user nova-compute[72362]:   </devices>
Aug 09 10:16:31 user nova-compute[72362]: </domain>
Aug 09 10:16:31 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:16:31 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:16:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1809299077',display_name='tempest-TestVolumeSwap-server-1809299077',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1809299077',id=6,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2Gz8XzDN7Je5NY8tGYVDzF64Yimgs6RHbgxOC5jc5XitNw/UEqfbDiCSmudIZcuCTMrfrI0dJXdCkL9cdctYTZFfc5bZMwGF/evkmd65qtVZXMhhdU2Kqaif1mmANddw==',key_name='tempest-keypair-920893137',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eadf3da29124620a2ec066a13cbf2c8',ramdisk_id='',reservation_id='r-9ua0am2z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1355303837',owner_user_name='tempest-TestVolumeSwap-1355303837-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:16:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9cb836c99dd84cd2a8cddefaca58a3c9',uuid=b17b317a-409e-45ad-ac7c-0c298f4f564b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76c0daec-94af-49ef-b33c-73925b6fb175", "address": "fa:16:3e:0d:a8:5c", "network": {"id": "8cf43717-164f-47a3-859d-66488f6725ea", "bridge": "br-int", "label": "tempest-TestVolumeSwap-365627362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eadf3da29124620a2ec066a13cbf2c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76c0daec-94", "ovs_interfaceid": "76c0daec-94af-49ef-b33c-73925b6fb175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:16:31 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Converting VIF {"id": "76c0daec-94af-49ef-b33c-73925b6fb175", "address": "fa:16:3e:0d:a8:5c", "network": {"id": "8cf43717-164f-47a3-859d-66488f6725ea", "bridge": "br-int", "label": "tempest-TestVolumeSwap-365627362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eadf3da29124620a2ec066a13cbf2c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76c0daec-94", "ovs_interfaceid": "76c0daec-94af-49ef-b33c-73925b6fb175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:16:31 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:a8:5c,bridge_name='br-int',has_traffic_filtering=True,id=76c0daec-94af-49ef-b33c-73925b6fb175,network=Network(8cf43717-164f-47a3-859d-66488f6725ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76c0daec-94') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:16:31 user nova-compute[72362]: DEBUG os_vif [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:a8:5c,bridge_name='br-int',has_traffic_filtering=True,id=76c0daec-94af-49ef-b33c-73925b6fb175,network=Network(8cf43717-164f-47a3-859d-66488f6725ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76c0daec-94') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:16:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:16:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:16:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap76c0daec-94, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:16:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap76c0daec-94, col_values=(('external_ids', {'iface-id': '76c0daec-94af-49ef-b33c-73925b6fb175', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:a8:5c', 'vm-uuid': 'b17b317a-409e-45ad-ac7c-0c298f4f564b'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:16:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:16:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:31 user nova-compute[72362]: INFO os_vif [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:a8:5c,bridge_name='br-int',has_traffic_filtering=True,id=76c0daec-94af-49ef-b33c-73925b6fb175,network=Network(8cf43717-164f-47a3-859d-66488f6725ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76c0daec-94')
Aug 09 10:16:32 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:16:32 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] No VIF found with MAC fa:16:3e:0d:a8:5c, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:16:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:32 user nova-compute[72362]: DEBUG nova.network.neutron [req-f0c3f384-ff8a-4418-86f0-19026163ab8e req-5aae940f-8d7a-45eb-a3aa-a0c2e1f1de7d service nova] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Updated VIF entry in instance network info cache for port 76c0daec-94af-49ef-b33c-73925b6fb175. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:16:32 user nova-compute[72362]: DEBUG nova.network.neutron [req-f0c3f384-ff8a-4418-86f0-19026163ab8e req-5aae940f-8d7a-45eb-a3aa-a0c2e1f1de7d service nova] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Updating instance_info_cache with network_info: [{"id": "76c0daec-94af-49ef-b33c-73925b6fb175", "address": "fa:16:3e:0d:a8:5c", "network": {"id": "8cf43717-164f-47a3-859d-66488f6725ea", "bridge": "br-int", "label": "tempest-TestVolumeSwap-365627362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eadf3da29124620a2ec066a13cbf2c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76c0daec-94", "ovs_interfaceid": "76c0daec-94af-49ef-b33c-73925b6fb175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:16:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f0c3f384-ff8a-4418-86f0-19026163ab8e req-5aae940f-8d7a-45eb-a3aa-a0c2e1f1de7d service nova] Releasing lock "refresh_cache-b17b317a-409e-45ad-ac7c-0c298f4f564b" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:16:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Acquiring lock "00af3d8e-bd93-4520-91e7-29c135c03e55" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Lock "00af3d8e-bd93-4520-91e7-29c135c03e55" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:33 user nova-compute[72362]: DEBUG nova.compute.manager [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Starting instance... {{(pid=72362) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 10:16:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:33 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:16:33 user nova-compute[72362]: INFO nova.compute.claims [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Claim successful on node user
Aug 09 10:16:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Acquiring lock "9f2bc700-2e69-406f-9a13-52396eae4258" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Lock "9f2bc700-2e69-406f-9a13-52396eae4258" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:33 user nova-compute[72362]: DEBUG nova.compute.manager [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Starting instance... {{(pid=72362) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 10:16:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:33 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:16:33 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:16:33 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:33 user nova-compute[72362]: DEBUG nova.compute.manager [req-96fd1ed0-6b06-413d-9ad8-06a18015c735 req-390df857-4d77-4548-a4a7-cc9db095e23d service nova] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Received event network-vif-plugged-fc1688e4-e2d3-4f8f-be55-4a6793ae4497 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:16:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-96fd1ed0-6b06-413d-9ad8-06a18015c735 req-390df857-4d77-4548-a4a7-cc9db095e23d service nova] Acquiring lock "ea95226c-40fe-4408-a9f0-5538659261a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-96fd1ed0-6b06-413d-9ad8-06a18015c735 req-390df857-4d77-4548-a4a7-cc9db095e23d service nova] Lock "ea95226c-40fe-4408-a9f0-5538659261a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.010s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-96fd1ed0-6b06-413d-9ad8-06a18015c735 req-390df857-4d77-4548-a4a7-cc9db095e23d service nova] Lock "ea95226c-40fe-4408-a9f0-5538659261a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:33 user nova-compute[72362]: DEBUG nova.compute.manager [req-96fd1ed0-6b06-413d-9ad8-06a18015c735 req-390df857-4d77-4548-a4a7-cc9db095e23d service nova] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] No waiting events found dispatching network-vif-plugged-fc1688e4-e2d3-4f8f-be55-4a6793ae4497 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:16:33 user nova-compute[72362]: WARNING nova.compute.manager [req-96fd1ed0-6b06-413d-9ad8-06a18015c735 req-390df857-4d77-4548-a4a7-cc9db095e23d service nova] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Received unexpected event network-vif-plugged-fc1688e4-e2d3-4f8f-be55-4a6793ae4497 for instance with vm_state building and task_state spawning.
Aug 09 10:16:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.635s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:33 user nova-compute[72362]: DEBUG nova.compute.manager [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Start building networks asynchronously for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 10:16:33 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.215s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:33 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:33 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:16:33 user nova-compute[72362]: INFO nova.compute.claims [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Claim successful on node user
Aug 09 10:16:33 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:34 user nova-compute[72362]: DEBUG nova.compute.manager [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Allocating IP information in the background. {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 10:16:34 user nova-compute[72362]: DEBUG nova.network.neutron [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] allocate_for_instance() {{(pid=72362) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 10:16:34 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 10:16:34 user nova-compute[72362]: DEBUG nova.compute.manager [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Start building block device mappings for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 10:16:34 user nova-compute[72362]: DEBUG nova.policy [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5dd4d0e5c03744569a542098432622d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a68b4a52019441480a19783a89e0af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72362) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 10:16:34 user nova-compute[72362]: DEBUG nova.compute.manager [req-7541d717-b46a-47b4-a997-db019f36982b req-1c701d67-4a19-4186-9884-8b86aeb8c46e service nova] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Received event network-vif-plugged-8b6fe644-7df3-429e-baa8-ab6407034e32 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:16:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-7541d717-b46a-47b4-a997-db019f36982b req-1c701d67-4a19-4186-9884-8b86aeb8c46e service nova] Acquiring lock "8f0c62c9-aa84-4a5b-b909-af5535e87c83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-7541d717-b46a-47b4-a997-db019f36982b req-1c701d67-4a19-4186-9884-8b86aeb8c46e service nova] Lock "8f0c62c9-aa84-4a5b-b909-af5535e87c83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-7541d717-b46a-47b4-a997-db019f36982b req-1c701d67-4a19-4186-9884-8b86aeb8c46e service nova] Lock "8f0c62c9-aa84-4a5b-b909-af5535e87c83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:34 user nova-compute[72362]: DEBUG nova.compute.manager [req-7541d717-b46a-47b4-a997-db019f36982b req-1c701d67-4a19-4186-9884-8b86aeb8c46e service nova] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] No waiting events found dispatching network-vif-plugged-8b6fe644-7df3-429e-baa8-ab6407034e32 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:16:34 user nova-compute[72362]: WARNING nova.compute.manager [req-7541d717-b46a-47b4-a997-db019f36982b req-1c701d67-4a19-4186-9884-8b86aeb8c46e service nova] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Received unexpected event network-vif-plugged-8b6fe644-7df3-429e-baa8-ab6407034e32 for instance with vm_state building and task_state spawning.
Aug 09 10:16:34 user nova-compute[72362]: DEBUG nova.compute.manager [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Start spawning the instance on the hypervisor. {{(pid=72362) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 10:16:34 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:16:34 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Creating image(s)
Aug 09 10:16:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Acquiring lock "/opt/stack/data/nova/instances/00af3d8e-bd93-4520-91e7-29c135c03e55/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Lock "/opt/stack/data/nova/instances/00af3d8e-bd93-4520-91e7-29c135c03e55/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Lock "/opt/stack/data/nova/instances/00af3d8e-bd93-4520-91e7-29c135c03e55/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:34 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:34 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:34 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.159s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Acquiring lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:34 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:16:34 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:16:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.156s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/00af3d8e-bd93-4520-91e7-29c135c03e55/disk 1073741824 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.667s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:34 user nova-compute[72362]: DEBUG nova.compute.manager [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Start building networks asynchronously for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 10:16:34 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/00af3d8e-bd93-4520-91e7-29c135c03e55/disk 1073741824" returned: 0 in 0.082s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:34 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:34 user nova-compute[72362]: DEBUG nova.compute.manager [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Allocating IP information in the background. {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 10:16:34 user nova-compute[72362]: DEBUG nova.network.neutron [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] allocate_for_instance() {{(pid=72362) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 10:16:34 user nova-compute[72362]: DEBUG nova.compute.manager [req-ee4406b5-9fda-40c2-9622-299b98a7471a req-999a5c5a-6056-4fcc-9ea4-96d91002b881 service nova] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Received event network-vif-plugged-76c0daec-94af-49ef-b33c-73925b6fb175 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:16:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ee4406b5-9fda-40c2-9622-299b98a7471a req-999a5c5a-6056-4fcc-9ea4-96d91002b881 service nova] Acquiring lock "b17b317a-409e-45ad-ac7c-0c298f4f564b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ee4406b5-9fda-40c2-9622-299b98a7471a req-999a5c5a-6056-4fcc-9ea4-96d91002b881 service nova] Lock "b17b317a-409e-45ad-ac7c-0c298f4f564b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ee4406b5-9fda-40c2-9622-299b98a7471a req-999a5c5a-6056-4fcc-9ea4-96d91002b881 service nova] Lock "b17b317a-409e-45ad-ac7c-0c298f4f564b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:34 user nova-compute[72362]: DEBUG nova.compute.manager [req-ee4406b5-9fda-40c2-9622-299b98a7471a req-999a5c5a-6056-4fcc-9ea4-96d91002b881 service nova] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] No waiting events found dispatching network-vif-plugged-76c0daec-94af-49ef-b33c-73925b6fb175 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:16:34 user nova-compute[72362]: WARNING nova.compute.manager [req-ee4406b5-9fda-40c2-9622-299b98a7471a req-999a5c5a-6056-4fcc-9ea4-96d91002b881 service nova] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Received unexpected event network-vif-plugged-76c0daec-94af-49ef-b33c-73925b6fb175 for instance with vm_state building and task_state spawning.
Aug 09 10:16:34 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 09 10:16:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.167s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:34 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Checking if we can resize image /opt/stack/data/nova/instances/00af3d8e-bd93-4520-91e7-29c135c03e55/disk. size=1073741824 {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 10:16:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00af3d8e-bd93-4520-91e7-29c135c03e55/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:34 user nova-compute[72362]: DEBUG nova.compute.manager [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Start building block device mappings for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 10:16:34 user nova-compute[72362]: DEBUG nova.policy [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd2b67a8ab3374254bca409f342f74c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098495c0d3ac4b9caa895f9ba60e4b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72362) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 10:16:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00af3d8e-bd93-4520-91e7-29c135c03e55/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:35 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Cannot resize image /opt/stack/data/nova/instances/00af3d8e-bd93-4520-91e7-29c135c03e55/disk to a smaller size. {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 10:16:35 user nova-compute[72362]: DEBUG nova.objects.instance [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Lazy-loading 'migration_context' on Instance uuid 00af3d8e-bd93-4520-91e7-29c135c03e55 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:16:35 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Created local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 10:16:35 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Ensure instance console log exists: /opt/stack/data/nova/instances/00af3d8e-bd93-4520-91e7-29c135c03e55/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:16:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:35 user nova-compute[72362]: DEBUG nova.compute.manager [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Start spawning the instance on the hypervisor. {{(pid=72362) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 10:16:35 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:16:35 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Creating image(s)
Aug 09 10:16:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Acquiring lock "/opt/stack/data/nova/instances/9f2bc700-2e69-406f-9a13-52396eae4258/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Lock "/opt/stack/data/nova/instances/9f2bc700-2e69-406f-9a13-52396eae4258/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Lock "/opt/stack/data/nova/instances/9f2bc700-2e69-406f-9a13-52396eae4258/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Acquiring lock "82f16d36bf0ae6e4ff0476166669ac0ab185d172" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Lock "82f16d36bf0ae6e4ff0476166669ac0ab185d172" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82f16d36bf0ae6e4ff0476166669ac0ab185d172.part --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:35 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:35 user nova-compute[72362]: DEBUG nova.network.neutron [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Successfully created port: 1efbc456-6c56-4367-845f-0afa8acdcec4 {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:16:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82f16d36bf0ae6e4ff0476166669ac0ab185d172.part --force-share --output=json" returned: 0 in 0.203s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:35 user nova-compute[72362]: DEBUG nova.virt.images [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] 935787e9-b90d-4cc2-8655-783953b40fb0 was qcow2, converting to raw {{(pid=72362) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 10:16:35 user nova-compute[72362]: DEBUG nova.privsep.utils [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72362) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 10:16:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/82f16d36bf0ae6e4ff0476166669ac0ab185d172.part /opt/stack/data/nova/instances/_base/82f16d36bf0ae6e4ff0476166669ac0ab185d172.converted {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:36 user nova-compute[72362]: DEBUG nova.network.neutron [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Successfully created port: d1a1302a-fe35-4d60-b89c-b5ef5f0dee76 {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:16:36 user nova-compute[72362]: DEBUG nova.compute.manager [req-878a84de-507d-4c5f-b1f7-3a2ee516211e req-f7ace3aa-eb61-4e43-aa53-62c0b5f23366 service nova] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Received event network-vif-plugged-8b6fe644-7df3-429e-baa8-ab6407034e32 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:16:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-878a84de-507d-4c5f-b1f7-3a2ee516211e req-f7ace3aa-eb61-4e43-aa53-62c0b5f23366 service nova] Acquiring lock "8f0c62c9-aa84-4a5b-b909-af5535e87c83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-878a84de-507d-4c5f-b1f7-3a2ee516211e req-f7ace3aa-eb61-4e43-aa53-62c0b5f23366 service nova] Lock "8f0c62c9-aa84-4a5b-b909-af5535e87c83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-878a84de-507d-4c5f-b1f7-3a2ee516211e req-f7ace3aa-eb61-4e43-aa53-62c0b5f23366 service nova] Lock "8f0c62c9-aa84-4a5b-b909-af5535e87c83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:36 user nova-compute[72362]: DEBUG nova.compute.manager [req-878a84de-507d-4c5f-b1f7-3a2ee516211e req-f7ace3aa-eb61-4e43-aa53-62c0b5f23366 service nova] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] No waiting events found dispatching network-vif-plugged-8b6fe644-7df3-429e-baa8-ab6407034e32 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:16:36 user nova-compute[72362]: WARNING nova.compute.manager [req-878a84de-507d-4c5f-b1f7-3a2ee516211e req-f7ace3aa-eb61-4e43-aa53-62c0b5f23366 service nova] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Received unexpected event network-vif-plugged-8b6fe644-7df3-429e-baa8-ab6407034e32 for instance with vm_state building and task_state spawning.
Aug 09 10:16:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/82f16d36bf0ae6e4ff0476166669ac0ab185d172.part /opt/stack/data/nova/instances/_base/82f16d36bf0ae6e4ff0476166669ac0ab185d172.converted" returned: 0 in 0.542s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82f16d36bf0ae6e4ff0476166669ac0ab185d172.converted --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82f16d36bf0ae6e4ff0476166669ac0ab185d172.converted --force-share --output=json" returned: 0 in 0.163s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Lock "82f16d36bf0ae6e4ff0476166669ac0ab185d172" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.654s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82f16d36bf0ae6e4ff0476166669ac0ab185d172 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:36 user nova-compute[72362]: DEBUG nova.compute.manager [req-89400540-1ce9-4fde-9af8-36a9d035291d req-b15db692-cbab-4b9c-b6c2-137229dc07d0 service nova] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Received event network-vif-plugged-76c0daec-94af-49ef-b33c-73925b6fb175 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:16:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-89400540-1ce9-4fde-9af8-36a9d035291d req-b15db692-cbab-4b9c-b6c2-137229dc07d0 service nova] Acquiring lock "b17b317a-409e-45ad-ac7c-0c298f4f564b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-89400540-1ce9-4fde-9af8-36a9d035291d req-b15db692-cbab-4b9c-b6c2-137229dc07d0 service nova] Lock "b17b317a-409e-45ad-ac7c-0c298f4f564b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-89400540-1ce9-4fde-9af8-36a9d035291d req-b15db692-cbab-4b9c-b6c2-137229dc07d0 service nova] Lock "b17b317a-409e-45ad-ac7c-0c298f4f564b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:36 user nova-compute[72362]: DEBUG nova.compute.manager [req-89400540-1ce9-4fde-9af8-36a9d035291d req-b15db692-cbab-4b9c-b6c2-137229dc07d0 service nova] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] No waiting events found dispatching network-vif-plugged-76c0daec-94af-49ef-b33c-73925b6fb175 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:16:36 user nova-compute[72362]: WARNING nova.compute.manager [req-89400540-1ce9-4fde-9af8-36a9d035291d req-b15db692-cbab-4b9c-b6c2-137229dc07d0 service nova] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Received unexpected event network-vif-plugged-76c0daec-94af-49ef-b33c-73925b6fb175 for instance with vm_state building and task_state spawning.
Aug 09 10:16:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82f16d36bf0ae6e4ff0476166669ac0ab185d172 --force-share --output=json" returned: 0 in 0.218s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Acquiring lock "82f16d36bf0ae6e4ff0476166669ac0ab185d172" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Lock "82f16d36bf0ae6e4ff0476166669ac0ab185d172" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82f16d36bf0ae6e4ff0476166669ac0ab185d172 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82f16d36bf0ae6e4ff0476166669ac0ab185d172 --force-share --output=json" returned: 0 in 0.151s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82f16d36bf0ae6e4ff0476166669ac0ab185d172,backing_fmt=raw /opt/stack/data/nova/instances/9f2bc700-2e69-406f-9a13-52396eae4258/disk 1073741824 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.network.neutron [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Successfully updated port: 1efbc456-6c56-4367-845f-0afa8acdcec4 {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Acquiring lock "refresh_cache-00af3d8e-bd93-4520-91e7-29c135c03e55" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Acquired lock "refresh_cache-00af3d8e-bd93-4520-91e7-29c135c03e55" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.network.neutron [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82f16d36bf0ae6e4ff0476166669ac0ab185d172,backing_fmt=raw /opt/stack/data/nova/instances/9f2bc700-2e69-406f-9a13-52396eae4258/disk 1073741824" returned: 0 in 0.197s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Lock "82f16d36bf0ae6e4ff0476166669ac0ab185d172" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.356s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82f16d36bf0ae6e4ff0476166669ac0ab185d172 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.network.neutron [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.compute.manager [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576197.4286706, ea95226c-40fe-4408-a9f0-5538659261a6 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:16:37 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] VM Resumed (Lifecycle Event)
Aug 09 10:16:37 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Instance spawned successfully.
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.compute.manager [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82f16d36bf0ae6e4ff0476166669ac0ab185d172 --force-share --output=json" returned: 0 in 0.186s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9f2bc700-2e69-406f-9a13-52396eae4258/disk. size=1073741824 {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f2bc700-2e69-406f-9a13-52396eae4258/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:37 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576197.4294057, ea95226c-40fe-4408-a9f0-5538659261a6 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:16:37 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] VM Started (Lifecycle Event)
Aug 09 10:16:37 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Instance spawned successfully.
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Found default for hw_cdrom_bus of ide {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Found default for hw_disk_bus of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Found default for hw_video_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Found default for hw_vif_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Found default for hw_cdrom_bus of ide {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Found default for hw_disk_bus of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Found default for hw_video_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Found default for hw_vif_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f2bc700-2e69-406f-9a13-52396eae4258/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Cannot resize image /opt/stack/data/nova/instances/9f2bc700-2e69-406f-9a13-52396eae4258/disk to a smaller size. {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.objects.instance [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Lazy-loading 'migration_context' on Instance uuid 9f2bc700-2e69-406f-9a13-52396eae4258 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:16:37 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576197.4736965, 8f0c62c9-aa84-4a5b-b909-af5535e87c83 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:16:37 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] VM Resumed (Lifecycle Event)
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.network.neutron [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Successfully updated port: d1a1302a-fe35-4d60-b89c-b5ef5f0dee76 {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Created local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Ensure instance console log exists: /opt/stack/data/nova/instances/9f2bc700-2e69-406f-9a13-52396eae4258/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:16:37 user nova-compute[72362]: INFO nova.compute.manager [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Took 12.64 seconds to spawn the instance on the hypervisor.
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.compute.manager [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Acquiring lock "refresh_cache-9f2bc700-2e69-406f-9a13-52396eae4258" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Acquired lock "refresh_cache-9f2bc700-2e69-406f-9a13-52396eae4258" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.network.neutron [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.compute.manager [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.compute.manager [req-5998c614-db33-4f73-a112-16396bfee1a4 req-c4261a4f-142f-4eba-a2f1-00f6392108a9 service nova] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Received event network-changed-d1a1302a-fe35-4d60-b89c-b5ef5f0dee76 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.compute.manager [req-5998c614-db33-4f73-a112-16396bfee1a4 req-c4261a4f-142f-4eba-a2f1-00f6392108a9 service nova] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Refreshing instance network info cache due to event network-changed-d1a1302a-fe35-4d60-b89c-b5ef5f0dee76. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-5998c614-db33-4f73-a112-16396bfee1a4 req-c4261a4f-142f-4eba-a2f1-00f6392108a9 service nova] Acquiring lock "refresh_cache-9f2bc700-2e69-406f-9a13-52396eae4258" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:16:37 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576197.4754303, 8f0c62c9-aa84-4a5b-b909-af5535e87c83 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:16:37 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] VM Started (Lifecycle Event)
Aug 09 10:16:37 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Instance spawned successfully.
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.network.neutron [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:16:37 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576197.7324538, b17b317a-409e-45ad-ac7c-0c298f4f564b => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:16:37 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] VM Resumed (Lifecycle Event)
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Found default for hw_cdrom_bus of ide {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Found default for hw_disk_bus of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Found default for hw_video_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Found default for hw_vif_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:16:37 user nova-compute[72362]: INFO nova.compute.manager [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Took 13.80 seconds to build instance.
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:16:37 user nova-compute[72362]: INFO nova.compute.manager [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Took 11.37 seconds to spawn the instance on the hypervisor.
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.compute.manager [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6f6c77e1-78aa-4164-b4ff-21725010432f tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Lock "ea95226c-40fe-4408-a9f0-5538659261a6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.173s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:37 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576197.7325537, b17b317a-409e-45ad-ac7c-0c298f4f564b => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:16:37 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] VM Started (Lifecycle Event)
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.network.neutron [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Updating instance_info_cache with network_info: [{"id": "1efbc456-6c56-4367-845f-0afa8acdcec4", "address": "fa:16:3e:76:bd:21", "network": {"id": "1eaf9aa3-1d74-424c-86c6-28096cf53571", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-621134432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a68b4a52019441480a19783a89e0af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1efbc456-6c", "ovs_interfaceid": "1efbc456-6c56-4367-845f-0afa8acdcec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Releasing lock "refresh_cache-00af3d8e-bd93-4520-91e7-29c135c03e55" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.compute.manager [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Instance network_info: |[{"id": "1efbc456-6c56-4367-845f-0afa8acdcec4", "address": "fa:16:3e:76:bd:21", "network": {"id": "1eaf9aa3-1d74-424c-86c6-28096cf53571", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-621134432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a68b4a52019441480a19783a89e0af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1efbc456-6c", "ovs_interfaceid": "1efbc456-6c56-4367-845f-0afa8acdcec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 10:16:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Start _get_guest_xml network_info=[{"id": "1efbc456-6c56-4367-845f-0afa8acdcec4", "address": "fa:16:3e:76:bd:21", "network": {"id": "1eaf9aa3-1d74-424c-86c6-28096cf53571", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-621134432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a68b4a52019441480a19783a89e0af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1efbc456-6c", "ovs_interfaceid": "1efbc456-6c56-4367-845f-0afa8acdcec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': 'a08d1a11-49eb-4212-a351-e11ee9553b95'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:16:38 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:16:38 user nova-compute[72362]: INFO nova.compute.manager [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Took 12.71 seconds to build instance.
Aug 09 10:16:38 user nova-compute[72362]: INFO nova.compute.manager [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Took 10.92 seconds to spawn the instance on the hypervisor.
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.compute.manager [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:16:38 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:16:38 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:16:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4c141cef-4154-4a79-a828-228dcb058677 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Lock "8f0c62c9-aa84-4a5b-b909-af5535e87c83" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.898s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:16:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1129807899',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1129807899',id=7,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKTy1BEGFgb2LwPCE0l4ZdsIb1CDE+2z5XZX+3IOS7BmpUspCkv8nslwIBX+XdLBElH9a7nR/A5XVOfQJoXDwudCeZ0lpAUFsL0E9TcfQKbmNmV+/CzT9enkfH7jf9KfQ==',key_name='tempest-keypair-426982747',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a68b4a52019441480a19783a89e0af8',ramdisk_id='',reservation_id='r-80xqf6s8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-202820908',owner_user_name='tempest-TaggedAttachmentsTest-202820908-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:16:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5dd4d0e5c03744569a542098432622d7',uuid=00af3d8e-bd93-4520-91e7-29c135c03e55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1efbc456-6c56-4367-845f-0afa8acdcec4", "address": "fa:16:3e:76:bd:21", "network": {"id": "1eaf9aa3-1d74-424c-86c6-28096cf53571", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-621134432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a68b4a52019441480a19783a89e0af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1efbc456-6c", "ovs_interfaceid": "1efbc456-6c56-4367-845f-0afa8acdcec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Converting VIF {"id": "1efbc456-6c56-4367-845f-0afa8acdcec4", "address": "fa:16:3e:76:bd:21", "network": {"id": "1eaf9aa3-1d74-424c-86c6-28096cf53571", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-621134432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a68b4a52019441480a19783a89e0af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1efbc456-6c", "ovs_interfaceid": "1efbc456-6c56-4367-845f-0afa8acdcec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:bd:21,bridge_name='br-int',has_traffic_filtering=True,id=1efbc456-6c56-4367-845f-0afa8acdcec4,network=Network(1eaf9aa3-1d74-424c-86c6-28096cf53571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1efbc456-6c') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.objects.instance [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Lazy-loading 'pci_devices' on Instance uuid 00af3d8e-bd93-4520-91e7-29c135c03e55 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:16:38 user nova-compute[72362]:   <uuid>00af3d8e-bd93-4520-91e7-29c135c03e55</uuid>
Aug 09 10:16:38 user nova-compute[72362]:   <name>instance-00000007</name>
Aug 09 10:16:38 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:16:38 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:16:38 user nova-compute[72362]:   <metadata>
Aug 09 10:16:38 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:16:38 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:16:38 user nova-compute[72362]:       <nova:name>tempest-device-tagging-server-1129807899</nova:name>
Aug 09 10:16:38 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:16:38</nova:creationTime>
Aug 09 10:16:38 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:16:38 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:16:38 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:16:38 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:16:38 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:16:38 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:16:38 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:16:38 user nova-compute[72362]:       <nova:owner>
Aug 09 10:16:38 user nova-compute[72362]:         <nova:user uuid="5dd4d0e5c03744569a542098432622d7">tempest-TaggedAttachmentsTest-202820908-project-member</nova:user>
Aug 09 10:16:38 user nova-compute[72362]:         <nova:project uuid="7a68b4a52019441480a19783a89e0af8">tempest-TaggedAttachmentsTest-202820908</nova:project>
Aug 09 10:16:38 user nova-compute[72362]:       </nova:owner>
Aug 09 10:16:38 user nova-compute[72362]:       <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:16:38 user nova-compute[72362]:       <nova:ports>
Aug 09 10:16:38 user nova-compute[72362]:         <nova:port uuid="1efbc456-6c56-4367-845f-0afa8acdcec4">
Aug 09 10:16:38 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 10:16:38 user nova-compute[72362]:         </nova:port>
Aug 09 10:16:38 user nova-compute[72362]:       </nova:ports>
Aug 09 10:16:38 user nova-compute[72362]:     </nova:instance>
Aug 09 10:16:38 user nova-compute[72362]:   </metadata>
Aug 09 10:16:38 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:16:38 user nova-compute[72362]:     <system>
Aug 09 10:16:38 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:16:38 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:16:38 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:16:38 user nova-compute[72362]:       <entry name="serial">00af3d8e-bd93-4520-91e7-29c135c03e55</entry>
Aug 09 10:16:38 user nova-compute[72362]:       <entry name="uuid">00af3d8e-bd93-4520-91e7-29c135c03e55</entry>
Aug 09 10:16:38 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:16:38 user nova-compute[72362]:     </system>
Aug 09 10:16:38 user nova-compute[72362]:   </sysinfo>
Aug 09 10:16:38 user nova-compute[72362]:   <os>
Aug 09 10:16:38 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:16:38 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:16:38 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:16:38 user nova-compute[72362]:   </os>
Aug 09 10:16:38 user nova-compute[72362]:   <features>
Aug 09 10:16:38 user nova-compute[72362]:     <acpi/>
Aug 09 10:16:38 user nova-compute[72362]:     <apic/>
Aug 09 10:16:38 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:16:38 user nova-compute[72362]:   </features>
Aug 09 10:16:38 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:16:38 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:16:38 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:16:38 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:16:38 user nova-compute[72362]:   </clock>
Aug 09 10:16:38 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:16:38 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:16:38 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:16:38 user nova-compute[72362]:   </cpu>
Aug 09 10:16:38 user nova-compute[72362]:   <devices>
Aug 09 10:16:38 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:16:38 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:16:38 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/00af3d8e-bd93-4520-91e7-29c135c03e55/disk"/>
Aug 09 10:16:38 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:16:38 user nova-compute[72362]:     </disk>
Aug 09 10:16:38 user nova-compute[72362]:     <disk type="file" device="cdrom">
Aug 09 10:16:38 user nova-compute[72362]:       <driver name="qemu" type="raw" cache="none"/>
Aug 09 10:16:38 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/00af3d8e-bd93-4520-91e7-29c135c03e55/disk.config"/>
Aug 09 10:16:38 user nova-compute[72362]:       <target dev="hda" bus="ide"/>
Aug 09 10:16:38 user nova-compute[72362]:     </disk>
Aug 09 10:16:38 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:16:38 user nova-compute[72362]:       <mac address="fa:16:3e:76:bd:21"/>
Aug 09 10:16:38 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:16:38 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:16:38 user nova-compute[72362]:       <target dev="tap1efbc456-6c"/>
Aug 09 10:16:38 user nova-compute[72362]:     </interface>
Aug 09 10:16:38 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:16:38 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/00af3d8e-bd93-4520-91e7-29c135c03e55/console.log" append="off"/>
Aug 09 10:16:38 user nova-compute[72362]:     </serial>
Aug 09 10:16:38 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:16:38 user nova-compute[72362]:     <video>
Aug 09 10:16:38 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:16:38 user nova-compute[72362]:     </video>
Aug 09 10:16:38 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:16:38 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:16:38 user nova-compute[72362]:     </rng>
Aug 09 10:16:38 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:16:38 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:16:38 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:16:38 user nova-compute[72362]:     </memballoon>
Aug 09 10:16:38 user nova-compute[72362]:   </devices>
Aug 09 10:16:38 user nova-compute[72362]: </domain>
Aug 09 10:16:38 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:16:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1129807899',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1129807899',id=7,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKTy1BEGFgb2LwPCE0l4ZdsIb1CDE+2z5XZX+3IOS7BmpUspCkv8nslwIBX+XdLBElH9a7nR/A5XVOfQJoXDwudCeZ0lpAUFsL0E9TcfQKbmNmV+/CzT9enkfH7jf9KfQ==',key_name='tempest-keypair-426982747',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a68b4a52019441480a19783a89e0af8',ramdisk_id='',reservation_id='r-80xqf6s8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-202820908',owner_user_name='tempest-TaggedAttachmentsTest-202820908-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:16:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5dd4d0e5c03744569a542098432622d7',uuid=00af3d8e-bd93-4520-91e7-29c135c03e55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1efbc456-6c56-4367-845f-0afa8acdcec4", "address": "fa:16:3e:76:bd:21", "network": {"id": "1eaf9aa3-1d74-424c-86c6-28096cf53571", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-621134432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a68b4a52019441480a19783a89e0af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1efbc456-6c", "ovs_interfaceid": "1efbc456-6c56-4367-845f-0afa8acdcec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Converting VIF {"id": "1efbc456-6c56-4367-845f-0afa8acdcec4", "address": "fa:16:3e:76:bd:21", "network": {"id": "1eaf9aa3-1d74-424c-86c6-28096cf53571", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-621134432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a68b4a52019441480a19783a89e0af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1efbc456-6c", "ovs_interfaceid": "1efbc456-6c56-4367-845f-0afa8acdcec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:bd:21,bridge_name='br-int',has_traffic_filtering=True,id=1efbc456-6c56-4367-845f-0afa8acdcec4,network=Network(1eaf9aa3-1d74-424c-86c6-28096cf53571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1efbc456-6c') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG os_vif [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:bd:21,bridge_name='br-int',has_traffic_filtering=True,id=1efbc456-6c56-4367-845f-0afa8acdcec4,network=Network(1eaf9aa3-1d74-424c-86c6-28096cf53571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1efbc456-6c') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1efbc456-6c, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1efbc456-6c, col_values=(('external_ids', {'iface-id': '1efbc456-6c56-4367-845f-0afa8acdcec4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:bd:21', 'vm-uuid': '00af3d8e-bd93-4520-91e7-29c135c03e55'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:16:38 user nova-compute[72362]: INFO nova.compute.manager [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Took 12.31 seconds to build instance.
Aug 09 10:16:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:38 user nova-compute[72362]: INFO os_vif [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:bd:21,bridge_name='br-int',has_traffic_filtering=True,id=1efbc456-6c56-4367-845f-0afa8acdcec4,network=Network(1eaf9aa3-1d74-424c-86c6-28096cf53571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1efbc456-6c')
Aug 09 10:16:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6b6965ac-e4fa-4137-b239-9f8cb593d3db tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Lock "b17b317a-409e-45ad-ac7c-0c298f4f564b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.589s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] No BDM found with device name hda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] No VIF found with MAC fa:16:3e:76:bd:21, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:16:38 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Using config drive
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.network.neutron [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Updating instance_info_cache with network_info: [{"id": "d1a1302a-fe35-4d60-b89c-b5ef5f0dee76", "address": "fa:16:3e:4a:45:de", "network": {"id": "bc7a82e2-b23e-48dd-b282-99f11cff58d3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-457661927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098495c0d3ac4b9caa895f9ba60e4b84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1a1302a-fe", "ovs_interfaceid": "d1a1302a-fe35-4d60-b89c-b5ef5f0dee76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Releasing lock "refresh_cache-9f2bc700-2e69-406f-9a13-52396eae4258" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.compute.manager [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Instance network_info: |[{"id": "d1a1302a-fe35-4d60-b89c-b5ef5f0dee76", "address": "fa:16:3e:4a:45:de", "network": {"id": "bc7a82e2-b23e-48dd-b282-99f11cff58d3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-457661927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098495c0d3ac4b9caa895f9ba60e4b84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1a1302a-fe", "ovs_interfaceid": "d1a1302a-fe35-4d60-b89c-b5ef5f0dee76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-5998c614-db33-4f73-a112-16396bfee1a4 req-c4261a4f-142f-4eba-a2f1-00f6392108a9 service nova] Acquired lock "refresh_cache-9f2bc700-2e69-406f-9a13-52396eae4258" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.network.neutron [req-5998c614-db33-4f73-a112-16396bfee1a4 req-c4261a4f-142f-4eba-a2f1-00f6392108a9 service nova] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Refreshing network info cache for port d1a1302a-fe35-4d60-b89c-b5ef5f0dee76 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Start _get_guest_xml network_info=[{"id": "d1a1302a-fe35-4d60-b89c-b5ef5f0dee76", "address": "fa:16:3e:4a:45:de", "network": {"id": "bc7a82e2-b23e-48dd-b282-99f11cff58d3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-457661927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098495c0d3ac4b9caa895f9ba60e4b84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1a1302a-fe", "ovs_interfaceid": "d1a1302a-fe35-4d60-b89c-b5ef5f0dee76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:16:25Z,direct_url=<?>,disk_format='qcow2',id=935787e9-b90d-4cc2-8655-783953b40fb0,min_disk=0,min_ram=0,name='',owner='a150db1b347440daa3cc41100e007ec0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:16:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/sda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'scsi', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': '935787e9-b90d-4cc2-8655-783953b40fb0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:16:38 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:16:38 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:16:25Z,direct_url=<?>,disk_format='qcow2',id=935787e9-b90d-4cc2-8655-783953b40fb0,min_disk=0,min_ram=0,name='',owner='a150db1b347440daa3cc41100e007ec0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:16:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:16:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-725671139',display_name='tempest-AttachSCSIVolumeTestJSON-server-725671139',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-725671139',id=8,image_ref='935787e9-b90d-4cc2-8655-783953b40fb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4dltahC5eI7zqUw1QBgNqbCZrM1qfqpyXM46W66BcK1c4WNoyFZzTs6vHNnRFnXqd55VXfQnYMOhqVRmFp53EUMT4ySvCYxXXVUQ9snlPMOrxTr5EmWslCgnaEwzb2LQ==',key_name='tempest-keypair-1644987629',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='098495c0d3ac4b9caa895f9ba60e4b84',ramdisk_id='',reservation_id='r-a0zo3dnn',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='935787e9-b90d-4cc2-8655-783953b40fb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1535324413',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1535324413-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:16:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2b67a8ab3374254bca409f342f74c9c',uuid=9f2bc700-2e69-406f-9a13-52396eae4258,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1a1302a-fe35-4d60-b89c-b5ef5f0dee76", "address": "fa:16:3e:4a:45:de", "network": {"id": "bc7a82e2-b23e-48dd-b282-99f11cff58d3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-457661927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098495c0d3ac4b9caa895f9ba60e4b84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1a1302a-fe", "ovs_interfaceid": "d1a1302a-fe35-4d60-b89c-b5ef5f0dee76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Converting VIF {"id": "d1a1302a-fe35-4d60-b89c-b5ef5f0dee76", "address": "fa:16:3e:4a:45:de", "network": {"id": "bc7a82e2-b23e-48dd-b282-99f11cff58d3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-457661927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098495c0d3ac4b9caa895f9ba60e4b84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1a1302a-fe", "ovs_interfaceid": "d1a1302a-fe35-4d60-b89c-b5ef5f0dee76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:45:de,bridge_name='br-int',has_traffic_filtering=True,id=d1a1302a-fe35-4d60-b89c-b5ef5f0dee76,network=Network(bc7a82e2-b23e-48dd-b282-99f11cff58d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1a1302a-fe') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.objects.instance [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Lazy-loading 'pci_devices' on Instance uuid 9f2bc700-2e69-406f-9a13-52396eae4258 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:16:38 user nova-compute[72362]:   <uuid>9f2bc700-2e69-406f-9a13-52396eae4258</uuid>
Aug 09 10:16:38 user nova-compute[72362]:   <name>instance-00000008</name>
Aug 09 10:16:38 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:16:38 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:16:38 user nova-compute[72362]:   <metadata>
Aug 09 10:16:38 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:16:38 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:16:38 user nova-compute[72362]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-725671139</nova:name>
Aug 09 10:16:38 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:16:38</nova:creationTime>
Aug 09 10:16:38 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:16:38 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:16:38 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:16:38 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:16:38 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:16:38 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:16:38 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:16:38 user nova-compute[72362]:       <nova:owner>
Aug 09 10:16:38 user nova-compute[72362]:         <nova:user uuid="d2b67a8ab3374254bca409f342f74c9c">tempest-AttachSCSIVolumeTestJSON-1535324413-project-member</nova:user>
Aug 09 10:16:38 user nova-compute[72362]:         <nova:project uuid="098495c0d3ac4b9caa895f9ba60e4b84">tempest-AttachSCSIVolumeTestJSON-1535324413</nova:project>
Aug 09 10:16:38 user nova-compute[72362]:       </nova:owner>
Aug 09 10:16:38 user nova-compute[72362]:       <nova:root type="image" uuid="935787e9-b90d-4cc2-8655-783953b40fb0"/>
Aug 09 10:16:38 user nova-compute[72362]:       <nova:ports>
Aug 09 10:16:38 user nova-compute[72362]:         <nova:port uuid="d1a1302a-fe35-4d60-b89c-b5ef5f0dee76">
Aug 09 10:16:38 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 10:16:38 user nova-compute[72362]:         </nova:port>
Aug 09 10:16:38 user nova-compute[72362]:       </nova:ports>
Aug 09 10:16:38 user nova-compute[72362]:     </nova:instance>
Aug 09 10:16:38 user nova-compute[72362]:   </metadata>
Aug 09 10:16:38 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:16:38 user nova-compute[72362]:     <system>
Aug 09 10:16:38 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:16:38 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:16:38 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:16:38 user nova-compute[72362]:       <entry name="serial">9f2bc700-2e69-406f-9a13-52396eae4258</entry>
Aug 09 10:16:38 user nova-compute[72362]:       <entry name="uuid">9f2bc700-2e69-406f-9a13-52396eae4258</entry>
Aug 09 10:16:38 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:16:38 user nova-compute[72362]:     </system>
Aug 09 10:16:38 user nova-compute[72362]:   </sysinfo>
Aug 09 10:16:38 user nova-compute[72362]:   <os>
Aug 09 10:16:38 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:16:38 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:16:38 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:16:38 user nova-compute[72362]:   </os>
Aug 09 10:16:38 user nova-compute[72362]:   <features>
Aug 09 10:16:38 user nova-compute[72362]:     <acpi/>
Aug 09 10:16:38 user nova-compute[72362]:     <apic/>
Aug 09 10:16:38 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:16:38 user nova-compute[72362]:   </features>
Aug 09 10:16:38 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:16:38 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:16:38 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:16:38 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:16:38 user nova-compute[72362]:   </clock>
Aug 09 10:16:38 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:16:38 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:16:38 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:16:38 user nova-compute[72362]:   </cpu>
Aug 09 10:16:38 user nova-compute[72362]:   <devices>
Aug 09 10:16:38 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:16:38 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:16:38 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/9f2bc700-2e69-406f-9a13-52396eae4258/disk"/>
Aug 09 10:16:38 user nova-compute[72362]:       <target dev="sda" bus="scsi"/>
Aug 09 10:16:38 user nova-compute[72362]:       <address type="drive" controller="0" unit="0"/>
Aug 09 10:16:38 user nova-compute[72362]:     </disk>
Aug 09 10:16:38 user nova-compute[72362]:     <disk type="file" device="cdrom">
Aug 09 10:16:38 user nova-compute[72362]:       <driver name="qemu" type="raw" cache="none"/>
Aug 09 10:16:38 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/9f2bc700-2e69-406f-9a13-52396eae4258/disk.config"/>
Aug 09 10:16:38 user nova-compute[72362]:       <target dev="sdb" bus="scsi"/>
Aug 09 10:16:38 user nova-compute[72362]:       <address type="drive" controller="0" unit="1"/>
Aug 09 10:16:38 user nova-compute[72362]:     </disk>
Aug 09 10:16:38 user nova-compute[72362]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 09 10:16:38 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:16:38 user nova-compute[72362]:       <mac address="fa:16:3e:4a:45:de"/>
Aug 09 10:16:38 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:16:38 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:16:38 user nova-compute[72362]:       <target dev="tapd1a1302a-fe"/>
Aug 09 10:16:38 user nova-compute[72362]:     </interface>
Aug 09 10:16:38 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:16:38 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/9f2bc700-2e69-406f-9a13-52396eae4258/console.log" append="off"/>
Aug 09 10:16:38 user nova-compute[72362]:     </serial>
Aug 09 10:16:38 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:16:38 user nova-compute[72362]:     <video>
Aug 09 10:16:38 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:16:38 user nova-compute[72362]:     </video>
Aug 09 10:16:38 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:16:38 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:16:38 user nova-compute[72362]:     </rng>
Aug 09 10:16:38 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:16:38 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:16:38 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:16:38 user nova-compute[72362]:     </memballoon>
Aug 09 10:16:38 user nova-compute[72362]:   </devices>
Aug 09 10:16:38 user nova-compute[72362]: </domain>
Aug 09 10:16:38 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:16:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-725671139',display_name='tempest-AttachSCSIVolumeTestJSON-server-725671139',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-725671139',id=8,image_ref='935787e9-b90d-4cc2-8655-783953b40fb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4dltahC5eI7zqUw1QBgNqbCZrM1qfqpyXM46W66BcK1c4WNoyFZzTs6vHNnRFnXqd55VXfQnYMOhqVRmFp53EUMT4ySvCYxXXVUQ9snlPMOrxTr5EmWslCgnaEwzb2LQ==',key_name='tempest-keypair-1644987629',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='098495c0d3ac4b9caa895f9ba60e4b84',ramdisk_id='',reservation_id='r-a0zo3dnn',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='935787e9-b90d-4cc2-8655-783953b40fb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1535324413',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1535324413-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:16:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2b67a8ab3374254bca409f342f74c9c',uuid=9f2bc700-2e69-406f-9a13-52396eae4258,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1a1302a-fe35-4d60-b89c-b5ef5f0dee76", "address": "fa:16:3e:4a:45:de", "network": {"id": "bc7a82e2-b23e-48dd-b282-99f11cff58d3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-457661927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098495c0d3ac4b9caa895f9ba60e4b84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1a1302a-fe", "ovs_interfaceid": "d1a1302a-fe35-4d60-b89c-b5ef5f0dee76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Converting VIF {"id": "d1a1302a-fe35-4d60-b89c-b5ef5f0dee76", "address": "fa:16:3e:4a:45:de", "network": {"id": "bc7a82e2-b23e-48dd-b282-99f11cff58d3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-457661927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098495c0d3ac4b9caa895f9ba60e4b84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1a1302a-fe", "ovs_interfaceid": "d1a1302a-fe35-4d60-b89c-b5ef5f0dee76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:45:de,bridge_name='br-int',has_traffic_filtering=True,id=d1a1302a-fe35-4d60-b89c-b5ef5f0dee76,network=Network(bc7a82e2-b23e-48dd-b282-99f11cff58d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1a1302a-fe') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG os_vif [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:45:de,bridge_name='br-int',has_traffic_filtering=True,id=d1a1302a-fe35-4d60-b89c-b5ef5f0dee76,network=Network(bc7a82e2-b23e-48dd-b282-99f11cff58d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1a1302a-fe') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd1a1302a-fe, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd1a1302a-fe, col_values=(('external_ids', {'iface-id': 'd1a1302a-fe35-4d60-b89c-b5ef5f0dee76', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:45:de', 'vm-uuid': '9f2bc700-2e69-406f-9a13-52396eae4258'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:38 user nova-compute[72362]: INFO os_vif [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:45:de,bridge_name='br-int',has_traffic_filtering=True,id=d1a1302a-fe35-4d60-b89c-b5ef5f0dee76,network=Network(bc7a82e2-b23e-48dd-b282-99f11cff58d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1a1302a-fe')
Aug 09 10:16:38 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Creating config drive at /opt/stack/data/nova/instances/00af3d8e-bd93-4520-91e7-29c135c03e55/disk.config
Aug 09 10:16:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/00af3d8e-bd93-4520-91e7-29c135c03e55/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp8jmx447v {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] No BDM found with device name sda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:16:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] No VIF found with MAC fa:16:3e:4a:45:de, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:16:38 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Using config drive
Aug 09 10:16:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/00af3d8e-bd93-4520-91e7-29c135c03e55/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp8jmx447v" returned: 0 in 0.121s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:39 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Creating config drive at /opt/stack/data/nova/instances/9f2bc700-2e69-406f-9a13-52396eae4258/disk.config
Aug 09 10:16:39 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9f2bc700-2e69-406f-9a13-52396eae4258/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpi0s62n5j {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:39 user nova-compute[72362]: DEBUG nova.compute.manager [req-db41b8bb-80e2-430b-acac-ede3211ff7c5 req-75678a30-eb7b-49cd-ac85-c4e38faaf9b0 service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Received event network-changed-1efbc456-6c56-4367-845f-0afa8acdcec4 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:16:39 user nova-compute[72362]: DEBUG nova.compute.manager [req-db41b8bb-80e2-430b-acac-ede3211ff7c5 req-75678a30-eb7b-49cd-ac85-c4e38faaf9b0 service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Refreshing instance network info cache due to event network-changed-1efbc456-6c56-4367-845f-0afa8acdcec4. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:16:39 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-db41b8bb-80e2-430b-acac-ede3211ff7c5 req-75678a30-eb7b-49cd-ac85-c4e38faaf9b0 service nova] Acquiring lock "refresh_cache-00af3d8e-bd93-4520-91e7-29c135c03e55" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:16:39 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-db41b8bb-80e2-430b-acac-ede3211ff7c5 req-75678a30-eb7b-49cd-ac85-c4e38faaf9b0 service nova] Acquired lock "refresh_cache-00af3d8e-bd93-4520-91e7-29c135c03e55" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:16:39 user nova-compute[72362]: DEBUG nova.network.neutron [req-db41b8bb-80e2-430b-acac-ede3211ff7c5 req-75678a30-eb7b-49cd-ac85-c4e38faaf9b0 service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Refreshing network info cache for port 1efbc456-6c56-4367-845f-0afa8acdcec4 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:16:39 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9f2bc700-2e69-406f-9a13-52396eae4258/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpi0s62n5j" returned: 0 in 0.099s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:39 user nova-compute[72362]: DEBUG nova.network.neutron [req-5998c614-db33-4f73-a112-16396bfee1a4 req-c4261a4f-142f-4eba-a2f1-00f6392108a9 service nova] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Updated VIF entry in instance network info cache for port d1a1302a-fe35-4d60-b89c-b5ef5f0dee76. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:16:39 user nova-compute[72362]: DEBUG nova.network.neutron [req-5998c614-db33-4f73-a112-16396bfee1a4 req-c4261a4f-142f-4eba-a2f1-00f6392108a9 service nova] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Updating instance_info_cache with network_info: [{"id": "d1a1302a-fe35-4d60-b89c-b5ef5f0dee76", "address": "fa:16:3e:4a:45:de", "network": {"id": "bc7a82e2-b23e-48dd-b282-99f11cff58d3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-457661927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098495c0d3ac4b9caa895f9ba60e4b84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1a1302a-fe", "ovs_interfaceid": "d1a1302a-fe35-4d60-b89c-b5ef5f0dee76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:16:39 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-5998c614-db33-4f73-a112-16396bfee1a4 req-c4261a4f-142f-4eba-a2f1-00f6392108a9 service nova] Releasing lock "refresh_cache-9f2bc700-2e69-406f-9a13-52396eae4258" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:16:40 user nova-compute[72362]: DEBUG nova.network.neutron [req-db41b8bb-80e2-430b-acac-ede3211ff7c5 req-75678a30-eb7b-49cd-ac85-c4e38faaf9b0 service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Updated VIF entry in instance network info cache for port 1efbc456-6c56-4367-845f-0afa8acdcec4. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:16:40 user nova-compute[72362]: DEBUG nova.network.neutron [req-db41b8bb-80e2-430b-acac-ede3211ff7c5 req-75678a30-eb7b-49cd-ac85-c4e38faaf9b0 service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Updating instance_info_cache with network_info: [{"id": "1efbc456-6c56-4367-845f-0afa8acdcec4", "address": "fa:16:3e:76:bd:21", "network": {"id": "1eaf9aa3-1d74-424c-86c6-28096cf53571", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-621134432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a68b4a52019441480a19783a89e0af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1efbc456-6c", "ovs_interfaceid": "1efbc456-6c56-4367-845f-0afa8acdcec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:16:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-db41b8bb-80e2-430b-acac-ede3211ff7c5 req-75678a30-eb7b-49cd-ac85-c4e38faaf9b0 service nova] Releasing lock "refresh_cache-00af3d8e-bd93-4520-91e7-29c135c03e55" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:16:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:42 user nova-compute[72362]: DEBUG nova.compute.manager [req-2a2d0655-bd5a-4409-a94f-27836592bbf5 req-792ceb6d-7afb-4211-9e02-d0ee3ae1721e service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Received event network-vif-plugged-1efbc456-6c56-4367-845f-0afa8acdcec4 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:16:42 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-2a2d0655-bd5a-4409-a94f-27836592bbf5 req-792ceb6d-7afb-4211-9e02-d0ee3ae1721e service nova] Acquiring lock "00af3d8e-bd93-4520-91e7-29c135c03e55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:42 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-2a2d0655-bd5a-4409-a94f-27836592bbf5 req-792ceb6d-7afb-4211-9e02-d0ee3ae1721e service nova] Lock "00af3d8e-bd93-4520-91e7-29c135c03e55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:42 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-2a2d0655-bd5a-4409-a94f-27836592bbf5 req-792ceb6d-7afb-4211-9e02-d0ee3ae1721e service nova] Lock "00af3d8e-bd93-4520-91e7-29c135c03e55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:42 user nova-compute[72362]: DEBUG nova.compute.manager [req-2a2d0655-bd5a-4409-a94f-27836592bbf5 req-792ceb6d-7afb-4211-9e02-d0ee3ae1721e service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] No waiting events found dispatching network-vif-plugged-1efbc456-6c56-4367-845f-0afa8acdcec4 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:16:42 user nova-compute[72362]: WARNING nova.compute.manager [req-2a2d0655-bd5a-4409-a94f-27836592bbf5 req-792ceb6d-7afb-4211-9e02-d0ee3ae1721e service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Received unexpected event network-vif-plugged-1efbc456-6c56-4367-845f-0afa8acdcec4 for instance with vm_state building and task_state spawning.
Aug 09 10:16:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:43 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:43 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:43 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:43 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:43 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:44 user nova-compute[72362]: DEBUG nova.compute.manager [req-ae8ba6ed-29d8-4b5e-ab32-0c7b3b804fe0 req-81e3957f-2850-430f-9a54-b5e70c718233 service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Received event network-vif-plugged-1efbc456-6c56-4367-845f-0afa8acdcec4 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:16:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ae8ba6ed-29d8-4b5e-ab32-0c7b3b804fe0 req-81e3957f-2850-430f-9a54-b5e70c718233 service nova] Acquiring lock "00af3d8e-bd93-4520-91e7-29c135c03e55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ae8ba6ed-29d8-4b5e-ab32-0c7b3b804fe0 req-81e3957f-2850-430f-9a54-b5e70c718233 service nova] Lock "00af3d8e-bd93-4520-91e7-29c135c03e55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ae8ba6ed-29d8-4b5e-ab32-0c7b3b804fe0 req-81e3957f-2850-430f-9a54-b5e70c718233 service nova] Lock "00af3d8e-bd93-4520-91e7-29c135c03e55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:44 user nova-compute[72362]: DEBUG nova.compute.manager [req-ae8ba6ed-29d8-4b5e-ab32-0c7b3b804fe0 req-81e3957f-2850-430f-9a54-b5e70c718233 service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] No waiting events found dispatching network-vif-plugged-1efbc456-6c56-4367-845f-0afa8acdcec4 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:16:44 user nova-compute[72362]: WARNING nova.compute.manager [req-ae8ba6ed-29d8-4b5e-ab32-0c7b3b804fe0 req-81e3957f-2850-430f-9a54-b5e70c718233 service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Received unexpected event network-vif-plugged-1efbc456-6c56-4367-845f-0afa8acdcec4 for instance with vm_state building and task_state spawning.
Aug 09 10:16:44 user nova-compute[72362]: DEBUG nova.compute.manager [req-ae8ba6ed-29d8-4b5e-ab32-0c7b3b804fe0 req-81e3957f-2850-430f-9a54-b5e70c718233 service nova] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Received event network-vif-plugged-d1a1302a-fe35-4d60-b89c-b5ef5f0dee76 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:16:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ae8ba6ed-29d8-4b5e-ab32-0c7b3b804fe0 req-81e3957f-2850-430f-9a54-b5e70c718233 service nova] Acquiring lock "9f2bc700-2e69-406f-9a13-52396eae4258-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ae8ba6ed-29d8-4b5e-ab32-0c7b3b804fe0 req-81e3957f-2850-430f-9a54-b5e70c718233 service nova] Lock "9f2bc700-2e69-406f-9a13-52396eae4258-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ae8ba6ed-29d8-4b5e-ab32-0c7b3b804fe0 req-81e3957f-2850-430f-9a54-b5e70c718233 service nova] Lock "9f2bc700-2e69-406f-9a13-52396eae4258-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:44 user nova-compute[72362]: DEBUG nova.compute.manager [req-ae8ba6ed-29d8-4b5e-ab32-0c7b3b804fe0 req-81e3957f-2850-430f-9a54-b5e70c718233 service nova] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] No waiting events found dispatching network-vif-plugged-d1a1302a-fe35-4d60-b89c-b5ef5f0dee76 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:16:44 user nova-compute[72362]: WARNING nova.compute.manager [req-ae8ba6ed-29d8-4b5e-ab32-0c7b3b804fe0 req-81e3957f-2850-430f-9a54-b5e70c718233 service nova] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Received unexpected event network-vif-plugged-d1a1302a-fe35-4d60-b89c-b5ef5f0dee76 for instance with vm_state building and task_state spawning.
Aug 09 10:16:44 user nova-compute[72362]: DEBUG nova.compute.manager [req-ae8ba6ed-29d8-4b5e-ab32-0c7b3b804fe0 req-81e3957f-2850-430f-9a54-b5e70c718233 service nova] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Received event network-vif-plugged-d1a1302a-fe35-4d60-b89c-b5ef5f0dee76 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:16:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ae8ba6ed-29d8-4b5e-ab32-0c7b3b804fe0 req-81e3957f-2850-430f-9a54-b5e70c718233 service nova] Acquiring lock "9f2bc700-2e69-406f-9a13-52396eae4258-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ae8ba6ed-29d8-4b5e-ab32-0c7b3b804fe0 req-81e3957f-2850-430f-9a54-b5e70c718233 service nova] Lock "9f2bc700-2e69-406f-9a13-52396eae4258-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ae8ba6ed-29d8-4b5e-ab32-0c7b3b804fe0 req-81e3957f-2850-430f-9a54-b5e70c718233 service nova] Lock "9f2bc700-2e69-406f-9a13-52396eae4258-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:44 user nova-compute[72362]: DEBUG nova.compute.manager [req-ae8ba6ed-29d8-4b5e-ab32-0c7b3b804fe0 req-81e3957f-2850-430f-9a54-b5e70c718233 service nova] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] No waiting events found dispatching network-vif-plugged-d1a1302a-fe35-4d60-b89c-b5ef5f0dee76 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:16:44 user nova-compute[72362]: WARNING nova.compute.manager [req-ae8ba6ed-29d8-4b5e-ab32-0c7b3b804fe0 req-81e3957f-2850-430f-9a54-b5e70c718233 service nova] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Received unexpected event network-vif-plugged-d1a1302a-fe35-4d60-b89c-b5ef5f0dee76 for instance with vm_state building and task_state spawning.
Aug 09 10:16:45 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:45 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576205.7866867, 9f2bc700-2e69-406f-9a13-52396eae4258 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:16:45 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] VM Resumed (Lifecycle Event)
Aug 09 10:16:45 user nova-compute[72362]: DEBUG nova.compute.manager [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:16:45 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:16:45 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:16:45 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Instance spawned successfully.
Aug 09 10:16:45 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 10:16:45 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:16:45 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:16:45 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:16:45 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Found default for hw_video_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:16:45 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Found default for hw_vif_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:16:45 user nova-compute[72362]: DEBUG nova.compute.manager [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:16:45 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:16:45 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:16:45 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576205.8078623, 9f2bc700-2e69-406f-9a13-52396eae4258 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:16:45 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] VM Started (Lifecycle Event)
Aug 09 10:16:45 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Instance spawned successfully.
Aug 09 10:16:45 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 10:16:45 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:16:45 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:16:45 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Found default for hw_cdrom_bus of ide {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:16:45 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Found default for hw_disk_bus of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:16:45 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:16:45 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:16:45 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Found default for hw_video_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:16:45 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Found default for hw_vif_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:16:45 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:16:45 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Cleaning up deleted instances {{(pid=72362) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 10:16:45 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:16:45 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576205.8656018, 00af3d8e-bd93-4520-91e7-29c135c03e55 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:16:45 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] VM Resumed (Lifecycle Event)
Aug 09 10:16:46 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:16:46 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] There are 0 instances to clean {{(pid=72362) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 10:16:46 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:16:46 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72362) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 10:16:46 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:16:46 user nova-compute[72362]: INFO nova.compute.manager [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Took 11.00 seconds to spawn the instance on the hypervisor.
Aug 09 10:16:46 user nova-compute[72362]: DEBUG nova.compute.manager [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:16:46 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:16:46 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576205.865854, 00af3d8e-bd93-4520-91e7-29c135c03e55 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:16:46 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] VM Started (Lifecycle Event)
Aug 09 10:16:46 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:16:46 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:16:46 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:16:46 user nova-compute[72362]: INFO nova.compute.manager [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Took 12.49 seconds to build instance.
Aug 09 10:16:46 user nova-compute[72362]: INFO nova.compute.manager [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Took 11.96 seconds to spawn the instance on the hypervisor.
Aug 09 10:16:46 user nova-compute[72362]: DEBUG nova.compute.manager [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:16:46 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:16:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-8b9fdddc-6095-4997-95be-34910d4ed9a4 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Lock "9f2bc700-2e69-406f-9a13-52396eae4258" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.654s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:46 user nova-compute[72362]: INFO nova.compute.manager [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Took 13.13 seconds to build instance.
Aug 09 10:16:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4c7a745a-ef10-49e8-8a36-7f859338f867 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Lock "00af3d8e-bd93-4520-91e7-29c135c03e55" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.274s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:47 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:16:47 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:16:48 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:48 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:16:48 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 10:16:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:49 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:16:50 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:50 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:16:51 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:51 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:51 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:51 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 10:16:51 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f2bc700-2e69-406f-9a13-52396eae4258/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:51 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f2bc700-2e69-406f-9a13-52396eae4258/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:51 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f2bc700-2e69-406f-9a13-52396eae4258/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:51 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f2bc700-2e69-406f-9a13-52396eae4258/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:51 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00af3d8e-bd93-4520-91e7-29c135c03e55/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:51 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00af3d8e-bd93-4520-91e7-29c135c03e55/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:51 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00af3d8e-bd93-4520-91e7-29c135c03e55/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:52 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00af3d8e-bd93-4520-91e7-29c135c03e55/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:52 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e2e53b4-3a00-4725-840d-215f6609c951/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:52 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e2e53b4-3a00-4725-840d-215f6609c951/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:52 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e2e53b4-3a00-4725-840d-215f6609c951/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:52 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e2e53b4-3a00-4725-840d-215f6609c951/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:52 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca002e73-ddf7-4452-82b6-0d831d984756/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:52 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca002e73-ddf7-4452-82b6-0d831d984756/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:52 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca002e73-ddf7-4452-82b6-0d831d984756/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca002e73-ddf7-4452-82b6-0d831d984756/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f0c62c9-aa84-4a5b-b909-af5535e87c83/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f0c62c9-aa84-4a5b-b909-af5535e87c83/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f0c62c9-aa84-4a5b-b909-af5535e87c83/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f0c62c9-aa84-4a5b-b909-af5535e87c83/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b17b317a-409e-45ad-ac7c-0c298f4f564b/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:53 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b17b317a-409e-45ad-ac7c-0c298f4f564b/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b17b317a-409e-45ad-ac7c-0c298f4f564b/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b17b317a-409e-45ad-ac7c-0c298f4f564b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea95226c-40fe-4408-a9f0-5538659261a6/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea95226c-40fe-4408-a9f0-5538659261a6/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea95226c-40fe-4408-a9f0-5538659261a6/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea95226c-40fe-4408-a9f0-5538659261a6/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:55 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:16:55 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:16:55 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=7773MB free_disk=25.64638900756836GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 10:16:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:55 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:55 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 9f2bc700-2e69-406f-9a13-52396eae4258 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:16:55 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 8f0c62c9-aa84-4a5b-b909-af5535e87c83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:16:55 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 1e2e53b4-3a00-4725-840d-215f6609c951 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:16:55 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 00af3d8e-bd93-4520-91e7-29c135c03e55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:16:55 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance b17b317a-409e-45ad-ac7c-0c298f4f564b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:16:55 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance ea95226c-40fe-4408-a9f0-5538659261a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:16:55 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 0e8a7668-1635-4cbc-8c09-ece19ff67d4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:16:55 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance ca002e73-ddf7-4452-82b6-0d831d984756 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:16:55 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 10:16:55 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 10:16:55 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Refreshing inventories for resource provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 10:16:55 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Updating ProviderTree inventory for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 10:16:55 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Updating inventory in ProviderTree for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 10:16:55 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Refreshing aggregate associations for resource provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d, aggregates: None {{(pid=72362) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 10:16:55 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Refreshing trait associations for resource provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE41,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=72362) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 10:16:56 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:16:56 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:16:56 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 10:16:56 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.121s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:56 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Acquiring lock "1cde3780-2215-4966-86a4-82aae151b022" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:56 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Lock "1cde3780-2215-4966-86a4-82aae151b022" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:56 user nova-compute[72362]: DEBUG nova.compute.manager [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Starting instance... {{(pid=72362) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 10:16:56 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:56 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:56 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:16:56 user nova-compute[72362]: INFO nova.compute.claims [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Claim successful on node user
Aug 09 10:16:57 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:16:57 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:16:57 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.461s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:57 user nova-compute[72362]: DEBUG nova.compute.manager [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Start building networks asynchronously for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 10:16:57 user nova-compute[72362]: DEBUG nova.compute.manager [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Allocating IP information in the background. {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 10:16:57 user nova-compute[72362]: DEBUG nova.network.neutron [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: 1cde3780-2215-4966-86a4-82aae151b022] allocate_for_instance() {{(pid=72362) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 10:16:57 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 10:16:57 user nova-compute[72362]: DEBUG nova.compute.manager [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Start building block device mappings for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 10:16:57 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:16:57 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 10:16:57 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Rebuilding the list of instances to heal {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 10:16:57 user nova-compute[72362]: DEBUG nova.policy [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fcbf88df1bf143c1b46cbf8d8ca879e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb89934454244f5a3438b5a8a74926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72362) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 10:16:57 user nova-compute[72362]: DEBUG nova.compute.manager [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Start spawning the instance on the hypervisor. {{(pid=72362) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 10:16:57 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:16:57 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Creating image(s)
Aug 09 10:16:57 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Acquiring lock "/opt/stack/data/nova/instances/1cde3780-2215-4966-86a4-82aae151b022/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:57 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Lock "/opt/stack/data/nova/instances/1cde3780-2215-4966-86a4-82aae151b022/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:57 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Lock "/opt/stack/data/nova/instances/1cde3780-2215-4966-86a4-82aae151b022/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:57 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:57 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Skipping network cache update for instance because it is Building. {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 09 10:16:57 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "refresh_cache-1e2e53b4-3a00-4725-840d-215f6609c951" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:16:57 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquired lock "refresh_cache-1e2e53b4-3a00-4725-840d-215f6609c951" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:16:57 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Forcefully refreshing network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 10:16:57 user nova-compute[72362]: DEBUG nova.objects.instance [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lazy-loading 'info_cache' on Instance uuid 1e2e53b4-3a00-4725-840d-215f6609c951 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:16:57 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.172s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:57 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Acquiring lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:57 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:57 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:57 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.146s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:57 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/1cde3780-2215-4966-86a4-82aae151b022/disk 1073741824 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:57 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/1cde3780-2215-4966-86a4-82aae151b022/disk 1073741824" returned: 0 in 0.070s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:57 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:57 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:57 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.156s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:57 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1cde3780-2215-4966-86a4-82aae151b022/disk. size=1073741824 {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 10:16:57 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cde3780-2215-4966-86a4-82aae151b022/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:16:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cde3780-2215-4966-86a4-82aae151b022/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:16:58 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Cannot resize image /opt/stack/data/nova/instances/1cde3780-2215-4966-86a4-82aae151b022/disk to a smaller size. {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 10:16:58 user nova-compute[72362]: DEBUG nova.objects.instance [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Lazy-loading 'migration_context' on Instance uuid 1cde3780-2215-4966-86a4-82aae151b022 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:16:58 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Created local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 10:16:58 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Ensure instance console log exists: /opt/stack/data/nova/instances/1cde3780-2215-4966-86a4-82aae151b022/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:16:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:16:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:16:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:16:58 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Updating instance_info_cache with network_info: [{"id": "e2fc4479-6950-479a-bf81-12149601afab", "address": "fa:16:3e:38:97:38", "network": {"id": "44e70325-9b00-4919-a808-7e32d3c9c7b8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2093963967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dcec0d088b642ef9262d53297d51240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2fc4479-69", "ovs_interfaceid": "e2fc4479-6950-479a-bf81-12149601afab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:16:58 user nova-compute[72362]: DEBUG nova.network.neutron [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Successfully created port: bc47e64d-5b9b-4518-be08-8b527fca479c {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:16:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Releasing lock "refresh_cache-1e2e53b4-3a00-4725-840d-215f6609c951" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:16:58 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Updated the network info_cache for instance {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 10:16:58 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:16:58 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:16:58 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:16:58 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:58 user nova-compute[72362]: DEBUG nova.network.neutron [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Successfully updated port: bc47e64d-5b9b-4518-be08-8b527fca479c {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:16:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Acquiring lock "refresh_cache-1cde3780-2215-4966-86a4-82aae151b022" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:16:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Acquired lock "refresh_cache-1cde3780-2215-4966-86a4-82aae151b022" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:16:58 user nova-compute[72362]: DEBUG nova.network.neutron [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:16:59 user nova-compute[72362]: DEBUG nova.compute.manager [req-6689e0be-9d8c-44c1-b7ae-8f5ce3d48a4c req-7f3c2d89-8602-43c4-bde0-5681bdac8426 service nova] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Received event network-changed-bc47e64d-5b9b-4518-be08-8b527fca479c {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:16:59 user nova-compute[72362]: DEBUG nova.compute.manager [req-6689e0be-9d8c-44c1-b7ae-8f5ce3d48a4c req-7f3c2d89-8602-43c4-bde0-5681bdac8426 service nova] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Refreshing instance network info cache due to event network-changed-bc47e64d-5b9b-4518-be08-8b527fca479c. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:16:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-6689e0be-9d8c-44c1-b7ae-8f5ce3d48a4c req-7f3c2d89-8602-43c4-bde0-5681bdac8426 service nova] Acquiring lock "refresh_cache-1cde3780-2215-4966-86a4-82aae151b022" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:16:59 user nova-compute[72362]: DEBUG nova.network.neutron [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:16:59 user nova-compute[72362]: DEBUG nova.network.neutron [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Updating instance_info_cache with network_info: [{"id": "bc47e64d-5b9b-4518-be08-8b527fca479c", "address": "fa:16:3e:ab:92:bd", "network": {"id": "65e9155d-dde9-47bb-aa24-e6331f2dc71e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1221293796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bb89934454244f5a3438b5a8a74926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc47e64d-5b", "ovs_interfaceid": "bc47e64d-5b9b-4518-be08-8b527fca479c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:16:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Releasing lock "refresh_cache-1cde3780-2215-4966-86a4-82aae151b022" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:16:59 user nova-compute[72362]: DEBUG nova.compute.manager [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Instance network_info: |[{"id": "bc47e64d-5b9b-4518-be08-8b527fca479c", "address": "fa:16:3e:ab:92:bd", "network": {"id": "65e9155d-dde9-47bb-aa24-e6331f2dc71e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1221293796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bb89934454244f5a3438b5a8a74926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc47e64d-5b", "ovs_interfaceid": "bc47e64d-5b9b-4518-be08-8b527fca479c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 10:16:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-6689e0be-9d8c-44c1-b7ae-8f5ce3d48a4c req-7f3c2d89-8602-43c4-bde0-5681bdac8426 service nova] Acquired lock "refresh_cache-1cde3780-2215-4966-86a4-82aae151b022" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:16:59 user nova-compute[72362]: DEBUG nova.network.neutron [req-6689e0be-9d8c-44c1-b7ae-8f5ce3d48a4c req-7f3c2d89-8602-43c4-bde0-5681bdac8426 service nova] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Refreshing network info cache for port bc47e64d-5b9b-4518-be08-8b527fca479c {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:16:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Start _get_guest_xml network_info=[{"id": "bc47e64d-5b9b-4518-be08-8b527fca479c", "address": "fa:16:3e:ab:92:bd", "network": {"id": "65e9155d-dde9-47bb-aa24-e6331f2dc71e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1221293796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bb89934454244f5a3438b5a8a74926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc47e64d-5b", "ovs_interfaceid": "bc47e64d-5b9b-4518-be08-8b527fca479c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': 'a08d1a11-49eb-4212-a351-e11ee9553b95'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:16:59 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:16:59 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:16:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:16:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:16:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:16:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:16:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:16:59 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:16:59 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:16:59 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:16:59 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:16:59 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:16:59 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:16:59 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:16:59 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:16:59 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:16:59 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:16:59 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:16:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:16:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-272415521',display_name='tempest-VolumesActionsTest-instance-272415521',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-272415521',id=9,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0bb89934454244f5a3438b5a8a74926a',ramdisk_id='',reservation_id='r-fhtk2059',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2128587251',owner_user_name='tempest-VolumesActionsTest-2128587251-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:16:57Z,user_data=None,user_id='fcbf88df1bf143c1b46cbf8d8ca879e4',uuid=1cde3780-2215-4966-86a4-82aae151b022,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc47e64d-5b9b-4518-be08-8b527fca479c", "address": "fa:16:3e:ab:92:bd", "network": {"id": "65e9155d-dde9-47bb-aa24-e6331f2dc71e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1221293796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bb89934454244f5a3438b5a8a74926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc47e64d-5b", "ovs_interfaceid": "bc47e64d-5b9b-4518-be08-8b527fca479c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:16:59 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Converting VIF {"id": "bc47e64d-5b9b-4518-be08-8b527fca479c", "address": "fa:16:3e:ab:92:bd", "network": {"id": "65e9155d-dde9-47bb-aa24-e6331f2dc71e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1221293796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bb89934454244f5a3438b5a8a74926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc47e64d-5b", "ovs_interfaceid": "bc47e64d-5b9b-4518-be08-8b527fca479c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:16:59 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:92:bd,bridge_name='br-int',has_traffic_filtering=True,id=bc47e64d-5b9b-4518-be08-8b527fca479c,network=Network(65e9155d-dde9-47bb-aa24-e6331f2dc71e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc47e64d-5b') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:16:59 user nova-compute[72362]: DEBUG nova.objects.instance [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Lazy-loading 'pci_devices' on Instance uuid 1cde3780-2215-4966-86a4-82aae151b022 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:16:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: 1cde3780-2215-4966-86a4-82aae151b022] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:16:59 user nova-compute[72362]:   <uuid>1cde3780-2215-4966-86a4-82aae151b022</uuid>
Aug 09 10:16:59 user nova-compute[72362]:   <name>instance-00000009</name>
Aug 09 10:16:59 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:16:59 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:16:59 user nova-compute[72362]:   <metadata>
Aug 09 10:16:59 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:16:59 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:16:59 user nova-compute[72362]:       <nova:name>tempest-VolumesActionsTest-instance-272415521</nova:name>
Aug 09 10:16:59 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:16:59</nova:creationTime>
Aug 09 10:16:59 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:16:59 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:16:59 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:16:59 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:16:59 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:16:59 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:16:59 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:16:59 user nova-compute[72362]:       <nova:owner>
Aug 09 10:16:59 user nova-compute[72362]:         <nova:user uuid="fcbf88df1bf143c1b46cbf8d8ca879e4">tempest-VolumesActionsTest-2128587251-project-member</nova:user>
Aug 09 10:16:59 user nova-compute[72362]:         <nova:project uuid="0bb89934454244f5a3438b5a8a74926a">tempest-VolumesActionsTest-2128587251</nova:project>
Aug 09 10:16:59 user nova-compute[72362]:       </nova:owner>
Aug 09 10:16:59 user nova-compute[72362]:       <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:16:59 user nova-compute[72362]:       <nova:ports>
Aug 09 10:16:59 user nova-compute[72362]:         <nova:port uuid="bc47e64d-5b9b-4518-be08-8b527fca479c">
Aug 09 10:16:59 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 10:16:59 user nova-compute[72362]:         </nova:port>
Aug 09 10:16:59 user nova-compute[72362]:       </nova:ports>
Aug 09 10:16:59 user nova-compute[72362]:     </nova:instance>
Aug 09 10:16:59 user nova-compute[72362]:   </metadata>
Aug 09 10:16:59 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:16:59 user nova-compute[72362]:     <system>
Aug 09 10:16:59 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:16:59 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:16:59 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:16:59 user nova-compute[72362]:       <entry name="serial">1cde3780-2215-4966-86a4-82aae151b022</entry>
Aug 09 10:16:59 user nova-compute[72362]:       <entry name="uuid">1cde3780-2215-4966-86a4-82aae151b022</entry>
Aug 09 10:16:59 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:16:59 user nova-compute[72362]:     </system>
Aug 09 10:16:59 user nova-compute[72362]:   </sysinfo>
Aug 09 10:16:59 user nova-compute[72362]:   <os>
Aug 09 10:16:59 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:16:59 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:16:59 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:16:59 user nova-compute[72362]:   </os>
Aug 09 10:16:59 user nova-compute[72362]:   <features>
Aug 09 10:16:59 user nova-compute[72362]:     <acpi/>
Aug 09 10:16:59 user nova-compute[72362]:     <apic/>
Aug 09 10:16:59 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:16:59 user nova-compute[72362]:   </features>
Aug 09 10:16:59 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:16:59 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:16:59 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:16:59 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:16:59 user nova-compute[72362]:   </clock>
Aug 09 10:16:59 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:16:59 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:16:59 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:16:59 user nova-compute[72362]:   </cpu>
Aug 09 10:16:59 user nova-compute[72362]:   <devices>
Aug 09 10:16:59 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:16:59 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:16:59 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/1cde3780-2215-4966-86a4-82aae151b022/disk"/>
Aug 09 10:16:59 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:16:59 user nova-compute[72362]:     </disk>
Aug 09 10:16:59 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:16:59 user nova-compute[72362]:       <mac address="fa:16:3e:ab:92:bd"/>
Aug 09 10:16:59 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:16:59 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:16:59 user nova-compute[72362]:       <target dev="tapbc47e64d-5b"/>
Aug 09 10:16:59 user nova-compute[72362]:     </interface>
Aug 09 10:16:59 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:16:59 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/1cde3780-2215-4966-86a4-82aae151b022/console.log" append="off"/>
Aug 09 10:16:59 user nova-compute[72362]:     </serial>
Aug 09 10:16:59 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:16:59 user nova-compute[72362]:     <video>
Aug 09 10:16:59 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:16:59 user nova-compute[72362]:     </video>
Aug 09 10:16:59 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:16:59 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:16:59 user nova-compute[72362]:     </rng>
Aug 09 10:16:59 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:16:59 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:16:59 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:16:59 user nova-compute[72362]:     </memballoon>
Aug 09 10:16:59 user nova-compute[72362]:   </devices>
Aug 09 10:16:59 user nova-compute[72362]: </domain>
Aug 09 10:16:59 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:16:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:16:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-272415521',display_name='tempest-VolumesActionsTest-instance-272415521',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-272415521',id=9,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0bb89934454244f5a3438b5a8a74926a',ramdisk_id='',reservation_id='r-fhtk2059',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2128587251',owner_user_name='tempest-VolumesActionsTest-2128587251-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:16:57Z,user_data=None,user_id='fcbf88df1bf143c1b46cbf8d8ca879e4',uuid=1cde3780-2215-4966-86a4-82aae151b022,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc47e64d-5b9b-4518-be08-8b527fca479c", "address": "fa:16:3e:ab:92:bd", "network": {"id": "65e9155d-dde9-47bb-aa24-e6331f2dc71e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1221293796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bb89934454244f5a3438b5a8a74926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc47e64d-5b", "ovs_interfaceid": "bc47e64d-5b9b-4518-be08-8b527fca479c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:16:59 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Converting VIF {"id": "bc47e64d-5b9b-4518-be08-8b527fca479c", "address": "fa:16:3e:ab:92:bd", "network": {"id": "65e9155d-dde9-47bb-aa24-e6331f2dc71e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1221293796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bb89934454244f5a3438b5a8a74926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc47e64d-5b", "ovs_interfaceid": "bc47e64d-5b9b-4518-be08-8b527fca479c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:16:59 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:92:bd,bridge_name='br-int',has_traffic_filtering=True,id=bc47e64d-5b9b-4518-be08-8b527fca479c,network=Network(65e9155d-dde9-47bb-aa24-e6331f2dc71e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc47e64d-5b') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:16:59 user nova-compute[72362]: DEBUG os_vif [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:92:bd,bridge_name='br-int',has_traffic_filtering=True,id=bc47e64d-5b9b-4518-be08-8b527fca479c,network=Network(65e9155d-dde9-47bb-aa24-e6331f2dc71e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc47e64d-5b') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:16:59 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:59 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:16:59 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:16:59 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:59 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbc47e64d-5b, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:16:59 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbc47e64d-5b, col_values=(('external_ids', {'iface-id': 'bc47e64d-5b9b-4518-be08-8b527fca479c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:92:bd', 'vm-uuid': '1cde3780-2215-4966-86a4-82aae151b022'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:16:59 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:59 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:16:59 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:16:59 user nova-compute[72362]: INFO os_vif [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:92:bd,bridge_name='br-int',has_traffic_filtering=True,id=bc47e64d-5b9b-4518-be08-8b527fca479c,network=Network(65e9155d-dde9-47bb-aa24-e6331f2dc71e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc47e64d-5b')
Aug 09 10:16:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:16:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] No VIF found with MAC fa:16:3e:ab:92:bd, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:16:59 user nova-compute[72362]: DEBUG nova.network.neutron [req-6689e0be-9d8c-44c1-b7ae-8f5ce3d48a4c req-7f3c2d89-8602-43c4-bde0-5681bdac8426 service nova] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Updated VIF entry in instance network info cache for port bc47e64d-5b9b-4518-be08-8b527fca479c. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:16:59 user nova-compute[72362]: DEBUG nova.network.neutron [req-6689e0be-9d8c-44c1-b7ae-8f5ce3d48a4c req-7f3c2d89-8602-43c4-bde0-5681bdac8426 service nova] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Updating instance_info_cache with network_info: [{"id": "bc47e64d-5b9b-4518-be08-8b527fca479c", "address": "fa:16:3e:ab:92:bd", "network": {"id": "65e9155d-dde9-47bb-aa24-e6331f2dc71e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1221293796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bb89934454244f5a3438b5a8a74926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc47e64d-5b", "ovs_interfaceid": "bc47e64d-5b9b-4518-be08-8b527fca479c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:16:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-6689e0be-9d8c-44c1-b7ae-8f5ce3d48a4c req-7f3c2d89-8602-43c4-bde0-5681bdac8426 service nova] Releasing lock "refresh_cache-1cde3780-2215-4966-86a4-82aae151b022" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:17:00 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:17:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:17:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:17:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:17:01 user nova-compute[72362]: DEBUG nova.compute.manager [req-fef7a9cc-eed9-4452-821d-59b46d81aed2 req-dd76232d-78b8-47b2-963c-eed998cb0172 service nova] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Received event network-vif-plugged-bc47e64d-5b9b-4518-be08-8b527fca479c {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:17:01 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-fef7a9cc-eed9-4452-821d-59b46d81aed2 req-dd76232d-78b8-47b2-963c-eed998cb0172 service nova] Acquiring lock "1cde3780-2215-4966-86a4-82aae151b022-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:17:01 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-fef7a9cc-eed9-4452-821d-59b46d81aed2 req-dd76232d-78b8-47b2-963c-eed998cb0172 service nova] Lock "1cde3780-2215-4966-86a4-82aae151b022-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:17:01 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-fef7a9cc-eed9-4452-821d-59b46d81aed2 req-dd76232d-78b8-47b2-963c-eed998cb0172 service nova] Lock "1cde3780-2215-4966-86a4-82aae151b022-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:17:01 user nova-compute[72362]: DEBUG nova.compute.manager [req-fef7a9cc-eed9-4452-821d-59b46d81aed2 req-dd76232d-78b8-47b2-963c-eed998cb0172 service nova] [instance: 1cde3780-2215-4966-86a4-82aae151b022] No waiting events found dispatching network-vif-plugged-bc47e64d-5b9b-4518-be08-8b527fca479c {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:17:01 user nova-compute[72362]: WARNING nova.compute.manager [req-fef7a9cc-eed9-4452-821d-59b46d81aed2 req-dd76232d-78b8-47b2-963c-eed998cb0172 service nova] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Received unexpected event network-vif-plugged-bc47e64d-5b9b-4518-be08-8b527fca479c for instance with vm_state building and task_state spawning.
Aug 09 10:17:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:17:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:17:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:17:03 user nova-compute[72362]: DEBUG nova.compute.manager [req-7de21c58-cc29-4477-83be-af35889afe62 req-0b357922-f7f2-4c53-9d4d-ac529541be48 service nova] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Received event network-vif-plugged-bc47e64d-5b9b-4518-be08-8b527fca479c {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:17:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-7de21c58-cc29-4477-83be-af35889afe62 req-0b357922-f7f2-4c53-9d4d-ac529541be48 service nova] Acquiring lock "1cde3780-2215-4966-86a4-82aae151b022-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:17:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-7de21c58-cc29-4477-83be-af35889afe62 req-0b357922-f7f2-4c53-9d4d-ac529541be48 service nova] Lock "1cde3780-2215-4966-86a4-82aae151b022-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:17:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-7de21c58-cc29-4477-83be-af35889afe62 req-0b357922-f7f2-4c53-9d4d-ac529541be48 service nova] Lock "1cde3780-2215-4966-86a4-82aae151b022-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:17:03 user nova-compute[72362]: DEBUG nova.compute.manager [req-7de21c58-cc29-4477-83be-af35889afe62 req-0b357922-f7f2-4c53-9d4d-ac529541be48 service nova] [instance: 1cde3780-2215-4966-86a4-82aae151b022] No waiting events found dispatching network-vif-plugged-bc47e64d-5b9b-4518-be08-8b527fca479c {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:17:03 user nova-compute[72362]: WARNING nova.compute.manager [req-7de21c58-cc29-4477-83be-af35889afe62 req-0b357922-f7f2-4c53-9d4d-ac529541be48 service nova] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Received unexpected event network-vif-plugged-bc47e64d-5b9b-4518-be08-8b527fca479c for instance with vm_state building and task_state spawning.
Aug 09 10:17:03 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576223.6734424, 1cde3780-2215-4966-86a4-82aae151b022 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:17:03 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 1cde3780-2215-4966-86a4-82aae151b022] VM Resumed (Lifecycle Event)
Aug 09 10:17:03 user nova-compute[72362]: DEBUG nova.compute.manager [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:17:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:17:03 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:17:03 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Instance spawned successfully.
Aug 09 10:17:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 10:17:03 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:17:03 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 1cde3780-2215-4966-86a4-82aae151b022] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:17:03 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576223.676063, 1cde3780-2215-4966-86a4-82aae151b022 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:17:03 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 1cde3780-2215-4966-86a4-82aae151b022] VM Started (Lifecycle Event)
Aug 09 10:17:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Found default for hw_cdrom_bus of ide {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:17:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Found default for hw_disk_bus of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:17:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:17:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:17:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Found default for hw_video_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:17:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Found default for hw_vif_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:17:03 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:17:03 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:17:03 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 1cde3780-2215-4966-86a4-82aae151b022] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:17:03 user nova-compute[72362]: INFO nova.compute.manager [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Took 6.54 seconds to spawn the instance on the hypervisor.
Aug 09 10:17:03 user nova-compute[72362]: DEBUG nova.compute.manager [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:17:03 user nova-compute[72362]: INFO nova.compute.manager [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Took 7.38 seconds to build instance.
Aug 09 10:17:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6f38d340-7400-4438-af26-23ac1c3f31ad tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Lock "1cde3780-2215-4966-86a4-82aae151b022" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.504s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:17:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:17:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:17:09 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:17:10 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:17:14 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:17:15 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:17:19 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:17:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:17:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:17:25 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:17:29 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:17:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:17:34 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:17:35 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:17:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:17:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:17:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:17:48 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:17:48 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:17:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:17:49 user nova-compute[72362]: DEBUG nova.compute.manager [req-6fe6eb8a-9b9d-482b-b6b8-c6431706f3b3 req-c57f4cd6-5c14-4e43-9c78-34355d1a31f3 service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Received event network-changed-ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:17:49 user nova-compute[72362]: DEBUG nova.compute.manager [req-6fe6eb8a-9b9d-482b-b6b8-c6431706f3b3 req-c57f4cd6-5c14-4e43-9c78-34355d1a31f3 service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Refreshing instance network info cache due to event network-changed-ec7889ae-0cbc-41e3-a750-a5cb2b522ce9. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:17:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-6fe6eb8a-9b9d-482b-b6b8-c6431706f3b3 req-c57f4cd6-5c14-4e43-9c78-34355d1a31f3 service nova] Acquiring lock "refresh_cache-0e8a7668-1635-4cbc-8c09-ece19ff67d4f" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:17:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-6fe6eb8a-9b9d-482b-b6b8-c6431706f3b3 req-c57f4cd6-5c14-4e43-9c78-34355d1a31f3 service nova] Acquired lock "refresh_cache-0e8a7668-1635-4cbc-8c09-ece19ff67d4f" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:17:49 user nova-compute[72362]: DEBUG nova.network.neutron [req-6fe6eb8a-9b9d-482b-b6b8-c6431706f3b3 req-c57f4cd6-5c14-4e43-9c78-34355d1a31f3 service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Refreshing network info cache for port ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:17:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:17:49 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:17:49 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 10:17:50 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Acquiring lock "1e2e53b4-3a00-4725-840d-215f6609c951" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:17:50 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Lock "1e2e53b4-3a00-4725-840d-215f6609c951" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:17:50 user nova-compute[72362]: DEBUG nova.objects.instance [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Lazy-loading 'flavor' on Instance uuid 1e2e53b4-3a00-4725-840d-215f6609c951 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:17:50 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Lock "1e2e53b4-3a00-4725-840d-215f6609c951" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.092s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:17:50 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Acquiring lock "1e2e53b4-3a00-4725-840d-215f6609c951" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:17:50 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Lock "1e2e53b4-3a00-4725-840d-215f6609c951" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:17:50 user nova-compute[72362]: INFO nova.compute.manager [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Attaching volume 1974f39d-16e2-4e0b-bbe4-f84f298add28 to /dev/vdb
Aug 09 10:17:50 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:17:50 user nova-compute[72362]: DEBUG os_brick.utils [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:17:50 user nova-compute[72362]: INFO oslo.privsep.daemon [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmptbgszkwa/privsep.sock']
Aug 09 10:17:50 user sudo[84000]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmptbgszkwa/privsep.sock
Aug 09 10:17:50 user sudo[84000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 09 10:17:50 user nova-compute[72362]: DEBUG nova.network.neutron [req-6fe6eb8a-9b9d-482b-b6b8-c6431706f3b3 req-c57f4cd6-5c14-4e43-9c78-34355d1a31f3 service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Updated VIF entry in instance network info cache for port ec7889ae-0cbc-41e3-a750-a5cb2b522ce9. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:17:50 user nova-compute[72362]: DEBUG nova.network.neutron [req-6fe6eb8a-9b9d-482b-b6b8-c6431706f3b3 req-c57f4cd6-5c14-4e43-9c78-34355d1a31f3 service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Updating instance_info_cache with network_info: [{"id": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "address": "fa:16:3e:16:b7:79", "network": {"id": "446f0622-648e-499f-bbb1-e4c0d89ab4df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-409995858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5438525a82b4ab08734e363ab1f80ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec7889ae-0c", "ovs_interfaceid": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:17:50 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-6fe6eb8a-9b9d-482b-b6b8-c6431706f3b3 req-c57f4cd6-5c14-4e43-9c78-34355d1a31f3 service nova] Releasing lock "refresh_cache-0e8a7668-1635-4cbc-8c09-ece19ff67d4f" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:17:50 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:17:51 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:17:52 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Acquiring lock "93faa4d2-324e-4373-9706-99ef83cd6f9d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:17:52 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Lock "93faa4d2-324e-4373-9706-99ef83cd6f9d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:17:52 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Starting instance... {{(pid=72362) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 10:17:52 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:17:52 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:17:52 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:17:52 user nova-compute[72362]: INFO nova.compute.claims [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Claim successful on node user
Aug 09 10:17:52 user sudo[84000]: pam_unix(sudo:session): session closed for user root
Aug 09 10:17:52 user nova-compute[72362]: INFO oslo.privsep.daemon [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Spawned new privsep daemon via rootwrap
Aug 09 10:17:52 user nova-compute[72362]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 09 10:17:52 user nova-compute[72362]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 09 10:17:52 user nova-compute[72362]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 09 10:17:52 user nova-compute[72362]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84003
Aug 09 10:17:52 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad87631-ab69-458e-aa7b-43cc4151a7fc]: (2,) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:17:52 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:17:52 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:17:52 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[46650c90-daaf-41c4-a455-cd9dbbe36bea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:17:52 user nova-compute[72362]: WARNING os_brick.initiator.connectors.nvmeof [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 09 10:17:52 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:17:52 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:17:52 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4858b2-43a6-4f4b-ad07-3ba496ee8d7a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:17:52 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:17:52 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:17:52 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:17:52 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c6f171-9b5c-474d-a82b-8b63fb0f27bc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:17:52 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe02b20-730f-45da-a6f1-cfe13bfb1f7a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:17:52 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:17:52 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:17:52 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:17:52 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:17:52 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:17:52 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:17:52 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:17:52 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2163855-6e8b-42a6-a505-85268fa60a23]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:17:52 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:17:52 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:17:52 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:17:52 user nova-compute[72362]: DEBUG os_brick.utils [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] <== get_connector_properties: return (2103ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:17:52 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Updating existing volume attachment record: a7e02827-06b9-443a-8b37-a791e7ae2f50 {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 10:17:52 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.481s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:17:52 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Start building networks asynchronously for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 10:17:52 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Allocating IP information in the background. {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 10:17:52 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] allocate_for_instance() {{(pid=72362) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 10:17:52 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 10:17:52 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Start building block device mappings for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 10:17:52 user nova-compute[72362]: DEBUG nova.policy [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8a4feca60bf046c6bfdd136c25ecbee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd000751b939e4805abb861b91d698b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72362) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 10:17:52 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:17:52 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:17:52 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:17:53 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:17:53 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:17:53 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:17:53 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 10:17:53 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Start spawning the instance on the hypervisor. {{(pid=72362) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 10:17:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:17:53 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Creating image(s)
Aug 09 10:17:53 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Acquiring lock "/opt/stack/data/nova/instances/93faa4d2-324e-4373-9706-99ef83cd6f9d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:17:53 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Lock "/opt/stack/data/nova/instances/93faa4d2-324e-4373-9706-99ef83cd6f9d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:17:53 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Lock "/opt/stack/data/nova/instances/93faa4d2-324e-4373-9706-99ef83cd6f9d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:17:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:17:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.172s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:17:53 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Acquiring lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:17:53 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:17:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:17:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f2bc700-2e69-406f-9a13-52396eae4258/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:17:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.149s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:17:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/93faa4d2-324e-4373-9706-99ef83cd6f9d/disk 1073741824 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:17:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/93faa4d2-324e-4373-9706-99ef83cd6f9d/disk 1073741824" returned: 0 in 0.050s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:17:53 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:17:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:17:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f2bc700-2e69-406f-9a13-52396eae4258/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:17:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f2bc700-2e69-406f-9a13-52396eae4258/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:17:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.149s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:17:53 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Checking if we can resize image /opt/stack/data/nova/instances/93faa4d2-324e-4373-9706-99ef83cd6f9d/disk. size=1073741824 {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 10:17:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93faa4d2-324e-4373-9706-99ef83cd6f9d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:17:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f2bc700-2e69-406f-9a13-52396eae4258/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:17:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00af3d8e-bd93-4520-91e7-29c135c03e55/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:17:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93faa4d2-324e-4373-9706-99ef83cd6f9d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:17:53 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Cannot resize image /opt/stack/data/nova/instances/93faa4d2-324e-4373-9706-99ef83cd6f9d/disk to a smaller size. {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 10:17:53 user nova-compute[72362]: DEBUG nova.objects.instance [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Lazy-loading 'migration_context' on Instance uuid 93faa4d2-324e-4373-9706-99ef83cd6f9d {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:17:53 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:17:53 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Successfully created port: d9a9926b-0688-4bc0-ad84-d04d1c11e889 {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:17:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Created local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 10:17:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Ensure instance console log exists: /opt/stack/data/nova/instances/93faa4d2-324e-4373-9706-99ef83cd6f9d/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:17:53 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:17:53 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:17:53 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:17:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00af3d8e-bd93-4520-91e7-29c135c03e55/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:17:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00af3d8e-bd93-4520-91e7-29c135c03e55/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:17:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00af3d8e-bd93-4520-91e7-29c135c03e55/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:17:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e2e53b4-3a00-4725-840d-215f6609c951/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:17:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e2e53b4-3a00-4725-840d-215f6609c951/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:17:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e2e53b4-3a00-4725-840d-215f6609c951/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:17:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e2e53b4-3a00-4725-840d-215f6609c951/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:17:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cde3780-2215-4966-86a4-82aae151b022/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:17:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cde3780-2215-4966-86a4-82aae151b022/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:17:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cde3780-2215-4966-86a4-82aae151b022/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:17:54 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:17:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cde3780-2215-4966-86a4-82aae151b022/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:17:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca002e73-ddf7-4452-82b6-0d831d984756/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:17:54 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Successfully updated port: d9a9926b-0688-4bc0-ad84-d04d1c11e889 {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:17:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Acquiring lock "refresh_cache-93faa4d2-324e-4373-9706-99ef83cd6f9d" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:17:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Acquired lock "refresh_cache-93faa4d2-324e-4373-9706-99ef83cd6f9d" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:17:54 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:17:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca002e73-ddf7-4452-82b6-0d831d984756/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:17:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca002e73-ddf7-4452-82b6-0d831d984756/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:17:54 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:17:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca002e73-ddf7-4452-82b6-0d831d984756/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:17:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f0c62c9-aa84-4a5b-b909-af5535e87c83/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG nova.compute.manager [req-26bc212d-0f55-434e-931f-a5dcf960e6b3 req-7f6abaa7-b95b-4b53-90ef-8c13af7b75f1 service nova] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Received event network-changed-d9a9926b-0688-4bc0-ad84-d04d1c11e889 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG nova.compute.manager [req-26bc212d-0f55-434e-931f-a5dcf960e6b3 req-7f6abaa7-b95b-4b53-90ef-8c13af7b75f1 service nova] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Refreshing instance network info cache due to event network-changed-d9a9926b-0688-4bc0-ad84-d04d1c11e889. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-26bc212d-0f55-434e-931f-a5dcf960e6b3 req-7f6abaa7-b95b-4b53-90ef-8c13af7b75f1 service nova] Acquiring lock "refresh_cache-93faa4d2-324e-4373-9706-99ef83cd6f9d" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f0c62c9-aa84-4a5b-b909-af5535e87c83/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f0c62c9-aa84-4a5b-b909-af5535e87c83/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f0c62c9-aa84-4a5b-b909-af5535e87c83/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b17b317a-409e-45ad-ac7c-0c298f4f564b/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b17b317a-409e-45ad-ac7c-0c298f4f564b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b17b317a-409e-45ad-ac7c-0c298f4f564b/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b17b317a-409e-45ad-ac7c-0c298f4f564b/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Updating instance_info_cache with network_info: [{"id": "d9a9926b-0688-4bc0-ad84-d04d1c11e889", "address": "fa:16:3e:0d:89:98", "network": {"id": "f6bb574e-dc90-445b-b678-6e7d825a8437", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-198645654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d000751b939e4805abb861b91d698b6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a9926b-06", "ovs_interfaceid": "d9a9926b-0688-4bc0-ad84-d04d1c11e889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea95226c-40fe-4408-a9f0-5538659261a6/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Releasing lock "refresh_cache-93faa4d2-324e-4373-9706-99ef83cd6f9d" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Instance network_info: |[{"id": "d9a9926b-0688-4bc0-ad84-d04d1c11e889", "address": "fa:16:3e:0d:89:98", "network": {"id": "f6bb574e-dc90-445b-b678-6e7d825a8437", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-198645654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d000751b939e4805abb861b91d698b6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a9926b-06", "ovs_interfaceid": "d9a9926b-0688-4bc0-ad84-d04d1c11e889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-26bc212d-0f55-434e-931f-a5dcf960e6b3 req-7f6abaa7-b95b-4b53-90ef-8c13af7b75f1 service nova] Acquired lock "refresh_cache-93faa4d2-324e-4373-9706-99ef83cd6f9d" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG nova.network.neutron [req-26bc212d-0f55-434e-931f-a5dcf960e6b3 req-7f6abaa7-b95b-4b53-90ef-8c13af7b75f1 service nova] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Refreshing network info cache for port d9a9926b-0688-4bc0-ad84-d04d1c11e889 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Start _get_guest_xml network_info=[{"id": "d9a9926b-0688-4bc0-ad84-d04d1c11e889", "address": "fa:16:3e:0d:89:98", "network": {"id": "f6bb574e-dc90-445b-b678-6e7d825a8437", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-198645654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d000751b939e4805abb861b91d698b6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a9926b-06", "ovs_interfaceid": "d9a9926b-0688-4bc0-ad84-d04d1c11e889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': 'a08d1a11-49eb-4212-a351-e11ee9553b95'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:17:55 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:17:55 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:17:55 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:17:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-786448649',display_name='tempest-ServersNegativeTestJSON-server-786448649',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-786448649',id=10,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d000751b939e4805abb861b91d698b6c',ramdisk_id='',reservation_id='r-f74unme7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1689094468',owner_user_name='tempest-ServersNegativeTestJSON-1689094468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:17:53Z,user_data=None,user_id='8a4feca60bf046c6bfdd136c25ecbee3',uuid=93faa4d2-324e-4373-9706-99ef83cd6f9d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9a9926b-0688-4bc0-ad84-d04d1c11e889", "address": "fa:16:3e:0d:89:98", "network": {"id": "f6bb574e-dc90-445b-b678-6e7d825a8437", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-198645654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d000751b939e4805abb861b91d698b6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a9926b-06", "ovs_interfaceid": "d9a9926b-0688-4bc0-ad84-d04d1c11e889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Converting VIF {"id": "d9a9926b-0688-4bc0-ad84-d04d1c11e889", "address": "fa:16:3e:0d:89:98", "network": {"id": "f6bb574e-dc90-445b-b678-6e7d825a8437", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-198645654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d000751b939e4805abb861b91d698b6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a9926b-06", "ovs_interfaceid": "d9a9926b-0688-4bc0-ad84-d04d1c11e889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:89:98,bridge_name='br-int',has_traffic_filtering=True,id=d9a9926b-0688-4bc0-ad84-d04d1c11e889,network=Network(f6bb574e-dc90-445b-b678-6e7d825a8437),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9a9926b-06') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG nova.objects.instance [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Lazy-loading 'pci_devices' on Instance uuid 93faa4d2-324e-4373-9706-99ef83cd6f9d {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:17:55 user nova-compute[72362]:   <uuid>93faa4d2-324e-4373-9706-99ef83cd6f9d</uuid>
Aug 09 10:17:55 user nova-compute[72362]:   <name>instance-0000000a</name>
Aug 09 10:17:55 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:17:55 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:17:55 user nova-compute[72362]:   <metadata>
Aug 09 10:17:55 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:17:55 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:17:55 user nova-compute[72362]:       <nova:name>tempest-ServersNegativeTestJSON-server-786448649</nova:name>
Aug 09 10:17:55 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:17:55</nova:creationTime>
Aug 09 10:17:55 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:17:55 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:17:55 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:17:55 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:17:55 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:17:55 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:17:55 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:17:55 user nova-compute[72362]:       <nova:owner>
Aug 09 10:17:55 user nova-compute[72362]:         <nova:user uuid="8a4feca60bf046c6bfdd136c25ecbee3">tempest-ServersNegativeTestJSON-1689094468-project-member</nova:user>
Aug 09 10:17:55 user nova-compute[72362]:         <nova:project uuid="d000751b939e4805abb861b91d698b6c">tempest-ServersNegativeTestJSON-1689094468</nova:project>
Aug 09 10:17:55 user nova-compute[72362]:       </nova:owner>
Aug 09 10:17:55 user nova-compute[72362]:       <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:17:55 user nova-compute[72362]:       <nova:ports>
Aug 09 10:17:55 user nova-compute[72362]:         <nova:port uuid="d9a9926b-0688-4bc0-ad84-d04d1c11e889">
Aug 09 10:17:55 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 10:17:55 user nova-compute[72362]:         </nova:port>
Aug 09 10:17:55 user nova-compute[72362]:       </nova:ports>
Aug 09 10:17:55 user nova-compute[72362]:     </nova:instance>
Aug 09 10:17:55 user nova-compute[72362]:   </metadata>
Aug 09 10:17:55 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:17:55 user nova-compute[72362]:     <system>
Aug 09 10:17:55 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:17:55 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:17:55 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:17:55 user nova-compute[72362]:       <entry name="serial">93faa4d2-324e-4373-9706-99ef83cd6f9d</entry>
Aug 09 10:17:55 user nova-compute[72362]:       <entry name="uuid">93faa4d2-324e-4373-9706-99ef83cd6f9d</entry>
Aug 09 10:17:55 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:17:55 user nova-compute[72362]:     </system>
Aug 09 10:17:55 user nova-compute[72362]:   </sysinfo>
Aug 09 10:17:55 user nova-compute[72362]:   <os>
Aug 09 10:17:55 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:17:55 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:17:55 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:17:55 user nova-compute[72362]:   </os>
Aug 09 10:17:55 user nova-compute[72362]:   <features>
Aug 09 10:17:55 user nova-compute[72362]:     <acpi/>
Aug 09 10:17:55 user nova-compute[72362]:     <apic/>
Aug 09 10:17:55 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:17:55 user nova-compute[72362]:   </features>
Aug 09 10:17:55 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:17:55 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:17:55 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:17:55 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:17:55 user nova-compute[72362]:   </clock>
Aug 09 10:17:55 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:17:55 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:17:55 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:17:55 user nova-compute[72362]:   </cpu>
Aug 09 10:17:55 user nova-compute[72362]:   <devices>
Aug 09 10:17:55 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:17:55 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:17:55 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/93faa4d2-324e-4373-9706-99ef83cd6f9d/disk"/>
Aug 09 10:17:55 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:17:55 user nova-compute[72362]:     </disk>
Aug 09 10:17:55 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:17:55 user nova-compute[72362]:       <mac address="fa:16:3e:0d:89:98"/>
Aug 09 10:17:55 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:17:55 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:17:55 user nova-compute[72362]:       <target dev="tapd9a9926b-06"/>
Aug 09 10:17:55 user nova-compute[72362]:     </interface>
Aug 09 10:17:55 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:17:55 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/93faa4d2-324e-4373-9706-99ef83cd6f9d/console.log" append="off"/>
Aug 09 10:17:55 user nova-compute[72362]:     </serial>
Aug 09 10:17:55 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:17:55 user nova-compute[72362]:     <video>
Aug 09 10:17:55 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:17:55 user nova-compute[72362]:     </video>
Aug 09 10:17:55 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:17:55 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:17:55 user nova-compute[72362]:     </rng>
Aug 09 10:17:55 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:17:55 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:17:55 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:17:55 user nova-compute[72362]:     </memballoon>
Aug 09 10:17:55 user nova-compute[72362]:   </devices>
Aug 09 10:17:55 user nova-compute[72362]: </domain>
Aug 09 10:17:55 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:17:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-786448649',display_name='tempest-ServersNegativeTestJSON-server-786448649',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-786448649',id=10,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d000751b939e4805abb861b91d698b6c',ramdisk_id='',reservation_id='r-f74unme7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1689094468',owner_user_name='tempest-ServersNegativeTestJSON-1689094468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:17:53Z,user_data=None,user_id='8a4feca60bf046c6bfdd136c25ecbee3',uuid=93faa4d2-324e-4373-9706-99ef83cd6f9d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9a9926b-0688-4bc0-ad84-d04d1c11e889", "address": "fa:16:3e:0d:89:98", "network": {"id": "f6bb574e-dc90-445b-b678-6e7d825a8437", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-198645654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d000751b939e4805abb861b91d698b6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a9926b-06", "ovs_interfaceid": "d9a9926b-0688-4bc0-ad84-d04d1c11e889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Converting VIF {"id": "d9a9926b-0688-4bc0-ad84-d04d1c11e889", "address": "fa:16:3e:0d:89:98", "network": {"id": "f6bb574e-dc90-445b-b678-6e7d825a8437", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-198645654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d000751b939e4805abb861b91d698b6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a9926b-06", "ovs_interfaceid": "d9a9926b-0688-4bc0-ad84-d04d1c11e889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:89:98,bridge_name='br-int',has_traffic_filtering=True,id=d9a9926b-0688-4bc0-ad84-d04d1c11e889,network=Network(f6bb574e-dc90-445b-b678-6e7d825a8437),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9a9926b-06') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG os_vif [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:89:98,bridge_name='br-int',has_traffic_filtering=True,id=d9a9926b-0688-4bc0-ad84-d04d1c11e889,network=Network(f6bb574e-dc90-445b-b678-6e7d825a8437),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9a9926b-06') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea95226c-40fe-4408-a9f0-5538659261a6/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea95226c-40fe-4408-a9f0-5538659261a6/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd9a9926b-06, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd9a9926b-06, col_values=(('external_ids', {'iface-id': 'd9a9926b-0688-4bc0-ad84-d04d1c11e889', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:89:98', 'vm-uuid': '93faa4d2-324e-4373-9706-99ef83cd6f9d'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:17:55 user nova-compute[72362]: INFO os_vif [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:89:98,bridge_name='br-int',has_traffic_filtering=True,id=d9a9926b-0688-4bc0-ad84-d04d1c11e889,network=Network(f6bb574e-dc90-445b-b678-6e7d825a8437),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9a9926b-06')
Aug 09 10:17:55 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] No VIF found with MAC fa:16:3e:0d:89:98, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea95226c-40fe-4408-a9f0-5538659261a6/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:17:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:17:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:17:56 user nova-compute[72362]: DEBUG nova.network.neutron [req-26bc212d-0f55-434e-931f-a5dcf960e6b3 req-7f6abaa7-b95b-4b53-90ef-8c13af7b75f1 service nova] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Updated VIF entry in instance network info cache for port d9a9926b-0688-4bc0-ad84-d04d1c11e889. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:17:56 user nova-compute[72362]: DEBUG nova.network.neutron [req-26bc212d-0f55-434e-931f-a5dcf960e6b3 req-7f6abaa7-b95b-4b53-90ef-8c13af7b75f1 service nova] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Updating instance_info_cache with network_info: [{"id": "d9a9926b-0688-4bc0-ad84-d04d1c11e889", "address": "fa:16:3e:0d:89:98", "network": {"id": "f6bb574e-dc90-445b-b678-6e7d825a8437", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-198645654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d000751b939e4805abb861b91d698b6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a9926b-06", "ovs_interfaceid": "d9a9926b-0688-4bc0-ad84-d04d1c11e889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:17:59 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:17:59 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576279.3246794, 93faa4d2-324e-4373-9706-99ef83cd6f9d => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:17:59 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] VM Resumed (Lifecycle Event)
Aug 09 10:17:59 user nova-compute[72362]: DEBUG nova.compute.manager [req-e06f0806-5f54-4650-8a80-69edf4289694 req-ac4a18f1-cabf-43a6-b191-ccb3602a25a2 service nova] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Received event network-vif-plugged-d9a9926b-0688-4bc0-ad84-d04d1c11e889 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:17:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e06f0806-5f54-4650-8a80-69edf4289694 req-ac4a18f1-cabf-43a6-b191-ccb3602a25a2 service nova] Acquiring lock "93faa4d2-324e-4373-9706-99ef83cd6f9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:17:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e06f0806-5f54-4650-8a80-69edf4289694 req-ac4a18f1-cabf-43a6-b191-ccb3602a25a2 service nova] Lock "93faa4d2-324e-4373-9706-99ef83cd6f9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:17:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e06f0806-5f54-4650-8a80-69edf4289694 req-ac4a18f1-cabf-43a6-b191-ccb3602a25a2 service nova] Lock "93faa4d2-324e-4373-9706-99ef83cd6f9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:17:59 user nova-compute[72362]: DEBUG nova.compute.manager [req-e06f0806-5f54-4650-8a80-69edf4289694 req-ac4a18f1-cabf-43a6-b191-ccb3602a25a2 service nova] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] No waiting events found dispatching network-vif-plugged-d9a9926b-0688-4bc0-ad84-d04d1c11e889 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:17:59 user nova-compute[72362]: WARNING nova.compute.manager [req-e06f0806-5f54-4650-8a80-69edf4289694 req-ac4a18f1-cabf-43a6-b191-ccb3602a25a2 service nova] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Received unexpected event network-vif-plugged-d9a9926b-0688-4bc0-ad84-d04d1c11e889 for instance with vm_state building and task_state spawning.
Aug 09 10:17:59 user nova-compute[72362]: DEBUG nova.compute.manager [req-5e9b4901-1ce3-4ed3-a4eb-63cf148ce739 req-1db4cece-d315-46df-8cd7-3dd737446598 service nova] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Received event network-vif-plugged-d9a9926b-0688-4bc0-ad84-d04d1c11e889 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:17:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-5e9b4901-1ce3-4ed3-a4eb-63cf148ce739 req-1db4cece-d315-46df-8cd7-3dd737446598 service nova] Acquiring lock "93faa4d2-324e-4373-9706-99ef83cd6f9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:17:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-5e9b4901-1ce3-4ed3-a4eb-63cf148ce739 req-1db4cece-d315-46df-8cd7-3dd737446598 service nova] Lock "93faa4d2-324e-4373-9706-99ef83cd6f9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:17:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-5e9b4901-1ce3-4ed3-a4eb-63cf148ce739 req-1db4cece-d315-46df-8cd7-3dd737446598 service nova] Lock "93faa4d2-324e-4373-9706-99ef83cd6f9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:17:59 user nova-compute[72362]: DEBUG nova.compute.manager [req-5e9b4901-1ce3-4ed3-a4eb-63cf148ce739 req-1db4cece-d315-46df-8cd7-3dd737446598 service nova] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] No waiting events found dispatching network-vif-plugged-d9a9926b-0688-4bc0-ad84-d04d1c11e889 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:17:59 user nova-compute[72362]: WARNING nova.compute.manager [req-5e9b4901-1ce3-4ed3-a4eb-63cf148ce739 req-1db4cece-d315-46df-8cd7-3dd737446598 service nova] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Received unexpected event network-vif-plugged-d9a9926b-0688-4bc0-ad84-d04d1c11e889 for instance with vm_state building and task_state spawning.
Aug 09 10:17:59 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:17:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:17:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-26bc212d-0f55-434e-931f-a5dcf960e6b3 req-7f6abaa7-b95b-4b53-90ef-8c13af7b75f1 service nova] Releasing lock "refresh_cache-93faa4d2-324e-4373-9706-99ef83cd6f9d" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:17:59 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:17:59 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:17:59 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Instance spawned successfully.
Aug 09 10:17:59 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:17:59 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:17:59 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=7157MB free_disk=25.4649658203125GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 10:17:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:17:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:17:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 10:17:59 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:17:59 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576279.325528, 93faa4d2-324e-4373-9706-99ef83cd6f9d => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:17:59 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] VM Started (Lifecycle Event)
Aug 09 10:17:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Found default for hw_cdrom_bus of ide {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:17:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Found default for hw_disk_bus of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:17:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:17:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:17:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Found default for hw_video_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:17:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Found default for hw_vif_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:17:59 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:17:59 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:17:59 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:18:00 user nova-compute[72362]: INFO nova.compute.manager [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Took 7.06 seconds to spawn the instance on the hypervisor.
Aug 09 10:18:00 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:18:00 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 1e2e53b4-3a00-4725-840d-215f6609c951 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:18:00 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 0e8a7668-1635-4cbc-8c09-ece19ff67d4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:18:00 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance ca002e73-ddf7-4452-82b6-0d831d984756 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:18:00 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance ea95226c-40fe-4408-a9f0-5538659261a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:18:00 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 8f0c62c9-aa84-4a5b-b909-af5535e87c83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:18:00 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance b17b317a-409e-45ad-ac7c-0c298f4f564b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:18:00 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 00af3d8e-bd93-4520-91e7-29c135c03e55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:18:00 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 9f2bc700-2e69-406f-9a13-52396eae4258 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:18:00 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 1cde3780-2215-4966-86a4-82aae151b022 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:18:00 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 93faa4d2-324e-4373-9706-99ef83cd6f9d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:18:00 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 10:18:00 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 10:18:00 user nova-compute[72362]: INFO nova.compute.manager [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Took 7.97 seconds to build instance.
Aug 09 10:18:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1211a057-9077-441c-8a18-5c681c61da1f tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Lock "93faa4d2-324e-4373-9706-99ef83cd6f9d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.087s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:18:00 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:18:00 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:18:00 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 10:18:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.658s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:18:00 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:00 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:01 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:18:01 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:18:01 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 10:18:01 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "refresh_cache-0e8a7668-1635-4cbc-8c09-ece19ff67d4f" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:18:01 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquired lock "refresh_cache-0e8a7668-1635-4cbc-8c09-ece19ff67d4f" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:18:01 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Forcefully refreshing network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 10:18:02 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Updating instance_info_cache with network_info: [{"id": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "address": "fa:16:3e:16:b7:79", "network": {"id": "446f0622-648e-499f-bbb1-e4c0d89ab4df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-409995858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5438525a82b4ab08734e363ab1f80ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec7889ae-0c", "ovs_interfaceid": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:18:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Releasing lock "refresh_cache-0e8a7668-1635-4cbc-8c09-ece19ff67d4f" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:18:02 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Updated the network info_cache for instance {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 10:18:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Acquiring lock "9b731e53-3436-44d2-b674-841871804c80" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:18:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Lock "9b731e53-3436-44d2-b674-841871804c80" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:18:02 user nova-compute[72362]: DEBUG nova.compute.manager [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] [instance: 9b731e53-3436-44d2-b674-841871804c80] Starting instance... {{(pid=72362) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 10:18:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:18:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:18:02 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:18:02 user nova-compute[72362]: INFO nova.compute.claims [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] [instance: 9b731e53-3436-44d2-b674-841871804c80] Claim successful on node user
Aug 09 10:18:03 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:18:03 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:18:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.562s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:18:03 user nova-compute[72362]: DEBUG nova.compute.manager [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] [instance: 9b731e53-3436-44d2-b674-841871804c80] Start building networks asynchronously for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 10:18:03 user nova-compute[72362]: DEBUG nova.compute.manager [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] [instance: 9b731e53-3436-44d2-b674-841871804c80] Allocating IP information in the background. {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 10:18:03 user nova-compute[72362]: DEBUG nova.network.neutron [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] [instance: 9b731e53-3436-44d2-b674-841871804c80] allocate_for_instance() {{(pid=72362) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 10:18:03 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] [instance: 9b731e53-3436-44d2-b674-841871804c80] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 10:18:03 user nova-compute[72362]: DEBUG nova.compute.manager [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] [instance: 9b731e53-3436-44d2-b674-841871804c80] Start building block device mappings for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 10:18:03 user nova-compute[72362]: DEBUG nova.policy [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5b07543d712f4b8299f25508ec88a705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf8f7f0d90e4cdaacc82ef0ca2bb6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72362) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 10:18:03 user nova-compute[72362]: DEBUG nova.compute.manager [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] [instance: 9b731e53-3436-44d2-b674-841871804c80] Start spawning the instance on the hypervisor. {{(pid=72362) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 10:18:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] [instance: 9b731e53-3436-44d2-b674-841871804c80] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:18:03 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] [instance: 9b731e53-3436-44d2-b674-841871804c80] Creating image(s)
Aug 09 10:18:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Acquiring lock "/opt/stack/data/nova/instances/9b731e53-3436-44d2-b674-841871804c80/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:18:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Lock "/opt/stack/data/nova/instances/9b731e53-3436-44d2-b674-841871804c80/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:18:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Lock "/opt/stack/data/nova/instances/9b731e53-3436-44d2-b674-841871804c80/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:18:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.149s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Acquiring lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:18:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:18:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.141s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/9b731e53-3436-44d2-b674-841871804c80/disk 1073741824 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/9b731e53-3436-44d2-b674-841871804c80/disk 1073741824" returned: 0 in 0.062s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:18:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.165s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:04 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9b731e53-3436-44d2-b674-841871804c80/disk. size=1073741824 {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 10:18:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b731e53-3436-44d2-b674-841871804c80/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b731e53-3436-44d2-b674-841871804c80/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:04 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Cannot resize image /opt/stack/data/nova/instances/9b731e53-3436-44d2-b674-841871804c80/disk to a smaller size. {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 10:18:04 user nova-compute[72362]: DEBUG nova.objects.instance [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Lazy-loading 'migration_context' on Instance uuid 9b731e53-3436-44d2-b674-841871804c80 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:18:04 user nova-compute[72362]: DEBUG nova.network.neutron [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] [instance: 9b731e53-3436-44d2-b674-841871804c80] Successfully created port: f62ea1bc-bdf0-4f55-8364-b48bcaf3fcd6 {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:18:04 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] [instance: 9b731e53-3436-44d2-b674-841871804c80] Created local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 10:18:04 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] [instance: 9b731e53-3436-44d2-b674-841871804c80] Ensure instance console log exists: /opt/stack/data/nova/instances/9b731e53-3436-44d2-b674-841871804c80/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:18:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:18:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:18:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:18:05 user nova-compute[72362]: DEBUG nova.network.neutron [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] [instance: 9b731e53-3436-44d2-b674-841871804c80] Successfully updated port: f62ea1bc-bdf0-4f55-8364-b48bcaf3fcd6 {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:18:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Acquiring lock "refresh_cache-9b731e53-3436-44d2-b674-841871804c80" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:18:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Acquired lock "refresh_cache-9b731e53-3436-44d2-b674-841871804c80" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:18:05 user nova-compute[72362]: DEBUG nova.network.neutron [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] [instance: 9b731e53-3436-44d2-b674-841871804c80] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:18:05 user nova-compute[72362]: DEBUG nova.compute.manager [req-db610c67-01fb-4182-8a79-c369a68e22ee req-2fb493d9-9788-4647-8f89-5b74293dec64 service nova] [instance: 9b731e53-3436-44d2-b674-841871804c80] Received event network-changed-f62ea1bc-bdf0-4f55-8364-b48bcaf3fcd6 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:18:05 user nova-compute[72362]: DEBUG nova.compute.manager [req-db610c67-01fb-4182-8a79-c369a68e22ee req-2fb493d9-9788-4647-8f89-5b74293dec64 service nova] [instance: 9b731e53-3436-44d2-b674-841871804c80] Refreshing instance network info cache due to event network-changed-f62ea1bc-bdf0-4f55-8364-b48bcaf3fcd6. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:18:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-db610c67-01fb-4182-8a79-c369a68e22ee req-2fb493d9-9788-4647-8f89-5b74293dec64 service nova] Acquiring lock "refresh_cache-9b731e53-3436-44d2-b674-841871804c80" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:18:05 user nova-compute[72362]: DEBUG nova.network.neutron [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] [instance: 9b731e53-3436-44d2-b674-841871804c80] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:18:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:05 user nova-compute[72362]: DEBUG nova.network.neutron [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] [instance: 9b731e53-3436-44d2-b674-841871804c80] Updating instance_info_cache with network_info: [{"id": "f62ea1bc-bdf0-4f55-8364-b48bcaf3fcd6", "address": "fa:16:3e:42:29:7d", "network": {"id": "0c430946-544b-4a74-91c7-a532c31a242b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-265088703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bf8f7f0d90e4cdaacc82ef0ca2bb6f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf62ea1bc-bd", "ovs_interfaceid": "f62ea1bc-bdf0-4f55-8364-b48bcaf3fcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:18:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Releasing lock "refresh_cache-9b731e53-3436-44d2-b674-841871804c80" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:18:05 user nova-compute[72362]: DEBUG nova.compute.manager [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] [instance: 9b731e53-3436-44d2-b674-841871804c80] Instance network_info: |[{"id": "f62ea1bc-bdf0-4f55-8364-b48bcaf3fcd6", "address": "fa:16:3e:42:29:7d", "network": {"id": "0c430946-544b-4a74-91c7-a532c31a242b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-265088703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bf8f7f0d90e4cdaacc82ef0ca2bb6f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf62ea1bc-bd", "ovs_interfaceid": "f62ea1bc-bdf0-4f55-8364-b48bcaf3fcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 10:18:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-db610c67-01fb-4182-8a79-c369a68e22ee req-2fb493d9-9788-4647-8f89-5b74293dec64 service nova] Acquired lock "refresh_cache-9b731e53-3436-44d2-b674-841871804c80" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:18:05 user nova-compute[72362]: DEBUG nova.network.neutron [req-db610c67-01fb-4182-8a79-c369a68e22ee req-2fb493d9-9788-4647-8f89-5b74293dec64 service nova] [instance: 9b731e53-3436-44d2-b674-841871804c80] Refreshing network info cache for port f62ea1bc-bdf0-4f55-8364-b48bcaf3fcd6 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:18:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] [instance: 9b731e53-3436-44d2-b674-841871804c80] Start _get_guest_xml network_info=[{"id": "f62ea1bc-bdf0-4f55-8364-b48bcaf3fcd6", "address": "fa:16:3e:42:29:7d", "network": {"id": "0c430946-544b-4a74-91c7-a532c31a242b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-265088703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bf8f7f0d90e4cdaacc82ef0ca2bb6f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf62ea1bc-bd", "ovs_interfaceid": "f62ea1bc-bdf0-4f55-8364-b48bcaf3fcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': 'a08d1a11-49eb-4212-a351-e11ee9553b95'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:18:05 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:18:05 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:18:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:18:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:18:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:18:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:18:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:18:05 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:18:05 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:18:05 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:18:05 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:18:05 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:18:05 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:18:05 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:18:05 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:18:05 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:18:05 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:18:05 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:18:06 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:18:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-490422599',display_name='tempest-VolumesActionsTest-instance-490422599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-490422599',id=11,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bf8f7f0d90e4cdaacc82ef0ca2bb6f0',ramdisk_id='',reservation_id='r-shlvf065',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1694979699',owner_user_name='tempest-VolumesActionsTest-1694979699-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:18:04Z,user_data=None,user_id='5b07543d712f4b8299f25508ec88a705',uuid=9b731e53-3436-44d2-b674-841871804c80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f62ea1bc-bdf0-4f55-8364-b48bcaf3fcd6", "address": "fa:16:3e:42:29:7d", "network": {"id": "0c430946-544b-4a74-91c7-a532c31a242b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-265088703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bf8f7f0d90e4cdaacc82ef0ca2bb6f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf62ea1bc-bd", "ovs_interfaceid": "f62ea1bc-bdf0-4f55-8364-b48bcaf3fcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:18:06 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Converting VIF {"id": "f62ea1bc-bdf0-4f55-8364-b48bcaf3fcd6", "address": "fa:16:3e:42:29:7d", "network": {"id": "0c430946-544b-4a74-91c7-a532c31a242b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-265088703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bf8f7f0d90e4cdaacc82ef0ca2bb6f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf62ea1bc-bd", "ovs_interfaceid": "f62ea1bc-bdf0-4f55-8364-b48bcaf3fcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:18:06 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:29:7d,bridge_name='br-int',has_traffic_filtering=True,id=f62ea1bc-bdf0-4f55-8364-b48bcaf3fcd6,network=Network(0c430946-544b-4a74-91c7-a532c31a242b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf62ea1bc-bd') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:18:06 user nova-compute[72362]: DEBUG nova.objects.instance [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Lazy-loading 'pci_devices' on Instance uuid 9b731e53-3436-44d2-b674-841871804c80 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:18:06 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] [instance: 9b731e53-3436-44d2-b674-841871804c80] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:18:06 user nova-compute[72362]:   <uuid>9b731e53-3436-44d2-b674-841871804c80</uuid>
Aug 09 10:18:06 user nova-compute[72362]:   <name>instance-0000000b</name>
Aug 09 10:18:06 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:18:06 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:18:06 user nova-compute[72362]:   <metadata>
Aug 09 10:18:06 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:18:06 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:18:06 user nova-compute[72362]:       <nova:name>tempest-VolumesActionsTest-instance-490422599</nova:name>
Aug 09 10:18:06 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:18:05</nova:creationTime>
Aug 09 10:18:06 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:18:06 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:18:06 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:18:06 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:18:06 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:18:06 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:18:06 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:18:06 user nova-compute[72362]:       <nova:owner>
Aug 09 10:18:06 user nova-compute[72362]:         <nova:user uuid="5b07543d712f4b8299f25508ec88a705">tempest-VolumesActionsTest-1694979699-project-member</nova:user>
Aug 09 10:18:06 user nova-compute[72362]:         <nova:project uuid="7bf8f7f0d90e4cdaacc82ef0ca2bb6f0">tempest-VolumesActionsTest-1694979699</nova:project>
Aug 09 10:18:06 user nova-compute[72362]:       </nova:owner>
Aug 09 10:18:06 user nova-compute[72362]:       <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:18:06 user nova-compute[72362]:       <nova:ports>
Aug 09 10:18:06 user nova-compute[72362]:         <nova:port uuid="f62ea1bc-bdf0-4f55-8364-b48bcaf3fcd6">
Aug 09 10:18:06 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 09 10:18:06 user nova-compute[72362]:         </nova:port>
Aug 09 10:18:06 user nova-compute[72362]:       </nova:ports>
Aug 09 10:18:06 user nova-compute[72362]:     </nova:instance>
Aug 09 10:18:06 user nova-compute[72362]:   </metadata>
Aug 09 10:18:06 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:18:06 user nova-compute[72362]:     <system>
Aug 09 10:18:06 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:18:06 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:18:06 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:18:06 user nova-compute[72362]:       <entry name="serial">9b731e53-3436-44d2-b674-841871804c80</entry>
Aug 09 10:18:06 user nova-compute[72362]:       <entry name="uuid">9b731e53-3436-44d2-b674-841871804c80</entry>
Aug 09 10:18:06 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:18:06 user nova-compute[72362]:     </system>
Aug 09 10:18:06 user nova-compute[72362]:   </sysinfo>
Aug 09 10:18:06 user nova-compute[72362]:   <os>
Aug 09 10:18:06 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:18:06 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:18:06 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:18:06 user nova-compute[72362]:   </os>
Aug 09 10:18:06 user nova-compute[72362]:   <features>
Aug 09 10:18:06 user nova-compute[72362]:     <acpi/>
Aug 09 10:18:06 user nova-compute[72362]:     <apic/>
Aug 09 10:18:06 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:18:06 user nova-compute[72362]:   </features>
Aug 09 10:18:06 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:18:06 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:18:06 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:18:06 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:18:06 user nova-compute[72362]:   </clock>
Aug 09 10:18:06 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:18:06 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:18:06 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:18:06 user nova-compute[72362]:   </cpu>
Aug 09 10:18:06 user nova-compute[72362]:   <devices>
Aug 09 10:18:06 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:18:06 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:18:06 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/9b731e53-3436-44d2-b674-841871804c80/disk"/>
Aug 09 10:18:06 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:18:06 user nova-compute[72362]:     </disk>
Aug 09 10:18:06 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:18:06 user nova-compute[72362]:       <mac address="fa:16:3e:42:29:7d"/>
Aug 09 10:18:06 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:18:06 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:18:06 user nova-compute[72362]:       <target dev="tapf62ea1bc-bd"/>
Aug 09 10:18:06 user nova-compute[72362]:     </interface>
Aug 09 10:18:06 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:18:06 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/9b731e53-3436-44d2-b674-841871804c80/console.log" append="off"/>
Aug 09 10:18:06 user nova-compute[72362]:     </serial>
Aug 09 10:18:06 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:18:06 user nova-compute[72362]:     <video>
Aug 09 10:18:06 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:18:06 user nova-compute[72362]:     </video>
Aug 09 10:18:06 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:18:06 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:18:06 user nova-compute[72362]:     </rng>
Aug 09 10:18:06 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:18:06 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:18:06 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:18:06 user nova-compute[72362]:     </memballoon>
Aug 09 10:18:06 user nova-compute[72362]:   </devices>
Aug 09 10:18:06 user nova-compute[72362]: </domain>
Aug 09 10:18:06 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:18:06 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:18:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-490422599',display_name='tempest-VolumesActionsTest-instance-490422599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-490422599',id=11,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bf8f7f0d90e4cdaacc82ef0ca2bb6f0',ramdisk_id='',reservation_id='r-shlvf065',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1694979699',owner_user_name='tempest-VolumesActionsTest-1694979699-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:18:04Z,user_data=None,user_id='5b07543d712f4b8299f25508ec88a705',uuid=9b731e53-3436-44d2-b674-841871804c80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f62ea1bc-bdf0-4f55-8364-b48bcaf3fcd6", "address": "fa:16:3e:42:29:7d", "network": {"id": "0c430946-544b-4a74-91c7-a532c31a242b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-265088703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bf8f7f0d90e4cdaacc82ef0ca2bb6f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf62ea1bc-bd", "ovs_interfaceid": "f62ea1bc-bdf0-4f55-8364-b48bcaf3fcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:18:06 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Converting VIF {"id": "f62ea1bc-bdf0-4f55-8364-b48bcaf3fcd6", "address": "fa:16:3e:42:29:7d", "network": {"id": "0c430946-544b-4a74-91c7-a532c31a242b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-265088703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bf8f7f0d90e4cdaacc82ef0ca2bb6f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf62ea1bc-bd", "ovs_interfaceid": "f62ea1bc-bdf0-4f55-8364-b48bcaf3fcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:18:06 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:29:7d,bridge_name='br-int',has_traffic_filtering=True,id=f62ea1bc-bdf0-4f55-8364-b48bcaf3fcd6,network=Network(0c430946-544b-4a74-91c7-a532c31a242b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf62ea1bc-bd') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:18:06 user nova-compute[72362]: DEBUG os_vif [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:29:7d,bridge_name='br-int',has_traffic_filtering=True,id=f62ea1bc-bdf0-4f55-8364-b48bcaf3fcd6,network=Network(0c430946-544b-4a74-91c7-a532c31a242b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf62ea1bc-bd') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:18:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:18:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:18:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf62ea1bc-bd, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:18:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf62ea1bc-bd, col_values=(('external_ids', {'iface-id': 'f62ea1bc-bdf0-4f55-8364-b48bcaf3fcd6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:29:7d', 'vm-uuid': '9b731e53-3436-44d2-b674-841871804c80'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:18:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:18:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:06 user nova-compute[72362]: INFO os_vif [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:29:7d,bridge_name='br-int',has_traffic_filtering=True,id=f62ea1bc-bdf0-4f55-8364-b48bcaf3fcd6,network=Network(0c430946-544b-4a74-91c7-a532c31a242b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf62ea1bc-bd')
Aug 09 10:18:06 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:18:06 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] No VIF found with MAC fa:16:3e:42:29:7d, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:18:06 user nova-compute[72362]: DEBUG nova.network.neutron [req-db610c67-01fb-4182-8a79-c369a68e22ee req-2fb493d9-9788-4647-8f89-5b74293dec64 service nova] [instance: 9b731e53-3436-44d2-b674-841871804c80] Updated VIF entry in instance network info cache for port f62ea1bc-bdf0-4f55-8364-b48bcaf3fcd6. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:18:06 user nova-compute[72362]: DEBUG nova.network.neutron [req-db610c67-01fb-4182-8a79-c369a68e22ee req-2fb493d9-9788-4647-8f89-5b74293dec64 service nova] [instance: 9b731e53-3436-44d2-b674-841871804c80] Updating instance_info_cache with network_info: [{"id": "f62ea1bc-bdf0-4f55-8364-b48bcaf3fcd6", "address": "fa:16:3e:42:29:7d", "network": {"id": "0c430946-544b-4a74-91c7-a532c31a242b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-265088703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bf8f7f0d90e4cdaacc82ef0ca2bb6f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf62ea1bc-bd", "ovs_interfaceid": "f62ea1bc-bdf0-4f55-8364-b48bcaf3fcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:18:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-db610c67-01fb-4182-8a79-c369a68e22ee req-2fb493d9-9788-4647-8f89-5b74293dec64 service nova] Releasing lock "refresh_cache-9b731e53-3436-44d2-b674-841871804c80" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:18:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:07 user nova-compute[72362]: DEBUG nova.compute.manager [req-9fb13720-64b8-4597-a6b3-f09c14189c49 req-be51b9c3-22ab-4760-95c5-70085ae042dc service nova] [instance: 9b731e53-3436-44d2-b674-841871804c80] Received event network-vif-plugged-f62ea1bc-bdf0-4f55-8364-b48bcaf3fcd6 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:18:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-9fb13720-64b8-4597-a6b3-f09c14189c49 req-be51b9c3-22ab-4760-95c5-70085ae042dc service nova] Acquiring lock "9b731e53-3436-44d2-b674-841871804c80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:18:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-9fb13720-64b8-4597-a6b3-f09c14189c49 req-be51b9c3-22ab-4760-95c5-70085ae042dc service nova] Lock "9b731e53-3436-44d2-b674-841871804c80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:18:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-9fb13720-64b8-4597-a6b3-f09c14189c49 req-be51b9c3-22ab-4760-95c5-70085ae042dc service nova] Lock "9b731e53-3436-44d2-b674-841871804c80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:18:07 user nova-compute[72362]: DEBUG nova.compute.manager [req-9fb13720-64b8-4597-a6b3-f09c14189c49 req-be51b9c3-22ab-4760-95c5-70085ae042dc service nova] [instance: 9b731e53-3436-44d2-b674-841871804c80] No waiting events found dispatching network-vif-plugged-f62ea1bc-bdf0-4f55-8364-b48bcaf3fcd6 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:18:07 user nova-compute[72362]: WARNING nova.compute.manager [req-9fb13720-64b8-4597-a6b3-f09c14189c49 req-be51b9c3-22ab-4760-95c5-70085ae042dc service nova] [instance: 9b731e53-3436-44d2-b674-841871804c80] Received unexpected event network-vif-plugged-f62ea1bc-bdf0-4f55-8364-b48bcaf3fcd6 for instance with vm_state building and task_state spawning.
Aug 09 10:18:08 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:08 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:08 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:08 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:09 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576289.7920203, 9b731e53-3436-44d2-b674-841871804c80 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:18:09 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 9b731e53-3436-44d2-b674-841871804c80] VM Resumed (Lifecycle Event)
Aug 09 10:18:09 user nova-compute[72362]: DEBUG nova.compute.manager [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] [instance: 9b731e53-3436-44d2-b674-841871804c80] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:18:09 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] [instance: 9b731e53-3436-44d2-b674-841871804c80] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:18:09 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 9b731e53-3436-44d2-b674-841871804c80] Instance spawned successfully.
Aug 09 10:18:09 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] [instance: 9b731e53-3436-44d2-b674-841871804c80] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 10:18:09 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 9b731e53-3436-44d2-b674-841871804c80] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:18:09 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 9b731e53-3436-44d2-b674-841871804c80] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:18:09 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] [instance: 9b731e53-3436-44d2-b674-841871804c80] Found default for hw_cdrom_bus of ide {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:18:09 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] [instance: 9b731e53-3436-44d2-b674-841871804c80] Found default for hw_disk_bus of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:18:09 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] [instance: 9b731e53-3436-44d2-b674-841871804c80] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:18:09 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] [instance: 9b731e53-3436-44d2-b674-841871804c80] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:18:09 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] [instance: 9b731e53-3436-44d2-b674-841871804c80] Found default for hw_video_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:18:09 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] [instance: 9b731e53-3436-44d2-b674-841871804c80] Found default for hw_vif_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:18:09 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 9b731e53-3436-44d2-b674-841871804c80] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:18:09 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576289.7965546, 9b731e53-3436-44d2-b674-841871804c80 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:18:09 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 9b731e53-3436-44d2-b674-841871804c80] VM Started (Lifecycle Event)
Aug 09 10:18:09 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 9b731e53-3436-44d2-b674-841871804c80] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:18:09 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 9b731e53-3436-44d2-b674-841871804c80] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:18:09 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 9b731e53-3436-44d2-b674-841871804c80] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:18:09 user nova-compute[72362]: INFO nova.compute.manager [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] [instance: 9b731e53-3436-44d2-b674-841871804c80] Took 6.33 seconds to spawn the instance on the hypervisor.
Aug 09 10:18:09 user nova-compute[72362]: DEBUG nova.compute.manager [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] [instance: 9b731e53-3436-44d2-b674-841871804c80] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:18:09 user nova-compute[72362]: DEBUG nova.compute.manager [req-3e8bd52c-9eb0-4988-97ca-b554302addff req-7c7825cc-be84-47e6-af42-762844eac9b0 service nova] [instance: 9b731e53-3436-44d2-b674-841871804c80] Received event network-vif-plugged-f62ea1bc-bdf0-4f55-8364-b48bcaf3fcd6 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:18:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3e8bd52c-9eb0-4988-97ca-b554302addff req-7c7825cc-be84-47e6-af42-762844eac9b0 service nova] Acquiring lock "9b731e53-3436-44d2-b674-841871804c80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:18:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3e8bd52c-9eb0-4988-97ca-b554302addff req-7c7825cc-be84-47e6-af42-762844eac9b0 service nova] Lock "9b731e53-3436-44d2-b674-841871804c80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:18:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3e8bd52c-9eb0-4988-97ca-b554302addff req-7c7825cc-be84-47e6-af42-762844eac9b0 service nova] Lock "9b731e53-3436-44d2-b674-841871804c80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:18:09 user nova-compute[72362]: DEBUG nova.compute.manager [req-3e8bd52c-9eb0-4988-97ca-b554302addff req-7c7825cc-be84-47e6-af42-762844eac9b0 service nova] [instance: 9b731e53-3436-44d2-b674-841871804c80] No waiting events found dispatching network-vif-plugged-f62ea1bc-bdf0-4f55-8364-b48bcaf3fcd6 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:18:09 user nova-compute[72362]: WARNING nova.compute.manager [req-3e8bd52c-9eb0-4988-97ca-b554302addff req-7c7825cc-be84-47e6-af42-762844eac9b0 service nova] [instance: 9b731e53-3436-44d2-b674-841871804c80] Received unexpected event network-vif-plugged-f62ea1bc-bdf0-4f55-8364-b48bcaf3fcd6 for instance with vm_state building and task_state spawning.
Aug 09 10:18:10 user nova-compute[72362]: INFO nova.compute.manager [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] [instance: 9b731e53-3436-44d2-b674-841871804c80] Took 7.30 seconds to build instance.
Aug 09 10:18:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-fe8b07da-c0d4-4d4b-94e4-7630abdc6b96 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Lock "9b731e53-3436-44d2-b674-841871804c80" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.406s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG os_brick.initiator.connector [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Factory for ISCSI on None {{(pid=72362) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.007s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1974f39d-16e2-4e0b-bbe4-f84f298add28'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HIofhtGX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:18:10 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:18:10 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:18:10 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:18:10 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1974f39d-16e2-4e0b-bbe4-f84f298add28" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1974f39d-16e2-4e0b-bbe4-f84f298add28" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:18:10 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:18:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1974f39d-16e2-4e0b-bbe4-f84f298add28 -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1974f39d-16e2-4e0b-bbe4-f84f298add28 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b0450f-624e-4320-a138-1849370e00e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:18:10 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1974f39d-16e2-4e0b-bbe4-f84f298add28 -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1974f39d-16e2-4e0b-bbe4-f84f298add28 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0139d43-384e-4d56-b39c-4cb12eed3e15]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1974f39d-16e2-4e0b-bbe4-f84f298add28] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1974f39d-16e2-4e0b-bbe4-f84f298add28] added
Aug 09 10:18:10 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1974f39d-16e2-4e0b-bbe4-f84f298add28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1974f39d-16e2-4e0b-bbe4-f84f298add28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8333364-6d1b-493a-9900-ccfed3bdae08]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1974f39d-16e2-4e0b-bbe4-f84f298add28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1974f39d-16e2-4e0b-bbe4-f84f298add28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acb07a4-f9c6-4321-81fe-cc856de5ea42]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1974f39d-16e2-4e0b-bbe4-f84f298add28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HIofhtGX {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1974f39d-16e2-4e0b-bbe4-f84f298add28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HIofhtGX" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbf50d1-1a1d-4c06-9755-a68e27c7eced]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HIofhtGX'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1974f39d-16e2-4e0b-bbe4-f84f298add28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1974f39d-16e2-4e0b-bbe4-f84f298add28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[968b2941-4744-4430-8fbd-3618420117a4]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a043ba-fd15-4ee3-a2ed-01cbef835ecc]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 10:18:10 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 10:18:10 user nova-compute[72362]:  {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:18:10 user nova-compute[72362]: WARNING os_brick.initiator.connectors.iscsi [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 10:18:10 user nova-compute[72362]: 
Aug 09 10:18:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1974f39d-16e2-4e0b-bbe4-f84f298add28 -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1974f39d-16e2-4e0b-bbe4-f84f298add28 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3cc7cb-ba90-4a4b-bde0-8740fe4ede77]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1974f39d-16e2-4e0b-bbe4-f84f298add28, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1974f39d-16e2-4e0b-bbe4-f84f298add28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1974f39d-16e2-4e0b-bbe4-f84f298add28, portal: 172.16.0.220,3260]
Aug 09 10:18:10 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:1974f39d-16e2-4e0b-bbe4-f84f298add28, portal: 172.16.0.220,3260] successful.
Aug 09 10:18:10 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1974f39d-16e2-4e0b-bbe4-f84f298add28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1974f39d-16e2-4e0b-bbe4-f84f298add28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0521a1-57bd-4a07-925c-c167c92d45a1]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbd78d4-b640-4590-b082-32373c5bb819]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1974f39d-16e2-4e0b-bbe4-f84f298add28 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1974f39d-16e2-4e0b-bbe4-f84f298add28 (non-flash)
Aug 09 10:18:10 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1974f39d-16e2-4e0b-bbe4-f84f298add28 (non-flash)
Aug 09 10:18:10 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1974f39d-16e2-4e0b-bbe4-f84f298add28" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc6a07f-7502-40b0-bb69-b86d14a0511b]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HIofhtGX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:18:10 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:11 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:11 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:18:11 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '26164383564626364', 'path': '/dev/sdb'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:18:11 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164383564626364', 'path': '/dev/sdb'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:18:11 user nova-compute[72362]: DEBUG nova.objects.instance [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Lazy-loading 'flavor' on Instance uuid 1e2e53b4-3a00-4725-840d-215f6609c951 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:18:11 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 10:18:11 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:18:11 user nova-compute[72362]:   <source dev="/dev/sdb"/>
Aug 09 10:18:11 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:18:11 user nova-compute[72362]:   <serial>1974f39d-16e2-4e0b-bbe4-f84f298add28</serial>
Aug 09 10:18:11 user nova-compute[72362]: </disk>
Aug 09 10:18:11 user nova-compute[72362]:  {{(pid=72362) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 10:18:12 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:18:12 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:18:12 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] No VIF found with MAC fa:16:3e:38:97:38, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:18:12 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2e3f29ed-d6a7-4e14-b13d-d2b1937bb4ce tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Lock "1e2e53b4-3a00-4725-840d-215f6609c951" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.651s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:18:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a112bee8-5cfe-40df-9180-cfeb95be101e tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Acquiring lock "1e2e53b4-3a00-4725-840d-215f6609c951" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:18:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a112bee8-5cfe-40df-9180-cfeb95be101e tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Lock "1e2e53b4-3a00-4725-840d-215f6609c951" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:18:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a112bee8-5cfe-40df-9180-cfeb95be101e tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Acquiring lock "1e2e53b4-3a00-4725-840d-215f6609c951-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:18:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a112bee8-5cfe-40df-9180-cfeb95be101e tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Lock "1e2e53b4-3a00-4725-840d-215f6609c951-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:18:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a112bee8-5cfe-40df-9180-cfeb95be101e tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Lock "1e2e53b4-3a00-4725-840d-215f6609c951-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:18:13 user nova-compute[72362]: INFO nova.compute.manager [None req-a112bee8-5cfe-40df-9180-cfeb95be101e tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Terminating instance
Aug 09 10:18:13 user nova-compute[72362]: DEBUG nova.compute.manager [None req-a112bee8-5cfe-40df-9180-cfeb95be101e tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Start destroying the instance on the hypervisor. {{(pid=72362) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 10:18:13 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:13 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:13 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:13 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG nova.compute.manager [req-db981d71-37e0-4f30-ae52-c7078028b943 req-b9fb1066-72bc-4827-afd7-6e7b4f59f7fe service nova] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Received event network-vif-unplugged-e2fc4479-6950-479a-bf81-12149601afab {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-db981d71-37e0-4f30-ae52-c7078028b943 req-b9fb1066-72bc-4827-afd7-6e7b4f59f7fe service nova] Acquiring lock "1e2e53b4-3a00-4725-840d-215f6609c951-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-db981d71-37e0-4f30-ae52-c7078028b943 req-b9fb1066-72bc-4827-afd7-6e7b4f59f7fe service nova] Lock "1e2e53b4-3a00-4725-840d-215f6609c951-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-db981d71-37e0-4f30-ae52-c7078028b943 req-b9fb1066-72bc-4827-afd7-6e7b4f59f7fe service nova] Lock "1e2e53b4-3a00-4725-840d-215f6609c951-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG nova.compute.manager [req-db981d71-37e0-4f30-ae52-c7078028b943 req-b9fb1066-72bc-4827-afd7-6e7b4f59f7fe service nova] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] No waiting events found dispatching network-vif-unplugged-e2fc4479-6950-479a-bf81-12149601afab {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG nova.compute.manager [req-db981d71-37e0-4f30-ae52-c7078028b943 req-b9fb1066-72bc-4827-afd7-6e7b4f59f7fe service nova] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Received event network-vif-unplugged-e2fc4479-6950-479a-bf81-12149601afab for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:18:14 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Instance destroyed successfully.
Aug 09 10:18:14 user nova-compute[72362]: DEBUG nova.objects.instance [None req-a112bee8-5cfe-40df-9180-cfeb95be101e tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Lazy-loading 'resources' on Instance uuid 1e2e53b4-3a00-4725-840d-215f6609c951 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-a112bee8-5cfe-40df-9180-cfeb95be101e tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:15:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1049991305',display_name='tempest-DeleteServersTestJSON-server-1049991305',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1049991305',id=1,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:16:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3dcec0d088b642ef9262d53297d51240',ramdisk_id='',reservation_id='r-t0ti0hgj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1734726466',owner_user_name='tempest-DeleteServersTestJSON-1734726466-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:16:13Z,user_data=None,user_id='e4e5357e1c9c4f64879b505362ebd8c2',uuid=1e2e53b4-3a00-4725-840d-215f6609c951,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2fc4479-6950-479a-bf81-12149601afab", "address": "fa:16:3e:38:97:38", "network": {"id": "44e70325-9b00-4919-a808-7e32d3c9c7b8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2093963967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dcec0d088b642ef9262d53297d51240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2fc4479-69", "ovs_interfaceid": "e2fc4479-6950-479a-bf81-12149601afab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-a112bee8-5cfe-40df-9180-cfeb95be101e tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Converting VIF {"id": "e2fc4479-6950-479a-bf81-12149601afab", "address": "fa:16:3e:38:97:38", "network": {"id": "44e70325-9b00-4919-a808-7e32d3c9c7b8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2093963967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dcec0d088b642ef9262d53297d51240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2fc4479-69", "ovs_interfaceid": "e2fc4479-6950-479a-bf81-12149601afab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-a112bee8-5cfe-40df-9180-cfeb95be101e tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:97:38,bridge_name='br-int',has_traffic_filtering=True,id=e2fc4479-6950-479a-bf81-12149601afab,network=Network(44e70325-9b00-4919-a808-7e32d3c9c7b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2fc4479-69') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG os_vif [None req-a112bee8-5cfe-40df-9180-cfeb95be101e tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:97:38,bridge_name='br-int',has_traffic_filtering=True,id=e2fc4479-6950-479a-bf81-12149601afab,network=Network(44e70325-9b00-4919-a808-7e32d3c9c7b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2fc4479-69') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape2fc4479-69, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:14 user nova-compute[72362]: INFO os_vif [None req-a112bee8-5cfe-40df-9180-cfeb95be101e tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:97:38,bridge_name='br-int',has_traffic_filtering=True,id=e2fc4479-6950-479a-bf81-12149601afab,network=Network(44e70325-9b00-4919-a808-7e32d3c9c7b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2fc4479-69')
Aug 09 10:18:14 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a112bee8-5cfe-40df-9180-cfeb95be101e tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a112bee8-5cfe-40df-9180-cfeb95be101e tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:1974f39d-16e2-4e0b-bbe4-f84f298add28'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HIofhtGX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:18:14 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-a112bee8-5cfe-40df-9180-cfeb95be101e tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:18:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-a112bee8-5cfe-40df-9180-cfeb95be101e tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-a112bee8-5cfe-40df-9180-cfeb95be101e tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a112bee8-5cfe-40df-9180-cfeb95be101e tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1974f39d-16e2-4e0b-bbe4-f84f298add28', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eeac8af-0f14-4389-ae8e-319559170c24]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1974f39d-16e2-4e0b-bbe4-f84f298add28\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b3f9ec-0a9d-4c26-8e15-5f6f80e53f41]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1974f39d-16e2-4e0b-bbe4-f84f298add28 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a112bee8-5cfe-40df-9180-cfeb95be101e tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1974f39d-16e2-4e0b-bbe4-f84f298add28 (non-flash)
Aug 09 10:18:14 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a112bee8-5cfe-40df-9180-cfeb95be101e tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1974f39d-16e2-4e0b-bbe4-f84f298add28 (non-flash)
Aug 09 10:18:14 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a112bee8-5cfe-40df-9180-cfeb95be101e tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e425a950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1974f39d-16e2-4e0b-bbe4-f84f298add28'): ({'sdb'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-a112bee8-5cfe-40df-9180-cfeb95be101e tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Removing single pathed devices sdb {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf642e29-cf41-4c8f-8b7c-4c7d7dab486d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[171f0fa3-1787-45c8-bffa-95f7953215b3]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-a112bee8-5cfe-40df-9180-cfeb95be101e tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Flushing IO for device /dev/sdb {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f792c8-afe4-4a4d-9df3-3ea63dd60a1a]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-a112bee8-5cfe-40df-9180-cfeb95be101e tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[67491039-52c7-4a96-94d8-53aed6b93692]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-a112bee8-5cfe-40df-9180-cfeb95be101e tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-a112bee8-5cfe-40df-9180-cfeb95be101e tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] SCSI volumes sdb have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a112bee8-5cfe-40df-9180-cfeb95be101e tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1974f39d-16e2-4e0b-bbe4-f84f298add28')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1974f39d-16e2-4e0b-bbe4-f84f298add28 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1974f39d-16e2-4e0b-bbe4-f84f298add28 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d47bcdc-f040-4a8c-91d5-665f4c562950]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a112bee8-5cfe-40df-9180-cfeb95be101e tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1974f39d-16e2-4e0b-bbe4-f84f298add28 -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1974f39d-16e2-4e0b-bbe4-f84f298add28 -p 172.16.0.220:3260 --logout" returned: 0 in 0.165s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f25192-55be-4eb4-b1a9-0ac00cf230ad]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:1974f39d-16e2-4e0b-bbe4-f84f298add28, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:1974f39d-16e2-4e0b-bbe4-f84f298add28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a112bee8-5cfe-40df-9180-cfeb95be101e tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:1974f39d-16e2-4e0b-bbe4-f84f298add28, portal: 172.16.0.220,3260]
Aug 09 10:18:14 user nova-compute[72362]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:1974f39d-16e2-4e0b-bbe4-f84f298add28, portal: 172.16.0.220,3260] successful.
Aug 09 10:18:14 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1974f39d-16e2-4e0b-bbe4-f84f298add28 -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1974f39d-16e2-4e0b-bbe4-f84f298add28 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[8403fdf2-6241-42e5-9709-25d8fea0a1fd]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a112bee8-5cfe-40df-9180-cfeb95be101e tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-a112bee8-5cfe-40df-9180-cfeb95be101e tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.418s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a112bee8-5cfe-40df-9180-cfeb95be101e tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] <== disconnect_volume: return (420ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a112bee8-5cfe-40df-9180-cfeb95be101e tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:18:14 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-a112bee8-5cfe-40df-9180-cfeb95be101e tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Deleting instance files /opt/stack/data/nova/instances/1e2e53b4-3a00-4725-840d-215f6609c951_del
Aug 09 10:18:14 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-a112bee8-5cfe-40df-9180-cfeb95be101e tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Deletion of /opt/stack/data/nova/instances/1e2e53b4-3a00-4725-840d-215f6609c951_del complete
Aug 09 10:18:14 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-a112bee8-5cfe-40df-9180-cfeb95be101e tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Checking UEFI support for host arch (x86_64) {{(pid=72362) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 09 10:18:14 user nova-compute[72362]: INFO nova.virt.libvirt.host [None req-a112bee8-5cfe-40df-9180-cfeb95be101e tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] UEFI support detected
Aug 09 10:18:14 user nova-compute[72362]: INFO nova.compute.manager [None req-a112bee8-5cfe-40df-9180-cfeb95be101e tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Took 1.46 seconds to destroy the instance on the hypervisor.
Aug 09 10:18:14 user nova-compute[72362]: DEBUG oslo.service.loopingcall [None req-a112bee8-5cfe-40df-9180-cfeb95be101e tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72362) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG nova.compute.manager [-] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Deallocating network for instance {{(pid=72362) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 10:18:14 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] deallocate_for_instance() {{(pid=72362) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 10:18:15 user nova-compute[72362]: DEBUG nova.compute.manager [req-60eb5be5-373c-4088-abfc-50aef69b2013 req-4b9342e2-d83d-4338-ba0c-80c9f5ff8f4d service nova] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Received event network-changed-fc1688e4-e2d3-4f8f-be55-4a6793ae4497 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:18:15 user nova-compute[72362]: DEBUG nova.compute.manager [req-60eb5be5-373c-4088-abfc-50aef69b2013 req-4b9342e2-d83d-4338-ba0c-80c9f5ff8f4d service nova] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Refreshing instance network info cache due to event network-changed-fc1688e4-e2d3-4f8f-be55-4a6793ae4497. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:18:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-60eb5be5-373c-4088-abfc-50aef69b2013 req-4b9342e2-d83d-4338-ba0c-80c9f5ff8f4d service nova] Acquiring lock "refresh_cache-ea95226c-40fe-4408-a9f0-5538659261a6" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:18:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-60eb5be5-373c-4088-abfc-50aef69b2013 req-4b9342e2-d83d-4338-ba0c-80c9f5ff8f4d service nova] Acquired lock "refresh_cache-ea95226c-40fe-4408-a9f0-5538659261a6" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:18:15 user nova-compute[72362]: DEBUG nova.network.neutron [req-60eb5be5-373c-4088-abfc-50aef69b2013 req-4b9342e2-d83d-4338-ba0c-80c9f5ff8f4d service nova] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Refreshing network info cache for port fc1688e4-e2d3-4f8f-be55-4a6793ae4497 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:18:15 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:15 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:18:15 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Took 0.84 seconds to deallocate network for instance.
Aug 09 10:18:15 user nova-compute[72362]: DEBUG nova.compute.manager [req-f22698e1-150b-4d91-85b2-95d38233f56d req-e820a19f-d6cf-496a-8703-75bb5d2065b0 service nova] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Received event network-vif-deleted-e2fc4479-6950-479a-bf81-12149601afab {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:18:16 user nova-compute[72362]: DEBUG nova.compute.manager [req-d9753d9d-e943-4dbe-a602-06a5fed82e54 req-5278d517-d71b-42ec-a1f4-50c1193937f5 service nova] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Received event network-vif-plugged-e2fc4479-6950-479a-bf81-12149601afab {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:18:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-d9753d9d-e943-4dbe-a602-06a5fed82e54 req-5278d517-d71b-42ec-a1f4-50c1193937f5 service nova] Acquiring lock "1e2e53b4-3a00-4725-840d-215f6609c951-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:18:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-d9753d9d-e943-4dbe-a602-06a5fed82e54 req-5278d517-d71b-42ec-a1f4-50c1193937f5 service nova] Lock "1e2e53b4-3a00-4725-840d-215f6609c951-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:18:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-d9753d9d-e943-4dbe-a602-06a5fed82e54 req-5278d517-d71b-42ec-a1f4-50c1193937f5 service nova] Lock "1e2e53b4-3a00-4725-840d-215f6609c951-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:18:16 user nova-compute[72362]: DEBUG nova.compute.manager [req-d9753d9d-e943-4dbe-a602-06a5fed82e54 req-5278d517-d71b-42ec-a1f4-50c1193937f5 service nova] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] No waiting events found dispatching network-vif-plugged-e2fc4479-6950-479a-bf81-12149601afab {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:18:16 user nova-compute[72362]: WARNING nova.compute.manager [req-d9753d9d-e943-4dbe-a602-06a5fed82e54 req-5278d517-d71b-42ec-a1f4-50c1193937f5 service nova] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Received unexpected event network-vif-plugged-e2fc4479-6950-479a-bf81-12149601afab for instance with vm_state active and task_state deleting.
Aug 09 10:18:16 user nova-compute[72362]: DEBUG nova.network.neutron [req-60eb5be5-373c-4088-abfc-50aef69b2013 req-4b9342e2-d83d-4338-ba0c-80c9f5ff8f4d service nova] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Updated VIF entry in instance network info cache for port fc1688e4-e2d3-4f8f-be55-4a6793ae4497. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:18:16 user nova-compute[72362]: DEBUG nova.network.neutron [req-60eb5be5-373c-4088-abfc-50aef69b2013 req-4b9342e2-d83d-4338-ba0c-80c9f5ff8f4d service nova] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Updating instance_info_cache with network_info: [{"id": "fc1688e4-e2d3-4f8f-be55-4a6793ae4497", "address": "fa:16:3e:31:49:f0", "network": {"id": "c32d66f0-0db4-4c6b-a45d-8c1eb6f4b510", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-858657617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2e7ca3484c64611b9573ba0b86592b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc1688e4-e2", "ovs_interfaceid": "fc1688e4-e2d3-4f8f-be55-4a6793ae4497", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:18:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-60eb5be5-373c-4088-abfc-50aef69b2013 req-4b9342e2-d83d-4338-ba0c-80c9f5ff8f4d service nova] Releasing lock "refresh_cache-ea95226c-40fe-4408-a9f0-5538659261a6" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:18:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-9d45c112-c7f6-49b0-bb99-63a3eabea0a8 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Acquiring lock "b17b317a-409e-45ad-ac7c-0c298f4f564b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:18:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-9d45c112-c7f6-49b0-bb99-63a3eabea0a8 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Lock "b17b317a-409e-45ad-ac7c-0c298f4f564b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:18:17 user nova-compute[72362]: DEBUG nova.objects.instance [None req-9d45c112-c7f6-49b0-bb99-63a3eabea0a8 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Lazy-loading 'flavor' on Instance uuid b17b317a-409e-45ad-ac7c-0c298f4f564b {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:18:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-9d45c112-c7f6-49b0-bb99-63a3eabea0a8 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Lock "b17b317a-409e-45ad-ac7c-0c298f4f564b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:18:17 user nova-compute[72362]: DEBUG nova.compute.manager [req-8c8b753f-4c0e-44ad-9ee7-a6fe154870a2 req-ed16a71c-b946-4751-acd2-8937ec1903be service nova] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Received event network-changed-76c0daec-94af-49ef-b33c-73925b6fb175 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:18:17 user nova-compute[72362]: DEBUG nova.compute.manager [req-8c8b753f-4c0e-44ad-9ee7-a6fe154870a2 req-ed16a71c-b946-4751-acd2-8937ec1903be service nova] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Refreshing instance network info cache due to event network-changed-76c0daec-94af-49ef-b33c-73925b6fb175. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:18:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8c8b753f-4c0e-44ad-9ee7-a6fe154870a2 req-ed16a71c-b946-4751-acd2-8937ec1903be service nova] Acquiring lock "refresh_cache-b17b317a-409e-45ad-ac7c-0c298f4f564b" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:18:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8c8b753f-4c0e-44ad-9ee7-a6fe154870a2 req-ed16a71c-b946-4751-acd2-8937ec1903be service nova] Acquired lock "refresh_cache-b17b317a-409e-45ad-ac7c-0c298f4f564b" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:18:17 user nova-compute[72362]: DEBUG nova.network.neutron [req-8c8b753f-4c0e-44ad-9ee7-a6fe154870a2 req-ed16a71c-b946-4751-acd2-8937ec1903be service nova] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Refreshing network info cache for port 76c0daec-94af-49ef-b33c-73925b6fb175 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:18:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-9d45c112-c7f6-49b0-bb99-63a3eabea0a8 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Acquiring lock "b17b317a-409e-45ad-ac7c-0c298f4f564b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:18:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-9d45c112-c7f6-49b0-bb99-63a3eabea0a8 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Lock "b17b317a-409e-45ad-ac7c-0c298f4f564b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:18:17 user nova-compute[72362]: INFO nova.compute.manager [None req-9d45c112-c7f6-49b0-bb99-63a3eabea0a8 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Attaching volume 85bc12a2-e20a-44af-919e-746a6239532d to /dev/vdb
Aug 09 10:18:17 user nova-compute[72362]: DEBUG os_brick.utils [None req-9d45c112-c7f6-49b0-bb99-63a3eabea0a8 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:18:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:17 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[196fcaa1-c504-4bf1-801b-86d218652f97]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:17 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5705d04c-23cb-4daa-adb2-1e777403e7a4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:17 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c2534a-6eba-4c1b-a440-2bdd656393f9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:17 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[203482bc-ea4f-4122-a0a1-a987a2190695]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-9d45c112-c7f6-49b0-bb99-63a3eabea0a8 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-9d45c112-c7f6-49b0-bb99-63a3eabea0a8 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:18:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9d45c112-c7f6-49b0-bb99-63a3eabea0a8 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:18:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:17 user nova-compute[72362]: INFO nova.compute.manager [None req-a112bee8-5cfe-40df-9180-cfeb95be101e tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Took 2.20 seconds to detach 1 volumes for instance.
Aug 09 10:18:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:18:17 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:18:17 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[178fa008-75b3-4863-b896-e3de0683993b]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-9d45c112-c7f6-49b0-bb99-63a3eabea0a8 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:18:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-9d45c112-c7f6-49b0-bb99-63a3eabea0a8 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:18:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-9d45c112-c7f6-49b0-bb99-63a3eabea0a8 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:18:17 user nova-compute[72362]: DEBUG os_brick.utils [None req-9d45c112-c7f6-49b0-bb99-63a3eabea0a8 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:18:17 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-9d45c112-c7f6-49b0-bb99-63a3eabea0a8 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Updating existing volume attachment record: 4a0811d2-cda0-409e-9a38-6c3ffd55e0c2 {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 10:18:18 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d4e565a0-8a49-49d9-a42d-7b1521cb05a7 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] Acquiring lock "8f0c62c9-aa84-4a5b-b909-af5535e87c83" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:18:18 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d4e565a0-8a49-49d9-a42d-7b1521cb05a7 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] Lock "8f0c62c9-aa84-4a5b-b909-af5535e87c83" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:18:18 user nova-compute[72362]: DEBUG nova.objects.instance [None req-d4e565a0-8a49-49d9-a42d-7b1521cb05a7 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] Lazy-loading 'flavor' on Instance uuid 8f0c62c9-aa84-4a5b-b909-af5535e87c83 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:18:18 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a112bee8-5cfe-40df-9180-cfeb95be101e tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:18:18 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a112bee8-5cfe-40df-9180-cfeb95be101e tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:18:18 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d4e565a0-8a49-49d9-a42d-7b1521cb05a7 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] Lock "8f0c62c9-aa84-4a5b-b909-af5535e87c83" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.114s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:18:18 user nova-compute[72362]: DEBUG nova.network.neutron [req-8c8b753f-4c0e-44ad-9ee7-a6fe154870a2 req-ed16a71c-b946-4751-acd2-8937ec1903be service nova] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Updated VIF entry in instance network info cache for port 76c0daec-94af-49ef-b33c-73925b6fb175. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:18:18 user nova-compute[72362]: DEBUG nova.network.neutron [req-8c8b753f-4c0e-44ad-9ee7-a6fe154870a2 req-ed16a71c-b946-4751-acd2-8937ec1903be service nova] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Updating instance_info_cache with network_info: [{"id": "76c0daec-94af-49ef-b33c-73925b6fb175", "address": "fa:16:3e:0d:a8:5c", "network": {"id": "8cf43717-164f-47a3-859d-66488f6725ea", "bridge": "br-int", "label": "tempest-TestVolumeSwap-365627362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eadf3da29124620a2ec066a13cbf2c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76c0daec-94", "ovs_interfaceid": "76c0daec-94af-49ef-b33c-73925b6fb175", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:18:18 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8c8b753f-4c0e-44ad-9ee7-a6fe154870a2 req-ed16a71c-b946-4751-acd2-8937ec1903be service nova] Releasing lock "refresh_cache-b17b317a-409e-45ad-ac7c-0c298f4f564b" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:18:18 user nova-compute[72362]: DEBUG nova.compute.manager [req-19049f40-60ee-4458-88c4-29cd3f46238a req-2be0f068-5d34-406a-8ba9-6f09237947cd service nova] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Received event network-changed-8b6fe644-7df3-429e-baa8-ab6407034e32 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:18:18 user nova-compute[72362]: DEBUG nova.compute.manager [req-19049f40-60ee-4458-88c4-29cd3f46238a req-2be0f068-5d34-406a-8ba9-6f09237947cd service nova] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Refreshing instance network info cache due to event network-changed-8b6fe644-7df3-429e-baa8-ab6407034e32. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:18:18 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-19049f40-60ee-4458-88c4-29cd3f46238a req-2be0f068-5d34-406a-8ba9-6f09237947cd service nova] Acquiring lock "refresh_cache-8f0c62c9-aa84-4a5b-b909-af5535e87c83" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:18:18 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-19049f40-60ee-4458-88c4-29cd3f46238a req-2be0f068-5d34-406a-8ba9-6f09237947cd service nova] Acquired lock "refresh_cache-8f0c62c9-aa84-4a5b-b909-af5535e87c83" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:18:18 user nova-compute[72362]: DEBUG nova.network.neutron [req-19049f40-60ee-4458-88c4-29cd3f46238a req-2be0f068-5d34-406a-8ba9-6f09237947cd service nova] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Refreshing network info cache for port 8b6fe644-7df3-429e-baa8-ab6407034e32 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:18:18 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d4e565a0-8a49-49d9-a42d-7b1521cb05a7 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] Acquiring lock "8f0c62c9-aa84-4a5b-b909-af5535e87c83" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:18:18 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d4e565a0-8a49-49d9-a42d-7b1521cb05a7 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] Lock "8f0c62c9-aa84-4a5b-b909-af5535e87c83" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.004s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:18:18 user nova-compute[72362]: INFO nova.compute.manager [None req-d4e565a0-8a49-49d9-a42d-7b1521cb05a7 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Attaching volume a6f32fab-0eed-4346-b78c-69a9360ce812 to /dev/vdb
Aug 09 10:18:18 user nova-compute[72362]: DEBUG os_brick.utils [None req-d4e565a0-8a49-49d9-a42d-7b1521cb05a7 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:18:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.029s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:18 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a5e084-e7ed-4cc1-a4e0-d43899957503]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:18 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[674927a1-80cb-47f2-a919-65d931b5ba9f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:18 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-a112bee8-5cfe-40df-9180-cfeb95be101e tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:18:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:18 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[234b64bf-56c7-4e75-892c-f6c81a536807]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:18 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca114c40-fd2a-477a-bda8-cf22f0830433]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-d4e565a0-8a49-49d9-a42d-7b1521cb05a7 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-d4e565a0-8a49-49d9-a42d-7b1521cb05a7 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:18:18 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d4e565a0-8a49-49d9-a42d-7b1521cb05a7 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:18:18 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-a112bee8-5cfe-40df-9180-cfeb95be101e tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:18:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:18:18 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:18:18 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[39df6f86-6373-4483-b551-7afb2eb844f0]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:18 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-d4e565a0-8a49-49d9-a42d-7b1521cb05a7 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:18:18 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-d4e565a0-8a49-49d9-a42d-7b1521cb05a7 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:18:18 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-d4e565a0-8a49-49d9-a42d-7b1521cb05a7 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:18:18 user nova-compute[72362]: DEBUG os_brick.utils [None req-d4e565a0-8a49-49d9-a42d-7b1521cb05a7 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] <== get_connector_properties: return (185ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:18:18 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-d4e565a0-8a49-49d9-a42d-7b1521cb05a7 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Updating existing volume attachment record: 5747a71b-8139-430f-80af-3a5f0679ace8 {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 10:18:18 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a112bee8-5cfe-40df-9180-cfeb95be101e tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.582s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:18:18 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-a112bee8-5cfe-40df-9180-cfeb95be101e tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Deleted allocations for instance 1e2e53b4-3a00-4725-840d-215f6609c951
Aug 09 10:18:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a112bee8-5cfe-40df-9180-cfeb95be101e tempest-DeleteServersTestJSON-1734726466 tempest-DeleteServersTestJSON-1734726466-project-member] Lock "1e2e53b4-3a00-4725-840d-215f6609c951" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.636s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:18:19 user nova-compute[72362]: DEBUG nova.network.neutron [req-19049f40-60ee-4458-88c4-29cd3f46238a req-2be0f068-5d34-406a-8ba9-6f09237947cd service nova] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Updated VIF entry in instance network info cache for port 8b6fe644-7df3-429e-baa8-ab6407034e32. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:18:19 user nova-compute[72362]: DEBUG nova.network.neutron [req-19049f40-60ee-4458-88c4-29cd3f46238a req-2be0f068-5d34-406a-8ba9-6f09237947cd service nova] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Updating instance_info_cache with network_info: [{"id": "8b6fe644-7df3-429e-baa8-ab6407034e32", "address": "fa:16:3e:63:7f:a8", "network": {"id": "45d52d71-edd6-4126-ba59-31d3c42169b9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1828391472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29102931855a43efb23963382ca5d4f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b6fe644-7d", "ovs_interfaceid": "8b6fe644-7df3-429e-baa8-ab6407034e32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:18:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-19049f40-60ee-4458-88c4-29cd3f46238a req-2be0f068-5d34-406a-8ba9-6f09237947cd service nova] Releasing lock "refresh_cache-8f0c62c9-aa84-4a5b-b909-af5535e87c83" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:18:19 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c97e21ed-a1df-481b-8237-c3fc9d38342e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Acquiring lock "ea95226c-40fe-4408-a9f0-5538659261a6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:18:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c97e21ed-a1df-481b-8237-c3fc9d38342e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Lock "ea95226c-40fe-4408-a9f0-5538659261a6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:18:20 user nova-compute[72362]: DEBUG nova.objects.instance [None req-c97e21ed-a1df-481b-8237-c3fc9d38342e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Lazy-loading 'flavor' on Instance uuid ea95226c-40fe-4408-a9f0-5538659261a6 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:18:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c97e21ed-a1df-481b-8237-c3fc9d38342e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Lock "ea95226c-40fe-4408-a9f0-5538659261a6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:18:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c97e21ed-a1df-481b-8237-c3fc9d38342e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Acquiring lock "ea95226c-40fe-4408-a9f0-5538659261a6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:18:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c97e21ed-a1df-481b-8237-c3fc9d38342e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Lock "ea95226c-40fe-4408-a9f0-5538659261a6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:18:20 user nova-compute[72362]: INFO nova.compute.manager [None req-c97e21ed-a1df-481b-8237-c3fc9d38342e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Attaching volume 276b6ff7-8005-4266-b02a-fb4432f2ee2e to /dev/vdb
Aug 09 10:18:21 user nova-compute[72362]: DEBUG os_brick.utils [None req-c97e21ed-a1df-481b-8237-c3fc9d38342e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:18:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:21 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5880f774-4034-4c62-8a17-b710e0e22127]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:21 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85da584-e9fa-4be4-b9b4-faa0c3188470]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:21 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f573b657-af96-41f0-9289-b9c7dfe5f96d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:21 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[91df8cea-7d31-4982-9787-1d942923dc87]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-c97e21ed-a1df-481b-8237-c3fc9d38342e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-c97e21ed-a1df-481b-8237-c3fc9d38342e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:18:21 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c97e21ed-a1df-481b-8237-c3fc9d38342e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:18:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:18:21 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:18:21 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8f8c2a-9195-4bb3-9ee0-49dd61a764ea]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:21 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-c97e21ed-a1df-481b-8237-c3fc9d38342e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:18:21 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-c97e21ed-a1df-481b-8237-c3fc9d38342e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:18:21 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-c97e21ed-a1df-481b-8237-c3fc9d38342e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:18:21 user nova-compute[72362]: DEBUG os_brick.utils [None req-c97e21ed-a1df-481b-8237-c3fc9d38342e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:18:21 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-c97e21ed-a1df-481b-8237-c3fc9d38342e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Updating existing volume attachment record: 589aa3c9-2106-4738-b30f-46c69ad045c5 {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 10:18:24 user nova-compute[72362]: DEBUG nova.compute.manager [req-27441e9f-d65c-46f2-ae27-2c70922bf0d7 req-d3bfa50f-1e1b-462c-9113-f76634878b70 service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Received event network-changed-1efbc456-6c56-4367-845f-0afa8acdcec4 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:18:24 user nova-compute[72362]: DEBUG nova.compute.manager [req-27441e9f-d65c-46f2-ae27-2c70922bf0d7 req-d3bfa50f-1e1b-462c-9113-f76634878b70 service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Refreshing instance network info cache due to event network-changed-1efbc456-6c56-4367-845f-0afa8acdcec4. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:18:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-27441e9f-d65c-46f2-ae27-2c70922bf0d7 req-d3bfa50f-1e1b-462c-9113-f76634878b70 service nova] Acquiring lock "refresh_cache-00af3d8e-bd93-4520-91e7-29c135c03e55" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:18:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-27441e9f-d65c-46f2-ae27-2c70922bf0d7 req-d3bfa50f-1e1b-462c-9113-f76634878b70 service nova] Acquired lock "refresh_cache-00af3d8e-bd93-4520-91e7-29c135c03e55" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:18:24 user nova-compute[72362]: DEBUG nova.network.neutron [req-27441e9f-d65c-46f2-ae27-2c70922bf0d7 req-d3bfa50f-1e1b-462c-9113-f76634878b70 service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Refreshing network info cache for port 1efbc456-6c56-4367-845f-0afa8acdcec4 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:18:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-8b19f952-ac11-4235-a0ef-d517dede9f5e tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Acquiring lock "interface-00af3d8e-bd93-4520-91e7-29c135c03e55-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:18:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-8b19f952-ac11-4235-a0ef-d517dede9f5e tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Lock "interface-00af3d8e-bd93-4520-91e7-29c135c03e55-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:18:25 user nova-compute[72362]: DEBUG nova.objects.instance [None req-8b19f952-ac11-4235-a0ef-d517dede9f5e tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Lazy-loading 'flavor' on Instance uuid 00af3d8e-bd93-4520-91e7-29c135c03e55 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:18:25 user nova-compute[72362]: DEBUG nova.compute.manager [req-eb59f5c5-7c70-4df8-bdde-198c65077b7c req-730e889f-aeed-470e-a7b9-5aaddce7841b service nova] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Received event network-changed-d1a1302a-fe35-4d60-b89c-b5ef5f0dee76 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:18:25 user nova-compute[72362]: DEBUG nova.compute.manager [req-eb59f5c5-7c70-4df8-bdde-198c65077b7c req-730e889f-aeed-470e-a7b9-5aaddce7841b service nova] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Refreshing instance network info cache due to event network-changed-d1a1302a-fe35-4d60-b89c-b5ef5f0dee76. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:18:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-eb59f5c5-7c70-4df8-bdde-198c65077b7c req-730e889f-aeed-470e-a7b9-5aaddce7841b service nova] Acquiring lock "refresh_cache-9f2bc700-2e69-406f-9a13-52396eae4258" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:18:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-eb59f5c5-7c70-4df8-bdde-198c65077b7c req-730e889f-aeed-470e-a7b9-5aaddce7841b service nova] Acquired lock "refresh_cache-9f2bc700-2e69-406f-9a13-52396eae4258" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:18:25 user nova-compute[72362]: DEBUG nova.network.neutron [req-eb59f5c5-7c70-4df8-bdde-198c65077b7c req-730e889f-aeed-470e-a7b9-5aaddce7841b service nova] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Refreshing network info cache for port d1a1302a-fe35-4d60-b89c-b5ef5f0dee76 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:18:25 user nova-compute[72362]: DEBUG nova.objects.instance [None req-8b19f952-ac11-4235-a0ef-d517dede9f5e tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Lazy-loading 'pci_requests' on Instance uuid 00af3d8e-bd93-4520-91e7-29c135c03e55 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:18:25 user nova-compute[72362]: DEBUG nova.network.neutron [None req-8b19f952-ac11-4235-a0ef-d517dede9f5e tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] allocate_for_instance() {{(pid=72362) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 10:18:25 user nova-compute[72362]: DEBUG nova.policy [None req-8b19f952-ac11-4235-a0ef-d517dede9f5e tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5dd4d0e5c03744569a542098432622d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a68b4a52019441480a19783a89e0af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72362) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 10:18:25 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:25 user nova-compute[72362]: DEBUG nova.network.neutron [req-27441e9f-d65c-46f2-ae27-2c70922bf0d7 req-d3bfa50f-1e1b-462c-9113-f76634878b70 service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Updated VIF entry in instance network info cache for port 1efbc456-6c56-4367-845f-0afa8acdcec4. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:18:25 user nova-compute[72362]: DEBUG nova.network.neutron [req-27441e9f-d65c-46f2-ae27-2c70922bf0d7 req-d3bfa50f-1e1b-462c-9113-f76634878b70 service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Updating instance_info_cache with network_info: [{"id": "1efbc456-6c56-4367-845f-0afa8acdcec4", "address": "fa:16:3e:76:bd:21", "network": {"id": "1eaf9aa3-1d74-424c-86c6-28096cf53571", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-621134432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a68b4a52019441480a19783a89e0af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1efbc456-6c", "ovs_interfaceid": "1efbc456-6c56-4367-845f-0afa8acdcec4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:18:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-27441e9f-d65c-46f2-ae27-2c70922bf0d7 req-d3bfa50f-1e1b-462c-9113-f76634878b70 service nova] Releasing lock "refresh_cache-00af3d8e-bd93-4520-91e7-29c135c03e55" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:18:26 user nova-compute[72362]: DEBUG nova.network.neutron [req-eb59f5c5-7c70-4df8-bdde-198c65077b7c req-730e889f-aeed-470e-a7b9-5aaddce7841b service nova] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Updated VIF entry in instance network info cache for port d1a1302a-fe35-4d60-b89c-b5ef5f0dee76. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:18:26 user nova-compute[72362]: DEBUG nova.network.neutron [req-eb59f5c5-7c70-4df8-bdde-198c65077b7c req-730e889f-aeed-470e-a7b9-5aaddce7841b service nova] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Updating instance_info_cache with network_info: [{"id": "d1a1302a-fe35-4d60-b89c-b5ef5f0dee76", "address": "fa:16:3e:4a:45:de", "network": {"id": "bc7a82e2-b23e-48dd-b282-99f11cff58d3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-457661927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098495c0d3ac4b9caa895f9ba60e4b84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1a1302a-fe", "ovs_interfaceid": "d1a1302a-fe35-4d60-b89c-b5ef5f0dee76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:18:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-eb59f5c5-7c70-4df8-bdde-198c65077b7c req-730e889f-aeed-470e-a7b9-5aaddce7841b service nova] Releasing lock "refresh_cache-9f2bc700-2e69-406f-9a13-52396eae4258" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:18:26 user nova-compute[72362]: DEBUG nova.network.neutron [None req-8b19f952-ac11-4235-a0ef-d517dede9f5e tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Successfully created port: 8c232e74-771d-40b3-8f0c-abdef770aafd {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG nova.network.neutron [None req-8b19f952-ac11-4235-a0ef-d517dede9f5e tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Successfully updated port: 8c232e74-771d-40b3-8f0c-abdef770aafd {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d45c112-c7f6-49b0-bb99-63a3eabea0a8 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d45c112-c7f6-49b0-bb99-63a3eabea0a8 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qEnGvXdt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:18:27 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-9d45c112-c7f6-49b0-bb99-63a3eabea0a8 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:18:27 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-9d45c112-c7f6-49b0-bb99-63a3eabea0a8 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-9d45c112-c7f6-49b0-bb99-63a3eabea0a8 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:18:27 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-9d45c112-c7f6-49b0-bb99-63a3eabea0a8 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:18:27 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-9d45c112-c7f6-49b0-bb99-63a3eabea0a8 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-9d45c112-c7f6-49b0-bb99-63a3eabea0a8 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:18:27 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-9d45c112-c7f6-49b0-bb99-63a3eabea0a8 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:18:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-8b19f952-ac11-4235-a0ef-d517dede9f5e tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Acquiring lock "refresh_cache-00af3d8e-bd93-4520-91e7-29c135c03e55" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-8b19f952-ac11-4235-a0ef-d517dede9f5e tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Acquired lock "refresh_cache-00af3d8e-bd93-4520-91e7-29c135c03e55" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG nova.network.neutron [None req-8b19f952-ac11-4235-a0ef-d517dede9f5e tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5684d33-5c44-488f-8fa2-b2fc8d5abfce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d45c112-c7f6-49b0-bb99-63a3eabea0a8 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:18:27 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG nova.compute.manager [req-0f81db84-42d9-431f-97e7-aa74c5391e2d req-46407944-5751-4455-8ade-dfc6cb3681be service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Received event network-changed-8c232e74-771d-40b3-8f0c-abdef770aafd {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG nova.compute.manager [req-0f81db84-42d9-431f-97e7-aa74c5391e2d req-46407944-5751-4455-8ade-dfc6cb3681be service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Refreshing instance network info cache due to event network-changed-8c232e74-771d-40b3-8f0c-abdef770aafd. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-0f81db84-42d9-431f-97e7-aa74c5391e2d req-46407944-5751-4455-8ade-dfc6cb3681be service nova] Acquiring lock "refresh_cache-00af3d8e-bd93-4520-91e7-29c135c03e55" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[657d0c58-941d-461e-b93d-de9d60054a63]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d45c112-c7f6-49b0-bb99-63a3eabea0a8 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d] added
Aug 09 10:18:27 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[40fcc18d-5c01-443d-804e-a9fe71eb17a8]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d45c112-c7f6-49b0-bb99-63a3eabea0a8 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c1505b-f243-47e5-a2c1-7738cdcfe7fa]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d45c112-c7f6-49b0-bb99-63a3eabea0a8 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qEnGvXdt {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qEnGvXdt" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb3be11-62d8-4060-8dba-b627eb86df77]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d45c112-c7f6-49b0-bb99-63a3eabea0a8 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qEnGvXdt'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71d02be-9819-4c6f-866a-d868cbb1f5eb]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d45c112-c7f6-49b0-bb99-63a3eabea0a8 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c463e4f-133f-4dab-8b14-8e2f0492ff92]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d45c112-c7f6-49b0-bb99-63a3eabea0a8 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 10:18:27 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d45c112-c7f6-49b0-bb99-63a3eabea0a8 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 10:18:27 user nova-compute[72362]:  {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:18:27 user nova-compute[72362]: WARNING os_brick.initiator.connectors.iscsi [None req-9d45c112-c7f6-49b0-bb99-63a3eabea0a8 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 10:18:27 user nova-compute[72362]: 
Aug 09 10:18:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[77550f10-e802-474f-bb53-9c152bdcea86]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d45c112-c7f6-49b0-bb99-63a3eabea0a8 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d, portal: 172.16.0.220,3260]
Aug 09 10:18:27 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d, portal: 172.16.0.220,3260] successful.
Aug 09 10:18:27 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d566f70e-275d-4ffc-8044-3566efc48096]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d45c112-c7f6-49b0-bb99-63a3eabea0a8 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[1630c35e-1e23-4d77-adb5-dfed9649dce1]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d45c112-c7f6-49b0-bb99-63a3eabea0a8 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)
Aug 09 10:18:27 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d45c112-c7f6-49b0-bb99-63a3eabea0a8 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)
Aug 09 10:18:27 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-9d45c112-c7f6-49b0-bb99-63a3eabea0a8 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d45c112-c7f6-49b0-bb99-63a3eabea0a8 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-9d45c112-c7f6-49b0-bb99-63a3eabea0a8 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] HCTL ('33', '-', '-', 0) found on session 3 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-9d45c112-c7f6-49b0-bb99-63a3eabea0a8 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea16a2d-2b76-4729-8f8f-34552257e9cc]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-9d45c112-c7f6-49b0-bb99-63a3eabea0a8 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Searching for a device in session 3 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d45c112-c7f6-49b0-bb99-63a3eabea0a8 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qEnGvXdt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4e565a0-8a49-49d9-a42d-7b1521cb05a7 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e565a0-8a49-49d9-a42d-7b1521cb05a7 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a6f32fab-0eed-4346-b78c-69a9360ce812'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qxvBsUzA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:18:27 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-d4e565a0-8a49-49d9-a42d-7b1521cb05a7 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:18:27 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-d4e565a0-8a49-49d9-a42d-7b1521cb05a7 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG nova.network.neutron [None req-8b19f952-ac11-4235-a0ef-d517dede9f5e tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Updating instance_info_cache with network_info: [{"id": "1efbc456-6c56-4367-845f-0afa8acdcec4", "address": "fa:16:3e:76:bd:21", "network": {"id": "1eaf9aa3-1d74-424c-86c6-28096cf53571", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-621134432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a68b4a52019441480a19783a89e0af8", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1efbc456-6c", "ovs_interfaceid": "1efbc456-6c56-4367-845f-0afa8acdcec4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8c232e74-771d-40b3-8f0c-abdef770aafd", "address": "fa:16:3e:f6:7f:94", "network": {"id": "20844264-ffb2-45b0-b420-8783270cc7f5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1034730248", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7a68b4a52019441480a19783a89e0af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c232e74-77", "ovs_interfaceid": "8c232e74-771d-40b3-8f0c-abdef770aafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-8b19f952-ac11-4235-a0ef-d517dede9f5e tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Releasing lock "refresh_cache-00af3d8e-bd93-4520-91e7-29c135c03e55" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-0f81db84-42d9-431f-97e7-aa74c5391e2d req-46407944-5751-4455-8ade-dfc6cb3681be service nova] Acquired lock "refresh_cache-00af3d8e-bd93-4520-91e7-29c135c03e55" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG nova.network.neutron [req-0f81db84-42d9-431f-97e7-aa74c5391e2d req-46407944-5751-4455-8ade-dfc6cb3681be service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Refreshing network info cache for port 8c232e74-771d-40b3-8f0c-abdef770aafd {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-8b19f952-ac11-4235-a0ef-d517dede9f5e tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:16:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1129807899',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1129807899',id=7,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKTy1BEGFgb2LwPCE0l4ZdsIb1CDE+2z5XZX+3IOS7BmpUspCkv8nslwIBX+XdLBElH9a7nR/A5XVOfQJoXDwudCeZ0lpAUFsL0E9TcfQKbmNmV+/CzT9enkfH7jf9KfQ==',key_name='tempest-keypair-426982747',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:16:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7a68b4a52019441480a19783a89e0af8',ramdisk_id='',reservation_id='r-80xqf6s8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-202820908',owner_user_name='tempest-TaggedAttachmentsTest-202820908-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:16:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5dd4d0e5c03744569a542098432622d7',uuid=00af3d8e-bd93-4520-91e7-29c135c03e55,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c232e74-771d-40b3-8f0c-abdef770aafd", "address": "fa:16:3e:f6:7f:94", "network": {"id": "20844264-ffb2-45b0-b420-8783270cc7f5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1034730248", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7a68b4a52019441480a19783a89e0af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c232e74-77", "ovs_interfaceid": "8c232e74-771d-40b3-8f0c-abdef770aafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-8b19f952-ac11-4235-a0ef-d517dede9f5e tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Converting VIF {"id": "8c232e74-771d-40b3-8f0c-abdef770aafd", "address": "fa:16:3e:f6:7f:94", "network": {"id": "20844264-ffb2-45b0-b420-8783270cc7f5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1034730248", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7a68b4a52019441480a19783a89e0af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c232e74-77", "ovs_interfaceid": "8c232e74-771d-40b3-8f0c-abdef770aafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-8b19f952-ac11-4235-a0ef-d517dede9f5e tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:7f:94,bridge_name='br-int',has_traffic_filtering=True,id=8c232e74-771d-40b3-8f0c-abdef770aafd,network=Network(20844264-ffb2-45b0-b420-8783270cc7f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c232e74-77') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG os_vif [None req-8b19f952-ac11-4235-a0ef-d517dede9f5e tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:7f:94,bridge_name='br-int',has_traffic_filtering=True,id=8c232e74-771d-40b3-8f0c-abdef770aafd,network=Network(20844264-ffb2-45b0-b420-8783270cc7f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c232e74-77') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c232e74-77, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8c232e74-77, col_values=(('external_ids', {'iface-id': '8c232e74-771d-40b3-8f0c-abdef770aafd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:7f:94', 'vm-uuid': '00af3d8e-bd93-4520-91e7-29c135c03e55'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:27 user nova-compute[72362]: INFO os_vif [None req-8b19f952-ac11-4235-a0ef-d517dede9f5e tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:7f:94,bridge_name='br-int',has_traffic_filtering=True,id=8c232e74-771d-40b3-8f0c-abdef770aafd,network=Network(20844264-ffb2-45b0-b420-8783270cc7f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c232e74-77')
Aug 09 10:18:27 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-8b19f952-ac11-4235-a0ef-d517dede9f5e tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:16:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1129807899',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1129807899',id=7,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKTy1BEGFgb2LwPCE0l4ZdsIb1CDE+2z5XZX+3IOS7BmpUspCkv8nslwIBX+XdLBElH9a7nR/A5XVOfQJoXDwudCeZ0lpAUFsL0E9TcfQKbmNmV+/CzT9enkfH7jf9KfQ==',key_name='tempest-keypair-426982747',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:16:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7a68b4a52019441480a19783a89e0af8',ramdisk_id='',reservation_id='r-80xqf6s8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-202820908',owner_user_name='tempest-TaggedAttachmentsTest-202820908-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:16:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5dd4d0e5c03744569a542098432622d7',uuid=00af3d8e-bd93-4520-91e7-29c135c03e55,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c232e74-771d-40b3-8f0c-abdef770aafd", "address": "fa:16:3e:f6:7f:94", "network": {"id": "20844264-ffb2-45b0-b420-8783270cc7f5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1034730248", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7a68b4a52019441480a19783a89e0af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c232e74-77", "ovs_interfaceid": "8c232e74-771d-40b3-8f0c-abdef770aafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-8b19f952-ac11-4235-a0ef-d517dede9f5e tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Converting VIF {"id": "8c232e74-771d-40b3-8f0c-abdef770aafd", "address": "fa:16:3e:f6:7f:94", "network": {"id": "20844264-ffb2-45b0-b420-8783270cc7f5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1034730248", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7a68b4a52019441480a19783a89e0af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c232e74-77", "ovs_interfaceid": "8c232e74-771d-40b3-8f0c-abdef770aafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-8b19f952-ac11-4235-a0ef-d517dede9f5e tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:7f:94,bridge_name='br-int',has_traffic_filtering=True,id=8c232e74-771d-40b3-8f0c-abdef770aafd,network=Network(20844264-ffb2-45b0-b420-8783270cc7f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c232e74-77') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-8b19f952-ac11-4235-a0ef-d517dede9f5e tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] attach device xml: <interface type="ethernet">
Aug 09 10:18:27 user nova-compute[72362]:   <mac address="fa:16:3e:f6:7f:94"/>
Aug 09 10:18:27 user nova-compute[72362]:   <model type="virtio"/>
Aug 09 10:18:27 user nova-compute[72362]:   <mtu size="1442"/>
Aug 09 10:18:27 user nova-compute[72362]:   <target dev="tap8c232e74-77"/>
Aug 09 10:18:27 user nova-compute[72362]: </interface>
Aug 09 10:18:27 user nova-compute[72362]:  {{(pid=72362) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG nova.compute.manager [req-f498b558-b4fd-4f0c-9567-366caa54fa9c req-a3c51cb2-b8d2-4da8-8ece-4e2633f7425b service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Received event network-vif-plugged-8c232e74-771d-40b3-8f0c-abdef770aafd {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f498b558-b4fd-4f0c-9567-366caa54fa9c req-a3c51cb2-b8d2-4da8-8ece-4e2633f7425b service nova] Acquiring lock "00af3d8e-bd93-4520-91e7-29c135c03e55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f498b558-b4fd-4f0c-9567-366caa54fa9c req-a3c51cb2-b8d2-4da8-8ece-4e2633f7425b service nova] Lock "00af3d8e-bd93-4520-91e7-29c135c03e55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f498b558-b4fd-4f0c-9567-366caa54fa9c req-a3c51cb2-b8d2-4da8-8ece-4e2633f7425b service nova] Lock "00af3d8e-bd93-4520-91e7-29c135c03e55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG nova.compute.manager [req-f498b558-b4fd-4f0c-9567-366caa54fa9c req-a3c51cb2-b8d2-4da8-8ece-4e2633f7425b service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] No waiting events found dispatching network-vif-plugged-8c232e74-771d-40b3-8f0c-abdef770aafd {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:18:28 user nova-compute[72362]: WARNING nova.compute.manager [req-f498b558-b4fd-4f0c-9567-366caa54fa9c req-a3c51cb2-b8d2-4da8-8ece-4e2633f7425b service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Received unexpected event network-vif-plugged-8c232e74-771d-40b3-8f0c-abdef770aafd for instance with vm_state active and task_state None.
Aug 09 10:18:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-8b19f952-ac11-4235-a0ef-d517dede9f5e tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-8b19f952-ac11-4235-a0ef-d517dede9f5e tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] No BDM found with device name hda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-8b19f952-ac11-4235-a0ef-d517dede9f5e tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] No VIF found with MAC fa:16:3e:76:bd:21, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-8b19f952-ac11-4235-a0ef-d517dede9f5e tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:18:28 user nova-compute[72362]:   <nova:package version="0.0.0"/>
Aug 09 10:18:28 user nova-compute[72362]:   <nova:name>tempest-device-tagging-server-1129807899</nova:name>
Aug 09 10:18:28 user nova-compute[72362]:   <nova:creationTime>2023-08-09 10:18:28</nova:creationTime>
Aug 09 10:18:28 user nova-compute[72362]:   <nova:flavor name="m1.tiny">
Aug 09 10:18:28 user nova-compute[72362]:     <nova:memory>512</nova:memory>
Aug 09 10:18:28 user nova-compute[72362]:     <nova:disk>1</nova:disk>
Aug 09 10:18:28 user nova-compute[72362]:     <nova:swap>0</nova:swap>
Aug 09 10:18:28 user nova-compute[72362]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:18:28 user nova-compute[72362]:     <nova:vcpus>1</nova:vcpus>
Aug 09 10:18:28 user nova-compute[72362]:   </nova:flavor>
Aug 09 10:18:28 user nova-compute[72362]:   <nova:owner>
Aug 09 10:18:28 user nova-compute[72362]:     <nova:user uuid="5dd4d0e5c03744569a542098432622d7">tempest-TaggedAttachmentsTest-202820908-project-member</nova:user>
Aug 09 10:18:28 user nova-compute[72362]:     <nova:project uuid="7a68b4a52019441480a19783a89e0af8">tempest-TaggedAttachmentsTest-202820908</nova:project>
Aug 09 10:18:28 user nova-compute[72362]:   </nova:owner>
Aug 09 10:18:28 user nova-compute[72362]:   <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:18:28 user nova-compute[72362]:   <nova:ports>
Aug 09 10:18:28 user nova-compute[72362]:     <nova:port uuid="1efbc456-6c56-4367-845f-0afa8acdcec4">
Aug 09 10:18:28 user nova-compute[72362]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 10:18:28 user nova-compute[72362]:     </nova:port>
Aug 09 10:18:28 user nova-compute[72362]:     <nova:port uuid="8c232e74-771d-40b3-8f0c-abdef770aafd">
Aug 09 10:18:28 user nova-compute[72362]:       <nova:ip type="fixed" address="10.10.10.165" ipVersion="4"/>
Aug 09 10:18:28 user nova-compute[72362]:     </nova:port>
Aug 09 10:18:28 user nova-compute[72362]:   </nova:ports>
Aug 09 10:18:28 user nova-compute[72362]: </nova:instance>
Aug 09 10:18:28 user nova-compute[72362]:  {{(pid=72362) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-9d45c112-c7f6-49b0-bb99-63a3eabea0a8 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d45c112-c7f6-49b0-bb99-63a3eabea0a8 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26233333236306364', 'path': '/dev/sdb'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d45c112-c7f6-49b0-bb99-63a3eabea0a8 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233333236306364', 'path': '/dev/sdb'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-d4e565a0-8a49-49d9-a42d-7b1521cb05a7 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.941s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:18:28 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-d4e565a0-8a49-49d9-a42d-7b1521cb05a7 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:18:28 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-d4e565a0-8a49-49d9-a42d-7b1521cb05a7 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6f32fab-0eed-4346-b78c-69a9360ce812" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-d4e565a0-8a49-49d9-a42d-7b1521cb05a7 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6f32fab-0eed-4346-b78c-69a9360ce812" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:18:28 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-d4e565a0-8a49-49d9-a42d-7b1521cb05a7 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:18:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6f32fab-0eed-4346-b78c-69a9360ce812 -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG nova.objects.instance [None req-9d45c112-c7f6-49b0-bb99-63a3eabea0a8 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Lazy-loading 'flavor' on Instance uuid b17b317a-409e-45ad-ac7c-0c298f4f564b {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-8b19f952-ac11-4235-a0ef-d517dede9f5e tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Lock "interface-00af3d8e-bd93-4520-91e7-29c135c03e55-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.197s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6f32fab-0eed-4346-b78c-69a9360ce812 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[061a8861-9eab-4c70-b0e2-e8ed8be17b1d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e565a0-8a49-49d9-a42d-7b1521cb05a7 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:18:28 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6f32fab-0eed-4346-b78c-69a9360ce812 -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-9d45c112-c7f6-49b0-bb99-63a3eabea0a8 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 10:18:28 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:18:28 user nova-compute[72362]:   <source dev="/dev/sdb"/>
Aug 09 10:18:28 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:18:28 user nova-compute[72362]:   <serial>85bc12a2-e20a-44af-919e-746a6239532d</serial>
Aug 09 10:18:28 user nova-compute[72362]: </disk>
Aug 09 10:18:28 user nova-compute[72362]:  {{(pid=72362) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6f32fab-0eed-4346-b78c-69a9360ce812 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[287c2748-448e-4abe-857c-2a72fb012bbb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6f32fab-0eed-4346-b78c-69a9360ce812] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e565a0-8a49-49d9-a42d-7b1521cb05a7 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6f32fab-0eed-4346-b78c-69a9360ce812] added
Aug 09 10:18:28 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6f32fab-0eed-4346-b78c-69a9360ce812 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6f32fab-0eed-4346-b78c-69a9360ce812 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8e2b72-0057-4667-92f4-c6276567947f]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e565a0-8a49-49d9-a42d-7b1521cb05a7 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6f32fab-0eed-4346-b78c-69a9360ce812 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6f32fab-0eed-4346-b78c-69a9360ce812 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b96ea5a-3137-4e80-9b92-29fe6ef2d72d]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e565a0-8a49-49d9-a42d-7b1521cb05a7 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6f32fab-0eed-4346-b78c-69a9360ce812 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qxvBsUzA {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6f32fab-0eed-4346-b78c-69a9360ce812 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qxvBsUzA" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d7411c-e4ed-4705-8228-3358b275c0a1]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e565a0-8a49-49d9-a42d-7b1521cb05a7 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qxvBsUzA'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6f32fab-0eed-4346-b78c-69a9360ce812 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6f32fab-0eed-4346-b78c-69a9360ce812 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d348f0fa-4e68-4ec6-982e-3e3a24aa0c7f]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e565a0-8a49-49d9-a42d-7b1521cb05a7 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90d012a-5de0-407f-931e-35b1f6d59be0]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e565a0-8a49-49d9-a42d-7b1521cb05a7 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)
Aug 09 10:18:28 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e565a0-8a49-49d9-a42d-7b1521cb05a7 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)
Aug 09 10:18:28 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6f32fab-0eed-4346-b78c-69a9360ce812 -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6f32fab-0eed-4346-b78c-69a9360ce812 -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1083441-fef5-47f6-b890-f272822d277a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6f32fab-0eed-4346-b78c-69a9360ce812, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a6f32fab-0eed-4346-b78c-69a9360ce812, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e565a0-8a49-49d9-a42d-7b1521cb05a7 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6f32fab-0eed-4346-b78c-69a9360ce812, portal: 172.16.0.220,3260]
Aug 09 10:18:28 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:a6f32fab-0eed-4346-b78c-69a9360ce812, portal: 172.16.0.220,3260] successful.
Aug 09 10:18:28 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6f32fab-0eed-4346-b78c-69a9360ce812 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6f32fab-0eed-4346-b78c-69a9360ce812 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4bb5e70-0827-4f31-a683-be96f1e9c948]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e565a0-8a49-49d9-a42d-7b1521cb05a7 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac4ad79-4ed2-4482-a749-c46a1d3524aa]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f32fab-0eed-4346-b78c-69a9360ce812 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e565a0-8a49-49d9-a42d-7b1521cb05a7 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)
Aug 09 10:18:28 user nova-compute[72362]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f32fab-0eed-4346-b78c-69a9360ce812 (non-flash)
Aug 09 10:18:28 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e565a0-8a49-49d9-a42d-7b1521cb05a7 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)
Aug 09 10:18:28 user nova-compute[72362]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f32fab-0eed-4346-b78c-69a9360ce812 (non-flash)
Aug 09 10:18:28 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-d4e565a0-8a49-49d9-a42d-7b1521cb05a7 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6f32fab-0eed-4346-b78c-69a9360ce812" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.398s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e565a0-8a49-49d9-a42d-7b1521cb05a7 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-d4e565a0-8a49-49d9-a42d-7b1521cb05a7 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-d4e565a0-8a49-49d9-a42d-7b1521cb05a7 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.025s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5fd048-4e00-484b-95fc-304dfbe1361b]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-d4e565a0-8a49-49d9-a42d-7b1521cb05a7 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e565a0-8a49-49d9-a42d-7b1521cb05a7 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qxvBsUzA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG nova.network.neutron [req-0f81db84-42d9-431f-97e7-aa74c5391e2d req-46407944-5751-4455-8ade-dfc6cb3681be service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Updated VIF entry in instance network info cache for port 8c232e74-771d-40b3-8f0c-abdef770aafd. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG nova.network.neutron [req-0f81db84-42d9-431f-97e7-aa74c5391e2d req-46407944-5751-4455-8ade-dfc6cb3681be service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Updating instance_info_cache with network_info: [{"id": "1efbc456-6c56-4367-845f-0afa8acdcec4", "address": "fa:16:3e:76:bd:21", "network": {"id": "1eaf9aa3-1d74-424c-86c6-28096cf53571", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-621134432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a68b4a52019441480a19783a89e0af8", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1efbc456-6c", "ovs_interfaceid": "1efbc456-6c56-4367-845f-0afa8acdcec4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8c232e74-771d-40b3-8f0c-abdef770aafd", "address": "fa:16:3e:f6:7f:94", "network": {"id": "20844264-ffb2-45b0-b420-8783270cc7f5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1034730248", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7a68b4a52019441480a19783a89e0af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c232e74-77", "ovs_interfaceid": "8c232e74-771d-40b3-8f0c-abdef770aafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-0f81db84-42d9-431f-97e7-aa74c5391e2d req-46407944-5751-4455-8ade-dfc6cb3681be service nova] Releasing lock "refresh_cache-00af3d8e-bd93-4520-91e7-29c135c03e55" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1af5a2be-aa7b-43a8-95e3-200c307ad4a2 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Acquiring lock "00af3d8e-bd93-4520-91e7-29c135c03e55" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1af5a2be-aa7b-43a8-95e3-200c307ad4a2 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Lock "00af3d8e-bd93-4520-91e7-29c135c03e55" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG nova.objects.instance [None req-1af5a2be-aa7b-43a8-95e3-200c307ad4a2 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Lazy-loading 'flavor' on Instance uuid 00af3d8e-bd93-4520-91e7-29c135c03e55 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-9d45c112-c7f6-49b0-bb99-63a3eabea0a8 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-9d45c112-c7f6-49b0-bb99-63a3eabea0a8 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-9d45c112-c7f6-49b0-bb99-63a3eabea0a8 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] No VIF found with MAC fa:16:3e:0d:a8:5c, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:18:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1af5a2be-aa7b-43a8-95e3-200c307ad4a2 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Lock "00af3d8e-bd93-4520-91e7-29c135c03e55" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:18:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1af5a2be-aa7b-43a8-95e3-200c307ad4a2 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Acquiring lock "00af3d8e-bd93-4520-91e7-29c135c03e55" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:18:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1af5a2be-aa7b-43a8-95e3-200c307ad4a2 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Lock "00af3d8e-bd93-4520-91e7-29c135c03e55" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:18:29 user nova-compute[72362]: INFO nova.compute.manager [None req-1af5a2be-aa7b-43a8-95e3-200c307ad4a2 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Attaching volume 46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4 to /dev/vdb
Aug 09 10:18:29 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691576294.213107, 1e2e53b4-3a00-4725-840d-215f6609c951 => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:18:29 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] VM Stopped (Lifecycle Event)
Aug 09 10:18:29 user nova-compute[72362]: DEBUG nova.compute.manager [None req-82e7c006-ea22-40a7-8b71-d001463b8f75 None None] [instance: 1e2e53b4-3a00-4725-840d-215f6609c951] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:18:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-9d45c112-c7f6-49b0-bb99-63a3eabea0a8 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Lock "b17b317a-409e-45ad-ac7c-0c298f4f564b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.568s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:18:29 user nova-compute[72362]: DEBUG os_brick.utils [None req-1af5a2be-aa7b-43a8-95e3-200c307ad4a2 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:18:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:29 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb4e60f-a239-4d5d-bf0d-133517948f33]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:29 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3576ce-ce89-4c60-be97-b1d288df506a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:29 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6869a6-353f-41da-9dd3-7cf2f5db91d1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:29 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[608814dc-9cd6-4e15-b21f-03e94d555d1f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1af5a2be-aa7b-43a8-95e3-200c307ad4a2 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1af5a2be-aa7b-43a8-95e3-200c307ad4a2 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:18:29 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1af5a2be-aa7b-43a8-95e3-200c307ad4a2 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:18:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:18:29 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:18:29 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17a7825-4343-4a3a-a0ae-a882870e8699]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:29 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-1af5a2be-aa7b-43a8-95e3-200c307ad4a2 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:18:29 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-1af5a2be-aa7b-43a8-95e3-200c307ad4a2 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:18:29 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-1af5a2be-aa7b-43a8-95e3-200c307ad4a2 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:18:29 user nova-compute[72362]: DEBUG os_brick.utils [None req-1af5a2be-aa7b-43a8-95e3-200c307ad4a2 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:18:29 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-1af5a2be-aa7b-43a8-95e3-200c307ad4a2 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Updating existing volume attachment record: 245f8e7c-ca89-47ae-8d3b-9d32b86d861b {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 10:18:29 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-d4e565a0-8a49-49d9-a42d-7b1521cb05a7 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.448s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:18:29 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e565a0-8a49-49d9-a42d-7b1521cb05a7 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] <== connect_volume: return (2389ms) {'type': 'block', 'scsi_wwn': '26266653666366264', 'path': '/dev/sdc'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:18:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4e565a0-8a49-49d9-a42d-7b1521cb05a7 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266653666366264', 'path': '/dev/sdc'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:18:29 user nova-compute[72362]: DEBUG nova.objects.instance [None req-d4e565a0-8a49-49d9-a42d-7b1521cb05a7 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] Lazy-loading 'flavor' on Instance uuid 8f0c62c9-aa84-4a5b-b909-af5535e87c83 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:18:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-d4e565a0-8a49-49d9-a42d-7b1521cb05a7 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] attach device xml: <disk type="block" device="disk">
Aug 09 10:18:29 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:18:29 user nova-compute[72362]:   <source dev="/dev/sdc"/>
Aug 09 10:18:29 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:18:29 user nova-compute[72362]:   <serial>a6f32fab-0eed-4346-b78c-69a9360ce812</serial>
Aug 09 10:18:29 user nova-compute[72362]: </disk>
Aug 09 10:18:29 user nova-compute[72362]:  {{(pid=72362) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 10:18:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Acquiring lock "b17b317a-409e-45ad-ac7c-0c298f4f564b" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:18:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Lock "b17b317a-409e-45ad-ac7c-0c298f4f564b" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:18:30 user nova-compute[72362]: DEBUG os_brick.utils [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:18:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:30 user nova-compute[72362]: DEBUG nova.compute.manager [req-ead815fd-64e9-4f3f-9b62-2c118362c5e9 req-9a2426c6-f987-4da0-bc3a-919e32fbfad4 service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Received event network-vif-plugged-8c232e74-771d-40b3-8f0c-abdef770aafd {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:18:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ead815fd-64e9-4f3f-9b62-2c118362c5e9 req-9a2426c6-f987-4da0-bc3a-919e32fbfad4 service nova] Acquiring lock "00af3d8e-bd93-4520-91e7-29c135c03e55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:18:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ead815fd-64e9-4f3f-9b62-2c118362c5e9 req-9a2426c6-f987-4da0-bc3a-919e32fbfad4 service nova] Lock "00af3d8e-bd93-4520-91e7-29c135c03e55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:18:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ead815fd-64e9-4f3f-9b62-2c118362c5e9 req-9a2426c6-f987-4da0-bc3a-919e32fbfad4 service nova] Lock "00af3d8e-bd93-4520-91e7-29c135c03e55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:18:30 user nova-compute[72362]: DEBUG nova.compute.manager [req-ead815fd-64e9-4f3f-9b62-2c118362c5e9 req-9a2426c6-f987-4da0-bc3a-919e32fbfad4 service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] No waiting events found dispatching network-vif-plugged-8c232e74-771d-40b3-8f0c-abdef770aafd {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:18:30 user nova-compute[72362]: WARNING nova.compute.manager [req-ead815fd-64e9-4f3f-9b62-2c118362c5e9 req-9a2426c6-f987-4da0-bc3a-919e32fbfad4 service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Received unexpected event network-vif-plugged-8c232e74-771d-40b3-8f0c-abdef770aafd for instance with vm_state active and task_state None.
Aug 09 10:18:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:30 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f44572-63d8-4a03-9478-a00661c76b41]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:30 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7d0661-6f44-4784-9f03-6429a7d3facb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:30 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-d4e565a0-8a49-49d9-a42d-7b1521cb05a7 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:18:30 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-d4e565a0-8a49-49d9-a42d-7b1521cb05a7 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:18:30 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-d4e565a0-8a49-49d9-a42d-7b1521cb05a7 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] No VIF found with MAC fa:16:3e:63:7f:a8, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:18:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:30 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[158f4830-ea81-4162-9c11-eb852c680329]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:30 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[519f1479-6ff9-45b8-a428-8511529b90fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:18:30 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:18:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:18:30 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:18:30 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[79071f22-b993-4965-a005-c21931cb89de]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:30 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:18:30 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:18:30 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:18:30 user nova-compute[72362]: DEBUG os_brick.utils [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:18:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d4e565a0-8a49-49d9-a42d-7b1521cb05a7 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] Lock "8f0c62c9-aa84-4a5b-b909-af5535e87c83" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.478s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:18:30 user nova-compute[72362]: INFO nova.compute.manager [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Swapping volume 85bc12a2-e20a-44af-919e-746a6239532d for 54f624f3-1ddb-4904-b1e5-11d5811883fa
Aug 09 10:18:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c97e21ed-a1df-481b-8237-c3fc9d38342e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97e21ed-a1df-481b-8237-c3fc9d38342e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GVaDklnQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:18:33 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-c97e21ed-a1df-481b-8237-c3fc9d38342e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:18:33 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-c97e21ed-a1df-481b-8237-c3fc9d38342e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-c97e21ed-a1df-481b-8237-c3fc9d38342e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:18:33 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-c97e21ed-a1df-481b-8237-c3fc9d38342e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:18:33 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-c97e21ed-a1df-481b-8237-c3fc9d38342e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-c97e21ed-a1df-481b-8237-c3fc9d38342e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:18:33 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-c97e21ed-a1df-481b-8237-c3fc9d38342e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:18:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3d250c-e917-43d9-b9b9-1f00b2e1f0dd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97e21ed-a1df-481b-8237-c3fc9d38342e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:18:33 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[599aacd2-58fd-46e2-b2b9-47e401677476]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97e21ed-a1df-481b-8237-c3fc9d38342e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e] added
Aug 09 10:18:33 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[535fdaee-8537-4b50-82ab-5bec7aa50f46]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97e21ed-a1df-481b-8237-c3fc9d38342e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42f50a2-03f3-48ad-85f3-e63156dc3ca0]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97e21ed-a1df-481b-8237-c3fc9d38342e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GVaDklnQ {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GVaDklnQ" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd577f3-f8b3-4024-aede-636953898a26]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97e21ed-a1df-481b-8237-c3fc9d38342e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GVaDklnQ'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b37e5ce-3e96-43cd-a9f8-f4262f33e75b]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97e21ed-a1df-481b-8237-c3fc9d38342e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceeda212-0b22-4051-9948-55bef23cf1e1]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f32fab-0eed-4346-b78c-69a9360ce812 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97e21ed-a1df-481b-8237-c3fc9d38342e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)
Aug 09 10:18:33 user nova-compute[72362]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f32fab-0eed-4346-b78c-69a9360ce812 (non-flash)
Aug 09 10:18:33 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97e21ed-a1df-481b-8237-c3fc9d38342e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)
Aug 09 10:18:33 user nova-compute[72362]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f32fab-0eed-4346-b78c-69a9360ce812 (non-flash)
Aug 09 10:18:33 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbf6391-d461-40ce-91a1-5b04e0471315]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97e21ed-a1df-481b-8237-c3fc9d38342e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e, portal: 172.16.0.220,3260]
Aug 09 10:18:33 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e, portal: 172.16.0.220,3260] successful.
Aug 09 10:18:33 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c424135-316f-4262-bf00-6db06a3a99e5]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97e21ed-a1df-481b-8237-c3fc9d38342e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[989016a7-7013-48f7-a42d-221e0d96f5d0]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f32fab-0eed-4346-b78c-69a9360ce812 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97e21ed-a1df-481b-8237-c3fc9d38342e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)
Aug 09 10:18:33 user nova-compute[72362]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f32fab-0eed-4346-b78c-69a9360ce812 (non-flash)
Aug 09 10:18:33 user nova-compute[72362]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e (non-flash)
Aug 09 10:18:33 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97e21ed-a1df-481b-8237-c3fc9d38342e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)
Aug 09 10:18:33 user nova-compute[72362]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f32fab-0eed-4346-b78c-69a9360ce812 (non-flash)
Aug 09 10:18:33 user nova-compute[72362]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e (non-flash)
Aug 09 10:18:33 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-c97e21ed-a1df-481b-8237-c3fc9d38342e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97e21ed-a1df-481b-8237-c3fc9d38342e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-c97e21ed-a1df-481b-8237-c3fc9d38342e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-c97e21ed-a1df-481b-8237-c3fc9d38342e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a29133-ee2a-4d2b-9709-36a132a8c54d]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-c97e21ed-a1df-481b-8237-c3fc9d38342e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97e21ed-a1df-481b-8237-c3fc9d38342e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GVaDklnQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-09a6eb91-ed62-4e90-8de2-f64cf26a29f3 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] volume_snapshot_create: create_info: {'snapshot_id': 'c546dffc-ec6d-426d-be4c-8e644e9d82bc', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=72362) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-09a6eb91-ed62-4e90-8de2-f64cf26a29f3 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] snap xml: <domainsnapshot>
Aug 09 10:18:33 user nova-compute[72362]:   <disks>
Aug 09 10:18:33 user nova-compute[72362]:     <disk name="/dev/sdc" snapshot="external" type="file">
Aug 09 10:18:33 user nova-compute[72362]:       <source file="/dev/new_file"/>
Aug 09 10:18:33 user nova-compute[72362]:     </disk>
Aug 09 10:18:33 user nova-compute[72362]:     <disk name="vda" snapshot="no"/>
Aug 09 10:18:33 user nova-compute[72362]:   </disks>
Aug 09 10:18:33 user nova-compute[72362]: </domainsnapshot>
Aug 09 10:18:33 user nova-compute[72362]:  {{(pid=72362) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG nova.objects.instance [None req-09a6eb91-ed62-4e90-8de2-f64cf26a29f3 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] Lazy-loading 'system_metadata' on Instance uuid 8f0c62c9-aa84-4a5b-b909-af5535e87c83 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2d6dd431-b83c-447a-baae-9ebea3967859 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Acquiring lock "9f2bc700-2e69-406f-9a13-52396eae4258" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2d6dd431-b83c-447a-baae-9ebea3967859 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Lock "9f2bc700-2e69-406f-9a13-52396eae4258" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG nova.objects.instance [None req-2d6dd431-b83c-447a-baae-9ebea3967859 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Lazy-loading 'flavor' on Instance uuid 9f2bc700-2e69-406f-9a13-52396eae4258 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:18:33 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-65b45316-d6b2-4daa-8f54-45eeb84c4828 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] volume_snapshot_delete: delete_info: {'volume_id': 'a6f32fab-0eed-4346-b78c-69a9360ce812'} {{(pid=72362) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 09 10:18:33 user nova-compute[72362]: ERROR nova.virt.libvirt.driver [None req-65b45316-d6b2-4daa-8f54-45eeb84c4828 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 09 10:18:33 user nova-compute[72362]: ERROR nova.virt.libvirt.driver [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Traceback (most recent call last):
Aug 09 10:18:33 user nova-compute[72362]: ERROR nova.virt.libvirt.driver [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 09 10:18:33 user nova-compute[72362]: ERROR nova.virt.libvirt.driver [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 09 10:18:33 user nova-compute[72362]: ERROR nova.virt.libvirt.driver [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 09 10:18:33 user nova-compute[72362]: ERROR nova.virt.libvirt.driver [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83]     if delete_info['type'] != 'qcow2':
Aug 09 10:18:33 user nova-compute[72362]: ERROR nova.virt.libvirt.driver [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] KeyError: 'type'
Aug 09 10:18:33 user nova-compute[72362]: ERROR nova.virt.libvirt.driver [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] 
Aug 09 10:18:33 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-09a6eb91-ed62-4e90-8de2-f64cf26a29f3 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 09 10:18:33 user nova-compute[72362]: ERROR nova.virt.libvirt.driver [None req-09a6eb91-ed62-4e90-8de2-f64cf26a29f3 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 10:18:33 user nova-compute[72362]: ERROR nova.virt.libvirt.driver [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Traceback (most recent call last):
Aug 09 10:18:33 user nova-compute[72362]: ERROR nova.virt.libvirt.driver [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 09 10:18:33 user nova-compute[72362]: ERROR nova.virt.libvirt.driver [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 09 10:18:33 user nova-compute[72362]: ERROR nova.virt.libvirt.driver [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 09 10:18:33 user nova-compute[72362]: ERROR nova.virt.libvirt.driver [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 09 10:18:33 user nova-compute[72362]: ERROR nova.virt.libvirt.driver [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 193, in doit
Aug 09 10:18:33 user nova-compute[72362]: ERROR nova.virt.libvirt.driver [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 09 10:18:33 user nova-compute[72362]: ERROR nova.virt.libvirt.driver [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 09 10:18:33 user nova-compute[72362]: ERROR nova.virt.libvirt.driver [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83]     rv = execute(f, *args, **kwargs)
Aug 09 10:18:33 user nova-compute[72362]: ERROR nova.virt.libvirt.driver [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 132, in execute
Aug 09 10:18:33 user nova-compute[72362]: ERROR nova.virt.libvirt.driver [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83]     six.reraise(c, e, tb)
Aug 09 10:18:33 user nova-compute[72362]: ERROR nova.virt.libvirt.driver [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 09 10:18:33 user nova-compute[72362]: ERROR nova.virt.libvirt.driver [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83]     raise value
Aug 09 10:18:33 user nova-compute[72362]: ERROR nova.virt.libvirt.driver [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 86, in tworker
Aug 09 10:18:33 user nova-compute[72362]: ERROR nova.virt.libvirt.driver [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83]     rv = meth(*args, **kwargs)
Aug 09 10:18:33 user nova-compute[72362]: ERROR nova.virt.libvirt.driver [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 09 10:18:33 user nova-compute[72362]: ERROR nova.virt.libvirt.driver [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 09 10:18:33 user nova-compute[72362]: ERROR nova.virt.libvirt.driver [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 10:18:33 user nova-compute[72362]: ERROR nova.virt.libvirt.driver [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] 
Aug 09 10:18:33 user nova-compute[72362]: ERROR nova.virt.libvirt.driver [None req-09a6eb91-ed62-4e90-8de2-f64cf26a29f3 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 10:18:33 user nova-compute[72362]: ERROR nova.virt.libvirt.driver [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Traceback (most recent call last):
Aug 09 10:18:33 user nova-compute[72362]: ERROR nova.virt.libvirt.driver [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 09 10:18:33 user nova-compute[72362]: ERROR nova.virt.libvirt.driver [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83]     self._volume_snapshot_create(context, instance, guest,
Aug 09 10:18:33 user nova-compute[72362]: ERROR nova.virt.libvirt.driver [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 09 10:18:33 user nova-compute[72362]: ERROR nova.virt.libvirt.driver [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 09 10:18:33 user nova-compute[72362]: ERROR nova.virt.libvirt.driver [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 09 10:18:33 user nova-compute[72362]: ERROR nova.virt.libvirt.driver [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 09 10:18:33 user nova-compute[72362]: ERROR nova.virt.libvirt.driver [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 193, in doit
Aug 09 10:18:33 user nova-compute[72362]: ERROR nova.virt.libvirt.driver [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 09 10:18:33 user nova-compute[72362]: ERROR nova.virt.libvirt.driver [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 09 10:18:33 user nova-compute[72362]: ERROR nova.virt.libvirt.driver [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83]     rv = execute(f, *args, **kwargs)
Aug 09 10:18:33 user nova-compute[72362]: ERROR nova.virt.libvirt.driver [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 132, in execute
Aug 09 10:18:33 user nova-compute[72362]: ERROR nova.virt.libvirt.driver [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83]     six.reraise(c, e, tb)
Aug 09 10:18:33 user nova-compute[72362]: ERROR nova.virt.libvirt.driver [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 09 10:18:33 user nova-compute[72362]: ERROR nova.virt.libvirt.driver [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83]     raise value
Aug 09 10:18:33 user nova-compute[72362]: ERROR nova.virt.libvirt.driver [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 86, in tworker
Aug 09 10:18:33 user nova-compute[72362]: ERROR nova.virt.libvirt.driver [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83]     rv = meth(*args, **kwargs)
Aug 09 10:18:33 user nova-compute[72362]: ERROR nova.virt.libvirt.driver [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 09 10:18:33 user nova-compute[72362]: ERROR nova.virt.libvirt.driver [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 09 10:18:33 user nova-compute[72362]: ERROR nova.virt.libvirt.driver [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 10:18:33 user nova-compute[72362]: ERROR nova.virt.libvirt.driver [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] 
Aug 09 10:18:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2d6dd431-b83c-447a-baae-9ebea3967859 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Lock "9f2bc700-2e69-406f-9a13-52396eae4258" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.125s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver [None req-65b45316-d6b2-4daa-8f54-45eeb84c4828 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver 
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver 
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 223, in post
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-d4a6d2b0-0a32-4cce-bb55-3538af5488c1)
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver 
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver 
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 223, in post
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver 
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server [None req-65b45316-d6b2-4daa-8f54-45eeb84c4828 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] Exception during message handling: KeyError: 'type'
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server 
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver [None req-09a6eb91-ed62-4e90-8de2-f64cf26a29f3 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot c546dffc-ec6d-426d-be4c-8e644e9d82bc could not be found.
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 193, in doit
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 132, in execute
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver     raise value
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 86, in tworker
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver 
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver 
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 223, in post
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot c546dffc-ec6d-426d-be4c-8e644e9d82bc could not be found. (HTTP 404) (Request-ID: req-7d924280-91ef-4b0b-88cc-e4fab4319e21)
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver 
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver 
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 223, in post
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot c546dffc-ec6d-426d-be4c-8e644e9d82bc could not be found.
Aug 09 10:18:34 user nova-compute[72362]: ERROR nova.virt.libvirt.driver 
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server [None req-09a6eb91-ed62-4e90-8de2-f64cf26a29f3 tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 193, in doit
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 132, in execute
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server     raise value
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 86, in tworker
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 10:18:34 user nova-compute[72362]: ERROR oslo_messaging.rpc.server 
Aug 09 10:18:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2d6dd431-b83c-447a-baae-9ebea3967859 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Acquiring lock "9f2bc700-2e69-406f-9a13-52396eae4258" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:18:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2d6dd431-b83c-447a-baae-9ebea3967859 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Lock "9f2bc700-2e69-406f-9a13-52396eae4258" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:18:34 user nova-compute[72362]: INFO nova.compute.manager [None req-2d6dd431-b83c-447a-baae-9ebea3967859 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Attaching volume e98b7d2a-6ed5-4f6c-beb7-e40059291e10 to /dev/sdc
Aug 09 10:18:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d6b63b87-6027-4fd0-bad8-8a5cd6a5fafc tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] Acquiring lock "8f0c62c9-aa84-4a5b-b909-af5535e87c83" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:18:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d6b63b87-6027-4fd0-bad8-8a5cd6a5fafc tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] Lock "8f0c62c9-aa84-4a5b-b909-af5535e87c83" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:18:34 user nova-compute[72362]: DEBUG os_brick.utils [None req-2d6dd431-b83c-447a-baae-9ebea3967859 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:18:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:34 user nova-compute[72362]: INFO nova.compute.manager [None req-d6b63b87-6027-4fd0-bad8-8a5cd6a5fafc tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Detaching volume a6f32fab-0eed-4346-b78c-69a9360ce812
Aug 09 10:18:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:34 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e96e0a0-c535-4d8d-9067-435a2074e308]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:34 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6c3aa7-6b86-4112-9d34-90c7c7999fb1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:34 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3c4c0f-fbf8-40e1-94e4-1a3dfa39aaf1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:34 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea36b0f0-6b0a-47d3-a526-d8287bd1202d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-2d6dd431-b83c-447a-baae-9ebea3967859 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-2d6dd431-b83c-447a-baae-9ebea3967859 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:18:34 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2d6dd431-b83c-447a-baae-9ebea3967859 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:18:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:34 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-c97e21ed-a1df-481b-8237-c3fc9d38342e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:18:34 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97e21ed-a1df-481b-8237-c3fc9d38342e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23036626134613934', 'path': '/dev/sdd'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:18:34 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c97e21ed-a1df-481b-8237-c3fc9d38342e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036626134613934', 'path': '/dev/sdd'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:18:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:18:34 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:18:34 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[911582df-5a22-4b85-9745-c077a153c0a3]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:34 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-2d6dd431-b83c-447a-baae-9ebea3967859 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:18:34 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-2d6dd431-b83c-447a-baae-9ebea3967859 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:18:34 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-2d6dd431-b83c-447a-baae-9ebea3967859 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:18:34 user nova-compute[72362]: DEBUG os_brick.utils [None req-2d6dd431-b83c-447a-baae-9ebea3967859 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:18:34 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-2d6dd431-b83c-447a-baae-9ebea3967859 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Updating existing volume attachment record: 9b11d736-1d54-4c6a-bfa7-116f49d25f00 {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 10:18:34 user nova-compute[72362]: DEBUG nova.objects.instance [None req-c97e21ed-a1df-481b-8237-c3fc9d38342e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Lazy-loading 'flavor' on Instance uuid ea95226c-40fe-4408-a9f0-5538659261a6 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:18:34 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-c97e21ed-a1df-481b-8237-c3fc9d38342e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 10:18:34 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:18:34 user nova-compute[72362]:   <source dev="/dev/sdd"/>
Aug 09 10:18:34 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:18:34 user nova-compute[72362]:   <serial>276b6ff7-8005-4266-b02a-fb4432f2ee2e</serial>
Aug 09 10:18:34 user nova-compute[72362]: </disk>
Aug 09 10:18:34 user nova-compute[72362]:  {{(pid=72362) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 10:18:34 user nova-compute[72362]: INFO nova.virt.block_device [None req-d6b63b87-6027-4fd0-bad8-8a5cd6a5fafc tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Attempting to driver detach volume a6f32fab-0eed-4346-b78c-69a9360ce812 from mountpoint /dev/vdb
Aug 09 10:18:34 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-d6b63b87-6027-4fd0-bad8-8a5cd6a5fafc tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] Attempting to detach device vdb from instance 8f0c62c9-aa84-4a5b-b909-af5535e87c83 from the persistent domain config. {{(pid=72362) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 10:18:34 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-d6b63b87-6027-4fd0-bad8-8a5cd6a5fafc tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] detach device xml: <disk type="block" device="disk">
Aug 09 10:18:34 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:18:34 user nova-compute[72362]:   <source dev="/dev/sdc"/>
Aug 09 10:18:34 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:18:34 user nova-compute[72362]:   <serial>a6f32fab-0eed-4346-b78c-69a9360ce812</serial>
Aug 09 10:18:34 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 10:18:34 user nova-compute[72362]: </disk>
Aug 09 10:18:34 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:18:34 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-d6b63b87-6027-4fd0-bad8-8a5cd6a5fafc tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] Successfully detached device vdb from instance 8f0c62c9-aa84-4a5b-b909-af5535e87c83 from the persistent domain config.
Aug 09 10:18:34 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-d6b63b87-6027-4fd0-bad8-8a5cd6a5fafc tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8f0c62c9-aa84-4a5b-b909-af5535e87c83 from the live domain config. {{(pid=72362) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 10:18:34 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-d6b63b87-6027-4fd0-bad8-8a5cd6a5fafc tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] detach device xml: <disk type="block" device="disk">
Aug 09 10:18:34 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:18:34 user nova-compute[72362]:   <source dev="/dev/sdc"/>
Aug 09 10:18:34 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:18:34 user nova-compute[72362]:   <serial>a6f32fab-0eed-4346-b78c-69a9360ce812</serial>
Aug 09 10:18:34 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 10:18:34 user nova-compute[72362]: </disk>
Aug 09 10:18:34 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:18:35 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-c97e21ed-a1df-481b-8237-c3fc9d38342e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:18:35 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-c97e21ed-a1df-481b-8237-c3fc9d38342e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:18:35 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-c97e21ed-a1df-481b-8237-c3fc9d38342e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] No VIF found with MAC fa:16:3e:31:49:f0, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:18:35 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Received event <DeviceRemovedEvent: 1691576315.367127, 8f0c62c9-aa84-4a5b-b909-af5535e87c83 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72362) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 10:18:35 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-d6b63b87-6027-4fd0-bad8-8a5cd6a5fafc tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8f0c62c9-aa84-4a5b-b909-af5535e87c83 {{(pid=72362) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 10:18:35 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-d6b63b87-6027-4fd0-bad8-8a5cd6a5fafc tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] Successfully detached device vdb from instance 8f0c62c9-aa84-4a5b-b909-af5535e87c83 from the live domain config.
Aug 09 10:18:35 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6b63b87-6027-4fd0-bad8-8a5cd6a5fafc tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:18:35 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b63b87-6027-4fd0-bad8-8a5cd6a5fafc tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:a6f32fab-0eed-4346-b78c-69a9360ce812'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qxvBsUzA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:18:35 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-d6b63b87-6027-4fd0-bad8-8a5cd6a5fafc tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:18:35 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-d6b63b87-6027-4fd0-bad8-8a5cd6a5fafc tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:18:35 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-d6b63b87-6027-4fd0-bad8-8a5cd6a5fafc tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:18:35 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b63b87-6027-4fd0-bad8-8a5cd6a5fafc tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6f32fab-0eed-4346-b78c-69a9360ce812', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:18:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:35 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7cc1c8d-da3d-4f77-b431-bb7b07d6a532]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6f32fab-0eed-4346-b78c-69a9360ce812\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:35 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7683f15-e545-435a-b48a-1aa103dfbce1]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f32fab-0eed-4346-b78c-69a9360ce812 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:35 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b63b87-6027-4fd0-bad8-8a5cd6a5fafc tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)
Aug 09 10:18:35 user nova-compute[72362]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f32fab-0eed-4346-b78c-69a9360ce812 (non-flash)
Aug 09 10:18:35 user nova-compute[72362]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e (non-flash)
Aug 09 10:18:35 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:18:35 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b63b87-6027-4fd0-bad8-8a5cd6a5fafc tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)
Aug 09 10:18:35 user nova-compute[72362]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f32fab-0eed-4346-b78c-69a9360ce812 (non-flash)
Aug 09 10:18:35 user nova-compute[72362]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e (non-flash)
Aug 09 10:18:35 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:18:35 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b63b87-6027-4fd0-bad8-8a5cd6a5fafc tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34f0fc6440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6f32fab-0eed-4346-b78c-69a9360ce812'): ({'sdc'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:18:35 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-d6b63b87-6027-4fd0-bad8-8a5cd6a5fafc tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] Removing single pathed devices sdc {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:18:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:35 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7cd718-d42d-4a21-87b2-8d4476d52bd1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:35 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[560f0c96-7cd1-4cab-b13f-fffbb5727087]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:35 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-d6b63b87-6027-4fd0-bad8-8a5cd6a5fafc tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] Flushing IO for device /dev/sdc {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:18:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:35 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[2259d21a-d69d-4c89-87b2-9d00e5a3abf7]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:35 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-d6b63b87-6027-4fd0-bad8-8a5cd6a5fafc tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:18:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:35 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec4aa11-c1dc-44f6-a0e6-f671f71eb182]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:35 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-d6b63b87-6027-4fd0-bad8-8a5cd6a5fafc tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] Checking to see if SCSI volumes sdc have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:18:35 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-d6b63b87-6027-4fd0-bad8-8a5cd6a5fafc tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] SCSI volumes sdc have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:18:35 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b63b87-6027-4fd0-bad8-8a5cd6a5fafc tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6f32fab-0eed-4346-b78c-69a9360ce812')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:18:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6f32fab-0eed-4346-b78c-69a9360ce812 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6f32fab-0eed-4346-b78c-69a9360ce812 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:35 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[67cab3ea-38f8-4832-9fff-2b4b795e2a1a]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:35 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b63b87-6027-4fd0-bad8-8a5cd6a5fafc tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6f32fab-0eed-4346-b78c-69a9360ce812 -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6f32fab-0eed-4346-b78c-69a9360ce812 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:35 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6271c95f-fa35-4514-8f1a-d92b1d60d3ef]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:a6f32fab-0eed-4346-b78c-69a9360ce812, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:a6f32fab-0eed-4346-b78c-69a9360ce812, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:35 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b63b87-6027-4fd0-bad8-8a5cd6a5fafc tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:a6f32fab-0eed-4346-b78c-69a9360ce812, portal: 172.16.0.220,3260]
Aug 09 10:18:35 user nova-compute[72362]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:a6f32fab-0eed-4346-b78c-69a9360ce812, portal: 172.16.0.220,3260] successful.
Aug 09 10:18:35 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6f32fab-0eed-4346-b78c-69a9360ce812 -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6f32fab-0eed-4346-b78c-69a9360ce812 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:35 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e989dec7-84bd-4268-8026-a895f86c5115]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:35 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b63b87-6027-4fd0-bad8-8a5cd6a5fafc tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:35 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-d6b63b87-6027-4fd0-bad8-8a5cd6a5fafc tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:18:35 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b63b87-6027-4fd0-bad8-8a5cd6a5fafc tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] <== disconnect_volume: return (285ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:18:35 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6b63b87-6027-4fd0-bad8-8a5cd6a5fafc tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:18:35 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:40 user nova-compute[72362]: DEBUG nova.compute.manager [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OxChRspE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b17b317a-409e-45ad-ac7c-0c298f4f564b', 'attached_at': '', 'detached_at': '', 'volume_id': '54f624f3-1ddb-4904-b1e5-11d5811883fa', 'serial': '54f624f3-1ddb-4904-b1e5-11d5811883fa'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qEnGvXdt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'b17b317a-409e-45ad-ac7c-0c298f4f564b', 'attached_at': '', 'detached_at': '', 'volume_id': '85bc12a2-e20a-44af-919e-746a6239532d', 'serial'} {{(pid=72362) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 09 10:18:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:18:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OxChRspE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:18:40 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:18:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:18:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:18:40 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:18:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:18:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:18:40 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:18:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:40 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f99f8d7-f440-4350-84ed-f0b3de3e34cb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:18:40 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:40 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[af15d980-dfc8-4a94-87e5-22e2b78039f4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa] added
Aug 09 10:18:40 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:40 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cec39e-6e19-4e16-adca-2cf926e9b357]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:40 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ca34ed-68fb-4eaf-b00c-6e8e0cd77aa0]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OxChRspE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c97e21ed-a1df-481b-8237-c3fc9d38342e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Lock "ea95226c-40fe-4408-a9f0-5538659261a6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.881s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:18:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OxChRspE" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:40 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[08bbe36f-6f9a-48d8-8578-6cffc438607c]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OxChRspE'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:40 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a1a26f-e62a-4ad0-b9b0-40cf7ce58cb4]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1af5a2be-aa7b-43a8-95e3-200c307ad4a2 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:18:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af5a2be-aa7b-43a8-95e3-200c307ad4a2 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PdOWJzYk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:18:40 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-1af5a2be-aa7b-43a8-95e3-200c307ad4a2 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:18:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-1af5a2be-aa7b-43a8-95e3-200c307ad4a2 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:18:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:40 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f544745a-54c6-4175-b94d-eb1bd0bb6c32]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)
Aug 09 10:18:40 user nova-compute[72362]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e (non-flash)
Aug 09 10:18:40 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:18:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)
Aug 09 10:18:40 user nova-compute[72362]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e (non-flash)
Aug 09 10:18:40 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:18:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:40 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[82208b5e-b26a-456a-b365-ea1aaca112ce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa, portal: 172.16.0.220,3260]
Aug 09 10:18:40 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa, portal: 172.16.0.220,3260] successful.
Aug 09 10:18:40 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:40 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c22bba2-98d2-4d61-8ade-59b0d84f3d81]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:41 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e419d52a-ebf0-45dd-a6fb-a7b664b05a38]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:41 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)
Aug 09 10:18:41 user nova-compute[72362]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e (non-flash)
Aug 09 10:18:41 user nova-compute[72362]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa (non-flash)
Aug 09 10:18:41 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:18:41 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)
Aug 09 10:18:41 user nova-compute[72362]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e (non-flash)
Aug 09 10:18:41 user nova-compute[72362]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa (non-flash)
Aug 09 10:18:41 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:18:41 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:18:41 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:18:41 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] HCTL ('34', '-', '-', 0) found on session 6 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:18:41 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:18:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.028s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:41 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[382dc129-9bc9-4b1f-af11-7fa5bf227326]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:41 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Searching for a device in session 6 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:18:41 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OxChRspE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:18:41 user nova-compute[72362]: DEBUG nova.objects.instance [None req-d6b63b87-6027-4fd0-bad8-8a5cd6a5fafc tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] Lazy-loading 'flavor' on Instance uuid 8f0c62c9-aa84-4a5b-b909-af5535e87c83 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d6b63b87-6027-4fd0-bad8-8a5cd6a5fafc tempest-VolumesAssistedSnapshotsTest-959202743 tempest-VolumesAssistedSnapshotsTest-959202743-project-admin] Lock "8f0c62c9-aa84-4a5b-b909-af5535e87c83" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 7.502s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '23166623961613230', 'path': '/dev/sdc'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166623961613230', 'path': '/dev/sdc'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-1af5a2be-aa7b-43a8-95e3-200c307ad4a2 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.213s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:18:42 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-1af5a2be-aa7b-43a8-95e3-200c307ad4a2 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:18:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-1af5a2be-aa7b-43a8-95e3-200c307ad4a2 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-1af5a2be-aa7b-43a8-95e3-200c307ad4a2 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:18:42 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-1af5a2be-aa7b-43a8-95e3-200c307ad4a2 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:18:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4 -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG nova.objects.instance [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Lazy-loading 'flavor' on Instance uuid b17b317a-409e-45ad-ac7c-0c298f4f564b {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1b3deb-87c2-478f-b3b8-bba04f80ccda]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af5a2be-aa7b-43a8-95e3-200c307ad4a2 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:18:42 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3fd48ae7-36ea-41fd-b7b9-0b99d7d48b8b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Acquiring lock "ea95226c-40fe-4408-a9f0-5538659261a6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3fd48ae7-36ea-41fd-b7b9-0b99d7d48b8b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Lock "ea95226c-40fe-4408-a9f0-5538659261a6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:42 user nova-compute[72362]: INFO nova.compute.manager [None req-3fd48ae7-36ea-41fd-b7b9-0b99d7d48b8b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Detaching volume 276b6ff7-8005-4266-b02a-fb4432f2ee2e
Aug 09 10:18:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d27a8e5-2e70-434a-bec4-4c54cd1f16ed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af5a2be-aa7b-43a8-95e3-200c307ad4a2 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4] added
Aug 09 10:18:42 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[9247c7f8-1e7b-4d1f-81fa-67c7948f2ceb]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af5a2be-aa7b-43a8-95e3-200c307ad4a2 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[422cf58b-3de8-4d29-9ce1-fe5cb43e396c]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af5a2be-aa7b-43a8-95e3-200c307ad4a2 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PdOWJzYk {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:42 user nova-compute[72362]: INFO nova.virt.block_device [None req-3fd48ae7-36ea-41fd-b7b9-0b99d7d48b8b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Attempting to driver detach volume 276b6ff7-8005-4266-b02a-fb4432f2ee2e from mountpoint /dev/vdb
Aug 09 10:18:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PdOWJzYk" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9b810a-7d8c-4c67-9311-5dee1364a0a5]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af5a2be-aa7b-43a8-95e3-200c307ad4a2 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PdOWJzYk'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3fd48ae7-36ea-41fd-b7b9-0b99d7d48b8b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Attempting to detach device vdb from instance ea95226c-40fe-4408-a9f0-5538659261a6 from the persistent domain config. {{(pid=72362) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-3fd48ae7-36ea-41fd-b7b9-0b99d7d48b8b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 10:18:42 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:18:42 user nova-compute[72362]:   <source dev="/dev/sdd"/>
Aug 09 10:18:42 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:18:42 user nova-compute[72362]:   <serial>276b6ff7-8005-4266-b02a-fb4432f2ee2e</serial>
Aug 09 10:18:42 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 10:18:42 user nova-compute[72362]: </disk>
Aug 09 10:18:42 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:18:42 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-3fd48ae7-36ea-41fd-b7b9-0b99d7d48b8b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Successfully detached device vdb from instance ea95226c-40fe-4408-a9f0-5538659261a6 from the persistent domain config.
Aug 09 10:18:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3fd48ae7-36ea-41fd-b7b9-0b99d7d48b8b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ea95226c-40fe-4408-a9f0-5538659261a6 from the live domain config. {{(pid=72362) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-3fd48ae7-36ea-41fd-b7b9-0b99d7d48b8b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 10:18:42 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:18:42 user nova-compute[72362]:   <source dev="/dev/sdd"/>
Aug 09 10:18:42 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:18:42 user nova-compute[72362]:   <serial>276b6ff7-8005-4266-b02a-fb4432f2ee2e</serial>
Aug 09 10:18:42 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 10:18:42 user nova-compute[72362]: </disk>
Aug 09 10:18:42 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8de75c5-49a1-44b0-8886-117491e6ea7b]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af5a2be-aa7b-43a8-95e3-200c307ad4a2 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[422d6545-4eac-4b86-814b-00b7755a095f]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af5a2be-aa7b-43a8-95e3-200c307ad4a2 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)
Aug 09 10:18:42 user nova-compute[72362]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e (non-flash)
Aug 09 10:18:42 user nova-compute[72362]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa (non-flash)
Aug 09 10:18:42 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af5a2be-aa7b-43a8-95e3-200c307ad4a2 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)
Aug 09 10:18:42 user nova-compute[72362]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e (non-flash)
Aug 09 10:18:42 user nova-compute[72362]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa (non-flash)
Aug 09 10:18:42 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4 -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e74db9-79cb-4449-a19a-5073c05d26ea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af5a2be-aa7b-43a8-95e3-200c307ad4a2 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4, portal: 172.16.0.220,3260]
Aug 09 10:18:42 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4, portal: 172.16.0.220,3260] successful.
Aug 09 10:18:42 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50e824f-6f50-4277-b7b8-526d6efff2da]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af5a2be-aa7b-43a8-95e3-200c307ad4a2 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd14e80d-2b73-4c50-bfb4-4bec37d63a49]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af5a2be-aa7b-43a8-95e3-200c307ad4a2 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)
Aug 09 10:18:42 user nova-compute[72362]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e (non-flash)
Aug 09 10:18:42 user nova-compute[72362]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa (non-flash)
Aug 09 10:18:42 user nova-compute[72362]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4 (non-flash)
Aug 09 10:18:42 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af5a2be-aa7b-43a8-95e3-200c307ad4a2 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)
Aug 09 10:18:42 user nova-compute[72362]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e (non-flash)
Aug 09 10:18:42 user nova-compute[72362]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa (non-flash)
Aug 09 10:18:42 user nova-compute[72362]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4 (non-flash)
Aug 09 10:18:42 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-1af5a2be-aa7b-43a8-95e3-200c307ad4a2 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af5a2be-aa7b-43a8-95e3-200c307ad4a2 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-1af5a2be-aa7b-43a8-95e3-200c307ad4a2 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] HCTL ('36', '-', '-', 0) found on session 7 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-1af5a2be-aa7b-43a8-95e3-200c307ad4a2 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6039447-015f-4917-bde0-367bb6afe50e]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-1af5a2be-aa7b-43a8-95e3-200c307ad4a2 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Searching for a device in session 7 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af5a2be-aa7b-43a8-95e3-200c307ad4a2 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PdOWJzYk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Received event <DeviceRemovedEvent: 1691576322.8205755, ea95226c-40fe-4408-a9f0-5538659261a6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72362) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3fd48ae7-36ea-41fd-b7b9-0b99d7d48b8b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ea95226c-40fe-4408-a9f0-5538659261a6 {{(pid=72362) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 10:18:42 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-3fd48ae7-36ea-41fd-b7b9-0b99d7d48b8b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Successfully detached device vdb from instance ea95226c-40fe-4408-a9f0-5538659261a6 from the live domain config.
Aug 09 10:18:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fd48ae7-36ea-41fd-b7b9-0b99d7d48b8b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd48ae7-36ea-41fd-b7b9-0b99d7d48b8b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GVaDklnQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:18:42 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-3fd48ae7-36ea-41fd-b7b9-0b99d7d48b8b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:18:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-3fd48ae7-36ea-41fd-b7b9-0b99d7d48b8b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=72362) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 10:18:43 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] COPY block job progress, current cursor: 156237824 final cursor: 1073741824 {{(pid=72362) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 10:18:43 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-1af5a2be-aa7b-43a8-95e3-200c307ad4a2 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:18:43 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af5a2be-aa7b-43a8-95e3-200c307ad4a2 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] <== connect_volume: return (2568ms) {'type': 'block', 'scsi_wwn': '23131326533303166', 'path': '/dev/sde'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:18:43 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1af5a2be-aa7b-43a8-95e3-200c307ad4a2 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131326533303166', 'path': '/dev/sde'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:18:43 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-3fd48ae7-36ea-41fd-b7b9-0b99d7d48b8b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.596s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:18:43 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd48ae7-36ea-41fd-b7b9-0b99d7d48b8b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:18:43 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:43 user nova-compute[72362]: DEBUG nova.objects.instance [None req-1af5a2be-aa7b-43a8-95e3-200c307ad4a2 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Lazy-loading 'flavor' on Instance uuid 00af3d8e-bd93-4520-91e7-29c135c03e55 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:18:43 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:43 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f28089-7f9f-4acd-b74d-3644556123ed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:43 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:43 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-1af5a2be-aa7b-43a8-95e3-200c307ad4a2 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 10:18:43 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:18:43 user nova-compute[72362]:   <source dev="/dev/sde"/>
Aug 09 10:18:43 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:18:43 user nova-compute[72362]:   <serial>46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4</serial>
Aug 09 10:18:43 user nova-compute[72362]: </disk>
Aug 09 10:18:43 user nova-compute[72362]:  {{(pid=72362) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 10:18:43 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:43 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d55873-1b28-4ac6-95c2-68fc67880ec2]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:43 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd48ae7-36ea-41fd-b7b9-0b99d7d48b8b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)
Aug 09 10:18:43 user nova-compute[72362]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e (non-flash)
Aug 09 10:18:43 user nova-compute[72362]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa (non-flash)
Aug 09 10:18:43 user nova-compute[72362]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4 (non-flash)
Aug 09 10:18:43 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:18:43 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd48ae7-36ea-41fd-b7b9-0b99d7d48b8b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)
Aug 09 10:18:43 user nova-compute[72362]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e (non-flash)
Aug 09 10:18:43 user nova-compute[72362]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa (non-flash)
Aug 09 10:18:43 user nova-compute[72362]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4 (non-flash)
Aug 09 10:18:43 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:18:43 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd48ae7-36ea-41fd-b7b9-0b99d7d48b8b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34dc479240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e'): ({'sdd'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:18:43 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-3fd48ae7-36ea-41fd-b7b9-0b99d7d48b8b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Removing single pathed devices sdd {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:18:43 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:43 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:43 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a19d7e9-ce55-4221-adc2-f9eea79e05da]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:43 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:43 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.027s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:43 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b98fbd7-1172-4f6b-95ae-c2432d725389]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:43 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-3fd48ae7-36ea-41fd-b7b9-0b99d7d48b8b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Flushing IO for device /dev/sdd {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:18:43 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:43 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:43 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[998c73ce-ec06-42e6-82f2-04bfc13fbe2a]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:43 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-3fd48ae7-36ea-41fd-b7b9-0b99d7d48b8b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:18:43 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:43 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.057s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:43 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28d2c01-d2b5-4a0a-a528-49feab5b6c79]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:43 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-3fd48ae7-36ea-41fd-b7b9-0b99d7d48b8b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:18:43 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-3fd48ae7-36ea-41fd-b7b9-0b99d7d48b8b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] SCSI volumes sdd have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:18:43 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd48ae7-36ea-41fd-b7b9-0b99d7d48b8b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:18:43 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:43 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:43 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[76694bfc-3083-42c0-bc85-0d020c05739c]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:43 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd48ae7-36ea-41fd-b7b9-0b99d7d48b8b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:43 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:43 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:43 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bde0001-b325-41bd-92f9-08b4c4ed87cd]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:43 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd48ae7-36ea-41fd-b7b9-0b99d7d48b8b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e, portal: 172.16.0.220,3260]
Aug 09 10:18:43 user nova-compute[72362]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e, portal: 172.16.0.220,3260] successful.
Aug 09 10:18:43 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:43 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:43 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:276b6ff7-8005-4266-b02a-fb4432f2ee2e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:43 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc55938e-77ac-4822-8480-a6d2d4d7f8a1]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:43 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd48ae7-36ea-41fd-b7b9-0b99d7d48b8b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:43 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-3fd48ae7-36ea-41fd-b7b9-0b99d7d48b8b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:18:43 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd48ae7-36ea-41fd-b7b9-0b99d7d48b8b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] <== disconnect_volume: return (974ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:18:43 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fd48ae7-36ea-41fd-b7b9-0b99d7d48b8b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:18:43 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] COPY block job progress, current cursor: 318767104 final cursor: 1073741824 {{(pid=72362) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 10:18:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1af5a2be-aa7b-43a8-95e3-200c307ad4a2 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:18:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1af5a2be-aa7b-43a8-95e3-200c307ad4a2 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] No BDM found with device name hda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:18:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1af5a2be-aa7b-43a8-95e3-200c307ad4a2 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] No VIF found with MAC fa:16:3e:76:bd:21, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:18:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1af5a2be-aa7b-43a8-95e3-200c307ad4a2 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Lock "00af3d8e-bd93-4520-91e7-29c135c03e55" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.065s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:18:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] COPY block job progress, current cursor: 430964736 final cursor: 1073741824 {{(pid=72362) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 10:18:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d6dd431-b83c-447a-baae-9ebea3967859 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:18:44 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d6dd431-b83c-447a-baae-9ebea3967859 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PwoHRGcg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:18:44 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-2d6dd431-b83c-447a-baae-9ebea3967859 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:18:44 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-2d6dd431-b83c-447a-baae-9ebea3967859 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:18:44 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-2d6dd431-b83c-447a-baae-9ebea3967859 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:18:44 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-2d6dd431-b83c-447a-baae-9ebea3967859 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:18:44 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-2d6dd431-b83c-447a-baae-9ebea3967859 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:18:44 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-2d6dd431-b83c-447a-baae-9ebea3967859 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:18:44 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-2d6dd431-b83c-447a-baae-9ebea3967859 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:18:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10 -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:44 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e103cf35-564a-4508-871f-02ecb73ee2a6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:44 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d6dd431-b83c-447a-baae-9ebea3967859 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:18:44 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10 -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:44 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d29b7b0-8779-45fa-9e33-2b2ba0ba5743]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:44 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d6dd431-b83c-447a-baae-9ebea3967859 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10] added
Aug 09 10:18:44 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:44 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2ca416-c9e0-46b8-a282-ad7e0de7615e]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:44 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d6dd431-b83c-447a-baae-9ebea3967859 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] COPY block job progress, current cursor: 571473920 final cursor: 1073741824 {{(pid=72362) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 10:18:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:44 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[473493d8-b3d4-4afc-878a-87b8e818148e]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:44 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d6dd431-b83c-447a-baae-9ebea3967859 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PwoHRGcg {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PwoHRGcg" returned: 0 in 0.026s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:44 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d17c16d-8cbe-4222-ad9c-0de58c7c9fed]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:44 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d6dd431-b83c-447a-baae-9ebea3967859 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PwoHRGcg'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:45 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a471f58-a055-42de-9069-d28a75361d0b]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:45 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d6dd431-b83c-447a-baae-9ebea3967859 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:45 user nova-compute[72362]: DEBUG nova.objects.instance [None req-3fd48ae7-36ea-41fd-b7b9-0b99d7d48b8b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Lazy-loading 'flavor' on Instance uuid ea95226c-40fe-4408-a9f0-5538659261a6 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:18:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:45 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[9792aae8-b852-45f1-ae81-3eb8552f67a9]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:45 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d6dd431-b83c-447a-baae-9ebea3967859 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)
Aug 09 10:18:45 user nova-compute[72362]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa (non-flash)
Aug 09 10:18:45 user nova-compute[72362]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4 (non-flash)
Aug 09 10:18:45 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:18:45 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d6dd431-b83c-447a-baae-9ebea3967859 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)
Aug 09 10:18:45 user nova-compute[72362]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa (non-flash)
Aug 09 10:18:45 user nova-compute[72362]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4 (non-flash)
Aug 09 10:18:45 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:18:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10 -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3fd48ae7-36ea-41fd-b7b9-0b99d7d48b8b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Lock "ea95226c-40fe-4408-a9f0-5538659261a6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.993s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:18:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:45 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52bace4-7b5b-417a-b125-32a9bd848f86]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:45 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d6dd431-b83c-447a-baae-9ebea3967859 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10, portal: 172.16.0.220,3260]
Aug 09 10:18:45 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10, portal: 172.16.0.220,3260] successful.
Aug 09 10:18:45 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:45 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06cd170-f8cc-438b-9c2b-97d3c059f990]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:45 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d6dd431-b83c-447a-baae-9ebea3967859 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:45 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d33a2d-0141-4df4-8a4f-e77d0192aa70]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:45 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d6dd431-b83c-447a-baae-9ebea3967859 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)
Aug 09 10:18:45 user nova-compute[72362]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa (non-flash)
Aug 09 10:18:45 user nova-compute[72362]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4 (non-flash)
Aug 09 10:18:45 user nova-compute[72362]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10 (non-flash)
Aug 09 10:18:45 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:18:45 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d6dd431-b83c-447a-baae-9ebea3967859 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)
Aug 09 10:18:45 user nova-compute[72362]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa (non-flash)
Aug 09 10:18:45 user nova-compute[72362]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4 (non-flash)
Aug 09 10:18:45 user nova-compute[72362]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10 (non-flash)
Aug 09 10:18:45 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:18:45 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-2d6dd431-b83c-447a-baae-9ebea3967859 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:18:45 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d6dd431-b83c-447a-baae-9ebea3967859 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:18:45 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-2d6dd431-b83c-447a-baae-9ebea3967859 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] HCTL ('35', '-', '-', 0) found on session 8 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:18:45 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-2d6dd431-b83c-447a-baae-9ebea3967859 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:18:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:45 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1484e29-2c9b-4caf-9200-4cef3df3144d]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:45 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-2d6dd431-b83c-447a-baae-9ebea3967859 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Searching for a device in session 8 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:18:45 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d6dd431-b83c-447a-baae-9ebea3967859 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PwoHRGcg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:18:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ae1fbd02-3569-4170-a77f-7af798862d05 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Acquiring lock "00af3d8e-bd93-4520-91e7-29c135c03e55" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:18:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ae1fbd02-3569-4170-a77f-7af798862d05 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Lock "00af3d8e-bd93-4520-91e7-29c135c03e55" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:18:45 user nova-compute[72362]: INFO nova.compute.manager [None req-ae1fbd02-3569-4170-a77f-7af798862d05 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Detaching volume 46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4
Aug 09 10:18:45 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] COPY block job progress, current cursor: 743440384 final cursor: 1073741824 {{(pid=72362) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 10:18:45 user nova-compute[72362]: INFO nova.virt.block_device [None req-ae1fbd02-3569-4170-a77f-7af798862d05 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Attempting to driver detach volume 46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4 from mountpoint /dev/vdb
Aug 09 10:18:45 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-ae1fbd02-3569-4170-a77f-7af798862d05 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Attempting to detach device vdb from instance 00af3d8e-bd93-4520-91e7-29c135c03e55 from the persistent domain config. {{(pid=72362) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 10:18:45 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-ae1fbd02-3569-4170-a77f-7af798862d05 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 10:18:45 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:18:45 user nova-compute[72362]:   <source dev="/dev/sde"/>
Aug 09 10:18:45 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:18:45 user nova-compute[72362]:   <serial>46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4</serial>
Aug 09 10:18:45 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 10:18:45 user nova-compute[72362]: </disk>
Aug 09 10:18:45 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:18:45 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-ae1fbd02-3569-4170-a77f-7af798862d05 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Successfully detached device vdb from instance 00af3d8e-bd93-4520-91e7-29c135c03e55 from the persistent domain config.
Aug 09 10:18:45 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-ae1fbd02-3569-4170-a77f-7af798862d05 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 00af3d8e-bd93-4520-91e7-29c135c03e55 from the live domain config. {{(pid=72362) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 10:18:45 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-ae1fbd02-3569-4170-a77f-7af798862d05 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 10:18:45 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:18:45 user nova-compute[72362]:   <source dev="/dev/sde"/>
Aug 09 10:18:45 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:18:45 user nova-compute[72362]:   <serial>46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4</serial>
Aug 09 10:18:45 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 10:18:45 user nova-compute[72362]: </disk>
Aug 09 10:18:45 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:18:45 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:45 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] COPY block job progress, current cursor: 919601152 final cursor: 1073741824 {{(pid=72362) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Received event <DeviceRemovedEvent: 1691576326.1905334, 00af3d8e-bd93-4520-91e7-29c135c03e55 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72362) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-ae1fbd02-3569-4170-a77f-7af798862d05 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 00af3d8e-bd93-4520-91e7-29c135c03e55 {{(pid=72362) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 10:18:46 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-ae1fbd02-3569-4170-a77f-7af798862d05 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Successfully detached device vdb from instance 00af3d8e-bd93-4520-91e7-29c135c03e55 from the live domain config.
Aug 09 10:18:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae1fbd02-3569-4170-a77f-7af798862d05 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae1fbd02-3569-4170-a77f-7af798862d05 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PdOWJzYk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:18:46 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-ae1fbd02-3569-4170-a77f-7af798862d05 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:18:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-ae1fbd02-3569-4170-a77f-7af798862d05 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-2d6dd431-b83c-447a-baae-9ebea3967859 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.398s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d6dd431-b83c-447a-baae-9ebea3967859 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] <== connect_volume: return (1401ms) {'type': 'block', 'scsi_wwn': '23963643038353763', 'path': '/dev/sdd'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d6dd431-b83c-447a-baae-9ebea3967859 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963643038353763', 'path': '/dev/sdd'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-ae1fbd02-3569-4170-a77f-7af798862d05 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.041s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae1fbd02-3569-4170-a77f-7af798862d05 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG nova.objects.instance [None req-2d6dd431-b83c-447a-baae-9ebea3967859 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Lazy-loading 'flavor' on Instance uuid 9f2bc700-2e69-406f-9a13-52396eae4258 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b323d03c-a4ea-4295-bddf-1d27567d7746]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-2d6dd431-b83c-447a-baae-9ebea3967859 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 10:18:46 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:18:46 user nova-compute[72362]:   <source dev="/dev/sdd"/>
Aug 09 10:18:46 user nova-compute[72362]:   <target dev="sdc" bus="scsi"/>
Aug 09 10:18:46 user nova-compute[72362]:   <serial>e98b7d2a-6ed5-4f6c-beb7-e40059291e10</serial>
Aug 09 10:18:46 user nova-compute[72362]:   <address type="drive" controller="0" unit="2"/>
Aug 09 10:18:46 user nova-compute[72362]: </disk>
Aug 09 10:18:46 user nova-compute[72362]:  {{(pid=72362) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[767ba44e-5ec6-4d1d-8588-ef2a6e35698c]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae1fbd02-3569-4170-a77f-7af798862d05 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)
Aug 09 10:18:46 user nova-compute[72362]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa (non-flash)
Aug 09 10:18:46 user nova-compute[72362]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4 (non-flash)
Aug 09 10:18:46 user nova-compute[72362]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10 (non-flash)
Aug 09 10:18:46 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae1fbd02-3569-4170-a77f-7af798862d05 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)
Aug 09 10:18:46 user nova-compute[72362]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa (non-flash)
Aug 09 10:18:46 user nova-compute[72362]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4 (non-flash)
Aug 09 10:18:46 user nova-compute[72362]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10 (non-flash)
Aug 09 10:18:46 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae1fbd02-3569-4170-a77f-7af798862d05 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e425b520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4'): ({'sde'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-ae1fbd02-3569-4170-a77f-7af798862d05 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Removing single pathed devices sde {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[128f8644-59d8-48e6-9f4d-26e8f54b4b1e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ec03fe-75ad-4dd1-a39a-54170ac0497b]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-ae1fbd02-3569-4170-a77f-7af798862d05 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Flushing IO for device /dev/sde {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5610563d-07bf-4f5b-8de1-fe5feedef590]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-ae1fbd02-3569-4170-a77f-7af798862d05 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.033s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae077df9-f18e-42f7-b46e-f3d5f6481c77]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-ae1fbd02-3569-4170-a77f-7af798862d05 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-ae1fbd02-3569-4170-a77f-7af798862d05 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] SCSI volumes sde have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae1fbd02-3569-4170-a77f-7af798862d05 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cdfa5a-a7d5-4e5a-b84c-b62bad9345fd]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae1fbd02-3569-4170-a77f-7af798862d05 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4 -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72362) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c21c78-7930-44ee-9c67-2dce761a9ad6]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae1fbd02-3569-4170-a77f-7af798862d05 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4, portal: 172.16.0.220,3260]
Aug 09 10:18:46 user nova-compute[72362]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4, portal: 172.16.0.220,3260] successful.
Aug 09 10:18:46 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4 -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46a9c5f8-24e3-4249-b4d5-9fdbc5d27fc4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[98782c82-47bc-4db6-a8a8-f5a56fa3f105]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae1fbd02-3569-4170-a77f-7af798862d05 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-ae1fbd02-3569-4170-a77f-7af798862d05 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae1fbd02-3569-4170-a77f-7af798862d05 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] <== disconnect_volume: return (340ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae1fbd02-3569-4170-a77f-7af798862d05 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qEnGvXdt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:18:46 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:18:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e275c002-e908-4e6a-b304-96609611963f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f693c26f-2c82-480b-9683-8de23d883766]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)
Aug 09 10:18:46 user nova-compute[72362]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa (non-flash)
Aug 09 10:18:46 user nova-compute[72362]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10 (non-flash)
Aug 09 10:18:46 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)
Aug 09 10:18:46 user nova-compute[72362]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa (non-flash)
Aug 09 10:18:46 user nova-compute[72362]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10 (non-flash)
Aug 09 10:18:46 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e42580d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d'): ({'sdb'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Removing single pathed devices sdb {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-2d6dd431-b83c-447a-baae-9ebea3967859 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] No BDM found with device name sda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-2d6dd431-b83c-447a-baae-9ebea3967859 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-2d6dd431-b83c-447a-baae-9ebea3967859 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] No BDM found with device name sdc, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-2d6dd431-b83c-447a-baae-9ebea3967859 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] No VIF found with MAC fa:16:3e:4a:45:de, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[608fbe22-de56-409b-b1bb-9c47e3cde666]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbb010c-9465-4655-9eee-1d7e04d3f8ae]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Flushing IO for device /dev/sdb {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6f47e0-18a1-41fd-b2f9-57ea8415a7cf]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d874b68f-c2ad-4039-a7c5-29c839cc40bd]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] SCSI volumes sdb have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[135e9d81-a5d6-4698-96f7-73d934b26062]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2d6dd431-b83c-447a-baae-9ebea3967859 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Lock "9f2bc700-2e69-406f-9a13-52396eae4258" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.694s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:18:47 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:47 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5339b6c-3c60-4e1d-a42f-4aa251c39166]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:47 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d, portal: 172.16.0.220,3260]
Aug 09 10:18:47 user nova-compute[72362]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d, portal: 172.16.0.220,3260] successful.
Aug 09 10:18:47 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:47 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:47 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:47 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[536e93c8-506e-4bfa-ba7e-1ebe14cb5241]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:47 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:47 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:18:47 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] <== disconnect_volume: return (315ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:18:47 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:18:47 user nova-compute[72362]: DEBUG nova.compute.manager [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OxChRspE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'b17b317a-409e-45ad-ac7c-0c298f4f564b', 'attached_at': '', 'detached_at': '', 'volume_id': '54f624f3-1ddb-4904-b1e5-11d5811883fa', 'serial'} {{(pid=72362) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 09 10:18:47 user nova-compute[72362]: DEBUG nova.compute.manager [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] swap_volume: removing Cinder connection for volume 85bc12a2-e20a-44af-919e-746a6239532d {{(pid=72362) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 09 10:18:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-87d92cf8-4b9c-4f2b-937d-9e8e2794bfbc tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Acquiring lock "1cde3780-2215-4966-86a4-82aae151b022" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:18:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-87d92cf8-4b9c-4f2b-937d-9e8e2794bfbc tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Lock "1cde3780-2215-4966-86a4-82aae151b022" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:18:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-87d92cf8-4b9c-4f2b-937d-9e8e2794bfbc tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Acquiring lock "1cde3780-2215-4966-86a4-82aae151b022-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:18:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-87d92cf8-4b9c-4f2b-937d-9e8e2794bfbc tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Lock "1cde3780-2215-4966-86a4-82aae151b022-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:18:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-87d92cf8-4b9c-4f2b-937d-9e8e2794bfbc tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Lock "1cde3780-2215-4966-86a4-82aae151b022-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:18:47 user nova-compute[72362]: INFO nova.compute.manager [None req-87d92cf8-4b9c-4f2b-937d-9e8e2794bfbc tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Terminating instance
Aug 09 10:18:47 user nova-compute[72362]: DEBUG nova.compute.manager [None req-87d92cf8-4b9c-4f2b-937d-9e8e2794bfbc tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Start destroying the instance on the hypervisor. {{(pid=72362) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 10:18:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:47 user nova-compute[72362]: DEBUG nova.compute.manager [req-b1b346c4-2ce4-4849-9dd6-9d17ea63e55f req-51574e85-3515-454b-b21b-7416e199773a service nova] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Received event network-vif-unplugged-bc47e64d-5b9b-4518-be08-8b527fca479c {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:18:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b1b346c4-2ce4-4849-9dd6-9d17ea63e55f req-51574e85-3515-454b-b21b-7416e199773a service nova] Acquiring lock "1cde3780-2215-4966-86a4-82aae151b022-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:18:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b1b346c4-2ce4-4849-9dd6-9d17ea63e55f req-51574e85-3515-454b-b21b-7416e199773a service nova] Lock "1cde3780-2215-4966-86a4-82aae151b022-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:18:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b1b346c4-2ce4-4849-9dd6-9d17ea63e55f req-51574e85-3515-454b-b21b-7416e199773a service nova] Lock "1cde3780-2215-4966-86a4-82aae151b022-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:18:47 user nova-compute[72362]: DEBUG nova.compute.manager [req-b1b346c4-2ce4-4849-9dd6-9d17ea63e55f req-51574e85-3515-454b-b21b-7416e199773a service nova] [instance: 1cde3780-2215-4966-86a4-82aae151b022] No waiting events found dispatching network-vif-unplugged-bc47e64d-5b9b-4518-be08-8b527fca479c {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:18:47 user nova-compute[72362]: DEBUG nova.compute.manager [req-b1b346c4-2ce4-4849-9dd6-9d17ea63e55f req-51574e85-3515-454b-b21b-7416e199773a service nova] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Received event network-vif-unplugged-bc47e64d-5b9b-4518-be08-8b527fca479c for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:18:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4934bf70-c214-41a8-9724-f5e80bce39e7 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Acquiring lock "9f2bc700-2e69-406f-9a13-52396eae4258" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:18:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4934bf70-c214-41a8-9724-f5e80bce39e7 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Lock "9f2bc700-2e69-406f-9a13-52396eae4258" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:18:48 user nova-compute[72362]: INFO nova.compute.manager [None req-4934bf70-c214-41a8-9724-f5e80bce39e7 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Detaching volume e98b7d2a-6ed5-4f6c-beb7-e40059291e10
Aug 09 10:18:48 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Instance destroyed successfully.
Aug 09 10:18:48 user nova-compute[72362]: DEBUG nova.objects.instance [None req-87d92cf8-4b9c-4f2b-937d-9e8e2794bfbc tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Lazy-loading 'resources' on Instance uuid 1cde3780-2215-4966-86a4-82aae151b022 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-87d92cf8-4b9c-4f2b-937d-9e8e2794bfbc tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:16:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-272415521',display_name='tempest-VolumesActionsTest-instance-272415521',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-272415521',id=9,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:17:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0bb89934454244f5a3438b5a8a74926a',ramdisk_id='',reservation_id='r-fhtk2059',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-2128587251',owner_user_name='tempest-VolumesActionsTest-2128587251-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:17:04Z,user_data=None,user_id='fcbf88df1bf143c1b46cbf8d8ca879e4',uuid=1cde3780-2215-4966-86a4-82aae151b022,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc47e64d-5b9b-4518-be08-8b527fca479c", "address": "fa:16:3e:ab:92:bd", "network": {"id": "65e9155d-dde9-47bb-aa24-e6331f2dc71e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1221293796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bb89934454244f5a3438b5a8a74926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc47e64d-5b", "ovs_interfaceid": "bc47e64d-5b9b-4518-be08-8b527fca479c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-87d92cf8-4b9c-4f2b-937d-9e8e2794bfbc tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Converting VIF {"id": "bc47e64d-5b9b-4518-be08-8b527fca479c", "address": "fa:16:3e:ab:92:bd", "network": {"id": "65e9155d-dde9-47bb-aa24-e6331f2dc71e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1221293796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bb89934454244f5a3438b5a8a74926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc47e64d-5b", "ovs_interfaceid": "bc47e64d-5b9b-4518-be08-8b527fca479c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-87d92cf8-4b9c-4f2b-937d-9e8e2794bfbc tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:92:bd,bridge_name='br-int',has_traffic_filtering=True,id=bc47e64d-5b9b-4518-be08-8b527fca479c,network=Network(65e9155d-dde9-47bb-aa24-e6331f2dc71e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc47e64d-5b') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG os_vif [None req-87d92cf8-4b9c-4f2b-937d-9e8e2794bfbc tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:92:bd,bridge_name='br-int',has_traffic_filtering=True,id=bc47e64d-5b9b-4518-be08-8b527fca479c,network=Network(65e9155d-dde9-47bb-aa24-e6331f2dc71e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc47e64d-5b') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbc47e64d-5b, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:18:48 user nova-compute[72362]: INFO os_vif [None req-87d92cf8-4b9c-4f2b-937d-9e8e2794bfbc tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:92:bd,bridge_name='br-int',has_traffic_filtering=True,id=bc47e64d-5b9b-4518-be08-8b527fca479c,network=Network(65e9155d-dde9-47bb-aa24-e6331f2dc71e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc47e64d-5b')
Aug 09 10:18:48 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-87d92cf8-4b9c-4f2b-937d-9e8e2794bfbc tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Deleting instance files /opt/stack/data/nova/instances/1cde3780-2215-4966-86a4-82aae151b022_del
Aug 09 10:18:48 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-87d92cf8-4b9c-4f2b-937d-9e8e2794bfbc tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Deletion of /opt/stack/data/nova/instances/1cde3780-2215-4966-86a4-82aae151b022_del complete
Aug 09 10:18:48 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:48 user nova-compute[72362]: INFO nova.compute.manager [None req-87d92cf8-4b9c-4f2b-937d-9e8e2794bfbc tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Took 0.70 seconds to destroy the instance on the hypervisor.
Aug 09 10:18:48 user nova-compute[72362]: DEBUG oslo.service.loopingcall [None req-87d92cf8-4b9c-4f2b-937d-9e8e2794bfbc tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72362) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG nova.compute.manager [-] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Deallocating network for instance {{(pid=72362) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 1cde3780-2215-4966-86a4-82aae151b022] deallocate_for_instance() {{(pid=72362) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 10:18:48 user nova-compute[72362]: INFO nova.virt.block_device [None req-4934bf70-c214-41a8-9724-f5e80bce39e7 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Attempting to driver detach volume e98b7d2a-6ed5-4f6c-beb7-e40059291e10 from mountpoint /dev/sdc
Aug 09 10:18:48 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4934bf70-c214-41a8-9724-f5e80bce39e7 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Attempting to detach device sdc from instance 9f2bc700-2e69-406f-9a13-52396eae4258 from the persistent domain config. {{(pid=72362) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-4934bf70-c214-41a8-9724-f5e80bce39e7 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 10:18:48 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:18:48 user nova-compute[72362]:   <source dev="/dev/sdd"/>
Aug 09 10:18:48 user nova-compute[72362]:   <target dev="sdc" bus="scsi"/>
Aug 09 10:18:48 user nova-compute[72362]:   <serial>e98b7d2a-6ed5-4f6c-beb7-e40059291e10</serial>
Aug 09 10:18:48 user nova-compute[72362]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 09 10:18:48 user nova-compute[72362]: </disk>
Aug 09 10:18:48 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:18:48 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-4934bf70-c214-41a8-9724-f5e80bce39e7 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Successfully detached device sdc from instance 9f2bc700-2e69-406f-9a13-52396eae4258 from the persistent domain config.
Aug 09 10:18:48 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4934bf70-c214-41a8-9724-f5e80bce39e7 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 9f2bc700-2e69-406f-9a13-52396eae4258 from the live domain config. {{(pid=72362) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-4934bf70-c214-41a8-9724-f5e80bce39e7 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 10:18:48 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:18:48 user nova-compute[72362]:   <source dev="/dev/sdd"/>
Aug 09 10:18:48 user nova-compute[72362]:   <target dev="sdc" bus="scsi"/>
Aug 09 10:18:48 user nova-compute[72362]:   <serial>e98b7d2a-6ed5-4f6c-beb7-e40059291e10</serial>
Aug 09 10:18:48 user nova-compute[72362]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 09 10:18:48 user nova-compute[72362]: </disk>
Aug 09 10:18:48 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG nova.compute.manager [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] swap_volume: Updating volume 85bc12a2-e20a-44af-919e-746a6239532d BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "OxChRspE", "auth_password": "R9BHmekT3QI14J", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "54f624f3-1ddb-4904-b1e5-11d5811883fa"}, "status": "reserved", "instance": "b17b317a-409e-45ad-ac7c-0c298f4f564b", "attached_at": "", "detached_at": "", "volume_id": "54f624f3-1ddb-4904-b1e5-11d5811883fa", "serial": "54f624f3-1ddb-4904-b1e5-11d5811883fa"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '54f624f3-1ddb-4904-b1e5-11d5811883fa', 'no_device': None, 'attachment_id': '12135c2b-328f-4779-b311-2ecd0ef77133'} {{(pid=72362) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-18567cda-7d4c-49c2-9574-4c7b48b5087f tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Lock "b17b317a-409e-45ad-ac7c-0c298f4f564b" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 17.993s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Received event <DeviceRemovedEvent: 1691576328.6059158, 9f2bc700-2e69-406f-9a13-52396eae4258 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72362) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4934bf70-c214-41a8-9724-f5e80bce39e7 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 9f2bc700-2e69-406f-9a13-52396eae4258 {{(pid=72362) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 10:18:48 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-4934bf70-c214-41a8-9724-f5e80bce39e7 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Successfully detached device sdc from instance 9f2bc700-2e69-406f-9a13-52396eae4258 from the live domain config.
Aug 09 10:18:48 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4934bf70-c214-41a8-9724-f5e80bce39e7 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-4934bf70-c214-41a8-9724-f5e80bce39e7 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PwoHRGcg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:18:48 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-4934bf70-c214-41a8-9724-f5e80bce39e7 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:18:48 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-4934bf70-c214-41a8-9724-f5e80bce39e7 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-4934bf70-c214-41a8-9724-f5e80bce39e7 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-4934bf70-c214-41a8-9724-f5e80bce39e7 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6bd4f0-fece-486a-958b-3619b65a739e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e7708c-27d5-4cf3-b706-ea1f6e37d731]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-4934bf70-c214-41a8-9724-f5e80bce39e7 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa (non-flash)
Aug 09 10:18:48 user nova-compute[72362]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10 (non-flash)
Aug 09 10:18:48 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-4934bf70-c214-41a8-9724-f5e80bce39e7 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa (non-flash)
Aug 09 10:18:48 user nova-compute[72362]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10 (non-flash)
Aug 09 10:18:48 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-4934bf70-c214-41a8-9724-f5e80bce39e7 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e4462200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10'): ({'sdd'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-4934bf70-c214-41a8-9724-f5e80bce39e7 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Removing single pathed devices sdd {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8dcc884-ff43-458e-92d6-078cc1a8f2c1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:48 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Took 0.56 seconds to deallocate network for instance.
Aug 09 10:18:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c9b2a2-ae26-4a3a-914c-04ea9f653819]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-4934bf70-c214-41a8-9724-f5e80bce39e7 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Flushing IO for device /dev/sdd {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[69348420-f8a5-4d5a-b9ce-4031617719c7]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-4934bf70-c214-41a8-9724-f5e80bce39e7 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.096s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0867167-6768-4342-b9c3-a13593199b99]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-4934bf70-c214-41a8-9724-f5e80bce39e7 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-4934bf70-c214-41a8-9724-f5e80bce39e7 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] SCSI volumes sdd have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-4934bf70-c214-41a8-9724-f5e80bce39e7 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-87d92cf8-4b9c-4f2b-937d-9e8e2794bfbc tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-87d92cf8-4b9c-4f2b-937d-9e8e2794bfbc tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b058255f-d12f-4d10-b785-815f89a466c6]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-4934bf70-c214-41a8-9724-f5e80bce39e7 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10 -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0cf539-528e-492d-acef-826486d43f35]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-4934bf70-c214-41a8-9724-f5e80bce39e7 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10, portal: 172.16.0.220,3260]
Aug 09 10:18:48 user nova-compute[72362]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10, portal: 172.16.0.220,3260] successful.
Aug 09 10:18:48 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10 -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98b7d2a-6ed5-4f6c-beb7-e40059291e10 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ecb250-6ded-4176-8c26-091bc253990c]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-4934bf70-c214-41a8-9724-f5e80bce39e7 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-4934bf70-c214-41a8-9724-f5e80bce39e7 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-4934bf70-c214-41a8-9724-f5e80bce39e7 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] <== disconnect_volume: return (357ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:18:48 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4934bf70-c214-41a8-9724-f5e80bce39e7 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:18:49 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-87d92cf8-4b9c-4f2b-937d-9e8e2794bfbc tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:18:49 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-87d92cf8-4b9c-4f2b-937d-9e8e2794bfbc tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:18:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-87d92cf8-4b9c-4f2b-937d-9e8e2794bfbc tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.475s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:18:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Acquiring lock "b17b317a-409e-45ad-ac7c-0c298f4f564b" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:18:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Lock "b17b317a-409e-45ad-ac7c-0c298f4f564b" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:18:49 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-87d92cf8-4b9c-4f2b-937d-9e8e2794bfbc tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Deleted allocations for instance 1cde3780-2215-4966-86a4-82aae151b022
Aug 09 10:18:49 user nova-compute[72362]: DEBUG os_brick.utils [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:18:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ece775b-4825-4c7c-91e7-fb95a7795fa1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce3d644-2763-488b-8b32-6be533ac0110]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7c9a1a-5116-4951-9736-9ce57799ee71]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00f3fc5-453f-438b-b28e-bd066262f03c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:18:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:18:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-87d92cf8-4b9c-4f2b-937d-9e8e2794bfbc tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Lock "1cde3780-2215-4966-86a4-82aae151b022" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.052s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:18:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:18:49 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:18:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec11a817-8495-4ccb-aa7a-cde35bc3f3e8]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:18:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:18:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:18:49 user nova-compute[72362]: DEBUG os_brick.utils [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:18:49 user nova-compute[72362]: INFO nova.compute.manager [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Swapping volume 54f624f3-1ddb-4904-b1e5-11d5811883fa for 85bc12a2-e20a-44af-919e-746a6239532d
Aug 09 10:18:49 user nova-compute[72362]: DEBUG nova.objects.instance [None req-4934bf70-c214-41a8-9724-f5e80bce39e7 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Lazy-loading 'flavor' on Instance uuid 9f2bc700-2e69-406f-9a13-52396eae4258 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:18:49 user nova-compute[72362]: DEBUG nova.compute.manager [req-86ff3984-e45c-4108-ae32-205c38a6219d req-018ea9c1-07df-491e-a2f8-eb4f033de07c service nova] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Received event network-vif-plugged-bc47e64d-5b9b-4518-be08-8b527fca479c {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:18:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-86ff3984-e45c-4108-ae32-205c38a6219d req-018ea9c1-07df-491e-a2f8-eb4f033de07c service nova] Acquiring lock "1cde3780-2215-4966-86a4-82aae151b022-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:18:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-86ff3984-e45c-4108-ae32-205c38a6219d req-018ea9c1-07df-491e-a2f8-eb4f033de07c service nova] Lock "1cde3780-2215-4966-86a4-82aae151b022-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:18:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-86ff3984-e45c-4108-ae32-205c38a6219d req-018ea9c1-07df-491e-a2f8-eb4f033de07c service nova] Lock "1cde3780-2215-4966-86a4-82aae151b022-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:18:49 user nova-compute[72362]: DEBUG nova.compute.manager [req-86ff3984-e45c-4108-ae32-205c38a6219d req-018ea9c1-07df-491e-a2f8-eb4f033de07c service nova] [instance: 1cde3780-2215-4966-86a4-82aae151b022] No waiting events found dispatching network-vif-plugged-bc47e64d-5b9b-4518-be08-8b527fca479c {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:18:49 user nova-compute[72362]: WARNING nova.compute.manager [req-86ff3984-e45c-4108-ae32-205c38a6219d req-018ea9c1-07df-491e-a2f8-eb4f033de07c service nova] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Received unexpected event network-vif-plugged-bc47e64d-5b9b-4518-be08-8b527fca479c for instance with vm_state deleted and task_state None.
Aug 09 10:18:49 user nova-compute[72362]: DEBUG nova.compute.manager [req-86ff3984-e45c-4108-ae32-205c38a6219d req-018ea9c1-07df-491e-a2f8-eb4f033de07c service nova] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Received event network-vif-deleted-bc47e64d-5b9b-4518-be08-8b527fca479c {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:18:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4934bf70-c214-41a8-9724-f5e80bce39e7 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Lock "9f2bc700-2e69-406f-9a13-52396eae4258" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.868s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:18:49 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:18:50 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c97fc48c-5390-4fa6-ac47-f1bd1efca057 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Acquiring lock "9f2bc700-2e69-406f-9a13-52396eae4258" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:18:50 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c97fc48c-5390-4fa6-ac47-f1bd1efca057 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Lock "9f2bc700-2e69-406f-9a13-52396eae4258" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:18:50 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c97fc48c-5390-4fa6-ac47-f1bd1efca057 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Acquiring lock "9f2bc700-2e69-406f-9a13-52396eae4258-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:18:50 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c97fc48c-5390-4fa6-ac47-f1bd1efca057 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Lock "9f2bc700-2e69-406f-9a13-52396eae4258-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:18:50 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c97fc48c-5390-4fa6-ac47-f1bd1efca057 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Lock "9f2bc700-2e69-406f-9a13-52396eae4258-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:18:50 user nova-compute[72362]: INFO nova.compute.manager [None req-c97fc48c-5390-4fa6-ac47-f1bd1efca057 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Terminating instance
Aug 09 10:18:50 user nova-compute[72362]: DEBUG nova.compute.manager [None req-c97fc48c-5390-4fa6-ac47-f1bd1efca057 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Start destroying the instance on the hypervisor. {{(pid=72362) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 10:18:50 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:50 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:50 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:50 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:50 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:51 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Instance destroyed successfully.
Aug 09 10:18:51 user nova-compute[72362]: DEBUG nova.objects.instance [None req-c97fc48c-5390-4fa6-ac47-f1bd1efca057 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Lazy-loading 'resources' on Instance uuid 9f2bc700-2e69-406f-9a13-52396eae4258 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:18:51 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-c97fc48c-5390-4fa6-ac47-f1bd1efca057 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:16:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-725671139',display_name='tempest-AttachSCSIVolumeTestJSON-server-725671139',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-725671139',id=8,image_ref='935787e9-b90d-4cc2-8655-783953b40fb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4dltahC5eI7zqUw1QBgNqbCZrM1qfqpyXM46W66BcK1c4WNoyFZzTs6vHNnRFnXqd55VXfQnYMOhqVRmFp53EUMT4ySvCYxXXVUQ9snlPMOrxTr5EmWslCgnaEwzb2LQ==',key_name='tempest-keypair-1644987629',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:16:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='098495c0d3ac4b9caa895f9ba60e4b84',ramdisk_id='',reservation_id='r-a0zo3dnn',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='935787e9-b90d-4cc2-8655-783953b40fb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1535324413',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1535324413-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:16:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2b67a8ab3374254bca409f342f74c9c',uuid=9f2bc700-2e69-406f-9a13-52396eae4258,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1a1302a-fe35-4d60-b89c-b5ef5f0dee76", "address": "fa:16:3e:4a:45:de", "network": {"id": "bc7a82e2-b23e-48dd-b282-99f11cff58d3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-457661927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098495c0d3ac4b9caa895f9ba60e4b84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1a1302a-fe", "ovs_interfaceid": "d1a1302a-fe35-4d60-b89c-b5ef5f0dee76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:18:51 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-c97fc48c-5390-4fa6-ac47-f1bd1efca057 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Converting VIF {"id": "d1a1302a-fe35-4d60-b89c-b5ef5f0dee76", "address": "fa:16:3e:4a:45:de", "network": {"id": "bc7a82e2-b23e-48dd-b282-99f11cff58d3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-457661927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098495c0d3ac4b9caa895f9ba60e4b84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1a1302a-fe", "ovs_interfaceid": "d1a1302a-fe35-4d60-b89c-b5ef5f0dee76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:18:51 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-c97fc48c-5390-4fa6-ac47-f1bd1efca057 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:45:de,bridge_name='br-int',has_traffic_filtering=True,id=d1a1302a-fe35-4d60-b89c-b5ef5f0dee76,network=Network(bc7a82e2-b23e-48dd-b282-99f11cff58d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1a1302a-fe') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:18:51 user nova-compute[72362]: DEBUG os_vif [None req-c97fc48c-5390-4fa6-ac47-f1bd1efca057 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:45:de,bridge_name='br-int',has_traffic_filtering=True,id=d1a1302a-fe35-4d60-b89c-b5ef5f0dee76,network=Network(bc7a82e2-b23e-48dd-b282-99f11cff58d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1a1302a-fe') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:18:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1a1302a-fe, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:18:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:51 user nova-compute[72362]: INFO os_vif [None req-c97fc48c-5390-4fa6-ac47-f1bd1efca057 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:45:de,bridge_name='br-int',has_traffic_filtering=True,id=d1a1302a-fe35-4d60-b89c-b5ef5f0dee76,network=Network(bc7a82e2-b23e-48dd-b282-99f11cff58d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1a1302a-fe')
Aug 09 10:18:51 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-c97fc48c-5390-4fa6-ac47-f1bd1efca057 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Deleting instance files /opt/stack/data/nova/instances/9f2bc700-2e69-406f-9a13-52396eae4258_del
Aug 09 10:18:51 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-c97fc48c-5390-4fa6-ac47-f1bd1efca057 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Deletion of /opt/stack/data/nova/instances/9f2bc700-2e69-406f-9a13-52396eae4258_del complete
Aug 09 10:18:51 user nova-compute[72362]: DEBUG nova.objects.instance [None req-ae1fbd02-3569-4170-a77f-7af798862d05 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Lazy-loading 'flavor' on Instance uuid 00af3d8e-bd93-4520-91e7-29c135c03e55 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:18:51 user nova-compute[72362]: INFO nova.compute.manager [None req-c97fc48c-5390-4fa6-ac47-f1bd1efca057 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 09 10:18:51 user nova-compute[72362]: DEBUG oslo.service.loopingcall [None req-c97fc48c-5390-4fa6-ac47-f1bd1efca057 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72362) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 10:18:51 user nova-compute[72362]: DEBUG nova.compute.manager [-] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Deallocating network for instance {{(pid=72362) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 10:18:51 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] deallocate_for_instance() {{(pid=72362) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 10:18:51 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ae1fbd02-3569-4170-a77f-7af798862d05 tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Lock "00af3d8e-bd93-4520-91e7-29c135c03e55" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.188s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:18:51 user nova-compute[72362]: DEBUG nova.compute.manager [req-b73b6ff7-eeec-4217-821b-480d7c68e8a6 req-47e5fb10-185b-4c53-82b0-fa3647151c16 service nova] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Received event network-vif-unplugged-d1a1302a-fe35-4d60-b89c-b5ef5f0dee76 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:18:51 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b73b6ff7-eeec-4217-821b-480d7c68e8a6 req-47e5fb10-185b-4c53-82b0-fa3647151c16 service nova] Acquiring lock "9f2bc700-2e69-406f-9a13-52396eae4258-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:18:51 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b73b6ff7-eeec-4217-821b-480d7c68e8a6 req-47e5fb10-185b-4c53-82b0-fa3647151c16 service nova] Lock "9f2bc700-2e69-406f-9a13-52396eae4258-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:18:51 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b73b6ff7-eeec-4217-821b-480d7c68e8a6 req-47e5fb10-185b-4c53-82b0-fa3647151c16 service nova] Lock "9f2bc700-2e69-406f-9a13-52396eae4258-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:18:51 user nova-compute[72362]: DEBUG nova.compute.manager [req-b73b6ff7-eeec-4217-821b-480d7c68e8a6 req-47e5fb10-185b-4c53-82b0-fa3647151c16 service nova] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] No waiting events found dispatching network-vif-unplugged-d1a1302a-fe35-4d60-b89c-b5ef5f0dee76 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:18:51 user nova-compute[72362]: DEBUG nova.compute.manager [req-b73b6ff7-eeec-4217-821b-480d7c68e8a6 req-47e5fb10-185b-4c53-82b0-fa3647151c16 service nova] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Received event network-vif-unplugged-d1a1302a-fe35-4d60-b89c-b5ef5f0dee76 for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:18:51 user nova-compute[72362]: DEBUG nova.compute.manager [req-b73b6ff7-eeec-4217-821b-480d7c68e8a6 req-47e5fb10-185b-4c53-82b0-fa3647151c16 service nova] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Received event network-vif-plugged-d1a1302a-fe35-4d60-b89c-b5ef5f0dee76 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:18:51 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b73b6ff7-eeec-4217-821b-480d7c68e8a6 req-47e5fb10-185b-4c53-82b0-fa3647151c16 service nova] Acquiring lock "9f2bc700-2e69-406f-9a13-52396eae4258-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:18:51 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b73b6ff7-eeec-4217-821b-480d7c68e8a6 req-47e5fb10-185b-4c53-82b0-fa3647151c16 service nova] Lock "9f2bc700-2e69-406f-9a13-52396eae4258-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:18:51 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b73b6ff7-eeec-4217-821b-480d7c68e8a6 req-47e5fb10-185b-4c53-82b0-fa3647151c16 service nova] Lock "9f2bc700-2e69-406f-9a13-52396eae4258-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:18:51 user nova-compute[72362]: DEBUG nova.compute.manager [req-b73b6ff7-eeec-4217-821b-480d7c68e8a6 req-47e5fb10-185b-4c53-82b0-fa3647151c16 service nova] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] No waiting events found dispatching network-vif-plugged-d1a1302a-fe35-4d60-b89c-b5ef5f0dee76 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:18:51 user nova-compute[72362]: WARNING nova.compute.manager [req-b73b6ff7-eeec-4217-821b-480d7c68e8a6 req-47e5fb10-185b-4c53-82b0-fa3647151c16 service nova] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Received unexpected event network-vif-plugged-d1a1302a-fe35-4d60-b89c-b5ef5f0dee76 for instance with vm_state active and task_state deleting.
Aug 09 10:18:51 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:18:51 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f45baf25-20d7-44c5-b145-8bb8a6d50fff tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Acquiring lock "interface-00af3d8e-bd93-4520-91e7-29c135c03e55-8c232e74-771d-40b3-8f0c-abdef770aafd" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:18:51 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f45baf25-20d7-44c5-b145-8bb8a6d50fff tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Lock "interface-00af3d8e-bd93-4520-91e7-29c135c03e55-8c232e74-771d-40b3-8f0c-abdef770aafd" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:18:51 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:18:51 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 10:18:51 user nova-compute[72362]: DEBUG nova.objects.instance [None req-f45baf25-20d7-44c5-b145-8bb8a6d50fff tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Lazy-loading 'flavor' on Instance uuid 00af3d8e-bd93-4520-91e7-29c135c03e55 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:18:52 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-f45baf25-20d7-44c5-b145-8bb8a6d50fff tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:16:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1129807899',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1129807899',id=7,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKTy1BEGFgb2LwPCE0l4ZdsIb1CDE+2z5XZX+3IOS7BmpUspCkv8nslwIBX+XdLBElH9a7nR/A5XVOfQJoXDwudCeZ0lpAUFsL0E9TcfQKbmNmV+/CzT9enkfH7jf9KfQ==',key_name='tempest-keypair-426982747',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:16:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a68b4a52019441480a19783a89e0af8',ramdisk_id='',reservation_id='r-80xqf6s8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-202820908',owner_user_name='tempest-TaggedAttachmentsTest-202820908-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:16:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5dd4d0e5c03744569a542098432622d7',uuid=00af3d8e-bd93-4520-91e7-29c135c03e55,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c232e74-771d-40b3-8f0c-abdef770aafd", "address": "fa:16:3e:f6:7f:94", "network": {"id": "20844264-ffb2-45b0-b420-8783270cc7f5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1034730248", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7a68b4a52019441480a19783a89e0af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c232e74-77", "ovs_interfaceid": "8c232e74-771d-40b3-8f0c-abdef770aafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:18:52 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-f45baf25-20d7-44c5-b145-8bb8a6d50fff tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Converting VIF {"id": "8c232e74-771d-40b3-8f0c-abdef770aafd", "address": "fa:16:3e:f6:7f:94", "network": {"id": "20844264-ffb2-45b0-b420-8783270cc7f5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1034730248", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7a68b4a52019441480a19783a89e0af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c232e74-77", "ovs_interfaceid": "8c232e74-771d-40b3-8f0c-abdef770aafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:18:52 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-f45baf25-20d7-44c5-b145-8bb8a6d50fff tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:7f:94,bridge_name='br-int',has_traffic_filtering=True,id=8c232e74-771d-40b3-8f0c-abdef770aafd,network=Network(20844264-ffb2-45b0-b420-8783270cc7f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c232e74-77') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:18:52 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-f45baf25-20d7-44c5-b145-8bb8a6d50fff tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f6:7f:94"/><model type="virtio"/><mtu size="1442"/><target dev="tap8c232e74-77"/></interface> {{(pid=72362) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 09 10:18:52 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-f45baf25-20d7-44c5-b145-8bb8a6d50fff tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f6:7f:94"/><model type="virtio"/><mtu size="1442"/><target dev="tap8c232e74-77"/></interface> {{(pid=72362) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 09 10:18:52 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-f45baf25-20d7-44c5-b145-8bb8a6d50fff tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Attempting to detach device tap8c232e74-77 from instance 00af3d8e-bd93-4520-91e7-29c135c03e55 from the persistent domain config. {{(pid=72362) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 10:18:52 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-f45baf25-20d7-44c5-b145-8bb8a6d50fff tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] detach device xml: <interface type="ethernet">
Aug 09 10:18:52 user nova-compute[72362]:   <mac address="fa:16:3e:f6:7f:94"/>
Aug 09 10:18:52 user nova-compute[72362]:   <model type="virtio"/>
Aug 09 10:18:52 user nova-compute[72362]:   <mtu size="1442"/>
Aug 09 10:18:52 user nova-compute[72362]:   <target dev="tap8c232e74-77"/>
Aug 09 10:18:52 user nova-compute[72362]: </interface>
Aug 09 10:18:52 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:18:52 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-f45baf25-20d7-44c5-b145-8bb8a6d50fff tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f6:7f:94"/><model type="virtio"/><mtu size="1442"/><target dev="tap8c232e74-77"/></interface> {{(pid=72362) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 09 10:18:52 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-f45baf25-20d7-44c5-b145-8bb8a6d50fff tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f6:7f:94"/><model type="virtio"/><mtu size="1442"/><target dev="tap8c232e74-77"/></interface>not found in domain: <domain type='kvm' id='7'>
Aug 09 10:18:52 user nova-compute[72362]:   <name>instance-00000007</name>
Aug 09 10:18:52 user nova-compute[72362]:   <uuid>00af3d8e-bd93-4520-91e7-29c135c03e55</uuid>
Aug 09 10:18:52 user nova-compute[72362]:   <metadata>
Aug 09 10:18:52 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:18:52 user nova-compute[72362]:   <nova:package version="0.0.0"/>
Aug 09 10:18:52 user nova-compute[72362]:   <nova:name>tempest-device-tagging-server-1129807899</nova:name>
Aug 09 10:18:52 user nova-compute[72362]:   <nova:creationTime>2023-08-09 10:18:28</nova:creationTime>
Aug 09 10:18:52 user nova-compute[72362]:   <nova:flavor name="m1.tiny">
Aug 09 10:18:52 user nova-compute[72362]:     <nova:memory>512</nova:memory>
Aug 09 10:18:52 user nova-compute[72362]:     <nova:disk>1</nova:disk>
Aug 09 10:18:52 user nova-compute[72362]:     <nova:swap>0</nova:swap>
Aug 09 10:18:52 user nova-compute[72362]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:18:52 user nova-compute[72362]:     <nova:vcpus>1</nova:vcpus>
Aug 09 10:18:52 user nova-compute[72362]:   </nova:flavor>
Aug 09 10:18:52 user nova-compute[72362]:   <nova:owner>
Aug 09 10:18:52 user nova-compute[72362]:     <nova:user uuid="5dd4d0e5c03744569a542098432622d7">tempest-TaggedAttachmentsTest-202820908-project-member</nova:user>
Aug 09 10:18:52 user nova-compute[72362]:     <nova:project uuid="7a68b4a52019441480a19783a89e0af8">tempest-TaggedAttachmentsTest-202820908</nova:project>
Aug 09 10:18:52 user nova-compute[72362]:   </nova:owner>
Aug 09 10:18:52 user nova-compute[72362]:   <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:18:52 user nova-compute[72362]:   <nova:ports>
Aug 09 10:18:52 user nova-compute[72362]:     <nova:port uuid="1efbc456-6c56-4367-845f-0afa8acdcec4">
Aug 09 10:18:52 user nova-compute[72362]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 10:18:52 user nova-compute[72362]:     </nova:port>
Aug 09 10:18:52 user nova-compute[72362]:     <nova:port uuid="8c232e74-771d-40b3-8f0c-abdef770aafd">
Aug 09 10:18:52 user nova-compute[72362]:       <nova:ip type="fixed" address="10.10.10.165" ipVersion="4"/>
Aug 09 10:18:52 user nova-compute[72362]:     </nova:port>
Aug 09 10:18:52 user nova-compute[72362]:   </nova:ports>
Aug 09 10:18:52 user nova-compute[72362]: </nova:instance>
Aug 09 10:18:52 user nova-compute[72362]:   </metadata>
Aug 09 10:18:52 user nova-compute[72362]:   <memory unit='KiB'>524288</memory>
Aug 09 10:18:52 user nova-compute[72362]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 09 10:18:52 user nova-compute[72362]:   <vcpu placement='static'>1</vcpu>
Aug 09 10:18:52 user nova-compute[72362]:   <resource>
Aug 09 10:18:52 user nova-compute[72362]:     <partition>/machine</partition>
Aug 09 10:18:52 user nova-compute[72362]:   </resource>
Aug 09 10:18:52 user nova-compute[72362]:   <sysinfo type='smbios'>
Aug 09 10:18:52 user nova-compute[72362]:     <system>
Aug 09 10:18:52 user nova-compute[72362]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 09 10:18:52 user nova-compute[72362]:       <entry name='product'>OpenStack Nova</entry>
Aug 09 10:18:52 user nova-compute[72362]:       <entry name='version'>0.0.0</entry>
Aug 09 10:18:52 user nova-compute[72362]:       <entry name='serial'>00af3d8e-bd93-4520-91e7-29c135c03e55</entry>
Aug 09 10:18:52 user nova-compute[72362]:       <entry name='uuid'>00af3d8e-bd93-4520-91e7-29c135c03e55</entry>
Aug 09 10:18:52 user nova-compute[72362]:       <entry name='family'>Virtual Machine</entry>
Aug 09 10:18:52 user nova-compute[72362]:     </system>
Aug 09 10:18:52 user nova-compute[72362]:   </sysinfo>
Aug 09 10:18:52 user nova-compute[72362]:   <os>
Aug 09 10:18:52 user nova-compute[72362]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 09 10:18:52 user nova-compute[72362]:     <boot dev='hd'/>
Aug 09 10:18:52 user nova-compute[72362]:     <smbios mode='sysinfo'/>
Aug 09 10:18:52 user nova-compute[72362]:   </os>
Aug 09 10:18:52 user nova-compute[72362]:   <features>
Aug 09 10:18:52 user nova-compute[72362]:     <acpi/>
Aug 09 10:18:52 user nova-compute[72362]:     <apic/>
Aug 09 10:18:52 user nova-compute[72362]:     <vmcoreinfo state='on'/>
Aug 09 10:18:52 user nova-compute[72362]:   </features>
Aug 09 10:18:52 user nova-compute[72362]:   <cpu mode='custom' match='exact' check='full'>
Aug 09 10:18:52 user nova-compute[72362]:     <model fallback='forbid'>Nehalem</model>
Aug 09 10:18:52 user nova-compute[72362]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 09 10:18:52 user nova-compute[72362]:     <feature policy='require' name='vme'/>
Aug 09 10:18:52 user nova-compute[72362]:     <feature policy='require' name='x2apic'/>
Aug 09 10:18:52 user nova-compute[72362]:     <feature policy='require' name='hypervisor'/>
Aug 09 10:18:52 user nova-compute[72362]:   </cpu>
Aug 09 10:18:52 user nova-compute[72362]:   <clock offset='utc'>
Aug 09 10:18:52 user nova-compute[72362]:     <timer name='pit' tickpolicy='delay'/>
Aug 09 10:18:52 user nova-compute[72362]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 09 10:18:52 user nova-compute[72362]:     <timer name='hpet' present='no'/>
Aug 09 10:18:52 user nova-compute[72362]:   </clock>
Aug 09 10:18:52 user nova-compute[72362]:   <on_poweroff>destroy</on_poweroff>
Aug 09 10:18:52 user nova-compute[72362]:   <on_reboot>restart</on_reboot>
Aug 09 10:18:52 user nova-compute[72362]:   <on_crash>destroy</on_crash>
Aug 09 10:18:52 user nova-compute[72362]:   <devices>
Aug 09 10:18:52 user nova-compute[72362]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 09 10:18:52 user nova-compute[72362]:     <disk type='file' device='disk'>
Aug 09 10:18:52 user nova-compute[72362]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 09 10:18:52 user nova-compute[72362]:       <source file='/opt/stack/data/nova/instances/00af3d8e-bd93-4520-91e7-29c135c03e55/disk' index='2'/>
Aug 09 10:18:52 user nova-compute[72362]:       <backingStore type='file' index='3'>
Aug 09 10:18:52 user nova-compute[72362]:         <format type='raw'/>
Aug 09 10:18:52 user nova-compute[72362]:         <source file='/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4'/>
Aug 09 10:18:52 user nova-compute[72362]:         <backingStore/>
Aug 09 10:18:52 user nova-compute[72362]:       </backingStore>
Aug 09 10:18:52 user nova-compute[72362]:       <target dev='vda' bus='virtio'/>
Aug 09 10:18:52 user nova-compute[72362]:       <alias name='virtio-disk0'/>
Aug 09 10:18:52 user nova-compute[72362]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 09 10:18:52 user nova-compute[72362]:     </disk>
Aug 09 10:18:52 user nova-compute[72362]:     <disk type='file' device='cdrom'>
Aug 09 10:18:52 user nova-compute[72362]:       <driver name='qemu' type='raw' cache='none'/>
Aug 09 10:18:52 user nova-compute[72362]:       <source file='/opt/stack/data/nova/instances/00af3d8e-bd93-4520-91e7-29c135c03e55/disk.config' index='1'/>
Aug 09 10:18:52 user nova-compute[72362]:       <backingStore/>
Aug 09 10:18:52 user nova-compute[72362]:       <target dev='hda' bus='ide'/>
Aug 09 10:18:52 user nova-compute[72362]:       <readonly/>
Aug 09 10:18:52 user nova-compute[72362]:       <alias name='ide0-0-0'/>
Aug 09 10:18:52 user nova-compute[72362]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 09 10:18:52 user nova-compute[72362]:     </disk>
Aug 09 10:18:52 user nova-compute[72362]:     <controller type='usb' index='0' model='none'>
Aug 09 10:18:52 user nova-compute[72362]:       <alias name='usb'/>
Aug 09 10:18:52 user nova-compute[72362]:     </controller>
Aug 09 10:18:52 user nova-compute[72362]:     <controller type='pci' index='0' model='pci-root'>
Aug 09 10:18:52 user nova-compute[72362]:       <alias name='pci.0'/>
Aug 09 10:18:52 user nova-compute[72362]:     </controller>
Aug 09 10:18:52 user nova-compute[72362]:     <controller type='ide' index='0'>
Aug 09 10:18:52 user nova-compute[72362]:       <alias name='ide'/>
Aug 09 10:18:52 user nova-compute[72362]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 09 10:18:52 user nova-compute[72362]:     </controller>
Aug 09 10:18:52 user nova-compute[72362]:     <interface type='ethernet'>
Aug 09 10:18:52 user nova-compute[72362]:       <mac address='fa:16:3e:76:bd:21'/>
Aug 09 10:18:52 user nova-compute[72362]:       <target dev='tap1efbc456-6c'/>
Aug 09 10:18:52 user nova-compute[72362]:       <model type='virtio'/>
Aug 09 10:18:52 user nova-compute[72362]:       <mtu size='1442'/>
Aug 09 10:18:52 user nova-compute[72362]:       <alias name='net0'/>
Aug 09 10:18:52 user nova-compute[72362]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 09 10:18:52 user nova-compute[72362]:     </interface>
Aug 09 10:18:52 user nova-compute[72362]:     <interface type='ethernet'>
Aug 09 10:18:52 user nova-compute[72362]:       <mac address='fa:16:3e:f6:7f:94'/>
Aug 09 10:18:52 user nova-compute[72362]:       <target dev='tap8c232e74-77'/>
Aug 09 10:18:52 user nova-compute[72362]:       <model type='virtio'/>
Aug 09 10:18:52 user nova-compute[72362]:       <mtu size='1442'/>
Aug 09 10:18:52 user nova-compute[72362]:       <alias name='net1'/>
Aug 09 10:18:52 user nova-compute[72362]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 09 10:18:52 user nova-compute[72362]:     </interface>
Aug 09 10:18:52 user nova-compute[72362]:     <serial type='pty'>
Aug 09 10:18:52 user nova-compute[72362]:       <source path='/dev/pts/7'/>
Aug 09 10:18:52 user nova-compute[72362]:       <log file='/opt/stack/data/nova/instances/00af3d8e-bd93-4520-91e7-29c135c03e55/console.log' append='off'/>
Aug 09 10:18:52 user nova-compute[72362]:       <target type='isa-serial' port='0'>
Aug 09 10:18:52 user nova-compute[72362]:         <model name='isa-serial'/>
Aug 09 10:18:52 user nova-compute[72362]:       </target>
Aug 09 10:18:52 user nova-compute[72362]:       <alias name='serial0'/>
Aug 09 10:18:52 user nova-compute[72362]:     </serial>
Aug 09 10:18:52 user nova-compute[72362]:     <console type='pty' tty='/dev/pts/7'>
Aug 09 10:18:52 user nova-compute[72362]:       <source path='/dev/pts/7'/>
Aug 09 10:18:52 user nova-compute[72362]:       <log file='/opt/stack/data/nova/instances/00af3d8e-bd93-4520-91e7-29c135c03e55/console.log' append='off'/>
Aug 09 10:18:52 user nova-compute[72362]:       <target type='serial' port='0'/>
Aug 09 10:18:52 user nova-compute[72362]:       <alias name='serial0'/>
Aug 09 10:18:52 user nova-compute[72362]:     </console>
Aug 09 10:18:52 user nova-compute[72362]:     <input type='mouse' bus='ps2'>
Aug 09 10:18:52 user nova-compute[72362]:       <alias name='input0'/>
Aug 09 10:18:52 user nova-compute[72362]:     </input>
Aug 09 10:18:52 user nova-compute[72362]:     <input type='keyboard' bus='ps2'>
Aug 09 10:18:52 user nova-compute[72362]:       <alias name='input1'/>
Aug 09 10:18:52 user nova-compute[72362]:     </input>
Aug 09 10:18:52 user nova-compute[72362]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Aug 09 10:18:52 user nova-compute[72362]:       <listen type='address' address='0.0.0.0'/>
Aug 09 10:18:52 user nova-compute[72362]:     </graphics>
Aug 09 10:18:52 user nova-compute[72362]:     <audio id='1' type='none'/>
Aug 09 10:18:52 user nova-compute[72362]:     <video>
Aug 09 10:18:52 user nova-compute[72362]:       <model type='virtio' heads='1' primary='yes'/>
Aug 09 10:18:52 user nova-compute[72362]:       <alias name='video0'/>
Aug 09 10:18:52 user nova-compute[72362]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 09 10:18:52 user nova-compute[72362]:     </video>
Aug 09 10:18:52 user nova-compute[72362]:     <memballoon model='virtio'>
Aug 09 10:18:52 user nova-compute[72362]:       <stats period='10'/>
Aug 09 10:18:52 user nova-compute[72362]:       <alias name='balloon0'/>
Aug 09 10:18:52 user nova-compute[72362]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 09 10:18:52 user nova-compute[72362]:     </memballoon>
Aug 09 10:18:52 user nova-compute[72362]:     <rng model='virtio'>
Aug 09 10:18:52 user nova-compute[72362]:       <backend model='random'>/dev/urandom</backend>
Aug 09 10:18:52 user nova-compute[72362]:       <alias name='rng0'/>
Aug 09 10:18:52 user nova-compute[72362]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 09 10:18:52 user nova-compute[72362]:     </rng>
Aug 09 10:18:52 user nova-compute[72362]:   </devices>
Aug 09 10:18:52 user nova-compute[72362]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 09 10:18:52 user nova-compute[72362]:     <label>libvirt-00af3d8e-bd93-4520-91e7-29c135c03e55</label>
Aug 09 10:18:52 user nova-compute[72362]:     <imagelabel>libvirt-00af3d8e-bd93-4520-91e7-29c135c03e55</imagelabel>
Aug 09 10:18:52 user nova-compute[72362]:   </seclabel>
Aug 09 10:18:52 user nova-compute[72362]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 09 10:18:52 user nova-compute[72362]:     <label>+64055:+108</label>
Aug 09 10:18:52 user nova-compute[72362]:     <imagelabel>+64055:+108</imagelabel>
Aug 09 10:18:52 user nova-compute[72362]:   </seclabel>
Aug 09 10:18:52 user nova-compute[72362]: </domain>
Aug 09 10:18:52 user nova-compute[72362]:  {{(pid=72362) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 09 10:18:52 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-f45baf25-20d7-44c5-b145-8bb8a6d50fff tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Successfully detached device tap8c232e74-77 from instance 00af3d8e-bd93-4520-91e7-29c135c03e55 from the persistent domain config.
Aug 09 10:18:52 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-f45baf25-20d7-44c5-b145-8bb8a6d50fff tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] (1/8): Attempting to detach device tap8c232e74-77 with device alias net1 from instance 00af3d8e-bd93-4520-91e7-29c135c03e55 from the live domain config. {{(pid=72362) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 10:18:52 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-f45baf25-20d7-44c5-b145-8bb8a6d50fff tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] detach device xml: <interface type="ethernet">
Aug 09 10:18:52 user nova-compute[72362]:   <mac address="fa:16:3e:f6:7f:94"/>
Aug 09 10:18:52 user nova-compute[72362]:   <model type="virtio"/>
Aug 09 10:18:52 user nova-compute[72362]:   <mtu size="1442"/>
Aug 09 10:18:52 user nova-compute[72362]:   <target dev="tap8c232e74-77"/>
Aug 09 10:18:52 user nova-compute[72362]: </interface>
Aug 09 10:18:52 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:18:52 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:52 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:52 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Received event <DeviceRemovedEvent: 1691576332.4135504, 00af3d8e-bd93-4520-91e7-29c135c03e55 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72362) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 10:18:52 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-f45baf25-20d7-44c5-b145-8bb8a6d50fff tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Start waiting for the detach event from libvirt for device tap8c232e74-77 with device alias net1 for instance 00af3d8e-bd93-4520-91e7-29c135c03e55 {{(pid=72362) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 10:18:52 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-f45baf25-20d7-44c5-b145-8bb8a6d50fff tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f6:7f:94"/><model type="virtio"/><mtu size="1442"/><target dev="tap8c232e74-77"/></interface> {{(pid=72362) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 09 10:18:52 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-f45baf25-20d7-44c5-b145-8bb8a6d50fff tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f6:7f:94"/><model type="virtio"/><mtu size="1442"/><target dev="tap8c232e74-77"/></interface>not found in domain: <domain type='kvm' id='7'>
Aug 09 10:18:52 user nova-compute[72362]:   <name>instance-00000007</name>
Aug 09 10:18:52 user nova-compute[72362]:   <uuid>00af3d8e-bd93-4520-91e7-29c135c03e55</uuid>
Aug 09 10:18:52 user nova-compute[72362]:   <metadata>
Aug 09 10:18:52 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:18:52 user nova-compute[72362]:   <nova:package version="0.0.0"/>
Aug 09 10:18:52 user nova-compute[72362]:   <nova:name>tempest-device-tagging-server-1129807899</nova:name>
Aug 09 10:18:52 user nova-compute[72362]:   <nova:creationTime>2023-08-09 10:18:28</nova:creationTime>
Aug 09 10:18:52 user nova-compute[72362]:   <nova:flavor name="m1.tiny">
Aug 09 10:18:52 user nova-compute[72362]:     <nova:memory>512</nova:memory>
Aug 09 10:18:52 user nova-compute[72362]:     <nova:disk>1</nova:disk>
Aug 09 10:18:52 user nova-compute[72362]:     <nova:swap>0</nova:swap>
Aug 09 10:18:52 user nova-compute[72362]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:18:52 user nova-compute[72362]:     <nova:vcpus>1</nova:vcpus>
Aug 09 10:18:52 user nova-compute[72362]:   </nova:flavor>
Aug 09 10:18:52 user nova-compute[72362]:   <nova:owner>
Aug 09 10:18:52 user nova-compute[72362]:     <nova:user uuid="5dd4d0e5c03744569a542098432622d7">tempest-TaggedAttachmentsTest-202820908-project-member</nova:user>
Aug 09 10:18:52 user nova-compute[72362]:     <nova:project uuid="7a68b4a52019441480a19783a89e0af8">tempest-TaggedAttachmentsTest-202820908</nova:project>
Aug 09 10:18:52 user nova-compute[72362]:   </nova:owner>
Aug 09 10:18:52 user nova-compute[72362]:   <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:18:52 user nova-compute[72362]:   <nova:ports>
Aug 09 10:18:52 user nova-compute[72362]:     <nova:port uuid="1efbc456-6c56-4367-845f-0afa8acdcec4">
Aug 09 10:18:52 user nova-compute[72362]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 10:18:52 user nova-compute[72362]:     </nova:port>
Aug 09 10:18:52 user nova-compute[72362]:     <nova:port uuid="8c232e74-771d-40b3-8f0c-abdef770aafd">
Aug 09 10:18:52 user nova-compute[72362]:       <nova:ip type="fixed" address="10.10.10.165" ipVersion="4"/>
Aug 09 10:18:52 user nova-compute[72362]:     </nova:port>
Aug 09 10:18:52 user nova-compute[72362]:   </nova:ports>
Aug 09 10:18:52 user nova-compute[72362]: </nova:instance>
Aug 09 10:18:52 user nova-compute[72362]:   </metadata>
Aug 09 10:18:52 user nova-compute[72362]:   <memory unit='KiB'>524288</memory>
Aug 09 10:18:52 user nova-compute[72362]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 09 10:18:52 user nova-compute[72362]:   <vcpu placement='static'>1</vcpu>
Aug 09 10:18:52 user nova-compute[72362]:   <resource>
Aug 09 10:18:52 user nova-compute[72362]:     <partition>/machine</partition>
Aug 09 10:18:52 user nova-compute[72362]:   </resource>
Aug 09 10:18:52 user nova-compute[72362]:   <sysinfo type='smbios'>
Aug 09 10:18:52 user nova-compute[72362]:     <system>
Aug 09 10:18:52 user nova-compute[72362]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 09 10:18:52 user nova-compute[72362]:       <entry name='product'>OpenStack Nova</entry>
Aug 09 10:18:52 user nova-compute[72362]:       <entry name='version'>0.0.0</entry>
Aug 09 10:18:52 user nova-compute[72362]:       <entry name='serial'>00af3d8e-bd93-4520-91e7-29c135c03e55</entry>
Aug 09 10:18:52 user nova-compute[72362]:       <entry name='uuid'>00af3d8e-bd93-4520-91e7-29c135c03e55</entry>
Aug 09 10:18:52 user nova-compute[72362]:       <entry name='family'>Virtual Machine</entry>
Aug 09 10:18:52 user nova-compute[72362]:     </system>
Aug 09 10:18:52 user nova-compute[72362]:   </sysinfo>
Aug 09 10:18:52 user nova-compute[72362]:   <os>
Aug 09 10:18:52 user nova-compute[72362]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 09 10:18:52 user nova-compute[72362]:     <boot dev='hd'/>
Aug 09 10:18:52 user nova-compute[72362]:     <smbios mode='sysinfo'/>
Aug 09 10:18:52 user nova-compute[72362]:   </os>
Aug 09 10:18:52 user nova-compute[72362]:   <features>
Aug 09 10:18:52 user nova-compute[72362]:     <acpi/>
Aug 09 10:18:52 user nova-compute[72362]:     <apic/>
Aug 09 10:18:52 user nova-compute[72362]:     <vmcoreinfo state='on'/>
Aug 09 10:18:52 user nova-compute[72362]:   </features>
Aug 09 10:18:52 user nova-compute[72362]:   <cpu mode='custom' match='exact' check='full'>
Aug 09 10:18:52 user nova-compute[72362]:     <model fallback='forbid'>Nehalem</model>
Aug 09 10:18:52 user nova-compute[72362]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 09 10:18:52 user nova-compute[72362]:     <feature policy='require' name='vme'/>
Aug 09 10:18:52 user nova-compute[72362]:     <feature policy='require' name='x2apic'/>
Aug 09 10:18:52 user nova-compute[72362]:     <feature policy='require' name='hypervisor'/>
Aug 09 10:18:52 user nova-compute[72362]:   </cpu>
Aug 09 10:18:52 user nova-compute[72362]:   <clock offset='utc'>
Aug 09 10:18:52 user nova-compute[72362]:     <timer name='pit' tickpolicy='delay'/>
Aug 09 10:18:52 user nova-compute[72362]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 09 10:18:52 user nova-compute[72362]:     <timer name='hpet' present='no'/>
Aug 09 10:18:52 user nova-compute[72362]:   </clock>
Aug 09 10:18:52 user nova-compute[72362]:   <on_poweroff>destroy</on_poweroff>
Aug 09 10:18:52 user nova-compute[72362]:   <on_reboot>restart</on_reboot>
Aug 09 10:18:52 user nova-compute[72362]:   <on_crash>destroy</on_crash>
Aug 09 10:18:52 user nova-compute[72362]:   <devices>
Aug 09 10:18:52 user nova-compute[72362]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 09 10:18:52 user nova-compute[72362]:     <disk type='file' device='disk'>
Aug 09 10:18:52 user nova-compute[72362]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 09 10:18:52 user nova-compute[72362]:       <source file='/opt/stack/data/nova/instances/00af3d8e-bd93-4520-91e7-29c135c03e55/disk' index='2'/>
Aug 09 10:18:52 user nova-compute[72362]:       <backingStore type='file' index='3'>
Aug 09 10:18:52 user nova-compute[72362]:         <format type='raw'/>
Aug 09 10:18:52 user nova-compute[72362]:         <source file='/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4'/>
Aug 09 10:18:52 user nova-compute[72362]:         <backingStore/>
Aug 09 10:18:52 user nova-compute[72362]:       </backingStore>
Aug 09 10:18:52 user nova-compute[72362]:       <target dev='vda' bus='virtio'/>
Aug 09 10:18:52 user nova-compute[72362]:       <alias name='virtio-disk0'/>
Aug 09 10:18:52 user nova-compute[72362]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 09 10:18:52 user nova-compute[72362]:     </disk>
Aug 09 10:18:52 user nova-compute[72362]:     <disk type='file' device='cdrom'>
Aug 09 10:18:52 user nova-compute[72362]:       <driver name='qemu' type='raw' cache='none'/>
Aug 09 10:18:52 user nova-compute[72362]:       <source file='/opt/stack/data/nova/instances/00af3d8e-bd93-4520-91e7-29c135c03e55/disk.config' index='1'/>
Aug 09 10:18:52 user nova-compute[72362]:       <backingStore/>
Aug 09 10:18:52 user nova-compute[72362]:       <target dev='hda' bus='ide'/>
Aug 09 10:18:52 user nova-compute[72362]:       <readonly/>
Aug 09 10:18:52 user nova-compute[72362]:       <alias name='ide0-0-0'/>
Aug 09 10:18:52 user nova-compute[72362]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 09 10:18:52 user nova-compute[72362]:     </disk>
Aug 09 10:18:52 user nova-compute[72362]:     <controller type='usb' index='0' model='none'>
Aug 09 10:18:52 user nova-compute[72362]:       <alias name='usb'/>
Aug 09 10:18:52 user nova-compute[72362]:     </controller>
Aug 09 10:18:52 user nova-compute[72362]:     <controller type='pci' index='0' model='pci-root'>
Aug 09 10:18:52 user nova-compute[72362]:       <alias name='pci.0'/>
Aug 09 10:18:52 user nova-compute[72362]:     </controller>
Aug 09 10:18:52 user nova-compute[72362]:     <controller type='ide' index='0'>
Aug 09 10:18:52 user nova-compute[72362]:       <alias name='ide'/>
Aug 09 10:18:52 user nova-compute[72362]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 09 10:18:52 user nova-compute[72362]:     </controller>
Aug 09 10:18:52 user nova-compute[72362]:     <interface type='ethernet'>
Aug 09 10:18:52 user nova-compute[72362]:       <mac address='fa:16:3e:76:bd:21'/>
Aug 09 10:18:52 user nova-compute[72362]:       <target dev='tap1efbc456-6c'/>
Aug 09 10:18:52 user nova-compute[72362]:       <model type='virtio'/>
Aug 09 10:18:52 user nova-compute[72362]:       <mtu size='1442'/>
Aug 09 10:18:52 user nova-compute[72362]:       <alias name='net0'/>
Aug 09 10:18:52 user nova-compute[72362]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 09 10:18:52 user nova-compute[72362]:     </interface>
Aug 09 10:18:52 user nova-compute[72362]:     <serial type='pty'>
Aug 09 10:18:52 user nova-compute[72362]:       <source path='/dev/pts/7'/>
Aug 09 10:18:52 user nova-compute[72362]:       <log file='/opt/stack/data/nova/instances/00af3d8e-bd93-4520-91e7-29c135c03e55/console.log' append='off'/>
Aug 09 10:18:52 user nova-compute[72362]:       <target type='isa-serial' port='0'>
Aug 09 10:18:52 user nova-compute[72362]:         <model name='isa-serial'/>
Aug 09 10:18:52 user nova-compute[72362]:       </target>
Aug 09 10:18:52 user nova-compute[72362]:       <alias name='serial0'/>
Aug 09 10:18:52 user nova-compute[72362]:     </serial>
Aug 09 10:18:52 user nova-compute[72362]:     <console type='pty' tty='/dev/pts/7'>
Aug 09 10:18:52 user nova-compute[72362]:       <source path='/dev/pts/7'/>
Aug 09 10:18:52 user nova-compute[72362]:       <log file='/opt/stack/data/nova/instances/00af3d8e-bd93-4520-91e7-29c135c03e55/console.log' append='off'/>
Aug 09 10:18:52 user nova-compute[72362]:       <target type='serial' port='0'/>
Aug 09 10:18:52 user nova-compute[72362]:       <alias name='serial0'/>
Aug 09 10:18:52 user nova-compute[72362]:     </console>
Aug 09 10:18:52 user nova-compute[72362]:     <input type='mouse' bus='ps2'>
Aug 09 10:18:52 user nova-compute[72362]:       <alias name='input0'/>
Aug 09 10:18:52 user nova-compute[72362]:     </input>
Aug 09 10:18:52 user nova-compute[72362]:     <input type='keyboard' bus='ps2'>
Aug 09 10:18:52 user nova-compute[72362]:       <alias name='input1'/>
Aug 09 10:18:52 user nova-compute[72362]:     </input>
Aug 09 10:18:52 user nova-compute[72362]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Aug 09 10:18:52 user nova-compute[72362]:       <listen type='address' address='0.0.0.0'/>
Aug 09 10:18:52 user nova-compute[72362]:     </graphics>
Aug 09 10:18:52 user nova-compute[72362]:     <audio id='1' type='none'/>
Aug 09 10:18:52 user nova-compute[72362]:     <video>
Aug 09 10:18:52 user nova-compute[72362]:       <model type='virtio' heads='1' primary='yes'/>
Aug 09 10:18:52 user nova-compute[72362]:       <alias name='video0'/>
Aug 09 10:18:52 user nova-compute[72362]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 09 10:18:52 user nova-compute[72362]:     </video>
Aug 09 10:18:52 user nova-compute[72362]:     <memballoon model='virtio'>
Aug 09 10:18:52 user nova-compute[72362]:       <stats period='10'/>
Aug 09 10:18:52 user nova-compute[72362]:       <alias name='balloon0'/>
Aug 09 10:18:52 user nova-compute[72362]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 09 10:18:52 user nova-compute[72362]:     </memballoon>
Aug 09 10:18:52 user nova-compute[72362]:     <rng model='virtio'>
Aug 09 10:18:52 user nova-compute[72362]:       <backend model='random'>/dev/urandom</backend>
Aug 09 10:18:52 user nova-compute[72362]:       <alias name='rng0'/>
Aug 09 10:18:52 user nova-compute[72362]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 09 10:18:52 user nova-compute[72362]:     </rng>
Aug 09 10:18:52 user nova-compute[72362]:   </devices>
Aug 09 10:18:52 user nova-compute[72362]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 09 10:18:52 user nova-compute[72362]:     <label>libvirt-00af3d8e-bd93-4520-91e7-29c135c03e55</label>
Aug 09 10:18:52 user nova-compute[72362]:     <imagelabel>libvirt-00af3d8e-bd93-4520-91e7-29c135c03e55</imagelabel>
Aug 09 10:18:52 user nova-compute[72362]:   </seclabel>
Aug 09 10:18:52 user nova-compute[72362]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 09 10:18:52 user nova-compute[72362]:     <label>+64055:+108</label>
Aug 09 10:18:52 user nova-compute[72362]:     <imagelabel>+64055:+108</imagelabel>
Aug 09 10:18:52 user nova-compute[72362]:   </seclabel>
Aug 09 10:18:52 user nova-compute[72362]: </domain>
Aug 09 10:18:52 user nova-compute[72362]:  {{(pid=72362) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 09 10:18:52 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-f45baf25-20d7-44c5-b145-8bb8a6d50fff tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Successfully detached device tap8c232e74-77 from instance 00af3d8e-bd93-4520-91e7-29c135c03e55 from the live domain config.
Aug 09 10:18:52 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-f45baf25-20d7-44c5-b145-8bb8a6d50fff tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:16:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1129807899',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1129807899',id=7,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKTy1BEGFgb2LwPCE0l4ZdsIb1CDE+2z5XZX+3IOS7BmpUspCkv8nslwIBX+XdLBElH9a7nR/A5XVOfQJoXDwudCeZ0lpAUFsL0E9TcfQKbmNmV+/CzT9enkfH7jf9KfQ==',key_name='tempest-keypair-426982747',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:16:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a68b4a52019441480a19783a89e0af8',ramdisk_id='',reservation_id='r-80xqf6s8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-202820908',owner_user_name='tempest-TaggedAttachmentsTest-202820908-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:16:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5dd4d0e5c03744569a542098432622d7',uuid=00af3d8e-bd93-4520-91e7-29c135c03e55,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c232e74-771d-40b3-8f0c-abdef770aafd", "address": "fa:16:3e:f6:7f:94", "network": {"id": "20844264-ffb2-45b0-b420-8783270cc7f5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1034730248", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7a68b4a52019441480a19783a89e0af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c232e74-77", "ovs_interfaceid": "8c232e74-771d-40b3-8f0c-abdef770aafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:18:52 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-f45baf25-20d7-44c5-b145-8bb8a6d50fff tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Converting VIF {"id": "8c232e74-771d-40b3-8f0c-abdef770aafd", "address": "fa:16:3e:f6:7f:94", "network": {"id": "20844264-ffb2-45b0-b420-8783270cc7f5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1034730248", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7a68b4a52019441480a19783a89e0af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c232e74-77", "ovs_interfaceid": "8c232e74-771d-40b3-8f0c-abdef770aafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:18:52 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-f45baf25-20d7-44c5-b145-8bb8a6d50fff tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:7f:94,bridge_name='br-int',has_traffic_filtering=True,id=8c232e74-771d-40b3-8f0c-abdef770aafd,network=Network(20844264-ffb2-45b0-b420-8783270cc7f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c232e74-77') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:18:52 user nova-compute[72362]: DEBUG os_vif [None req-f45baf25-20d7-44c5-b145-8bb8a6d50fff tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:7f:94,bridge_name='br-int',has_traffic_filtering=True,id=8c232e74-771d-40b3-8f0c-abdef770aafd,network=Network(20844264-ffb2-45b0-b420-8783270cc7f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c232e74-77') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:18:52 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:52 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c232e74-77, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:18:52 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:52 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:18:52 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:52 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:52 user nova-compute[72362]: INFO os_vif [None req-f45baf25-20d7-44c5-b145-8bb8a6d50fff tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:7f:94,bridge_name='br-int',has_traffic_filtering=True,id=8c232e74-771d-40b3-8f0c-abdef770aafd,network=Network(20844264-ffb2-45b0-b420-8783270cc7f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c232e74-77')
Aug 09 10:18:52 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-f45baf25-20d7-44c5-b145-8bb8a6d50fff tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:18:52 user nova-compute[72362]:   <nova:package version="0.0.0"/>
Aug 09 10:18:52 user nova-compute[72362]:   <nova:name>tempest-device-tagging-server-1129807899</nova:name>
Aug 09 10:18:52 user nova-compute[72362]:   <nova:creationTime>2023-08-09 10:18:52</nova:creationTime>
Aug 09 10:18:52 user nova-compute[72362]:   <nova:flavor name="m1.tiny">
Aug 09 10:18:52 user nova-compute[72362]:     <nova:memory>512</nova:memory>
Aug 09 10:18:52 user nova-compute[72362]:     <nova:disk>1</nova:disk>
Aug 09 10:18:52 user nova-compute[72362]:     <nova:swap>0</nova:swap>
Aug 09 10:18:52 user nova-compute[72362]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:18:52 user nova-compute[72362]:     <nova:vcpus>1</nova:vcpus>
Aug 09 10:18:52 user nova-compute[72362]:   </nova:flavor>
Aug 09 10:18:52 user nova-compute[72362]:   <nova:owner>
Aug 09 10:18:52 user nova-compute[72362]:     <nova:user uuid="5dd4d0e5c03744569a542098432622d7">tempest-TaggedAttachmentsTest-202820908-project-member</nova:user>
Aug 09 10:18:52 user nova-compute[72362]:     <nova:project uuid="7a68b4a52019441480a19783a89e0af8">tempest-TaggedAttachmentsTest-202820908</nova:project>
Aug 09 10:18:52 user nova-compute[72362]:   </nova:owner>
Aug 09 10:18:52 user nova-compute[72362]:   <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:18:52 user nova-compute[72362]:   <nova:ports>
Aug 09 10:18:52 user nova-compute[72362]:     <nova:port uuid="1efbc456-6c56-4367-845f-0afa8acdcec4">
Aug 09 10:18:52 user nova-compute[72362]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 10:18:52 user nova-compute[72362]:     </nova:port>
Aug 09 10:18:52 user nova-compute[72362]:   </nova:ports>
Aug 09 10:18:52 user nova-compute[72362]: </nova:instance>
Aug 09 10:18:52 user nova-compute[72362]:  {{(pid=72362) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 09 10:18:52 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:18:52 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Took 1.20 seconds to deallocate network for instance.
Aug 09 10:18:52 user nova-compute[72362]: DEBUG nova.compute.manager [req-26820295-8740-48ef-b2f2-aab8fc47aa7c req-75f2282a-df54-4189-b735-8dc0b715dbd4 service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Received event network-vif-unplugged-8c232e74-771d-40b3-8f0c-abdef770aafd {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:18:52 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-26820295-8740-48ef-b2f2-aab8fc47aa7c req-75f2282a-df54-4189-b735-8dc0b715dbd4 service nova] Acquiring lock "00af3d8e-bd93-4520-91e7-29c135c03e55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:18:52 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-26820295-8740-48ef-b2f2-aab8fc47aa7c req-75f2282a-df54-4189-b735-8dc0b715dbd4 service nova] Lock "00af3d8e-bd93-4520-91e7-29c135c03e55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:18:52 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-26820295-8740-48ef-b2f2-aab8fc47aa7c req-75f2282a-df54-4189-b735-8dc0b715dbd4 service nova] Lock "00af3d8e-bd93-4520-91e7-29c135c03e55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:18:52 user nova-compute[72362]: DEBUG nova.compute.manager [req-26820295-8740-48ef-b2f2-aab8fc47aa7c req-75f2282a-df54-4189-b735-8dc0b715dbd4 service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] No waiting events found dispatching network-vif-unplugged-8c232e74-771d-40b3-8f0c-abdef770aafd {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:18:52 user nova-compute[72362]: WARNING nova.compute.manager [req-26820295-8740-48ef-b2f2-aab8fc47aa7c req-75f2282a-df54-4189-b735-8dc0b715dbd4 service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Received unexpected event network-vif-unplugged-8c232e74-771d-40b3-8f0c-abdef770aafd for instance with vm_state active and task_state None.
Aug 09 10:18:52 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c97fc48c-5390-4fa6-ac47-f1bd1efca057 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:18:52 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c97fc48c-5390-4fa6-ac47-f1bd1efca057 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:18:52 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:18:52 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:18:53 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-c97fc48c-5390-4fa6-ac47-f1bd1efca057 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:18:53 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-c97fc48c-5390-4fa6-ac47-f1bd1efca057 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:18:53 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c97fc48c-5390-4fa6-ac47-f1bd1efca057 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.365s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:18:53 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-c97fc48c-5390-4fa6-ac47-f1bd1efca057 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Deleted allocations for instance 9f2bc700-2e69-406f-9a13-52396eae4258
Aug 09 10:18:53 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c97fc48c-5390-4fa6-ac47-f1bd1efca057 tempest-AttachSCSIVolumeTestJSON-1535324413 tempest-AttachSCSIVolumeTestJSON-1535324413-project-member] Lock "9f2bc700-2e69-406f-9a13-52396eae4258" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.782s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:18:53 user nova-compute[72362]: DEBUG nova.compute.manager [req-36acc28b-fe70-4a09-9fb9-e2df5c6e23be req-7b219ac5-9fea-4764-99a9-357405ada1c6 service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Received event network-vif-deleted-8c232e74-771d-40b3-8f0c-abdef770aafd {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:18:53 user nova-compute[72362]: INFO nova.compute.manager [req-36acc28b-fe70-4a09-9fb9-e2df5c6e23be req-7b219ac5-9fea-4764-99a9-357405ada1c6 service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Neutron deleted interface 8c232e74-771d-40b3-8f0c-abdef770aafd; detaching it from the instance and deleting it from the info cache
Aug 09 10:18:53 user nova-compute[72362]: DEBUG nova.network.neutron [req-36acc28b-fe70-4a09-9fb9-e2df5c6e23be req-7b219ac5-9fea-4764-99a9-357405ada1c6 service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Updating instance_info_cache with network_info: [{"id": "1efbc456-6c56-4367-845f-0afa8acdcec4", "address": "fa:16:3e:76:bd:21", "network": {"id": "1eaf9aa3-1d74-424c-86c6-28096cf53571", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-621134432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a68b4a52019441480a19783a89e0af8", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1efbc456-6c", "ovs_interfaceid": "1efbc456-6c56-4367-845f-0afa8acdcec4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:18:53 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f45baf25-20d7-44c5-b145-8bb8a6d50fff tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Acquiring lock "refresh_cache-00af3d8e-bd93-4520-91e7-29c135c03e55" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:18:53 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f45baf25-20d7-44c5-b145-8bb8a6d50fff tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Acquired lock "refresh_cache-00af3d8e-bd93-4520-91e7-29c135c03e55" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:18:53 user nova-compute[72362]: DEBUG nova.network.neutron [None req-f45baf25-20d7-44c5-b145-8bb8a6d50fff tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:18:53 user nova-compute[72362]: DEBUG nova.objects.instance [req-36acc28b-fe70-4a09-9fb9-e2df5c6e23be req-7b219ac5-9fea-4764-99a9-357405ada1c6 service nova] Lazy-loading 'system_metadata' on Instance uuid 00af3d8e-bd93-4520-91e7-29c135c03e55 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:18:53 user nova-compute[72362]: DEBUG nova.objects.instance [req-36acc28b-fe70-4a09-9fb9-e2df5c6e23be req-7b219ac5-9fea-4764-99a9-357405ada1c6 service nova] Lazy-loading 'flavor' on Instance uuid 00af3d8e-bd93-4520-91e7-29c135c03e55 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:18:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [req-36acc28b-fe70-4a09-9fb9-e2df5c6e23be req-7b219ac5-9fea-4764-99a9-357405ada1c6 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:16:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1129807899',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1129807899',id=7,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKTy1BEGFgb2LwPCE0l4ZdsIb1CDE+2z5XZX+3IOS7BmpUspCkv8nslwIBX+XdLBElH9a7nR/A5XVOfQJoXDwudCeZ0lpAUFsL0E9TcfQKbmNmV+/CzT9enkfH7jf9KfQ==',key_name='tempest-keypair-426982747',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:16:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a68b4a52019441480a19783a89e0af8',ramdisk_id='',reservation_id='r-80xqf6s8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-202820908',owner_user_name='tempest-TaggedAttachmentsTest-202820908-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:16:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5dd4d0e5c03744569a542098432622d7',uuid=00af3d8e-bd93-4520-91e7-29c135c03e55,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c232e74-771d-40b3-8f0c-abdef770aafd", "address": "fa:16:3e:f6:7f:94", "network": {"id": "20844264-ffb2-45b0-b420-8783270cc7f5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1034730248", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7a68b4a52019441480a19783a89e0af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c232e74-77", "ovs_interfaceid": "8c232e74-771d-40b3-8f0c-abdef770aafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:18:53 user nova-compute[72362]: DEBUG nova.network.os_vif_util [req-36acc28b-fe70-4a09-9fb9-e2df5c6e23be req-7b219ac5-9fea-4764-99a9-357405ada1c6 service nova] Converting VIF {"id": "8c232e74-771d-40b3-8f0c-abdef770aafd", "address": "fa:16:3e:f6:7f:94", "network": {"id": "20844264-ffb2-45b0-b420-8783270cc7f5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1034730248", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7a68b4a52019441480a19783a89e0af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c232e74-77", "ovs_interfaceid": "8c232e74-771d-40b3-8f0c-abdef770aafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:18:53 user nova-compute[72362]: DEBUG nova.network.os_vif_util [req-36acc28b-fe70-4a09-9fb9-e2df5c6e23be req-7b219ac5-9fea-4764-99a9-357405ada1c6 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:7f:94,bridge_name='br-int',has_traffic_filtering=True,id=8c232e74-771d-40b3-8f0c-abdef770aafd,network=Network(20844264-ffb2-45b0-b420-8783270cc7f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c232e74-77') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:18:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [req-36acc28b-fe70-4a09-9fb9-e2df5c6e23be req-7b219ac5-9fea-4764-99a9-357405ada1c6 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f6:7f:94"/><model type="virtio"/><mtu size="1442"/><target dev="tap8c232e74-77"/></interface> {{(pid=72362) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 09 10:18:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [req-36acc28b-fe70-4a09-9fb9-e2df5c6e23be req-7b219ac5-9fea-4764-99a9-357405ada1c6 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f6:7f:94"/><model type="virtio"/><mtu size="1442"/><target dev="tap8c232e74-77"/></interface>not found in domain: <domain type='kvm' id='7'>
Aug 09 10:18:53 user nova-compute[72362]:   <name>instance-00000007</name>
Aug 09 10:18:53 user nova-compute[72362]:   <uuid>00af3d8e-bd93-4520-91e7-29c135c03e55</uuid>
Aug 09 10:18:53 user nova-compute[72362]:   <metadata>
Aug 09 10:18:53 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:18:53 user nova-compute[72362]:   <nova:package version="0.0.0"/>
Aug 09 10:18:53 user nova-compute[72362]:   <nova:name>tempest-device-tagging-server-1129807899</nova:name>
Aug 09 10:18:53 user nova-compute[72362]:   <nova:creationTime>2023-08-09 10:18:52</nova:creationTime>
Aug 09 10:18:53 user nova-compute[72362]:   <nova:flavor name="m1.tiny">
Aug 09 10:18:53 user nova-compute[72362]:     <nova:memory>512</nova:memory>
Aug 09 10:18:53 user nova-compute[72362]:     <nova:disk>1</nova:disk>
Aug 09 10:18:53 user nova-compute[72362]:     <nova:swap>0</nova:swap>
Aug 09 10:18:53 user nova-compute[72362]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:18:53 user nova-compute[72362]:     <nova:vcpus>1</nova:vcpus>
Aug 09 10:18:53 user nova-compute[72362]:   </nova:flavor>
Aug 09 10:18:53 user nova-compute[72362]:   <nova:owner>
Aug 09 10:18:53 user nova-compute[72362]:     <nova:user uuid="5dd4d0e5c03744569a542098432622d7">tempest-TaggedAttachmentsTest-202820908-project-member</nova:user>
Aug 09 10:18:53 user nova-compute[72362]:     <nova:project uuid="7a68b4a52019441480a19783a89e0af8">tempest-TaggedAttachmentsTest-202820908</nova:project>
Aug 09 10:18:53 user nova-compute[72362]:   </nova:owner>
Aug 09 10:18:53 user nova-compute[72362]:   <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:18:53 user nova-compute[72362]:   <nova:ports>
Aug 09 10:18:53 user nova-compute[72362]:     <nova:port uuid="1efbc456-6c56-4367-845f-0afa8acdcec4">
Aug 09 10:18:53 user nova-compute[72362]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 10:18:53 user nova-compute[72362]:     </nova:port>
Aug 09 10:18:53 user nova-compute[72362]:   </nova:ports>
Aug 09 10:18:53 user nova-compute[72362]: </nova:instance>
Aug 09 10:18:53 user nova-compute[72362]:   </metadata>
Aug 09 10:18:53 user nova-compute[72362]:   <memory unit='KiB'>524288</memory>
Aug 09 10:18:53 user nova-compute[72362]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 09 10:18:53 user nova-compute[72362]:   <vcpu placement='static'>1</vcpu>
Aug 09 10:18:53 user nova-compute[72362]:   <resource>
Aug 09 10:18:53 user nova-compute[72362]:     <partition>/machine</partition>
Aug 09 10:18:53 user nova-compute[72362]:   </resource>
Aug 09 10:18:53 user nova-compute[72362]:   <sysinfo type='smbios'>
Aug 09 10:18:53 user nova-compute[72362]:     <system>
Aug 09 10:18:53 user nova-compute[72362]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 09 10:18:53 user nova-compute[72362]:       <entry name='product'>OpenStack Nova</entry>
Aug 09 10:18:53 user nova-compute[72362]:       <entry name='version'>0.0.0</entry>
Aug 09 10:18:53 user nova-compute[72362]:       <entry name='serial'>00af3d8e-bd93-4520-91e7-29c135c03e55</entry>
Aug 09 10:18:53 user nova-compute[72362]:       <entry name='uuid'>00af3d8e-bd93-4520-91e7-29c135c03e55</entry>
Aug 09 10:18:53 user nova-compute[72362]:       <entry name='family'>Virtual Machine</entry>
Aug 09 10:18:53 user nova-compute[72362]:     </system>
Aug 09 10:18:53 user nova-compute[72362]:   </sysinfo>
Aug 09 10:18:53 user nova-compute[72362]:   <os>
Aug 09 10:18:53 user nova-compute[72362]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 09 10:18:53 user nova-compute[72362]:     <boot dev='hd'/>
Aug 09 10:18:53 user nova-compute[72362]:     <smbios mode='sysinfo'/>
Aug 09 10:18:53 user nova-compute[72362]:   </os>
Aug 09 10:18:53 user nova-compute[72362]:   <features>
Aug 09 10:18:53 user nova-compute[72362]:     <acpi/>
Aug 09 10:18:53 user nova-compute[72362]:     <apic/>
Aug 09 10:18:53 user nova-compute[72362]:     <vmcoreinfo state='on'/>
Aug 09 10:18:53 user nova-compute[72362]:   </features>
Aug 09 10:18:53 user nova-compute[72362]:   <cpu mode='custom' match='exact' check='full'>
Aug 09 10:18:53 user nova-compute[72362]:     <model fallback='forbid'>Nehalem</model>
Aug 09 10:18:53 user nova-compute[72362]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 09 10:18:53 user nova-compute[72362]:     <feature policy='require' name='vme'/>
Aug 09 10:18:53 user nova-compute[72362]:     <feature policy='require' name='x2apic'/>
Aug 09 10:18:53 user nova-compute[72362]:     <feature policy='require' name='hypervisor'/>
Aug 09 10:18:53 user nova-compute[72362]:   </cpu>
Aug 09 10:18:53 user nova-compute[72362]:   <clock offset='utc'>
Aug 09 10:18:53 user nova-compute[72362]:     <timer name='pit' tickpolicy='delay'/>
Aug 09 10:18:53 user nova-compute[72362]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 09 10:18:53 user nova-compute[72362]:     <timer name='hpet' present='no'/>
Aug 09 10:18:53 user nova-compute[72362]:   </clock>
Aug 09 10:18:53 user nova-compute[72362]:   <on_poweroff>destroy</on_poweroff>
Aug 09 10:18:53 user nova-compute[72362]:   <on_reboot>restart</on_reboot>
Aug 09 10:18:53 user nova-compute[72362]:   <on_crash>destroy</on_crash>
Aug 09 10:18:53 user nova-compute[72362]:   <devices>
Aug 09 10:18:53 user nova-compute[72362]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 09 10:18:53 user nova-compute[72362]:     <disk type='file' device='disk'>
Aug 09 10:18:53 user nova-compute[72362]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 09 10:18:53 user nova-compute[72362]:       <source file='/opt/stack/data/nova/instances/00af3d8e-bd93-4520-91e7-29c135c03e55/disk' index='2'/>
Aug 09 10:18:53 user nova-compute[72362]:       <backingStore type='file' index='3'>
Aug 09 10:18:53 user nova-compute[72362]:         <format type='raw'/>
Aug 09 10:18:53 user nova-compute[72362]:         <source file='/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4'/>
Aug 09 10:18:53 user nova-compute[72362]:         <backingStore/>
Aug 09 10:18:53 user nova-compute[72362]:       </backingStore>
Aug 09 10:18:53 user nova-compute[72362]:       <target dev='vda' bus='virtio'/>
Aug 09 10:18:53 user nova-compute[72362]:       <alias name='virtio-disk0'/>
Aug 09 10:18:53 user nova-compute[72362]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 09 10:18:53 user nova-compute[72362]:     </disk>
Aug 09 10:18:53 user nova-compute[72362]:     <disk type='file' device='cdrom'>
Aug 09 10:18:53 user nova-compute[72362]:       <driver name='qemu' type='raw' cache='none'/>
Aug 09 10:18:53 user nova-compute[72362]:       <source file='/opt/stack/data/nova/instances/00af3d8e-bd93-4520-91e7-29c135c03e55/disk.config' index='1'/>
Aug 09 10:18:53 user nova-compute[72362]:       <backingStore/>
Aug 09 10:18:53 user nova-compute[72362]:       <target dev='hda' bus='ide'/>
Aug 09 10:18:53 user nova-compute[72362]:       <readonly/>
Aug 09 10:18:53 user nova-compute[72362]:       <alias name='ide0-0-0'/>
Aug 09 10:18:53 user nova-compute[72362]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 09 10:18:53 user nova-compute[72362]:     </disk>
Aug 09 10:18:53 user nova-compute[72362]:     <controller type='usb' index='0' model='none'>
Aug 09 10:18:53 user nova-compute[72362]:       <alias name='usb'/>
Aug 09 10:18:53 user nova-compute[72362]:     </controller>
Aug 09 10:18:53 user nova-compute[72362]:     <controller type='pci' index='0' model='pci-root'>
Aug 09 10:18:53 user nova-compute[72362]:       <alias name='pci.0'/>
Aug 09 10:18:53 user nova-compute[72362]:     </controller>
Aug 09 10:18:53 user nova-compute[72362]:     <controller type='ide' index='0'>
Aug 09 10:18:53 user nova-compute[72362]:       <alias name='ide'/>
Aug 09 10:18:53 user nova-compute[72362]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 09 10:18:53 user nova-compute[72362]:     </controller>
Aug 09 10:18:53 user nova-compute[72362]:     <interface type='ethernet'>
Aug 09 10:18:53 user nova-compute[72362]:       <mac address='fa:16:3e:76:bd:21'/>
Aug 09 10:18:53 user nova-compute[72362]:       <target dev='tap1efbc456-6c'/>
Aug 09 10:18:53 user nova-compute[72362]:       <model type='virtio'/>
Aug 09 10:18:53 user nova-compute[72362]:       <mtu size='1442'/>
Aug 09 10:18:53 user nova-compute[72362]:       <alias name='net0'/>
Aug 09 10:18:53 user nova-compute[72362]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 09 10:18:53 user nova-compute[72362]:     </interface>
Aug 09 10:18:53 user nova-compute[72362]:     <serial type='pty'>
Aug 09 10:18:53 user nova-compute[72362]:       <source path='/dev/pts/7'/>
Aug 09 10:18:53 user nova-compute[72362]:       <log file='/opt/stack/data/nova/instances/00af3d8e-bd93-4520-91e7-29c135c03e55/console.log' append='off'/>
Aug 09 10:18:53 user nova-compute[72362]:       <target type='isa-serial' port='0'>
Aug 09 10:18:53 user nova-compute[72362]:         <model name='isa-serial'/>
Aug 09 10:18:53 user nova-compute[72362]:       </target>
Aug 09 10:18:53 user nova-compute[72362]:       <alias name='serial0'/>
Aug 09 10:18:53 user nova-compute[72362]:     </serial>
Aug 09 10:18:53 user nova-compute[72362]:     <console type='pty' tty='/dev/pts/7'>
Aug 09 10:18:53 user nova-compute[72362]:       <source path='/dev/pts/7'/>
Aug 09 10:18:53 user nova-compute[72362]:       <log file='/opt/stack/data/nova/instances/00af3d8e-bd93-4520-91e7-29c135c03e55/console.log' append='off'/>
Aug 09 10:18:53 user nova-compute[72362]:       <target type='serial' port='0'/>
Aug 09 10:18:53 user nova-compute[72362]:       <alias name='serial0'/>
Aug 09 10:18:53 user nova-compute[72362]:     </console>
Aug 09 10:18:53 user nova-compute[72362]:     <input type='mouse' bus='ps2'>
Aug 09 10:18:53 user nova-compute[72362]:       <alias name='input0'/>
Aug 09 10:18:53 user nova-compute[72362]:     </input>
Aug 09 10:18:53 user nova-compute[72362]:     <input type='keyboard' bus='ps2'>
Aug 09 10:18:53 user nova-compute[72362]:       <alias name='input1'/>
Aug 09 10:18:53 user nova-compute[72362]:     </input>
Aug 09 10:18:53 user nova-compute[72362]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Aug 09 10:18:53 user nova-compute[72362]:       <listen type='address' address='0.0.0.0'/>
Aug 09 10:18:53 user nova-compute[72362]:     </graphics>
Aug 09 10:18:53 user nova-compute[72362]:     <audio id='1' type='none'/>
Aug 09 10:18:53 user nova-compute[72362]:     <video>
Aug 09 10:18:53 user nova-compute[72362]:       <model type='virtio' heads='1' primary='yes'/>
Aug 09 10:18:53 user nova-compute[72362]:       <alias name='video0'/>
Aug 09 10:18:53 user nova-compute[72362]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 09 10:18:53 user nova-compute[72362]:     </video>
Aug 09 10:18:53 user nova-compute[72362]:     <memballoon model='virtio'>
Aug 09 10:18:53 user nova-compute[72362]:       <stats period='10'/>
Aug 09 10:18:53 user nova-compute[72362]:       <alias name='balloon0'/>
Aug 09 10:18:53 user nova-compute[72362]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 09 10:18:53 user nova-compute[72362]:     </memballoon>
Aug 09 10:18:53 user nova-compute[72362]:     <rng model='virtio'>
Aug 09 10:18:53 user nova-compute[72362]:       <backend model='random'>/dev/urandom</backend>
Aug 09 10:18:53 user nova-compute[72362]:       <alias name='rng0'/>
Aug 09 10:18:53 user nova-compute[72362]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 09 10:18:53 user nova-compute[72362]:     </rng>
Aug 09 10:18:53 user nova-compute[72362]:   </devices>
Aug 09 10:18:53 user nova-compute[72362]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 09 10:18:53 user nova-compute[72362]:     <label>libvirt-00af3d8e-bd93-4520-91e7-29c135c03e55</label>
Aug 09 10:18:53 user nova-compute[72362]:     <imagelabel>libvirt-00af3d8e-bd93-4520-91e7-29c135c03e55</imagelabel>
Aug 09 10:18:53 user nova-compute[72362]:   </seclabel>
Aug 09 10:18:53 user nova-compute[72362]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 09 10:18:53 user nova-compute[72362]:     <label>+64055:+108</label>
Aug 09 10:18:53 user nova-compute[72362]:     <imagelabel>+64055:+108</imagelabel>
Aug 09 10:18:53 user nova-compute[72362]:   </seclabel>
Aug 09 10:18:53 user nova-compute[72362]: </domain>
Aug 09 10:18:53 user nova-compute[72362]:  {{(pid=72362) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 09 10:18:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [req-36acc28b-fe70-4a09-9fb9-e2df5c6e23be req-7b219ac5-9fea-4764-99a9-357405ada1c6 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f6:7f:94"/><model type="virtio"/><mtu size="1442"/><target dev="tap8c232e74-77"/></interface> {{(pid=72362) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 09 10:18:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [req-36acc28b-fe70-4a09-9fb9-e2df5c6e23be req-7b219ac5-9fea-4764-99a9-357405ada1c6 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f6:7f:94"/><model type="virtio"/><mtu size="1442"/><target dev="tap8c232e74-77"/></interface>not found in domain: <domain type='kvm' id='7'>
Aug 09 10:18:53 user nova-compute[72362]:   <name>instance-00000007</name>
Aug 09 10:18:53 user nova-compute[72362]:   <uuid>00af3d8e-bd93-4520-91e7-29c135c03e55</uuid>
Aug 09 10:18:53 user nova-compute[72362]:   <metadata>
Aug 09 10:18:53 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:18:53 user nova-compute[72362]:   <nova:package version="0.0.0"/>
Aug 09 10:18:53 user nova-compute[72362]:   <nova:name>tempest-device-tagging-server-1129807899</nova:name>
Aug 09 10:18:53 user nova-compute[72362]:   <nova:creationTime>2023-08-09 10:18:52</nova:creationTime>
Aug 09 10:18:53 user nova-compute[72362]:   <nova:flavor name="m1.tiny">
Aug 09 10:18:53 user nova-compute[72362]:     <nova:memory>512</nova:memory>
Aug 09 10:18:53 user nova-compute[72362]:     <nova:disk>1</nova:disk>
Aug 09 10:18:53 user nova-compute[72362]:     <nova:swap>0</nova:swap>
Aug 09 10:18:53 user nova-compute[72362]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:18:53 user nova-compute[72362]:     <nova:vcpus>1</nova:vcpus>
Aug 09 10:18:53 user nova-compute[72362]:   </nova:flavor>
Aug 09 10:18:53 user nova-compute[72362]:   <nova:owner>
Aug 09 10:18:53 user nova-compute[72362]:     <nova:user uuid="5dd4d0e5c03744569a542098432622d7">tempest-TaggedAttachmentsTest-202820908-project-member</nova:user>
Aug 09 10:18:53 user nova-compute[72362]:     <nova:project uuid="7a68b4a52019441480a19783a89e0af8">tempest-TaggedAttachmentsTest-202820908</nova:project>
Aug 09 10:18:53 user nova-compute[72362]:   </nova:owner>
Aug 09 10:18:53 user nova-compute[72362]:   <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:18:53 user nova-compute[72362]:   <nova:ports>
Aug 09 10:18:53 user nova-compute[72362]:     <nova:port uuid="1efbc456-6c56-4367-845f-0afa8acdcec4">
Aug 09 10:18:53 user nova-compute[72362]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 10:18:53 user nova-compute[72362]:     </nova:port>
Aug 09 10:18:53 user nova-compute[72362]:   </nova:ports>
Aug 09 10:18:53 user nova-compute[72362]: </nova:instance>
Aug 09 10:18:53 user nova-compute[72362]:   </metadata>
Aug 09 10:18:53 user nova-compute[72362]:   <memory unit='KiB'>524288</memory>
Aug 09 10:18:53 user nova-compute[72362]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 09 10:18:53 user nova-compute[72362]:   <vcpu placement='static'>1</vcpu>
Aug 09 10:18:53 user nova-compute[72362]:   <resource>
Aug 09 10:18:53 user nova-compute[72362]:     <partition>/machine</partition>
Aug 09 10:18:53 user nova-compute[72362]:   </resource>
Aug 09 10:18:53 user nova-compute[72362]:   <sysinfo type='smbios'>
Aug 09 10:18:53 user nova-compute[72362]:     <system>
Aug 09 10:18:53 user nova-compute[72362]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 09 10:18:53 user nova-compute[72362]:       <entry name='product'>OpenStack Nova</entry>
Aug 09 10:18:53 user nova-compute[72362]:       <entry name='version'>0.0.0</entry>
Aug 09 10:18:53 user nova-compute[72362]:       <entry name='serial'>00af3d8e-bd93-4520-91e7-29c135c03e55</entry>
Aug 09 10:18:53 user nova-compute[72362]:       <entry name='uuid'>00af3d8e-bd93-4520-91e7-29c135c03e55</entry>
Aug 09 10:18:53 user nova-compute[72362]:       <entry name='family'>Virtual Machine</entry>
Aug 09 10:18:53 user nova-compute[72362]:     </system>
Aug 09 10:18:53 user nova-compute[72362]:   </sysinfo>
Aug 09 10:18:53 user nova-compute[72362]:   <os>
Aug 09 10:18:53 user nova-compute[72362]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 09 10:18:53 user nova-compute[72362]:     <boot dev='hd'/>
Aug 09 10:18:53 user nova-compute[72362]:     <smbios mode='sysinfo'/>
Aug 09 10:18:53 user nova-compute[72362]:   </os>
Aug 09 10:18:53 user nova-compute[72362]:   <features>
Aug 09 10:18:53 user nova-compute[72362]:     <acpi/>
Aug 09 10:18:53 user nova-compute[72362]:     <apic/>
Aug 09 10:18:53 user nova-compute[72362]:     <vmcoreinfo state='on'/>
Aug 09 10:18:53 user nova-compute[72362]:   </features>
Aug 09 10:18:53 user nova-compute[72362]:   <cpu mode='custom' match='exact' check='full'>
Aug 09 10:18:53 user nova-compute[72362]:     <model fallback='forbid'>Nehalem</model>
Aug 09 10:18:53 user nova-compute[72362]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 09 10:18:53 user nova-compute[72362]:     <feature policy='require' name='vme'/>
Aug 09 10:18:53 user nova-compute[72362]:     <feature policy='require' name='x2apic'/>
Aug 09 10:18:53 user nova-compute[72362]:     <feature policy='require' name='hypervisor'/>
Aug 09 10:18:53 user nova-compute[72362]:   </cpu>
Aug 09 10:18:53 user nova-compute[72362]:   <clock offset='utc'>
Aug 09 10:18:53 user nova-compute[72362]:     <timer name='pit' tickpolicy='delay'/>
Aug 09 10:18:53 user nova-compute[72362]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 09 10:18:53 user nova-compute[72362]:     <timer name='hpet' present='no'/>
Aug 09 10:18:53 user nova-compute[72362]:   </clock>
Aug 09 10:18:53 user nova-compute[72362]:   <on_poweroff>destroy</on_poweroff>
Aug 09 10:18:53 user nova-compute[72362]:   <on_reboot>restart</on_reboot>
Aug 09 10:18:53 user nova-compute[72362]:   <on_crash>destroy</on_crash>
Aug 09 10:18:53 user nova-compute[72362]:   <devices>
Aug 09 10:18:53 user nova-compute[72362]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 09 10:18:53 user nova-compute[72362]:     <disk type='file' device='disk'>
Aug 09 10:18:53 user nova-compute[72362]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 09 10:18:53 user nova-compute[72362]:       <source file='/opt/stack/data/nova/instances/00af3d8e-bd93-4520-91e7-29c135c03e55/disk' index='2'/>
Aug 09 10:18:53 user nova-compute[72362]:       <backingStore type='file' index='3'>
Aug 09 10:18:53 user nova-compute[72362]:         <format type='raw'/>
Aug 09 10:18:53 user nova-compute[72362]:         <source file='/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4'/>
Aug 09 10:18:53 user nova-compute[72362]:         <backingStore/>
Aug 09 10:18:53 user nova-compute[72362]:       </backingStore>
Aug 09 10:18:53 user nova-compute[72362]:       <target dev='vda' bus='virtio'/>
Aug 09 10:18:53 user nova-compute[72362]:       <alias name='virtio-disk0'/>
Aug 09 10:18:53 user nova-compute[72362]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 09 10:18:53 user nova-compute[72362]:     </disk>
Aug 09 10:18:53 user nova-compute[72362]:     <disk type='file' device='cdrom'>
Aug 09 10:18:53 user nova-compute[72362]:       <driver name='qemu' type='raw' cache='none'/>
Aug 09 10:18:53 user nova-compute[72362]:       <source file='/opt/stack/data/nova/instances/00af3d8e-bd93-4520-91e7-29c135c03e55/disk.config' index='1'/>
Aug 09 10:18:53 user nova-compute[72362]:       <backingStore/>
Aug 09 10:18:53 user nova-compute[72362]:       <target dev='hda' bus='ide'/>
Aug 09 10:18:53 user nova-compute[72362]:       <readonly/>
Aug 09 10:18:53 user nova-compute[72362]:       <alias name='ide0-0-0'/>
Aug 09 10:18:53 user nova-compute[72362]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 09 10:18:53 user nova-compute[72362]:     </disk>
Aug 09 10:18:53 user nova-compute[72362]:     <controller type='usb' index='0' model='none'>
Aug 09 10:18:53 user nova-compute[72362]:       <alias name='usb'/>
Aug 09 10:18:53 user nova-compute[72362]:     </controller>
Aug 09 10:18:53 user nova-compute[72362]:     <controller type='pci' index='0' model='pci-root'>
Aug 09 10:18:53 user nova-compute[72362]:       <alias name='pci.0'/>
Aug 09 10:18:53 user nova-compute[72362]:     </controller>
Aug 09 10:18:53 user nova-compute[72362]:     <controller type='ide' index='0'>
Aug 09 10:18:53 user nova-compute[72362]:       <alias name='ide'/>
Aug 09 10:18:53 user nova-compute[72362]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 09 10:18:53 user nova-compute[72362]:     </controller>
Aug 09 10:18:53 user nova-compute[72362]:     <interface type='ethernet'>
Aug 09 10:18:53 user nova-compute[72362]:       <mac address='fa:16:3e:76:bd:21'/>
Aug 09 10:18:53 user nova-compute[72362]:       <target dev='tap1efbc456-6c'/>
Aug 09 10:18:53 user nova-compute[72362]:       <model type='virtio'/>
Aug 09 10:18:53 user nova-compute[72362]:       <mtu size='1442'/>
Aug 09 10:18:53 user nova-compute[72362]:       <alias name='net0'/>
Aug 09 10:18:53 user nova-compute[72362]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 09 10:18:53 user nova-compute[72362]:     </interface>
Aug 09 10:18:53 user nova-compute[72362]:     <serial type='pty'>
Aug 09 10:18:53 user nova-compute[72362]:       <source path='/dev/pts/7'/>
Aug 09 10:18:53 user nova-compute[72362]:       <log file='/opt/stack/data/nova/instances/00af3d8e-bd93-4520-91e7-29c135c03e55/console.log' append='off'/>
Aug 09 10:18:53 user nova-compute[72362]:       <target type='isa-serial' port='0'>
Aug 09 10:18:53 user nova-compute[72362]:         <model name='isa-serial'/>
Aug 09 10:18:53 user nova-compute[72362]:       </target>
Aug 09 10:18:53 user nova-compute[72362]:       <alias name='serial0'/>
Aug 09 10:18:53 user nova-compute[72362]:     </serial>
Aug 09 10:18:53 user nova-compute[72362]:     <console type='pty' tty='/dev/pts/7'>
Aug 09 10:18:53 user nova-compute[72362]:       <source path='/dev/pts/7'/>
Aug 09 10:18:53 user nova-compute[72362]:       <log file='/opt/stack/data/nova/instances/00af3d8e-bd93-4520-91e7-29c135c03e55/console.log' append='off'/>
Aug 09 10:18:53 user nova-compute[72362]:       <target type='serial' port='0'/>
Aug 09 10:18:53 user nova-compute[72362]:       <alias name='serial0'/>
Aug 09 10:18:53 user nova-compute[72362]:     </console>
Aug 09 10:18:53 user nova-compute[72362]:     <input type='mouse' bus='ps2'>
Aug 09 10:18:53 user nova-compute[72362]:       <alias name='input0'/>
Aug 09 10:18:53 user nova-compute[72362]:     </input>
Aug 09 10:18:53 user nova-compute[72362]:     <input type='keyboard' bus='ps2'>
Aug 09 10:18:53 user nova-compute[72362]:       <alias name='input1'/>
Aug 09 10:18:53 user nova-compute[72362]:     </input>
Aug 09 10:18:53 user nova-compute[72362]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Aug 09 10:18:53 user nova-compute[72362]:       <listen type='address' address='0.0.0.0'/>
Aug 09 10:18:53 user nova-compute[72362]:     </graphics>
Aug 09 10:18:53 user nova-compute[72362]:     <audio id='1' type='none'/>
Aug 09 10:18:53 user nova-compute[72362]:     <video>
Aug 09 10:18:53 user nova-compute[72362]:       <model type='virtio' heads='1' primary='yes'/>
Aug 09 10:18:53 user nova-compute[72362]:       <alias name='video0'/>
Aug 09 10:18:53 user nova-compute[72362]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 09 10:18:53 user nova-compute[72362]:     </video>
Aug 09 10:18:53 user nova-compute[72362]:     <memballoon model='virtio'>
Aug 09 10:18:53 user nova-compute[72362]:       <stats period='10'/>
Aug 09 10:18:53 user nova-compute[72362]:       <alias name='balloon0'/>
Aug 09 10:18:53 user nova-compute[72362]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 09 10:18:53 user nova-compute[72362]:     </memballoon>
Aug 09 10:18:53 user nova-compute[72362]:     <rng model='virtio'>
Aug 09 10:18:53 user nova-compute[72362]:       <backend model='random'>/dev/urandom</backend>
Aug 09 10:18:53 user nova-compute[72362]:       <alias name='rng0'/>
Aug 09 10:18:53 user nova-compute[72362]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 09 10:18:53 user nova-compute[72362]:     </rng>
Aug 09 10:18:53 user nova-compute[72362]:   </devices>
Aug 09 10:18:53 user nova-compute[72362]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 09 10:18:53 user nova-compute[72362]:     <label>libvirt-00af3d8e-bd93-4520-91e7-29c135c03e55</label>
Aug 09 10:18:53 user nova-compute[72362]:     <imagelabel>libvirt-00af3d8e-bd93-4520-91e7-29c135c03e55</imagelabel>
Aug 09 10:18:53 user nova-compute[72362]:   </seclabel>
Aug 09 10:18:53 user nova-compute[72362]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 09 10:18:53 user nova-compute[72362]:     <label>+64055:+108</label>
Aug 09 10:18:53 user nova-compute[72362]:     <imagelabel>+64055:+108</imagelabel>
Aug 09 10:18:53 user nova-compute[72362]:   </seclabel>
Aug 09 10:18:53 user nova-compute[72362]: </domain>
Aug 09 10:18:53 user nova-compute[72362]:  {{(pid=72362) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 09 10:18:53 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [req-36acc28b-fe70-4a09-9fb9-e2df5c6e23be req-7b219ac5-9fea-4764-99a9-357405ada1c6 service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Detaching interface fa:16:3e:f6:7f:94 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap8c232e74-77' not found.
Aug 09 10:18:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [req-36acc28b-fe70-4a09-9fb9-e2df5c6e23be req-7b219ac5-9fea-4764-99a9-357405ada1c6 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:16:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1129807899',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1129807899',id=7,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKTy1BEGFgb2LwPCE0l4ZdsIb1CDE+2z5XZX+3IOS7BmpUspCkv8nslwIBX+XdLBElH9a7nR/A5XVOfQJoXDwudCeZ0lpAUFsL0E9TcfQKbmNmV+/CzT9enkfH7jf9KfQ==',key_name='tempest-keypair-426982747',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:16:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a68b4a52019441480a19783a89e0af8',ramdisk_id='',reservation_id='r-80xqf6s8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-202820908',owner_user_name='tempest-TaggedAttachmentsTest-202820908-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:16:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5dd4d0e5c03744569a542098432622d7',uuid=00af3d8e-bd93-4520-91e7-29c135c03e55,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c232e74-771d-40b3-8f0c-abdef770aafd", "address": "fa:16:3e:f6:7f:94", "network": {"id": "20844264-ffb2-45b0-b420-8783270cc7f5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1034730248", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7a68b4a52019441480a19783a89e0af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c232e74-77", "ovs_interfaceid": "8c232e74-771d-40b3-8f0c-abdef770aafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:18:53 user nova-compute[72362]: DEBUG nova.network.os_vif_util [req-36acc28b-fe70-4a09-9fb9-e2df5c6e23be req-7b219ac5-9fea-4764-99a9-357405ada1c6 service nova] Converting VIF {"id": "8c232e74-771d-40b3-8f0c-abdef770aafd", "address": "fa:16:3e:f6:7f:94", "network": {"id": "20844264-ffb2-45b0-b420-8783270cc7f5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1034730248", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7a68b4a52019441480a19783a89e0af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c232e74-77", "ovs_interfaceid": "8c232e74-771d-40b3-8f0c-abdef770aafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:18:53 user nova-compute[72362]: DEBUG nova.network.os_vif_util [req-36acc28b-fe70-4a09-9fb9-e2df5c6e23be req-7b219ac5-9fea-4764-99a9-357405ada1c6 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:7f:94,bridge_name='br-int',has_traffic_filtering=True,id=8c232e74-771d-40b3-8f0c-abdef770aafd,network=Network(20844264-ffb2-45b0-b420-8783270cc7f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c232e74-77') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:18:53 user nova-compute[72362]: DEBUG os_vif [req-36acc28b-fe70-4a09-9fb9-e2df5c6e23be req-7b219ac5-9fea-4764-99a9-357405ada1c6 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:7f:94,bridge_name='br-int',has_traffic_filtering=True,id=8c232e74-771d-40b3-8f0c-abdef770aafd,network=Network(20844264-ffb2-45b0-b420-8783270cc7f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c232e74-77') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:18:53 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:53 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c232e74-77, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:18:53 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:18:53 user nova-compute[72362]: INFO os_vif [req-36acc28b-fe70-4a09-9fb9-e2df5c6e23be req-7b219ac5-9fea-4764-99a9-357405ada1c6 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:7f:94,bridge_name='br-int',has_traffic_filtering=True,id=8c232e74-771d-40b3-8f0c-abdef770aafd,network=Network(20844264-ffb2-45b0-b420-8783270cc7f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c232e74-77')
Aug 09 10:18:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [req-36acc28b-fe70-4a09-9fb9-e2df5c6e23be req-7b219ac5-9fea-4764-99a9-357405ada1c6 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:18:53 user nova-compute[72362]:   <nova:package version="0.0.0"/>
Aug 09 10:18:53 user nova-compute[72362]:   <nova:name>tempest-device-tagging-server-1129807899</nova:name>
Aug 09 10:18:53 user nova-compute[72362]:   <nova:creationTime>2023-08-09 10:18:53</nova:creationTime>
Aug 09 10:18:53 user nova-compute[72362]:   <nova:flavor name="m1.tiny">
Aug 09 10:18:53 user nova-compute[72362]:     <nova:memory>512</nova:memory>
Aug 09 10:18:53 user nova-compute[72362]:     <nova:disk>1</nova:disk>
Aug 09 10:18:53 user nova-compute[72362]:     <nova:swap>0</nova:swap>
Aug 09 10:18:53 user nova-compute[72362]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:18:53 user nova-compute[72362]:     <nova:vcpus>1</nova:vcpus>
Aug 09 10:18:53 user nova-compute[72362]:   </nova:flavor>
Aug 09 10:18:53 user nova-compute[72362]:   <nova:owner>
Aug 09 10:18:53 user nova-compute[72362]:     <nova:user uuid="5dd4d0e5c03744569a542098432622d7">tempest-TaggedAttachmentsTest-202820908-project-member</nova:user>
Aug 09 10:18:53 user nova-compute[72362]:     <nova:project uuid="7a68b4a52019441480a19783a89e0af8">tempest-TaggedAttachmentsTest-202820908</nova:project>
Aug 09 10:18:53 user nova-compute[72362]:   </nova:owner>
Aug 09 10:18:53 user nova-compute[72362]:   <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:18:53 user nova-compute[72362]:   <nova:ports>
Aug 09 10:18:53 user nova-compute[72362]:     <nova:port uuid="1efbc456-6c56-4367-845f-0afa8acdcec4">
Aug 09 10:18:53 user nova-compute[72362]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 10:18:53 user nova-compute[72362]:     </nova:port>
Aug 09 10:18:53 user nova-compute[72362]:   </nova:ports>
Aug 09 10:18:53 user nova-compute[72362]: </nova:instance>
Aug 09 10:18:53 user nova-compute[72362]:  {{(pid=72362) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 09 10:18:53 user nova-compute[72362]: DEBUG nova.compute.manager [req-9b68ac5c-b971-469d-b119-62aaac427478 req-4dd443cd-1031-4986-8c47-31e1329a8287 service nova] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Received event network-vif-deleted-d1a1302a-fe35-4d60-b89c-b5ef5f0dee76 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:18:53 user nova-compute[72362]: DEBUG nova.network.neutron [None req-f45baf25-20d7-44c5-b145-8bb8a6d50fff tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Updating instance_info_cache with network_info: [{"id": "1efbc456-6c56-4367-845f-0afa8acdcec4", "address": "fa:16:3e:76:bd:21", "network": {"id": "1eaf9aa3-1d74-424c-86c6-28096cf53571", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-621134432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a68b4a52019441480a19783a89e0af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1efbc456-6c", "ovs_interfaceid": "1efbc456-6c56-4367-845f-0afa8acdcec4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:18:53 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f45baf25-20d7-44c5-b145-8bb8a6d50fff tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Releasing lock "refresh_cache-00af3d8e-bd93-4520-91e7-29c135c03e55" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:18:53 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:18:53 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 10:18:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f45baf25-20d7-44c5-b145-8bb8a6d50fff tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Lock "interface-00af3d8e-bd93-4520-91e7-29c135c03e55-8c232e74-771d-40b3-8f0c-abdef770aafd" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.033s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:18:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "refresh_cache-ca002e73-ddf7-4452-82b6-0d831d984756" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:18:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquired lock "refresh_cache-ca002e73-ddf7-4452-82b6-0d831d984756" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:18:54 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Forcefully refreshing network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 10:18:54 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Updating instance_info_cache with network_info: [{"id": "7ce03c91-ff2d-4735-bc98-088dc96293d0", "address": "fa:16:3e:57:3a:02", "network": {"id": "f6bb574e-dc90-445b-b678-6e7d825a8437", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-198645654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d000751b939e4805abb861b91d698b6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce03c91-ff", "ovs_interfaceid": "7ce03c91-ff2d-4735-bc98-088dc96293d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:18:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Releasing lock "refresh_cache-ca002e73-ddf7-4452-82b6-0d831d984756" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:18:54 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Updated the network info_cache for instance {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 10:18:54 user nova-compute[72362]: DEBUG nova.compute.manager [req-a701149c-39d2-4942-a25e-f3949907933f req-506dafbe-1b7d-4328-95c5-566988a1b4a8 service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Received event network-vif-plugged-8c232e74-771d-40b3-8f0c-abdef770aafd {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:18:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-a701149c-39d2-4942-a25e-f3949907933f req-506dafbe-1b7d-4328-95c5-566988a1b4a8 service nova] Acquiring lock "00af3d8e-bd93-4520-91e7-29c135c03e55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:18:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-a701149c-39d2-4942-a25e-f3949907933f req-506dafbe-1b7d-4328-95c5-566988a1b4a8 service nova] Lock "00af3d8e-bd93-4520-91e7-29c135c03e55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:18:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-a701149c-39d2-4942-a25e-f3949907933f req-506dafbe-1b7d-4328-95c5-566988a1b4a8 service nova] Lock "00af3d8e-bd93-4520-91e7-29c135c03e55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:18:54 user nova-compute[72362]: DEBUG nova.compute.manager [req-a701149c-39d2-4942-a25e-f3949907933f req-506dafbe-1b7d-4328-95c5-566988a1b4a8 service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] No waiting events found dispatching network-vif-plugged-8c232e74-771d-40b3-8f0c-abdef770aafd {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:18:54 user nova-compute[72362]: WARNING nova.compute.manager [req-a701149c-39d2-4942-a25e-f3949907933f req-506dafbe-1b7d-4328-95c5-566988a1b4a8 service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Received unexpected event network-vif-plugged-8c232e74-771d-40b3-8f0c-abdef770aafd for instance with vm_state active and task_state None.
Aug 09 10:18:54 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:18:54 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:18:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:18:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:18:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:18:55 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 10:18:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00af3d8e-bd93-4520-91e7-29c135c03e55/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00af3d8e-bd93-4520-91e7-29c135c03e55/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00af3d8e-bd93-4520-91e7-29c135c03e55/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00af3d8e-bd93-4520-91e7-29c135c03e55/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca002e73-ddf7-4452-82b6-0d831d984756/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca002e73-ddf7-4452-82b6-0d831d984756/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca002e73-ddf7-4452-82b6-0d831d984756/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:55 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca002e73-ddf7-4452-82b6-0d831d984756/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f0c62c9-aa84-4a5b-b909-af5535e87c83/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f0c62c9-aa84-4a5b-b909-af5535e87c83/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f0c62c9-aa84-4a5b-b909-af5535e87c83/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f0c62c9-aa84-4a5b-b909-af5535e87c83/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b17b317a-409e-45ad-ac7c-0c298f4f564b/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b17b317a-409e-45ad-ac7c-0c298f4f564b/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b17b317a-409e-45ad-ac7c-0c298f4f564b/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b17b317a-409e-45ad-ac7c-0c298f4f564b/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:56 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:18:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea95226c-40fe-4408-a9f0-5538659261a6/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea95226c-40fe-4408-a9f0-5538659261a6/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea95226c-40fe-4408-a9f0-5538659261a6/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea95226c-40fe-4408-a9f0-5538659261a6/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93faa4d2-324e-4373-9706-99ef83cd6f9d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93faa4d2-324e-4373-9706-99ef83cd6f9d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93faa4d2-324e-4373-9706-99ef83cd6f9d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:57 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93faa4d2-324e-4373-9706-99ef83cd6f9d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:57 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:57 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:57 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:57 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:57 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b731e53-3436-44d2-b674-841871804c80/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:18:57 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b731e53-3436-44d2-b674-841871804c80/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:57 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b731e53-3436-44d2-b674-841871804c80/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:57 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b731e53-3436-44d2-b674-841871804c80/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:58 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:18:58 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:18:58 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=7592MB free_disk=25.461349487304688GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 10:18:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:18:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:18:58 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 0e8a7668-1635-4cbc-8c09-ece19ff67d4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:18:58 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance ca002e73-ddf7-4452-82b6-0d831d984756 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:18:58 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance ea95226c-40fe-4408-a9f0-5538659261a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:18:58 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 8f0c62c9-aa84-4a5b-b909-af5535e87c83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:18:58 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance b17b317a-409e-45ad-ac7c-0c298f4f564b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:18:58 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 00af3d8e-bd93-4520-91e7-29c135c03e55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:18:58 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 93faa4d2-324e-4373-9706-99ef83cd6f9d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:18:58 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 9b731e53-3436-44d2-b674-841871804c80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:18:58 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 10:18:58 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 10:18:58 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:18:58 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:18:58 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 10:18:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.424s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG nova.compute.manager [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qEnGvXdt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b17b317a-409e-45ad-ac7c-0c298f4f564b', 'attached_at': '', 'detached_at': '', 'volume_id': '85bc12a2-e20a-44af-919e-746a6239532d', 'serial': '85bc12a2-e20a-44af-919e-746a6239532d'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OxChRspE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': '54f624f3-1ddb-4904-b1e5-11d5811883fa'}, 'status': 'reserved', 'instance': 'b17b317a-409e-45ad-ac7c-0c298f4f564b', 'attached_at': '', 'detached_at': '', 'volume_id': '54f624f3-1ddb-4904-b1e5-11d5811883fa', 'serial'} {{(pid=72362) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qEnGvXdt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:18:59 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:18:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:18:59 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:18:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:18:59 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:18:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65d554d-a5cd-40a2-8038-599900e6d8dc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:18:59 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d32854c-3b13-40da-8483-f13a24b1f141]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d] added
Aug 09 10:18:59 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23c6fec-5fcc-4cec-91f6-62132f6658fa]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb357b0-6223-4984-8d56-4a62a749a60a]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qEnGvXdt {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qEnGvXdt" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa95713e-2fb3-480e-8611-248197990f8c]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qEnGvXdt'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e191a2-e205-4d0a-9188-0bcec4a6c104]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2a6417-21ed-4342-b68f-3aee37cab304]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa (non-flash)
Aug 09 10:18:59 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa (non-flash)
Aug 09 10:18:59 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e423f27-4db6-4aeb-a821-c3ab6c62786e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d, portal: 172.16.0.220,3260]
Aug 09 10:18:59 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d, portal: 172.16.0.220,3260] successful.
Aug 09 10:18:59 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[94af21aa-72c6-4973-a97d-0fe1f4c902bf]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1402a92-2aa0-4284-9a91-786115574d76]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa (non-flash)
Aug 09 10:18:59 user nova-compute[72362]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)
Aug 09 10:18:59 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa (non-flash)
Aug 09 10:18:59 user nova-compute[72362]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)
Aug 09 10:18:59 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.244s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] HCTL ('33', '-', '-', 0) found on session 9 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[175b2be0-67ed-43a3-8e1e-045bf6b5f703]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:18:59 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Searching for a device in session 9 and hctl ['33', '*', '*', 0] yield: None {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:19:00 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Searching for a device in session 9 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:19:00 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qEnGvXdt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:19:00 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.275s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:19:00 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] <== connect_volume: return (1276ms) {'type': 'block', 'scsi_wwn': '26233333236306364', 'path': '/dev/sdb'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:19:00 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233333236306364', 'path': '/dev/sdb'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:19:00 user nova-compute[72362]: DEBUG nova.objects.instance [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Lazy-loading 'flavor' on Instance uuid b17b317a-409e-45ad-ac7c-0c298f4f564b {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:19:00 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=72362) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 10:19:01 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] COPY block job progress, current cursor: 164626432 final cursor: 1073741824 {{(pid=72362) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 10:19:01 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] COPY block job progress, current cursor: 349175808 final cursor: 1073741824 {{(pid=72362) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 10:19:02 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] COPY block job progress, current cursor: 537919488 final cursor: 1073741824 {{(pid=72362) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 10:19:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:19:02 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] COPY block job progress, current cursor: 717225984 final cursor: 1073741824 {{(pid=72362) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 10:19:03 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691576328.033133, 1cde3780-2215-4966-86a4-82aae151b022 => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:19:03 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 1cde3780-2215-4966-86a4-82aae151b022] VM Stopped (Lifecycle Event)
Aug 09 10:19:03 user nova-compute[72362]: DEBUG nova.compute.manager [None req-c2dbc340-1add-409b-974d-5bed0ab2c645 None None] [instance: 1cde3780-2215-4966-86a4-82aae151b022] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:19:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] COPY block job progress, current cursor: 889192448 final cursor: 1073741824 {{(pid=72362) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 10:19:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] COPY block job progress, current cursor: 1065353216 final cursor: 1073741824 {{(pid=72362) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 10:19:04 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72362) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 10:19:04 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:19:04 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OxChRspE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': '54f624f3-1ddb-4904-b1e5-11d5811883fa'}, None), 'kwargs': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:19:04 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:19:04 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:19:04 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:19:04 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:19:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:04 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa1ab3f-dfa7-4b4b-a928-11d44f4bd9f3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:19:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:04 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a7a70f-1aba-4888-9782-29945909105e]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:19:04 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa (non-flash)
Aug 09 10:19:04 user nova-compute[72362]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)
Aug 09 10:19:04 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:19:04 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa (non-flash)
Aug 09 10:19:04 user nova-compute[72362]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)
Aug 09 10:19:04 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:19:04 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e424fc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa'): ({'sdc'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:19:04 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Removing single pathed devices sdc {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:19:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:04 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e48408-a88e-481c-a780-40c2a41bdbc5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:19:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:04 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f235f4-50ec-4a57-8303-645f44c7baeb]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:19:04 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Flushing IO for device /dev/sdc {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:19:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:04 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[8167b951-e3af-43f0-bd09-06a3f5f82c26]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:19:04 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:19:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:04 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[56be0cc1-336c-4de6-b331-caaee84f44d1]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:19:04 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Checking to see if SCSI volumes sdc have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:19:04 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] SCSI volumes sdc have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:19:04 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:19:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:04 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9bf94c-4a00-493e-9aa5-2a27bd8e27e2]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:19:04 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:19:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:04 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e772f7c4-85cb-4258-8763-ef78a3f41254]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:19:04 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa, portal: 172.16.0.220,3260]
Aug 09 10:19:04 user nova-compute[72362]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa, portal: 172.16.0.220,3260] successful.
Aug 09 10:19:04 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:19:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f624f3-1ddb-4904-b1e5-11d5811883fa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:04 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8dd65bd-8298-4dfa-be97-58dd75fd6e1b]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:19:04 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:19:04 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:19:04 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] <== disconnect_volume: return (276ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:19:04 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:19:04 user nova-compute[72362]: DEBUG nova.compute.manager [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qEnGvXdt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'b17b317a-409e-45ad-ac7c-0c298f4f564b', 'attached_at': '', 'detached_at': '', 'volume_id': '85bc12a2-e20a-44af-919e-746a6239532d', 'serial'} {{(pid=72362) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 09 10:19:04 user nova-compute[72362]: DEBUG nova.compute.manager [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] swap_volume: removing Cinder connection for volume 54f624f3-1ddb-4904-b1e5-11d5811883fa {{(pid=72362) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 09 10:19:05 user nova-compute[72362]: DEBUG nova.compute.manager [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] swap_volume: Updating volume 54f624f3-1ddb-4904-b1e5-11d5811883fa BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "qEnGvXdt", "auth_password": "sA2cLOTwPi7r4Y", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "85bc12a2-e20a-44af-919e-746a6239532d"}, "status": "reserved", "instance": "b17b317a-409e-45ad-ac7c-0c298f4f564b", "attached_at": "", "detached_at": "", "volume_id": "85bc12a2-e20a-44af-919e-746a6239532d", "serial": "85bc12a2-e20a-44af-919e-746a6239532d"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '85bc12a2-e20a-44af-919e-746a6239532d', 'no_device': None, 'attachment_id': '3fdc230d-2445-4277-8d0a-e05847c99498'} {{(pid=72362) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 09 10:19:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6bca20b3-b977-4b1b-baae-90c9c72cfcaa tempest-TestVolumeSwap-1913703198 tempest-TestVolumeSwap-1913703198-project-admin] Lock "b17b317a-409e-45ad-ac7c-0c298f4f564b" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 16.176s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:19:06 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691576331.3656526, 9f2bc700-2e69-406f-9a13-52396eae4258 => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:19:06 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] VM Stopped (Lifecycle Event)
Aug 09 10:19:06 user nova-compute[72362]: DEBUG nova.compute.manager [None req-95b4116c-58c6-4d00-b71d-1d6de948ef9e None None] [instance: 9f2bc700-2e69-406f-9a13-52396eae4258] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:19:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a2a8ae00-5f23-4a16-9d38-27d597a2594f tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Acquiring lock "b17b317a-409e-45ad-ac7c-0c298f4f564b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:19:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a2a8ae00-5f23-4a16-9d38-27d597a2594f tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Lock "b17b317a-409e-45ad-ac7c-0c298f4f564b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:19:07 user nova-compute[72362]: INFO nova.compute.manager [None req-a2a8ae00-5f23-4a16-9d38-27d597a2594f tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Detaching volume 85bc12a2-e20a-44af-919e-746a6239532d
Aug 09 10:19:07 user nova-compute[72362]: INFO nova.virt.block_device [None req-a2a8ae00-5f23-4a16-9d38-27d597a2594f tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Attempting to driver detach volume 85bc12a2-e20a-44af-919e-746a6239532d from mountpoint /dev/vdb
Aug 09 10:19:07 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-a2a8ae00-5f23-4a16-9d38-27d597a2594f tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Attempting to detach device vdb from instance b17b317a-409e-45ad-ac7c-0c298f4f564b from the persistent domain config. {{(pid=72362) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 10:19:07 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-a2a8ae00-5f23-4a16-9d38-27d597a2594f tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 10:19:07 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:19:07 user nova-compute[72362]:   <source dev="/dev/sdb"/>
Aug 09 10:19:07 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:19:07 user nova-compute[72362]:   <serial>85bc12a2-e20a-44af-919e-746a6239532d</serial>
Aug 09 10:19:07 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 10:19:07 user nova-compute[72362]: </disk>
Aug 09 10:19:07 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:19:07 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-a2a8ae00-5f23-4a16-9d38-27d597a2594f tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Successfully detached device vdb from instance b17b317a-409e-45ad-ac7c-0c298f4f564b from the persistent domain config.
Aug 09 10:19:07 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-a2a8ae00-5f23-4a16-9d38-27d597a2594f tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b17b317a-409e-45ad-ac7c-0c298f4f564b from the live domain config. {{(pid=72362) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 10:19:07 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-a2a8ae00-5f23-4a16-9d38-27d597a2594f tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 10:19:07 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:19:07 user nova-compute[72362]:   <source dev="/dev/sdb"/>
Aug 09 10:19:07 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:19:07 user nova-compute[72362]:   <serial>85bc12a2-e20a-44af-919e-746a6239532d</serial>
Aug 09 10:19:07 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 10:19:07 user nova-compute[72362]: </disk>
Aug 09 10:19:07 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:19:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:07 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Received event <DeviceRemovedEvent: 1691576347.5558496, b17b317a-409e-45ad-ac7c-0c298f4f564b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72362) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 10:19:07 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-a2a8ae00-5f23-4a16-9d38-27d597a2594f tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b17b317a-409e-45ad-ac7c-0c298f4f564b {{(pid=72362) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 10:19:07 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-a2a8ae00-5f23-4a16-9d38-27d597a2594f tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Successfully detached device vdb from instance b17b317a-409e-45ad-ac7c-0c298f4f564b from the live domain config.
Aug 09 10:19:07 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2a8ae00-5f23-4a16-9d38-27d597a2594f tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:19:07 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a8ae00-5f23-4a16-9d38-27d597a2594f tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qEnGvXdt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '85bc12a2-e20a-44af-919e-746a6239532d'}, None), 'kwargs': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:19:07 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-a2a8ae00-5f23-4a16-9d38-27d597a2594f tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:19:07 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-a2a8ae00-5f23-4a16-9d38-27d597a2594f tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:19:07 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-a2a8ae00-5f23-4a16-9d38-27d597a2594f tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:19:07 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a8ae00-5f23-4a16-9d38-27d597a2594f tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:19:07 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:07 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:07 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c5cf02-3415-4255-af06-10fdadef693e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:19:07 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:07 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:07 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc1b093-2c90-4652-bf59-b820474a73fc]: (4, ('tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:19:07 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a8ae00-5f23-4a16-9d38-27d597a2594f tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)
Aug 09 10:19:07 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:19:07 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a8ae00-5f23-4a16-9d38-27d597a2594f tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] iscsi session list stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d (non-flash)
Aug 09 10:19:07 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:19:07 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a8ae00-5f23-4a16-9d38-27d597a2594f tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e4462b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d'): ({'sdb'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:19:07 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-a2a8ae00-5f23-4a16-9d38-27d597a2594f tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Removing single pathed devices sdb {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:19:07 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:07 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:07 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[2745ca20-33bb-43b3-b027-0897570d9cb6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:19:07 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:07 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:07 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad25a7cc-f62a-4300-86f8-4cb1dd6ef1ce]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:19:07 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-a2a8ae00-5f23-4a16-9d38-27d597a2594f tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Flushing IO for device /dev/sdb {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:19:07 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:07 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:07 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d739b33-7c88-4a9a-b28c-1d1bedb99442]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:19:07 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-a2a8ae00-5f23-4a16-9d38-27d597a2594f tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:19:07 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:07 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:07 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[1589a0e3-8af9-4c4d-9477-fdb052d97a8e]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:19:07 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-a2a8ae00-5f23-4a16-9d38-27d597a2594f tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:19:07 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-a2a8ae00-5f23-4a16-9d38-27d597a2594f tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] SCSI volumes sdb have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:19:07 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a8ae00-5f23-4a16-9d38-27d597a2594f tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:19:07 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:07 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:07 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[00864a48-42bb-48f8-8ebb-bba08ba364c6]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:19:07 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a8ae00-5f23-4a16-9d38-27d597a2594f tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:19:07 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:07 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:07 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4625335-df80-4d0c-883c-7b127f9d6fe0]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:19:07 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a8ae00-5f23-4a16-9d38-27d597a2594f tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d, portal: 172.16.0.220,3260]
Aug 09 10:19:07 user nova-compute[72362]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d, portal: 172.16.0.220,3260] successful.
Aug 09 10:19:07 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:19:07 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:07 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85bc12a2-e20a-44af-919e-746a6239532d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:07 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[453e98b0-451f-4627-b6b6-e631f583c04d]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:19:07 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a8ae00-5f23-4a16-9d38-27d597a2594f tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:19:07 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-a2a8ae00-5f23-4a16-9d38-27d597a2594f tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.244s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:19:07 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a8ae00-5f23-4a16-9d38-27d597a2594f tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] <== disconnect_volume: return (245ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:19:07 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2a8ae00-5f23-4a16-9d38-27d597a2594f tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:19:08 user nova-compute[72362]: DEBUG nova.objects.instance [None req-a2a8ae00-5f23-4a16-9d38-27d597a2594f tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Lazy-loading 'flavor' on Instance uuid b17b317a-409e-45ad-ac7c-0c298f4f564b {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:19:08 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a2a8ae00-5f23-4a16-9d38-27d597a2594f tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Lock "b17b317a-409e-45ad-ac7c-0c298f4f564b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.587s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:19:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:19:13 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:17 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:19 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquiring lock "8e055c58-a365-4f18-a6e3-377e32e2189d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:19:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "8e055c58-a365-4f18-a6e3-377e32e2189d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:19:24 user nova-compute[72362]: DEBUG nova.compute.manager [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Starting instance... {{(pid=72362) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 10:19:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:19:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:19:24 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:19:24 user nova-compute[72362]: INFO nova.compute.claims [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Claim successful on node user
Aug 09 10:19:24 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:19:24 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:19:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.390s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:19:24 user nova-compute[72362]: DEBUG nova.compute.manager [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Start building networks asynchronously for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 10:19:24 user nova-compute[72362]: DEBUG nova.compute.manager [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Allocating IP information in the background. {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 10:19:24 user nova-compute[72362]: DEBUG nova.network.neutron [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] allocate_for_instance() {{(pid=72362) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 10:19:24 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 10:19:24 user nova-compute[72362]: DEBUG nova.compute.manager [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Start building block device mappings for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 10:19:24 user nova-compute[72362]: DEBUG nova.policy [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4a1904ffd10b4e8b959971b5e2383113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f206cedc59df46deb91e7ec2167c1f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72362) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 10:19:24 user nova-compute[72362]: DEBUG nova.compute.manager [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Start spawning the instance on the hypervisor. {{(pid=72362) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 10:19:24 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:19:24 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Creating image(s)
Aug 09 10:19:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquiring lock "/opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:19:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "/opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:19:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "/opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:19:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.139s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquiring lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:19:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:19:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.129s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk 1073741824 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk 1073741824" returned: 0 in 0.059s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:19:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.129s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:25 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk. size=1073741824 {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 10:19:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:25 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Cannot resize image /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk to a smaller size. {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 10:19:25 user nova-compute[72362]: DEBUG nova.objects.instance [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lazy-loading 'migration_context' on Instance uuid 8e055c58-a365-4f18-a6e3-377e32e2189d {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:19:25 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Created local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 10:19:25 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Ensure instance console log exists: /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:19:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:19:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:19:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:19:25 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:25 user nova-compute[72362]: DEBUG nova.network.neutron [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Successfully created port: f1a870b6-1d3b-4567-b165-8f2571edf9bd {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:19:26 user nova-compute[72362]: DEBUG nova.network.neutron [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Successfully updated port: f1a870b6-1d3b-4567-b165-8f2571edf9bd {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:19:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquiring lock "refresh_cache-8e055c58-a365-4f18-a6e3-377e32e2189d" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:19:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquired lock "refresh_cache-8e055c58-a365-4f18-a6e3-377e32e2189d" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:19:26 user nova-compute[72362]: DEBUG nova.network.neutron [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:19:26 user nova-compute[72362]: DEBUG nova.compute.manager [req-24c5f42b-c6a8-4527-9801-a74b57cd72cf req-b35470eb-9d07-48f7-9705-015c32ac9cc1 service nova] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Received event network-changed-f1a870b6-1d3b-4567-b165-8f2571edf9bd {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:19:26 user nova-compute[72362]: DEBUG nova.compute.manager [req-24c5f42b-c6a8-4527-9801-a74b57cd72cf req-b35470eb-9d07-48f7-9705-015c32ac9cc1 service nova] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Refreshing instance network info cache due to event network-changed-f1a870b6-1d3b-4567-b165-8f2571edf9bd. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:19:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-24c5f42b-c6a8-4527-9801-a74b57cd72cf req-b35470eb-9d07-48f7-9705-015c32ac9cc1 service nova] Acquiring lock "refresh_cache-8e055c58-a365-4f18-a6e3-377e32e2189d" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:19:26 user nova-compute[72362]: DEBUG nova.network.neutron [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:19:27 user nova-compute[72362]: DEBUG nova.network.neutron [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Updating instance_info_cache with network_info: [{"id": "f1a870b6-1d3b-4567-b165-8f2571edf9bd", "address": "fa:16:3e:d7:84:09", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a870b6-1d", "ovs_interfaceid": "f1a870b6-1d3b-4567-b165-8f2571edf9bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:19:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Releasing lock "refresh_cache-8e055c58-a365-4f18-a6e3-377e32e2189d" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:19:27 user nova-compute[72362]: DEBUG nova.compute.manager [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Instance network_info: |[{"id": "f1a870b6-1d3b-4567-b165-8f2571edf9bd", "address": "fa:16:3e:d7:84:09", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a870b6-1d", "ovs_interfaceid": "f1a870b6-1d3b-4567-b165-8f2571edf9bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 10:19:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-24c5f42b-c6a8-4527-9801-a74b57cd72cf req-b35470eb-9d07-48f7-9705-015c32ac9cc1 service nova] Acquired lock "refresh_cache-8e055c58-a365-4f18-a6e3-377e32e2189d" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:19:27 user nova-compute[72362]: DEBUG nova.network.neutron [req-24c5f42b-c6a8-4527-9801-a74b57cd72cf req-b35470eb-9d07-48f7-9705-015c32ac9cc1 service nova] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Refreshing network info cache for port f1a870b6-1d3b-4567-b165-8f2571edf9bd {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:19:27 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Start _get_guest_xml network_info=[{"id": "f1a870b6-1d3b-4567-b165-8f2571edf9bd", "address": "fa:16:3e:d7:84:09", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a870b6-1d", "ovs_interfaceid": "f1a870b6-1d3b-4567-b165-8f2571edf9bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': 'a08d1a11-49eb-4212-a351-e11ee9553b95'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:19:27 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:19:27 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:19:27 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:19:27 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:19:27 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:19:27 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:19:27 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:19:27 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:19:27 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:19:27 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:19:27 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:19:27 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:19:27 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:19:27 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:19:27 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:19:27 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:19:27 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:19:27 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:19:27 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:19:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1293388884',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1293388884',id=12,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f206cedc59df46deb91e7ec2167c1f2b',ramdisk_id='',reservation_id='r-yyx17fjp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1706340435',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:19:25Z,user_data=None,user_id='4a1904ffd10b4e8b959971b5e2383113',uuid=8e055c58-a365-4f18-a6e3-377e32e2189d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1a870b6-1d3b-4567-b165-8f2571edf9bd", "address": "fa:16:3e:d7:84:09", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a870b6-1d", "ovs_interfaceid": "f1a870b6-1d3b-4567-b165-8f2571edf9bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:19:27 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Converting VIF {"id": "f1a870b6-1d3b-4567-b165-8f2571edf9bd", "address": "fa:16:3e:d7:84:09", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a870b6-1d", "ovs_interfaceid": "f1a870b6-1d3b-4567-b165-8f2571edf9bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:19:27 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:84:09,bridge_name='br-int',has_traffic_filtering=True,id=f1a870b6-1d3b-4567-b165-8f2571edf9bd,network=Network(bb852331-57aa-4911-b8ff-30f5411f65b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1a870b6-1d') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:19:27 user nova-compute[72362]: DEBUG nova.objects.instance [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e055c58-a365-4f18-a6e3-377e32e2189d {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:19:27 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:19:27 user nova-compute[72362]:   <uuid>8e055c58-a365-4f18-a6e3-377e32e2189d</uuid>
Aug 09 10:19:27 user nova-compute[72362]:   <name>instance-0000000c</name>
Aug 09 10:19:27 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:19:27 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:19:27 user nova-compute[72362]:   <metadata>
Aug 09 10:19:27 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:19:27 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:19:27 user nova-compute[72362]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1293388884</nova:name>
Aug 09 10:19:27 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:19:27</nova:creationTime>
Aug 09 10:19:27 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:19:27 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:19:27 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:19:27 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:19:27 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:19:27 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:19:27 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:19:27 user nova-compute[72362]:       <nova:owner>
Aug 09 10:19:27 user nova-compute[72362]:         <nova:user uuid="4a1904ffd10b4e8b959971b5e2383113">tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member</nova:user>
Aug 09 10:19:27 user nova-compute[72362]:         <nova:project uuid="f206cedc59df46deb91e7ec2167c1f2b">tempest-ServerBootFromVolumeStableRescueTest-1706340435</nova:project>
Aug 09 10:19:27 user nova-compute[72362]:       </nova:owner>
Aug 09 10:19:27 user nova-compute[72362]:       <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:19:27 user nova-compute[72362]:       <nova:ports>
Aug 09 10:19:27 user nova-compute[72362]:         <nova:port uuid="f1a870b6-1d3b-4567-b165-8f2571edf9bd">
Aug 09 10:19:27 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 09 10:19:27 user nova-compute[72362]:         </nova:port>
Aug 09 10:19:27 user nova-compute[72362]:       </nova:ports>
Aug 09 10:19:27 user nova-compute[72362]:     </nova:instance>
Aug 09 10:19:27 user nova-compute[72362]:   </metadata>
Aug 09 10:19:27 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:19:27 user nova-compute[72362]:     <system>
Aug 09 10:19:27 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:19:27 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:19:27 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:19:27 user nova-compute[72362]:       <entry name="serial">8e055c58-a365-4f18-a6e3-377e32e2189d</entry>
Aug 09 10:19:27 user nova-compute[72362]:       <entry name="uuid">8e055c58-a365-4f18-a6e3-377e32e2189d</entry>
Aug 09 10:19:27 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:19:27 user nova-compute[72362]:     </system>
Aug 09 10:19:27 user nova-compute[72362]:   </sysinfo>
Aug 09 10:19:27 user nova-compute[72362]:   <os>
Aug 09 10:19:27 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:19:27 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:19:27 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:19:27 user nova-compute[72362]:   </os>
Aug 09 10:19:27 user nova-compute[72362]:   <features>
Aug 09 10:19:27 user nova-compute[72362]:     <acpi/>
Aug 09 10:19:27 user nova-compute[72362]:     <apic/>
Aug 09 10:19:27 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:19:27 user nova-compute[72362]:   </features>
Aug 09 10:19:27 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:19:27 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:19:27 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:19:27 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:19:27 user nova-compute[72362]:   </clock>
Aug 09 10:19:27 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:19:27 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:19:27 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:19:27 user nova-compute[72362]:   </cpu>
Aug 09 10:19:27 user nova-compute[72362]:   <devices>
Aug 09 10:19:27 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:19:27 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:19:27 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk"/>
Aug 09 10:19:27 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:19:27 user nova-compute[72362]:     </disk>
Aug 09 10:19:27 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:19:27 user nova-compute[72362]:       <mac address="fa:16:3e:d7:84:09"/>
Aug 09 10:19:27 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:19:27 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:19:27 user nova-compute[72362]:       <target dev="tapf1a870b6-1d"/>
Aug 09 10:19:27 user nova-compute[72362]:     </interface>
Aug 09 10:19:27 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:19:27 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/console.log" append="off"/>
Aug 09 10:19:27 user nova-compute[72362]:     </serial>
Aug 09 10:19:27 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:19:27 user nova-compute[72362]:     <video>
Aug 09 10:19:27 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:19:27 user nova-compute[72362]:     </video>
Aug 09 10:19:27 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:19:27 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:19:27 user nova-compute[72362]:     </rng>
Aug 09 10:19:27 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:19:27 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:19:27 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:19:27 user nova-compute[72362]:     </memballoon>
Aug 09 10:19:27 user nova-compute[72362]:   </devices>
Aug 09 10:19:27 user nova-compute[72362]: </domain>
Aug 09 10:19:27 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:19:27 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:19:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1293388884',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1293388884',id=12,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f206cedc59df46deb91e7ec2167c1f2b',ramdisk_id='',reservation_id='r-yyx17fjp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1706340435',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:19:25Z,user_data=None,user_id='4a1904ffd10b4e8b959971b5e2383113',uuid=8e055c58-a365-4f18-a6e3-377e32e2189d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1a870b6-1d3b-4567-b165-8f2571edf9bd", "address": "fa:16:3e:d7:84:09", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a870b6-1d", "ovs_interfaceid": "f1a870b6-1d3b-4567-b165-8f2571edf9bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:19:27 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Converting VIF {"id": "f1a870b6-1d3b-4567-b165-8f2571edf9bd", "address": "fa:16:3e:d7:84:09", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a870b6-1d", "ovs_interfaceid": "f1a870b6-1d3b-4567-b165-8f2571edf9bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:19:27 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:84:09,bridge_name='br-int',has_traffic_filtering=True,id=f1a870b6-1d3b-4567-b165-8f2571edf9bd,network=Network(bb852331-57aa-4911-b8ff-30f5411f65b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1a870b6-1d') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:19:27 user nova-compute[72362]: DEBUG os_vif [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:84:09,bridge_name='br-int',has_traffic_filtering=True,id=f1a870b6-1d3b-4567-b165-8f2571edf9bd,network=Network(bb852331-57aa-4911-b8ff-30f5411f65b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1a870b6-1d') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:19:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:19:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:19:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf1a870b6-1d, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:19:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf1a870b6-1d, col_values=(('external_ids', {'iface-id': 'f1a870b6-1d3b-4567-b165-8f2571edf9bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:84:09', 'vm-uuid': '8e055c58-a365-4f18-a6e3-377e32e2189d'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:19:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:19:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:27 user nova-compute[72362]: INFO os_vif [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:84:09,bridge_name='br-int',has_traffic_filtering=True,id=f1a870b6-1d3b-4567-b165-8f2571edf9bd,network=Network(bb852331-57aa-4911-b8ff-30f5411f65b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1a870b6-1d')
Aug 09 10:19:27 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:19:27 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] No VIF found with MAC fa:16:3e:d7:84:09, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:19:27 user nova-compute[72362]: DEBUG nova.network.neutron [req-24c5f42b-c6a8-4527-9801-a74b57cd72cf req-b35470eb-9d07-48f7-9705-015c32ac9cc1 service nova] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Updated VIF entry in instance network info cache for port f1a870b6-1d3b-4567-b165-8f2571edf9bd. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:19:27 user nova-compute[72362]: DEBUG nova.network.neutron [req-24c5f42b-c6a8-4527-9801-a74b57cd72cf req-b35470eb-9d07-48f7-9705-015c32ac9cc1 service nova] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Updating instance_info_cache with network_info: [{"id": "f1a870b6-1d3b-4567-b165-8f2571edf9bd", "address": "fa:16:3e:d7:84:09", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a870b6-1d", "ovs_interfaceid": "f1a870b6-1d3b-4567-b165-8f2571edf9bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:19:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-24c5f42b-c6a8-4527-9801-a74b57cd72cf req-b35470eb-9d07-48f7-9705-015c32ac9cc1 service nova] Releasing lock "refresh_cache-8e055c58-a365-4f18-a6e3-377e32e2189d" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:19:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:28 user nova-compute[72362]: DEBUG nova.compute.manager [req-35a6a446-275d-4681-947e-b9278f3985a4 req-a9205be7-185d-4738-a7fc-050bbfbed443 service nova] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Received event network-vif-plugged-f1a870b6-1d3b-4567-b165-8f2571edf9bd {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:19:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-35a6a446-275d-4681-947e-b9278f3985a4 req-a9205be7-185d-4738-a7fc-050bbfbed443 service nova] Acquiring lock "8e055c58-a365-4f18-a6e3-377e32e2189d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:19:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-35a6a446-275d-4681-947e-b9278f3985a4 req-a9205be7-185d-4738-a7fc-050bbfbed443 service nova] Lock "8e055c58-a365-4f18-a6e3-377e32e2189d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:19:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-35a6a446-275d-4681-947e-b9278f3985a4 req-a9205be7-185d-4738-a7fc-050bbfbed443 service nova] Lock "8e055c58-a365-4f18-a6e3-377e32e2189d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:19:28 user nova-compute[72362]: DEBUG nova.compute.manager [req-35a6a446-275d-4681-947e-b9278f3985a4 req-a9205be7-185d-4738-a7fc-050bbfbed443 service nova] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] No waiting events found dispatching network-vif-plugged-f1a870b6-1d3b-4567-b165-8f2571edf9bd {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:19:28 user nova-compute[72362]: WARNING nova.compute.manager [req-35a6a446-275d-4681-947e-b9278f3985a4 req-a9205be7-185d-4738-a7fc-050bbfbed443 service nova] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Received unexpected event network-vif-plugged-f1a870b6-1d3b-4567-b165-8f2571edf9bd for instance with vm_state building and task_state spawning.
Aug 09 10:19:29 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:29 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:29 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:29 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6fe4e046-4d6b-4820-8207-18c44f4545d1 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Acquiring lock "8f0c62c9-aa84-4a5b-b909-af5535e87c83" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:19:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6fe4e046-4d6b-4820-8207-18c44f4545d1 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Lock "8f0c62c9-aa84-4a5b-b909-af5535e87c83" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:19:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6fe4e046-4d6b-4820-8207-18c44f4545d1 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Acquiring lock "8f0c62c9-aa84-4a5b-b909-af5535e87c83-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:19:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6fe4e046-4d6b-4820-8207-18c44f4545d1 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Lock "8f0c62c9-aa84-4a5b-b909-af5535e87c83-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:19:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6fe4e046-4d6b-4820-8207-18c44f4545d1 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Lock "8f0c62c9-aa84-4a5b-b909-af5535e87c83-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:19:30 user nova-compute[72362]: INFO nova.compute.manager [None req-6fe4e046-4d6b-4820-8207-18c44f4545d1 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Terminating instance
Aug 09 10:19:30 user nova-compute[72362]: DEBUG nova.compute.manager [None req-6fe4e046-4d6b-4820-8207-18c44f4545d1 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Start destroying the instance on the hypervisor. {{(pid=72362) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 10:19:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:30 user nova-compute[72362]: DEBUG nova.compute.manager [req-c0634e13-58a7-4b50-bf43-46863de67c3c req-49478311-f787-42be-9152-2316ecaf7a59 service nova] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Received event network-vif-unplugged-8b6fe644-7df3-429e-baa8-ab6407034e32 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:19:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c0634e13-58a7-4b50-bf43-46863de67c3c req-49478311-f787-42be-9152-2316ecaf7a59 service nova] Acquiring lock "8f0c62c9-aa84-4a5b-b909-af5535e87c83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:19:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c0634e13-58a7-4b50-bf43-46863de67c3c req-49478311-f787-42be-9152-2316ecaf7a59 service nova] Lock "8f0c62c9-aa84-4a5b-b909-af5535e87c83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:19:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c0634e13-58a7-4b50-bf43-46863de67c3c req-49478311-f787-42be-9152-2316ecaf7a59 service nova] Lock "8f0c62c9-aa84-4a5b-b909-af5535e87c83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:19:30 user nova-compute[72362]: DEBUG nova.compute.manager [req-c0634e13-58a7-4b50-bf43-46863de67c3c req-49478311-f787-42be-9152-2316ecaf7a59 service nova] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] No waiting events found dispatching network-vif-unplugged-8b6fe644-7df3-429e-baa8-ab6407034e32 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:19:30 user nova-compute[72362]: DEBUG nova.compute.manager [req-c0634e13-58a7-4b50-bf43-46863de67c3c req-49478311-f787-42be-9152-2316ecaf7a59 service nova] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Received event network-vif-unplugged-8b6fe644-7df3-429e-baa8-ab6407034e32 for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:19:30 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576370.7001097, 8e055c58-a365-4f18-a6e3-377e32e2189d => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:19:30 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] VM Resumed (Lifecycle Event)
Aug 09 10:19:30 user nova-compute[72362]: DEBUG nova.compute.manager [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:19:30 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:19:30 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Instance spawned successfully.
Aug 09 10:19:30 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 10:19:30 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:19:30 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:19:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:30 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Found default for hw_cdrom_bus of ide {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:19:30 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Found default for hw_disk_bus of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:19:30 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:19:30 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:19:30 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Found default for hw_video_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:19:30 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Found default for hw_vif_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:19:30 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:19:30 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576370.7042942, 8e055c58-a365-4f18-a6e3-377e32e2189d => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:19:30 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] VM Started (Lifecycle Event)
Aug 09 10:19:30 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:19:30 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:19:30 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:19:30 user nova-compute[72362]: INFO nova.compute.manager [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Took 6.12 seconds to spawn the instance on the hypervisor.
Aug 09 10:19:30 user nova-compute[72362]: DEBUG nova.compute.manager [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:19:30 user nova-compute[72362]: DEBUG nova.compute.manager [req-e378636c-28d5-47b0-b096-e3886bb10ef6 req-9ae8294d-da03-4bd2-8b8d-e0e5ae43f879 service nova] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Received event network-vif-plugged-f1a870b6-1d3b-4567-b165-8f2571edf9bd {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:19:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e378636c-28d5-47b0-b096-e3886bb10ef6 req-9ae8294d-da03-4bd2-8b8d-e0e5ae43f879 service nova] Acquiring lock "8e055c58-a365-4f18-a6e3-377e32e2189d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:19:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e378636c-28d5-47b0-b096-e3886bb10ef6 req-9ae8294d-da03-4bd2-8b8d-e0e5ae43f879 service nova] Lock "8e055c58-a365-4f18-a6e3-377e32e2189d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:19:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e378636c-28d5-47b0-b096-e3886bb10ef6 req-9ae8294d-da03-4bd2-8b8d-e0e5ae43f879 service nova] Lock "8e055c58-a365-4f18-a6e3-377e32e2189d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:19:30 user nova-compute[72362]: DEBUG nova.compute.manager [req-e378636c-28d5-47b0-b096-e3886bb10ef6 req-9ae8294d-da03-4bd2-8b8d-e0e5ae43f879 service nova] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] No waiting events found dispatching network-vif-plugged-f1a870b6-1d3b-4567-b165-8f2571edf9bd {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:19:30 user nova-compute[72362]: WARNING nova.compute.manager [req-e378636c-28d5-47b0-b096-e3886bb10ef6 req-9ae8294d-da03-4bd2-8b8d-e0e5ae43f879 service nova] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Received unexpected event network-vif-plugged-f1a870b6-1d3b-4567-b165-8f2571edf9bd for instance with vm_state building and task_state spawning.
Aug 09 10:19:30 user nova-compute[72362]: INFO nova.compute.manager [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Took 6.86 seconds to build instance.
Aug 09 10:19:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-78fe1761-5d34-4c02-901d-2ee4e29ba7d9 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "8e055c58-a365-4f18-a6e3-377e32e2189d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.955s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:19:31 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Instance destroyed successfully.
Aug 09 10:19:31 user nova-compute[72362]: DEBUG nova.objects.instance [None req-6fe4e046-4d6b-4820-8207-18c44f4545d1 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Lazy-loading 'resources' on Instance uuid 8f0c62c9-aa84-4a5b-b909-af5535e87c83 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:19:31 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-6fe4e046-4d6b-4820-8207-18c44f4545d1 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:16:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-599542738',display_name='tempest-VolumesAssistedSnapshotsTest-server-599542738',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-599542738',id=5,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJa4IUF321zLWRtdC8IMxosX4Q/aIft2JDosU8CGvsEA+O9/Uc+byIdGr6pEsLEFQc3AmI87cJNTXfnAxxhFys1wKqmGE5wyHRycshKQ0zd1ucgzMPs61shRzvK5mWKrfA==',key_name='tempest-keypair-857746219',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:16:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='29102931855a43efb23963382ca5d4f4',ramdisk_id='',reservation_id='r-kendn900',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1880300106',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1880300106-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:16:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a4c8c5a9e7a41d58f685db501b3940f',uuid=8f0c62c9-aa84-4a5b-b909-af5535e87c83,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b6fe644-7df3-429e-baa8-ab6407034e32", "address": "fa:16:3e:63:7f:a8", "network": {"id": "45d52d71-edd6-4126-ba59-31d3c42169b9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1828391472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29102931855a43efb23963382ca5d4f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b6fe644-7d", "ovs_interfaceid": "8b6fe644-7df3-429e-baa8-ab6407034e32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:19:31 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-6fe4e046-4d6b-4820-8207-18c44f4545d1 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Converting VIF {"id": "8b6fe644-7df3-429e-baa8-ab6407034e32", "address": "fa:16:3e:63:7f:a8", "network": {"id": "45d52d71-edd6-4126-ba59-31d3c42169b9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1828391472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29102931855a43efb23963382ca5d4f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b6fe644-7d", "ovs_interfaceid": "8b6fe644-7df3-429e-baa8-ab6407034e32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:19:31 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-6fe4e046-4d6b-4820-8207-18c44f4545d1 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:7f:a8,bridge_name='br-int',has_traffic_filtering=True,id=8b6fe644-7df3-429e-baa8-ab6407034e32,network=Network(45d52d71-edd6-4126-ba59-31d3c42169b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b6fe644-7d') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:19:31 user nova-compute[72362]: DEBUG os_vif [None req-6fe4e046-4d6b-4820-8207-18c44f4545d1 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:7f:a8,bridge_name='br-int',has_traffic_filtering=True,id=8b6fe644-7df3-429e-baa8-ab6407034e32,network=Network(45d52d71-edd6-4126-ba59-31d3c42169b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b6fe644-7d') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:19:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b6fe644-7d, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:19:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:19:31 user nova-compute[72362]: INFO os_vif [None req-6fe4e046-4d6b-4820-8207-18c44f4545d1 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:7f:a8,bridge_name='br-int',has_traffic_filtering=True,id=8b6fe644-7df3-429e-baa8-ab6407034e32,network=Network(45d52d71-edd6-4126-ba59-31d3c42169b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b6fe644-7d')
Aug 09 10:19:31 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-6fe4e046-4d6b-4820-8207-18c44f4545d1 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Deleting instance files /opt/stack/data/nova/instances/8f0c62c9-aa84-4a5b-b909-af5535e87c83_del
Aug 09 10:19:31 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-6fe4e046-4d6b-4820-8207-18c44f4545d1 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Deletion of /opt/stack/data/nova/instances/8f0c62c9-aa84-4a5b-b909-af5535e87c83_del complete
Aug 09 10:19:31 user nova-compute[72362]: INFO nova.compute.manager [None req-6fe4e046-4d6b-4820-8207-18c44f4545d1 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 09 10:19:31 user nova-compute[72362]: DEBUG oslo.service.loopingcall [None req-6fe4e046-4d6b-4820-8207-18c44f4545d1 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72362) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 10:19:31 user nova-compute[72362]: DEBUG nova.compute.manager [-] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Deallocating network for instance {{(pid=72362) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 10:19:31 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] deallocate_for_instance() {{(pid=72362) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 10:19:32 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:19:32 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Took 0.90 seconds to deallocate network for instance.
Aug 09 10:19:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6fe4e046-4d6b-4820-8207-18c44f4545d1 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:19:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6fe4e046-4d6b-4820-8207-18c44f4545d1 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:19:32 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-6fe4e046-4d6b-4820-8207-18c44f4545d1 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:19:32 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-6fe4e046-4d6b-4820-8207-18c44f4545d1 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:19:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6fe4e046-4d6b-4820-8207-18c44f4545d1 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.370s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:19:32 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-6fe4e046-4d6b-4820-8207-18c44f4545d1 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Deleted allocations for instance 8f0c62c9-aa84-4a5b-b909-af5535e87c83
Aug 09 10:19:32 user nova-compute[72362]: DEBUG nova.compute.manager [req-e879a239-d1bc-4622-ada2-02bd29b00df4 req-afdd3fa3-b161-49fc-8607-caa14d9bb7bf service nova] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Received event network-vif-plugged-8b6fe644-7df3-429e-baa8-ab6407034e32 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:19:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e879a239-d1bc-4622-ada2-02bd29b00df4 req-afdd3fa3-b161-49fc-8607-caa14d9bb7bf service nova] Acquiring lock "8f0c62c9-aa84-4a5b-b909-af5535e87c83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:19:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e879a239-d1bc-4622-ada2-02bd29b00df4 req-afdd3fa3-b161-49fc-8607-caa14d9bb7bf service nova] Lock "8f0c62c9-aa84-4a5b-b909-af5535e87c83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:19:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e879a239-d1bc-4622-ada2-02bd29b00df4 req-afdd3fa3-b161-49fc-8607-caa14d9bb7bf service nova] Lock "8f0c62c9-aa84-4a5b-b909-af5535e87c83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:19:32 user nova-compute[72362]: DEBUG nova.compute.manager [req-e879a239-d1bc-4622-ada2-02bd29b00df4 req-afdd3fa3-b161-49fc-8607-caa14d9bb7bf service nova] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] No waiting events found dispatching network-vif-plugged-8b6fe644-7df3-429e-baa8-ab6407034e32 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:19:32 user nova-compute[72362]: WARNING nova.compute.manager [req-e879a239-d1bc-4622-ada2-02bd29b00df4 req-afdd3fa3-b161-49fc-8607-caa14d9bb7bf service nova] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Received unexpected event network-vif-plugged-8b6fe644-7df3-429e-baa8-ab6407034e32 for instance with vm_state deleted and task_state None.
Aug 09 10:19:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6fe4e046-4d6b-4820-8207-18c44f4545d1 tempest-VolumesAssistedSnapshotsTest-1880300106 tempest-VolumesAssistedSnapshotsTest-1880300106-project-member] Lock "8f0c62c9-aa84-4a5b-b909-af5535e87c83" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.435s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:19:32 user nova-compute[72362]: DEBUG nova.compute.manager [req-4d0b0433-809e-4b38-b8d8-c7c461fc820c req-30c57f13-8351-4d83-923e-cb97789dd27f service nova] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Received event network-vif-deleted-8b6fe644-7df3-429e-baa8-ab6407034e32 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:19:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Acquiring lock "45316ca8-e866-4e2f-a92d-d1b256613dd1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:19:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Lock "45316ca8-e866-4e2f-a92d-d1b256613dd1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:19:33 user nova-compute[72362]: DEBUG nova.compute.manager [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Starting instance... {{(pid=72362) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 10:19:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:19:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:19:33 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:19:33 user nova-compute[72362]: INFO nova.compute.claims [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Claim successful on node user
Aug 09 10:19:34 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:19:34 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:19:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.413s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:19:34 user nova-compute[72362]: DEBUG nova.compute.manager [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Start building networks asynchronously for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 10:19:34 user nova-compute[72362]: DEBUG nova.compute.manager [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Allocating IP information in the background. {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 10:19:34 user nova-compute[72362]: DEBUG nova.network.neutron [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] allocate_for_instance() {{(pid=72362) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 10:19:34 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 10:19:34 user nova-compute[72362]: DEBUG nova.compute.manager [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Start building block device mappings for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 10:19:34 user nova-compute[72362]: DEBUG nova.policy [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c6220335c74b4c78a0d1a86efc98ebcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e7ca3484c64611b9573ba0b86592b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72362) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 10:19:34 user nova-compute[72362]: DEBUG nova.compute.manager [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Start spawning the instance on the hypervisor. {{(pid=72362) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 10:19:34 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:19:34 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Creating image(s)
Aug 09 10:19:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Acquiring lock "/opt/stack/data/nova/instances/45316ca8-e866-4e2f-a92d-d1b256613dd1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:19:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Lock "/opt/stack/data/nova/instances/45316ca8-e866-4e2f-a92d-d1b256613dd1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:19:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Lock "/opt/stack/data/nova/instances/45316ca8-e866-4e2f-a92d-d1b256613dd1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:19:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.145s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Acquiring lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:19:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:19:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.162s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/45316ca8-e866-4e2f-a92d-d1b256613dd1/disk 1073741824 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/45316ca8-e866-4e2f-a92d-d1b256613dd1/disk 1073741824" returned: 0 in 0.053s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:19:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:34 user nova-compute[72362]: DEBUG nova.network.neutron [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Successfully created port: 682ae965-7271-4f0d-819e-c01800656086 {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:19:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.155s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:34 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Checking if we can resize image /opt/stack/data/nova/instances/45316ca8-e866-4e2f-a92d-d1b256613dd1/disk. size=1073741824 {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 10:19:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45316ca8-e866-4e2f-a92d-d1b256613dd1/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45316ca8-e866-4e2f-a92d-d1b256613dd1/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:35 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Cannot resize image /opt/stack/data/nova/instances/45316ca8-e866-4e2f-a92d-d1b256613dd1/disk to a smaller size. {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 10:19:35 user nova-compute[72362]: DEBUG nova.objects.instance [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Lazy-loading 'migration_context' on Instance uuid 45316ca8-e866-4e2f-a92d-d1b256613dd1 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:19:35 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Created local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 10:19:35 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Ensure instance console log exists: /opt/stack/data/nova/instances/45316ca8-e866-4e2f-a92d-d1b256613dd1/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:19:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:19:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:19:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:19:35 user nova-compute[72362]: DEBUG nova.network.neutron [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Successfully updated port: 682ae965-7271-4f0d-819e-c01800656086 {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:19:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Acquiring lock "refresh_cache-45316ca8-e866-4e2f-a92d-d1b256613dd1" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:19:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Acquired lock "refresh_cache-45316ca8-e866-4e2f-a92d-d1b256613dd1" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:19:35 user nova-compute[72362]: DEBUG nova.network.neutron [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:19:35 user nova-compute[72362]: DEBUG nova.compute.manager [req-c6ee0d1a-2e22-4bbf-9b02-9228d192a6d3 req-4c9bc515-34c6-4399-b5c8-064bc9b5c3de service nova] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Received event network-changed-682ae965-7271-4f0d-819e-c01800656086 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:19:35 user nova-compute[72362]: DEBUG nova.compute.manager [req-c6ee0d1a-2e22-4bbf-9b02-9228d192a6d3 req-4c9bc515-34c6-4399-b5c8-064bc9b5c3de service nova] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Refreshing instance network info cache due to event network-changed-682ae965-7271-4f0d-819e-c01800656086. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:19:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c6ee0d1a-2e22-4bbf-9b02-9228d192a6d3 req-4c9bc515-34c6-4399-b5c8-064bc9b5c3de service nova] Acquiring lock "refresh_cache-45316ca8-e866-4e2f-a92d-d1b256613dd1" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:19:35 user nova-compute[72362]: DEBUG nova.network.neutron [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:19:35 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:36 user nova-compute[72362]: DEBUG nova.network.neutron [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Updating instance_info_cache with network_info: [{"id": "682ae965-7271-4f0d-819e-c01800656086", "address": "fa:16:3e:a4:a7:54", "network": {"id": "c32d66f0-0db4-4c6b-a45d-8c1eb6f4b510", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-858657617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2e7ca3484c64611b9573ba0b86592b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap682ae965-72", "ovs_interfaceid": "682ae965-7271-4f0d-819e-c01800656086", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:19:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Releasing lock "refresh_cache-45316ca8-e866-4e2f-a92d-d1b256613dd1" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:19:36 user nova-compute[72362]: DEBUG nova.compute.manager [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Instance network_info: |[{"id": "682ae965-7271-4f0d-819e-c01800656086", "address": "fa:16:3e:a4:a7:54", "network": {"id": "c32d66f0-0db4-4c6b-a45d-8c1eb6f4b510", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-858657617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2e7ca3484c64611b9573ba0b86592b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap682ae965-72", "ovs_interfaceid": "682ae965-7271-4f0d-819e-c01800656086", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 10:19:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c6ee0d1a-2e22-4bbf-9b02-9228d192a6d3 req-4c9bc515-34c6-4399-b5c8-064bc9b5c3de service nova] Acquired lock "refresh_cache-45316ca8-e866-4e2f-a92d-d1b256613dd1" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:19:36 user nova-compute[72362]: DEBUG nova.network.neutron [req-c6ee0d1a-2e22-4bbf-9b02-9228d192a6d3 req-4c9bc515-34c6-4399-b5c8-064bc9b5c3de service nova] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Refreshing network info cache for port 682ae965-7271-4f0d-819e-c01800656086 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:19:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Start _get_guest_xml network_info=[{"id": "682ae965-7271-4f0d-819e-c01800656086", "address": "fa:16:3e:a4:a7:54", "network": {"id": "c32d66f0-0db4-4c6b-a45d-8c1eb6f4b510", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-858657617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2e7ca3484c64611b9573ba0b86592b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap682ae965-72", "ovs_interfaceid": "682ae965-7271-4f0d-819e-c01800656086", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': 'a08d1a11-49eb-4212-a351-e11ee9553b95'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:19:36 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:19:36 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:19:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:19:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:19:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:19:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:19:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:19:36 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:19:36 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:19:36 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:19:36 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:19:36 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:19:36 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:19:36 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:19:36 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:19:36 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:19:36 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:19:36 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:19:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:19:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-694801406',display_name='tempest-VolumesAdminNegativeTest-server-694801406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-694801406',id=13,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b2e7ca3484c64611b9573ba0b86592b5',ramdisk_id='',reservation_id='r-rbtna33a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-240994046',owner_user_name='tempest-VolumesAdminNegativeTest-240994046-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:19:34Z,user_data=None,user_id='c6220335c74b4c78a0d1a86efc98ebcb',uuid=45316ca8-e866-4e2f-a92d-d1b256613dd1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "682ae965-7271-4f0d-819e-c01800656086", "address": "fa:16:3e:a4:a7:54", "network": {"id": "c32d66f0-0db4-4c6b-a45d-8c1eb6f4b510", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-858657617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2e7ca3484c64611b9573ba0b86592b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap682ae965-72", "ovs_interfaceid": "682ae965-7271-4f0d-819e-c01800656086", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:19:36 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Converting VIF {"id": "682ae965-7271-4f0d-819e-c01800656086", "address": "fa:16:3e:a4:a7:54", "network": {"id": "c32d66f0-0db4-4c6b-a45d-8c1eb6f4b510", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-858657617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2e7ca3484c64611b9573ba0b86592b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap682ae965-72", "ovs_interfaceid": "682ae965-7271-4f0d-819e-c01800656086", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:19:36 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:a7:54,bridge_name='br-int',has_traffic_filtering=True,id=682ae965-7271-4f0d-819e-c01800656086,network=Network(c32d66f0-0db4-4c6b-a45d-8c1eb6f4b510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap682ae965-72') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:19:36 user nova-compute[72362]: DEBUG nova.objects.instance [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Lazy-loading 'pci_devices' on Instance uuid 45316ca8-e866-4e2f-a92d-d1b256613dd1 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:19:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:19:36 user nova-compute[72362]:   <uuid>45316ca8-e866-4e2f-a92d-d1b256613dd1</uuid>
Aug 09 10:19:36 user nova-compute[72362]:   <name>instance-0000000d</name>
Aug 09 10:19:36 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:19:36 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:19:36 user nova-compute[72362]:   <metadata>
Aug 09 10:19:36 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:19:36 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:19:36 user nova-compute[72362]:       <nova:name>tempest-VolumesAdminNegativeTest-server-694801406</nova:name>
Aug 09 10:19:36 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:19:36</nova:creationTime>
Aug 09 10:19:36 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:19:36 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:19:36 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:19:36 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:19:36 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:19:36 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:19:36 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:19:36 user nova-compute[72362]:       <nova:owner>
Aug 09 10:19:36 user nova-compute[72362]:         <nova:user uuid="c6220335c74b4c78a0d1a86efc98ebcb">tempest-VolumesAdminNegativeTest-240994046-project-member</nova:user>
Aug 09 10:19:36 user nova-compute[72362]:         <nova:project uuid="b2e7ca3484c64611b9573ba0b86592b5">tempest-VolumesAdminNegativeTest-240994046</nova:project>
Aug 09 10:19:36 user nova-compute[72362]:       </nova:owner>
Aug 09 10:19:36 user nova-compute[72362]:       <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:19:36 user nova-compute[72362]:       <nova:ports>
Aug 09 10:19:36 user nova-compute[72362]:         <nova:port uuid="682ae965-7271-4f0d-819e-c01800656086">
Aug 09 10:19:36 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 10:19:36 user nova-compute[72362]:         </nova:port>
Aug 09 10:19:36 user nova-compute[72362]:       </nova:ports>
Aug 09 10:19:36 user nova-compute[72362]:     </nova:instance>
Aug 09 10:19:36 user nova-compute[72362]:   </metadata>
Aug 09 10:19:36 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:19:36 user nova-compute[72362]:     <system>
Aug 09 10:19:36 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:19:36 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:19:36 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:19:36 user nova-compute[72362]:       <entry name="serial">45316ca8-e866-4e2f-a92d-d1b256613dd1</entry>
Aug 09 10:19:36 user nova-compute[72362]:       <entry name="uuid">45316ca8-e866-4e2f-a92d-d1b256613dd1</entry>
Aug 09 10:19:36 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:19:36 user nova-compute[72362]:     </system>
Aug 09 10:19:36 user nova-compute[72362]:   </sysinfo>
Aug 09 10:19:36 user nova-compute[72362]:   <os>
Aug 09 10:19:36 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:19:36 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:19:36 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:19:36 user nova-compute[72362]:   </os>
Aug 09 10:19:36 user nova-compute[72362]:   <features>
Aug 09 10:19:36 user nova-compute[72362]:     <acpi/>
Aug 09 10:19:36 user nova-compute[72362]:     <apic/>
Aug 09 10:19:36 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:19:36 user nova-compute[72362]:   </features>
Aug 09 10:19:36 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:19:36 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:19:36 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:19:36 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:19:36 user nova-compute[72362]:   </clock>
Aug 09 10:19:36 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:19:36 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:19:36 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:19:36 user nova-compute[72362]:   </cpu>
Aug 09 10:19:36 user nova-compute[72362]:   <devices>
Aug 09 10:19:36 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:19:36 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:19:36 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/45316ca8-e866-4e2f-a92d-d1b256613dd1/disk"/>
Aug 09 10:19:36 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:19:36 user nova-compute[72362]:     </disk>
Aug 09 10:19:36 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:19:36 user nova-compute[72362]:       <mac address="fa:16:3e:a4:a7:54"/>
Aug 09 10:19:36 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:19:36 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:19:36 user nova-compute[72362]:       <target dev="tap682ae965-72"/>
Aug 09 10:19:36 user nova-compute[72362]:     </interface>
Aug 09 10:19:36 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:19:36 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/45316ca8-e866-4e2f-a92d-d1b256613dd1/console.log" append="off"/>
Aug 09 10:19:36 user nova-compute[72362]:     </serial>
Aug 09 10:19:36 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:19:36 user nova-compute[72362]:     <video>
Aug 09 10:19:36 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:19:36 user nova-compute[72362]:     </video>
Aug 09 10:19:36 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:19:36 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:19:36 user nova-compute[72362]:     </rng>
Aug 09 10:19:36 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:19:36 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:19:36 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:19:36 user nova-compute[72362]:     </memballoon>
Aug 09 10:19:36 user nova-compute[72362]:   </devices>
Aug 09 10:19:36 user nova-compute[72362]: </domain>
Aug 09 10:19:36 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:19:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:19:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-694801406',display_name='tempest-VolumesAdminNegativeTest-server-694801406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-694801406',id=13,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b2e7ca3484c64611b9573ba0b86592b5',ramdisk_id='',reservation_id='r-rbtna33a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-240994046',owner_user_name='tempest-VolumesAdminNegativeTest-240994046-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:19:34Z,user_data=None,user_id='c6220335c74b4c78a0d1a86efc98ebcb',uuid=45316ca8-e866-4e2f-a92d-d1b256613dd1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "682ae965-7271-4f0d-819e-c01800656086", "address": "fa:16:3e:a4:a7:54", "network": {"id": "c32d66f0-0db4-4c6b-a45d-8c1eb6f4b510", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-858657617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2e7ca3484c64611b9573ba0b86592b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap682ae965-72", "ovs_interfaceid": "682ae965-7271-4f0d-819e-c01800656086", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:19:36 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Converting VIF {"id": "682ae965-7271-4f0d-819e-c01800656086", "address": "fa:16:3e:a4:a7:54", "network": {"id": "c32d66f0-0db4-4c6b-a45d-8c1eb6f4b510", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-858657617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2e7ca3484c64611b9573ba0b86592b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap682ae965-72", "ovs_interfaceid": "682ae965-7271-4f0d-819e-c01800656086", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:19:36 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:a7:54,bridge_name='br-int',has_traffic_filtering=True,id=682ae965-7271-4f0d-819e-c01800656086,network=Network(c32d66f0-0db4-4c6b-a45d-8c1eb6f4b510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap682ae965-72') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:19:36 user nova-compute[72362]: DEBUG os_vif [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:a7:54,bridge_name='br-int',has_traffic_filtering=True,id=682ae965-7271-4f0d-819e-c01800656086,network=Network(c32d66f0-0db4-4c6b-a45d-8c1eb6f4b510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap682ae965-72') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:19:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:19:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:19:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap682ae965-72, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:19:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap682ae965-72, col_values=(('external_ids', {'iface-id': '682ae965-7271-4f0d-819e-c01800656086', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:a7:54', 'vm-uuid': '45316ca8-e866-4e2f-a92d-d1b256613dd1'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:19:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:19:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:36 user nova-compute[72362]: INFO os_vif [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:a7:54,bridge_name='br-int',has_traffic_filtering=True,id=682ae965-7271-4f0d-819e-c01800656086,network=Network(c32d66f0-0db4-4c6b-a45d-8c1eb6f4b510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap682ae965-72')
Aug 09 10:19:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:19:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] No VIF found with MAC fa:16:3e:a4:a7:54, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:19:36 user nova-compute[72362]: DEBUG nova.network.neutron [req-c6ee0d1a-2e22-4bbf-9b02-9228d192a6d3 req-4c9bc515-34c6-4399-b5c8-064bc9b5c3de service nova] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Updated VIF entry in instance network info cache for port 682ae965-7271-4f0d-819e-c01800656086. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:19:36 user nova-compute[72362]: DEBUG nova.network.neutron [req-c6ee0d1a-2e22-4bbf-9b02-9228d192a6d3 req-4c9bc515-34c6-4399-b5c8-064bc9b5c3de service nova] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Updating instance_info_cache with network_info: [{"id": "682ae965-7271-4f0d-819e-c01800656086", "address": "fa:16:3e:a4:a7:54", "network": {"id": "c32d66f0-0db4-4c6b-a45d-8c1eb6f4b510", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-858657617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2e7ca3484c64611b9573ba0b86592b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap682ae965-72", "ovs_interfaceid": "682ae965-7271-4f0d-819e-c01800656086", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:19:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c6ee0d1a-2e22-4bbf-9b02-9228d192a6d3 req-4c9bc515-34c6-4399-b5c8-064bc9b5c3de service nova] Releasing lock "refresh_cache-45316ca8-e866-4e2f-a92d-d1b256613dd1" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:19:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:38 user nova-compute[72362]: DEBUG nova.compute.manager [req-6954a30f-b022-4d6e-be75-c7b3d4ebeebc req-990017bd-ae9d-476c-b6ea-8350fd8e54d3 service nova] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Received event network-vif-plugged-682ae965-7271-4f0d-819e-c01800656086 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:19:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-6954a30f-b022-4d6e-be75-c7b3d4ebeebc req-990017bd-ae9d-476c-b6ea-8350fd8e54d3 service nova] Acquiring lock "45316ca8-e866-4e2f-a92d-d1b256613dd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:19:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-6954a30f-b022-4d6e-be75-c7b3d4ebeebc req-990017bd-ae9d-476c-b6ea-8350fd8e54d3 service nova] Lock "45316ca8-e866-4e2f-a92d-d1b256613dd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:19:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-6954a30f-b022-4d6e-be75-c7b3d4ebeebc req-990017bd-ae9d-476c-b6ea-8350fd8e54d3 service nova] Lock "45316ca8-e866-4e2f-a92d-d1b256613dd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:19:38 user nova-compute[72362]: DEBUG nova.compute.manager [req-6954a30f-b022-4d6e-be75-c7b3d4ebeebc req-990017bd-ae9d-476c-b6ea-8350fd8e54d3 service nova] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] No waiting events found dispatching network-vif-plugged-682ae965-7271-4f0d-819e-c01800656086 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:19:38 user nova-compute[72362]: WARNING nova.compute.manager [req-6954a30f-b022-4d6e-be75-c7b3d4ebeebc req-990017bd-ae9d-476c-b6ea-8350fd8e54d3 service nova] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Received unexpected event network-vif-plugged-682ae965-7271-4f0d-819e-c01800656086 for instance with vm_state building and task_state spawning.
Aug 09 10:19:39 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Acquiring lock "d5b048c8-a329-4fe3-ab62-a06ab6401230" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:19:39 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Lock "d5b048c8-a329-4fe3-ab62-a06ab6401230" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:19:39 user nova-compute[72362]: DEBUG nova.compute.manager [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Starting instance... {{(pid=72362) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 10:19:39 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:19:39 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:19:39 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:19:39 user nova-compute[72362]: INFO nova.compute.claims [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Claim successful on node user
Aug 09 10:19:39 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:19:39 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:19:39 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.519s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:19:39 user nova-compute[72362]: DEBUG nova.compute.manager [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Start building networks asynchronously for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 10:19:39 user nova-compute[72362]: DEBUG nova.compute.manager [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Allocating IP information in the background. {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 10:19:39 user nova-compute[72362]: DEBUG nova.network.neutron [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] allocate_for_instance() {{(pid=72362) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 10:19:39 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 10:19:39 user nova-compute[72362]: DEBUG nova.compute.manager [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Start building block device mappings for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 10:19:39 user nova-compute[72362]: DEBUG nova.policy [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fcbf88df1bf143c1b46cbf8d8ca879e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb89934454244f5a3438b5a8a74926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72362) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 10:19:40 user nova-compute[72362]: DEBUG nova.compute.manager [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Start spawning the instance on the hypervisor. {{(pid=72362) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 10:19:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:19:40 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Creating image(s)
Aug 09 10:19:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Acquiring lock "/opt/stack/data/nova/instances/d5b048c8-a329-4fe3-ab62-a06ab6401230/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:19:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Lock "/opt/stack/data/nova/instances/d5b048c8-a329-4fe3-ab62-a06ab6401230/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:19:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Lock "/opt/stack/data/nova/instances/d5b048c8-a329-4fe3-ab62-a06ab6401230/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:19:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.149s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Acquiring lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:19:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:19:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.139s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/d5b048c8-a329-4fe3-ab62-a06ab6401230/disk 1073741824 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:40 user nova-compute[72362]: DEBUG nova.compute.manager [req-5429dc62-f9bc-4391-a429-7c3454d211e3 req-d9ff56c1-c5b3-472f-8d5b-589187f90f84 service nova] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Received event network-vif-plugged-682ae965-7271-4f0d-819e-c01800656086 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:19:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-5429dc62-f9bc-4391-a429-7c3454d211e3 req-d9ff56c1-c5b3-472f-8d5b-589187f90f84 service nova] Acquiring lock "45316ca8-e866-4e2f-a92d-d1b256613dd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:19:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-5429dc62-f9bc-4391-a429-7c3454d211e3 req-d9ff56c1-c5b3-472f-8d5b-589187f90f84 service nova] Lock "45316ca8-e866-4e2f-a92d-d1b256613dd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:19:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-5429dc62-f9bc-4391-a429-7c3454d211e3 req-d9ff56c1-c5b3-472f-8d5b-589187f90f84 service nova] Lock "45316ca8-e866-4e2f-a92d-d1b256613dd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:19:40 user nova-compute[72362]: DEBUG nova.compute.manager [req-5429dc62-f9bc-4391-a429-7c3454d211e3 req-d9ff56c1-c5b3-472f-8d5b-589187f90f84 service nova] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] No waiting events found dispatching network-vif-plugged-682ae965-7271-4f0d-819e-c01800656086 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:19:40 user nova-compute[72362]: WARNING nova.compute.manager [req-5429dc62-f9bc-4391-a429-7c3454d211e3 req-d9ff56c1-c5b3-472f-8d5b-589187f90f84 service nova] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Received unexpected event network-vif-plugged-682ae965-7271-4f0d-819e-c01800656086 for instance with vm_state building and task_state spawning.
Aug 09 10:19:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/d5b048c8-a329-4fe3-ab62-a06ab6401230/disk 1073741824" returned: 0 in 0.050s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:19:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:40 user nova-compute[72362]: DEBUG nova.compute.manager [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:19:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:19:40 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576380.4104466, 45316ca8-e866-4e2f-a92d-d1b256613dd1 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:19:40 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] VM Resumed (Lifecycle Event)
Aug 09 10:19:40 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Instance spawned successfully.
Aug 09 10:19:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 10:19:40 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:19:40 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:19:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Found default for hw_cdrom_bus of ide {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:19:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Found default for hw_disk_bus of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:19:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:19:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:19:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Found default for hw_video_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:19:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Found default for hw_vif_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:19:40 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:19:40 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576380.424375, 45316ca8-e866-4e2f-a92d-d1b256613dd1 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:19:40 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] VM Started (Lifecycle Event)
Aug 09 10:19:40 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:19:40 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:19:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.159s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:40 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d5b048c8-a329-4fe3-ab62-a06ab6401230/disk. size=1073741824 {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 10:19:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5b048c8-a329-4fe3-ab62-a06ab6401230/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:40 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:19:40 user nova-compute[72362]: DEBUG nova.network.neutron [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Successfully created port: c6f3f94c-4160-4103-8784-d86042b30f45 {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:19:40 user nova-compute[72362]: INFO nova.compute.manager [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Took 6.13 seconds to spawn the instance on the hypervisor.
Aug 09 10:19:40 user nova-compute[72362]: DEBUG nova.compute.manager [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:19:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5b048c8-a329-4fe3-ab62-a06ab6401230/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:40 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Cannot resize image /opt/stack/data/nova/instances/d5b048c8-a329-4fe3-ab62-a06ab6401230/disk to a smaller size. {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 10:19:40 user nova-compute[72362]: DEBUG nova.objects.instance [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Lazy-loading 'migration_context' on Instance uuid d5b048c8-a329-4fe3-ab62-a06ab6401230 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:19:40 user nova-compute[72362]: INFO nova.compute.manager [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Took 6.94 seconds to build instance.
Aug 09 10:19:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Created local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 10:19:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Ensure instance console log exists: /opt/stack/data/nova/instances/d5b048c8-a329-4fe3-ab62-a06ab6401230/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:19:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:19:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:19:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:19:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-54f9ce0b-190f-483f-b3b8-733135c3f44b tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Lock "45316ca8-e866-4e2f-a92d-d1b256613dd1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.032s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:19:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:41 user nova-compute[72362]: DEBUG nova.network.neutron [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Successfully updated port: c6f3f94c-4160-4103-8784-d86042b30f45 {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:19:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Acquiring lock "refresh_cache-d5b048c8-a329-4fe3-ab62-a06ab6401230" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:19:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Acquired lock "refresh_cache-d5b048c8-a329-4fe3-ab62-a06ab6401230" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:19:41 user nova-compute[72362]: DEBUG nova.network.neutron [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:19:41 user nova-compute[72362]: DEBUG nova.compute.manager [req-c58c7a90-efd1-4ff1-9131-5729ec6860ce req-ae96e93c-6843-4857-b8df-f0efb21bfe82 service nova] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Received event network-changed-c6f3f94c-4160-4103-8784-d86042b30f45 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:19:41 user nova-compute[72362]: DEBUG nova.compute.manager [req-c58c7a90-efd1-4ff1-9131-5729ec6860ce req-ae96e93c-6843-4857-b8df-f0efb21bfe82 service nova] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Refreshing instance network info cache due to event network-changed-c6f3f94c-4160-4103-8784-d86042b30f45. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:19:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c58c7a90-efd1-4ff1-9131-5729ec6860ce req-ae96e93c-6843-4857-b8df-f0efb21bfe82 service nova] Acquiring lock "refresh_cache-d5b048c8-a329-4fe3-ab62-a06ab6401230" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:19:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:41 user nova-compute[72362]: DEBUG nova.network.neutron [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:19:41 user nova-compute[72362]: DEBUG nova.network.neutron [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Updating instance_info_cache with network_info: [{"id": "c6f3f94c-4160-4103-8784-d86042b30f45", "address": "fa:16:3e:b6:ef:e1", "network": {"id": "65e9155d-dde9-47bb-aa24-e6331f2dc71e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1221293796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bb89934454244f5a3438b5a8a74926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f3f94c-41", "ovs_interfaceid": "c6f3f94c-4160-4103-8784-d86042b30f45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:19:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Releasing lock "refresh_cache-d5b048c8-a329-4fe3-ab62-a06ab6401230" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:19:41 user nova-compute[72362]: DEBUG nova.compute.manager [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Instance network_info: |[{"id": "c6f3f94c-4160-4103-8784-d86042b30f45", "address": "fa:16:3e:b6:ef:e1", "network": {"id": "65e9155d-dde9-47bb-aa24-e6331f2dc71e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1221293796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bb89934454244f5a3438b5a8a74926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f3f94c-41", "ovs_interfaceid": "c6f3f94c-4160-4103-8784-d86042b30f45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 10:19:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c58c7a90-efd1-4ff1-9131-5729ec6860ce req-ae96e93c-6843-4857-b8df-f0efb21bfe82 service nova] Acquired lock "refresh_cache-d5b048c8-a329-4fe3-ab62-a06ab6401230" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:19:41 user nova-compute[72362]: DEBUG nova.network.neutron [req-c58c7a90-efd1-4ff1-9131-5729ec6860ce req-ae96e93c-6843-4857-b8df-f0efb21bfe82 service nova] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Refreshing network info cache for port c6f3f94c-4160-4103-8784-d86042b30f45 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:19:41 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Start _get_guest_xml network_info=[{"id": "c6f3f94c-4160-4103-8784-d86042b30f45", "address": "fa:16:3e:b6:ef:e1", "network": {"id": "65e9155d-dde9-47bb-aa24-e6331f2dc71e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1221293796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bb89934454244f5a3438b5a8a74926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f3f94c-41", "ovs_interfaceid": "c6f3f94c-4160-4103-8784-d86042b30f45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': 'a08d1a11-49eb-4212-a351-e11ee9553b95'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:19:42 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:19:42 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:19:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:19:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:19:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:19:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:19:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:19:42 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:19:42 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:19:42 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:19:42 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:19:42 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:19:42 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:19:42 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:19:42 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:19:42 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:19:42 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:19:42 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:19:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:19:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1624554120',display_name='tempest-VolumesActionsTest-instance-1624554120',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1624554120',id=14,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0bb89934454244f5a3438b5a8a74926a',ramdisk_id='',reservation_id='r-lu4c6f1e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2128587251',owner_user_name='tempest-VolumesActionsTest-2128587251-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:19:40Z,user_data=None,user_id='fcbf88df1bf143c1b46cbf8d8ca879e4',uuid=d5b048c8-a329-4fe3-ab62-a06ab6401230,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6f3f94c-4160-4103-8784-d86042b30f45", "address": "fa:16:3e:b6:ef:e1", "network": {"id": "65e9155d-dde9-47bb-aa24-e6331f2dc71e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1221293796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bb89934454244f5a3438b5a8a74926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f3f94c-41", "ovs_interfaceid": "c6f3f94c-4160-4103-8784-d86042b30f45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:19:42 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Converting VIF {"id": "c6f3f94c-4160-4103-8784-d86042b30f45", "address": "fa:16:3e:b6:ef:e1", "network": {"id": "65e9155d-dde9-47bb-aa24-e6331f2dc71e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1221293796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bb89934454244f5a3438b5a8a74926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f3f94c-41", "ovs_interfaceid": "c6f3f94c-4160-4103-8784-d86042b30f45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:19:42 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:ef:e1,bridge_name='br-int',has_traffic_filtering=True,id=c6f3f94c-4160-4103-8784-d86042b30f45,network=Network(65e9155d-dde9-47bb-aa24-e6331f2dc71e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6f3f94c-41') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:19:42 user nova-compute[72362]: DEBUG nova.objects.instance [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Lazy-loading 'pci_devices' on Instance uuid d5b048c8-a329-4fe3-ab62-a06ab6401230 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:19:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:19:42 user nova-compute[72362]:   <uuid>d5b048c8-a329-4fe3-ab62-a06ab6401230</uuid>
Aug 09 10:19:42 user nova-compute[72362]:   <name>instance-0000000e</name>
Aug 09 10:19:42 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:19:42 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:19:42 user nova-compute[72362]:   <metadata>
Aug 09 10:19:42 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:19:42 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:19:42 user nova-compute[72362]:       <nova:name>tempest-VolumesActionsTest-instance-1624554120</nova:name>
Aug 09 10:19:42 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:19:42</nova:creationTime>
Aug 09 10:19:42 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:19:42 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:19:42 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:19:42 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:19:42 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:19:42 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:19:42 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:19:42 user nova-compute[72362]:       <nova:owner>
Aug 09 10:19:42 user nova-compute[72362]:         <nova:user uuid="fcbf88df1bf143c1b46cbf8d8ca879e4">tempest-VolumesActionsTest-2128587251-project-member</nova:user>
Aug 09 10:19:42 user nova-compute[72362]:         <nova:project uuid="0bb89934454244f5a3438b5a8a74926a">tempest-VolumesActionsTest-2128587251</nova:project>
Aug 09 10:19:42 user nova-compute[72362]:       </nova:owner>
Aug 09 10:19:42 user nova-compute[72362]:       <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:19:42 user nova-compute[72362]:       <nova:ports>
Aug 09 10:19:42 user nova-compute[72362]:         <nova:port uuid="c6f3f94c-4160-4103-8784-d86042b30f45">
Aug 09 10:19:42 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 10:19:42 user nova-compute[72362]:         </nova:port>
Aug 09 10:19:42 user nova-compute[72362]:       </nova:ports>
Aug 09 10:19:42 user nova-compute[72362]:     </nova:instance>
Aug 09 10:19:42 user nova-compute[72362]:   </metadata>
Aug 09 10:19:42 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:19:42 user nova-compute[72362]:     <system>
Aug 09 10:19:42 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:19:42 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:19:42 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:19:42 user nova-compute[72362]:       <entry name="serial">d5b048c8-a329-4fe3-ab62-a06ab6401230</entry>
Aug 09 10:19:42 user nova-compute[72362]:       <entry name="uuid">d5b048c8-a329-4fe3-ab62-a06ab6401230</entry>
Aug 09 10:19:42 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:19:42 user nova-compute[72362]:     </system>
Aug 09 10:19:42 user nova-compute[72362]:   </sysinfo>
Aug 09 10:19:42 user nova-compute[72362]:   <os>
Aug 09 10:19:42 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:19:42 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:19:42 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:19:42 user nova-compute[72362]:   </os>
Aug 09 10:19:42 user nova-compute[72362]:   <features>
Aug 09 10:19:42 user nova-compute[72362]:     <acpi/>
Aug 09 10:19:42 user nova-compute[72362]:     <apic/>
Aug 09 10:19:42 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:19:42 user nova-compute[72362]:   </features>
Aug 09 10:19:42 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:19:42 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:19:42 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:19:42 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:19:42 user nova-compute[72362]:   </clock>
Aug 09 10:19:42 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:19:42 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:19:42 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:19:42 user nova-compute[72362]:   </cpu>
Aug 09 10:19:42 user nova-compute[72362]:   <devices>
Aug 09 10:19:42 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:19:42 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:19:42 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/d5b048c8-a329-4fe3-ab62-a06ab6401230/disk"/>
Aug 09 10:19:42 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:19:42 user nova-compute[72362]:     </disk>
Aug 09 10:19:42 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:19:42 user nova-compute[72362]:       <mac address="fa:16:3e:b6:ef:e1"/>
Aug 09 10:19:42 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:19:42 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:19:42 user nova-compute[72362]:       <target dev="tapc6f3f94c-41"/>
Aug 09 10:19:42 user nova-compute[72362]:     </interface>
Aug 09 10:19:42 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:19:42 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/d5b048c8-a329-4fe3-ab62-a06ab6401230/console.log" append="off"/>
Aug 09 10:19:42 user nova-compute[72362]:     </serial>
Aug 09 10:19:42 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:19:42 user nova-compute[72362]:     <video>
Aug 09 10:19:42 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:19:42 user nova-compute[72362]:     </video>
Aug 09 10:19:42 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:19:42 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:19:42 user nova-compute[72362]:     </rng>
Aug 09 10:19:42 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:19:42 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:19:42 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:19:42 user nova-compute[72362]:     </memballoon>
Aug 09 10:19:42 user nova-compute[72362]:   </devices>
Aug 09 10:19:42 user nova-compute[72362]: </domain>
Aug 09 10:19:42 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:19:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:19:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1624554120',display_name='tempest-VolumesActionsTest-instance-1624554120',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1624554120',id=14,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0bb89934454244f5a3438b5a8a74926a',ramdisk_id='',reservation_id='r-lu4c6f1e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2128587251',owner_user_name='tempest-VolumesActionsTest-2128587251-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:19:40Z,user_data=None,user_id='fcbf88df1bf143c1b46cbf8d8ca879e4',uuid=d5b048c8-a329-4fe3-ab62-a06ab6401230,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6f3f94c-4160-4103-8784-d86042b30f45", "address": "fa:16:3e:b6:ef:e1", "network": {"id": "65e9155d-dde9-47bb-aa24-e6331f2dc71e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1221293796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bb89934454244f5a3438b5a8a74926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f3f94c-41", "ovs_interfaceid": "c6f3f94c-4160-4103-8784-d86042b30f45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:19:42 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Converting VIF {"id": "c6f3f94c-4160-4103-8784-d86042b30f45", "address": "fa:16:3e:b6:ef:e1", "network": {"id": "65e9155d-dde9-47bb-aa24-e6331f2dc71e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1221293796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bb89934454244f5a3438b5a8a74926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f3f94c-41", "ovs_interfaceid": "c6f3f94c-4160-4103-8784-d86042b30f45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:19:42 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:ef:e1,bridge_name='br-int',has_traffic_filtering=True,id=c6f3f94c-4160-4103-8784-d86042b30f45,network=Network(65e9155d-dde9-47bb-aa24-e6331f2dc71e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6f3f94c-41') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:19:42 user nova-compute[72362]: DEBUG os_vif [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:ef:e1,bridge_name='br-int',has_traffic_filtering=True,id=c6f3f94c-4160-4103-8784-d86042b30f45,network=Network(65e9155d-dde9-47bb-aa24-e6331f2dc71e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6f3f94c-41') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:19:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:19:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:19:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc6f3f94c-41, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:19:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc6f3f94c-41, col_values=(('external_ids', {'iface-id': 'c6f3f94c-4160-4103-8784-d86042b30f45', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:ef:e1', 'vm-uuid': 'd5b048c8-a329-4fe3-ab62-a06ab6401230'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:19:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:19:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:42 user nova-compute[72362]: INFO os_vif [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:ef:e1,bridge_name='br-int',has_traffic_filtering=True,id=c6f3f94c-4160-4103-8784-d86042b30f45,network=Network(65e9155d-dde9-47bb-aa24-e6331f2dc71e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6f3f94c-41')
Aug 09 10:19:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:19:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] No VIF found with MAC fa:16:3e:b6:ef:e1, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:19:42 user nova-compute[72362]: DEBUG nova.network.neutron [req-c58c7a90-efd1-4ff1-9131-5729ec6860ce req-ae96e93c-6843-4857-b8df-f0efb21bfe82 service nova] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Updated VIF entry in instance network info cache for port c6f3f94c-4160-4103-8784-d86042b30f45. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:19:42 user nova-compute[72362]: DEBUG nova.network.neutron [req-c58c7a90-efd1-4ff1-9131-5729ec6860ce req-ae96e93c-6843-4857-b8df-f0efb21bfe82 service nova] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Updating instance_info_cache with network_info: [{"id": "c6f3f94c-4160-4103-8784-d86042b30f45", "address": "fa:16:3e:b6:ef:e1", "network": {"id": "65e9155d-dde9-47bb-aa24-e6331f2dc71e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1221293796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bb89934454244f5a3438b5a8a74926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f3f94c-41", "ovs_interfaceid": "c6f3f94c-4160-4103-8784-d86042b30f45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:19:42 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c58c7a90-efd1-4ff1-9131-5729ec6860ce req-ae96e93c-6843-4857-b8df-f0efb21bfe82 service nova] Releasing lock "refresh_cache-d5b048c8-a329-4fe3-ab62-a06ab6401230" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:19:42 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-08e50000-a814-4951-9264-23609359fc93 tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Acquiring lock "93faa4d2-324e-4373-9706-99ef83cd6f9d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:19:42 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-08e50000-a814-4951-9264-23609359fc93 tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Lock "93faa4d2-324e-4373-9706-99ef83cd6f9d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:19:42 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-08e50000-a814-4951-9264-23609359fc93 tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Acquiring lock "93faa4d2-324e-4373-9706-99ef83cd6f9d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:19:42 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-08e50000-a814-4951-9264-23609359fc93 tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Lock "93faa4d2-324e-4373-9706-99ef83cd6f9d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:19:42 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-08e50000-a814-4951-9264-23609359fc93 tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Lock "93faa4d2-324e-4373-9706-99ef83cd6f9d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:19:42 user nova-compute[72362]: INFO nova.compute.manager [None req-08e50000-a814-4951-9264-23609359fc93 tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Terminating instance
Aug 09 10:19:42 user nova-compute[72362]: DEBUG nova.compute.manager [None req-08e50000-a814-4951-9264-23609359fc93 tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Start destroying the instance on the hypervisor. {{(pid=72362) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 10:19:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0fdf3fee-5b00-4398-8cbb-464642723b4d tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Acquiring lock "00af3d8e-bd93-4520-91e7-29c135c03e55" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:19:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0fdf3fee-5b00-4398-8cbb-464642723b4d tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Lock "00af3d8e-bd93-4520-91e7-29c135c03e55" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:19:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0fdf3fee-5b00-4398-8cbb-464642723b4d tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Acquiring lock "00af3d8e-bd93-4520-91e7-29c135c03e55-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:19:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0fdf3fee-5b00-4398-8cbb-464642723b4d tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Lock "00af3d8e-bd93-4520-91e7-29c135c03e55-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:19:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0fdf3fee-5b00-4398-8cbb-464642723b4d tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Lock "00af3d8e-bd93-4520-91e7-29c135c03e55-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:19:43 user nova-compute[72362]: INFO nova.compute.manager [None req-0fdf3fee-5b00-4398-8cbb-464642723b4d tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Terminating instance
Aug 09 10:19:43 user nova-compute[72362]: DEBUG nova.compute.manager [None req-0fdf3fee-5b00-4398-8cbb-464642723b4d tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Start destroying the instance on the hypervisor. {{(pid=72362) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 10:19:43 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:43 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:43 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:43 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:43 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:43 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:43 user nova-compute[72362]: DEBUG nova.compute.manager [req-a01738df-450e-4e9b-9f69-62ac99345cb7 req-fb9043f2-4df4-4c05-9f53-4e6e97583905 service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Received event network-vif-unplugged-1efbc456-6c56-4367-845f-0afa8acdcec4 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:19:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-a01738df-450e-4e9b-9f69-62ac99345cb7 req-fb9043f2-4df4-4c05-9f53-4e6e97583905 service nova] Acquiring lock "00af3d8e-bd93-4520-91e7-29c135c03e55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:19:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-a01738df-450e-4e9b-9f69-62ac99345cb7 req-fb9043f2-4df4-4c05-9f53-4e6e97583905 service nova] Lock "00af3d8e-bd93-4520-91e7-29c135c03e55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:19:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-a01738df-450e-4e9b-9f69-62ac99345cb7 req-fb9043f2-4df4-4c05-9f53-4e6e97583905 service nova] Lock "00af3d8e-bd93-4520-91e7-29c135c03e55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:19:43 user nova-compute[72362]: DEBUG nova.compute.manager [req-a01738df-450e-4e9b-9f69-62ac99345cb7 req-fb9043f2-4df4-4c05-9f53-4e6e97583905 service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] No waiting events found dispatching network-vif-unplugged-1efbc456-6c56-4367-845f-0afa8acdcec4 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:19:43 user nova-compute[72362]: DEBUG nova.compute.manager [req-a01738df-450e-4e9b-9f69-62ac99345cb7 req-fb9043f2-4df4-4c05-9f53-4e6e97583905 service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Received event network-vif-unplugged-1efbc456-6c56-4367-845f-0afa8acdcec4 for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:19:43 user nova-compute[72362]: DEBUG nova.compute.manager [req-8b6badfb-2c89-4535-9ab7-aa1dea957945 req-6ddde6a0-84df-4a2f-a147-4311eccee226 service nova] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Received event network-vif-unplugged-d9a9926b-0688-4bc0-ad84-d04d1c11e889 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:19:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8b6badfb-2c89-4535-9ab7-aa1dea957945 req-6ddde6a0-84df-4a2f-a147-4311eccee226 service nova] Acquiring lock "93faa4d2-324e-4373-9706-99ef83cd6f9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:19:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8b6badfb-2c89-4535-9ab7-aa1dea957945 req-6ddde6a0-84df-4a2f-a147-4311eccee226 service nova] Lock "93faa4d2-324e-4373-9706-99ef83cd6f9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:19:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8b6badfb-2c89-4535-9ab7-aa1dea957945 req-6ddde6a0-84df-4a2f-a147-4311eccee226 service nova] Lock "93faa4d2-324e-4373-9706-99ef83cd6f9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:19:43 user nova-compute[72362]: DEBUG nova.compute.manager [req-8b6badfb-2c89-4535-9ab7-aa1dea957945 req-6ddde6a0-84df-4a2f-a147-4311eccee226 service nova] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] No waiting events found dispatching network-vif-unplugged-d9a9926b-0688-4bc0-ad84-d04d1c11e889 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:19:43 user nova-compute[72362]: DEBUG nova.compute.manager [req-8b6badfb-2c89-4535-9ab7-aa1dea957945 req-6ddde6a0-84df-4a2f-a147-4311eccee226 service nova] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Received event network-vif-unplugged-d9a9926b-0688-4bc0-ad84-d04d1c11e889 for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:19:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:44 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Instance destroyed successfully.
Aug 09 10:19:44 user nova-compute[72362]: DEBUG nova.objects.instance [None req-08e50000-a814-4951-9264-23609359fc93 tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Lazy-loading 'resources' on Instance uuid 93faa4d2-324e-4373-9706-99ef83cd6f9d {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:19:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-08e50000-a814-4951-9264-23609359fc93 tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:17:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-786448649',display_name='tempest-ServersNegativeTestJSON-server-786448649',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-786448649',id=10,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:18:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d000751b939e4805abb861b91d698b6c',ramdisk_id='',reservation_id='r-f74unme7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1689094468',owner_user_name='tempest-ServersNegativeTestJSON-1689094468-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:18:00Z,user_data=None,user_id='8a4feca60bf046c6bfdd136c25ecbee3',uuid=93faa4d2-324e-4373-9706-99ef83cd6f9d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9a9926b-0688-4bc0-ad84-d04d1c11e889", "address": "fa:16:3e:0d:89:98", "network": {"id": "f6bb574e-dc90-445b-b678-6e7d825a8437", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-198645654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d000751b939e4805abb861b91d698b6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a9926b-06", "ovs_interfaceid": "d9a9926b-0688-4bc0-ad84-d04d1c11e889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:19:44 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-08e50000-a814-4951-9264-23609359fc93 tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Converting VIF {"id": "d9a9926b-0688-4bc0-ad84-d04d1c11e889", "address": "fa:16:3e:0d:89:98", "network": {"id": "f6bb574e-dc90-445b-b678-6e7d825a8437", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-198645654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d000751b939e4805abb861b91d698b6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a9926b-06", "ovs_interfaceid": "d9a9926b-0688-4bc0-ad84-d04d1c11e889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:19:44 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-08e50000-a814-4951-9264-23609359fc93 tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:89:98,bridge_name='br-int',has_traffic_filtering=True,id=d9a9926b-0688-4bc0-ad84-d04d1c11e889,network=Network(f6bb574e-dc90-445b-b678-6e7d825a8437),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9a9926b-06') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:19:44 user nova-compute[72362]: DEBUG os_vif [None req-08e50000-a814-4951-9264-23609359fc93 tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:89:98,bridge_name='br-int',has_traffic_filtering=True,id=d9a9926b-0688-4bc0-ad84-d04d1c11e889,network=Network(f6bb574e-dc90-445b-b678-6e7d825a8437),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9a9926b-06') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:19:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd9a9926b-06, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:19:44 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Instance destroyed successfully.
Aug 09 10:19:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:19:44 user nova-compute[72362]: DEBUG nova.objects.instance [None req-0fdf3fee-5b00-4398-8cbb-464642723b4d tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Lazy-loading 'resources' on Instance uuid 00af3d8e-bd93-4520-91e7-29c135c03e55 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:19:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:44 user nova-compute[72362]: INFO os_vif [None req-08e50000-a814-4951-9264-23609359fc93 tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:89:98,bridge_name='br-int',has_traffic_filtering=True,id=d9a9926b-0688-4bc0-ad84-d04d1c11e889,network=Network(f6bb574e-dc90-445b-b678-6e7d825a8437),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9a9926b-06')
Aug 09 10:19:44 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-08e50000-a814-4951-9264-23609359fc93 tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Deleting instance files /opt/stack/data/nova/instances/93faa4d2-324e-4373-9706-99ef83cd6f9d_del
Aug 09 10:19:44 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-08e50000-a814-4951-9264-23609359fc93 tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Deletion of /opt/stack/data/nova/instances/93faa4d2-324e-4373-9706-99ef83cd6f9d_del complete
Aug 09 10:19:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-0fdf3fee-5b00-4398-8cbb-464642723b4d tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:16:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1129807899',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1129807899',id=7,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKTy1BEGFgb2LwPCE0l4ZdsIb1CDE+2z5XZX+3IOS7BmpUspCkv8nslwIBX+XdLBElH9a7nR/A5XVOfQJoXDwudCeZ0lpAUFsL0E9TcfQKbmNmV+/CzT9enkfH7jf9KfQ==',key_name='tempest-keypair-426982747',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:16:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a68b4a52019441480a19783a89e0af8',ramdisk_id='',reservation_id='r-80xqf6s8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-202820908',owner_user_name='tempest-TaggedAttachmentsTest-202820908-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:16:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5dd4d0e5c03744569a542098432622d7',uuid=00af3d8e-bd93-4520-91e7-29c135c03e55,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1efbc456-6c56-4367-845f-0afa8acdcec4", "address": "fa:16:3e:76:bd:21", "network": {"id": "1eaf9aa3-1d74-424c-86c6-28096cf53571", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-621134432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a68b4a52019441480a19783a89e0af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1efbc456-6c", "ovs_interfaceid": "1efbc456-6c56-4367-845f-0afa8acdcec4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:19:44 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-0fdf3fee-5b00-4398-8cbb-464642723b4d tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Converting VIF {"id": "1efbc456-6c56-4367-845f-0afa8acdcec4", "address": "fa:16:3e:76:bd:21", "network": {"id": "1eaf9aa3-1d74-424c-86c6-28096cf53571", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-621134432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a68b4a52019441480a19783a89e0af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1efbc456-6c", "ovs_interfaceid": "1efbc456-6c56-4367-845f-0afa8acdcec4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:19:44 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-0fdf3fee-5b00-4398-8cbb-464642723b4d tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:bd:21,bridge_name='br-int',has_traffic_filtering=True,id=1efbc456-6c56-4367-845f-0afa8acdcec4,network=Network(1eaf9aa3-1d74-424c-86c6-28096cf53571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1efbc456-6c') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:19:44 user nova-compute[72362]: DEBUG os_vif [None req-0fdf3fee-5b00-4398-8cbb-464642723b4d tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:bd:21,bridge_name='br-int',has_traffic_filtering=True,id=1efbc456-6c56-4367-845f-0afa8acdcec4,network=Network(1eaf9aa3-1d74-424c-86c6-28096cf53571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1efbc456-6c') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:19:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1efbc456-6c, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:19:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:19:44 user nova-compute[72362]: INFO os_vif [None req-0fdf3fee-5b00-4398-8cbb-464642723b4d tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:bd:21,bridge_name='br-int',has_traffic_filtering=True,id=1efbc456-6c56-4367-845f-0afa8acdcec4,network=Network(1eaf9aa3-1d74-424c-86c6-28096cf53571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1efbc456-6c')
Aug 09 10:19:44 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-0fdf3fee-5b00-4398-8cbb-464642723b4d tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Deleting instance files /opt/stack/data/nova/instances/00af3d8e-bd93-4520-91e7-29c135c03e55_del
Aug 09 10:19:44 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-0fdf3fee-5b00-4398-8cbb-464642723b4d tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Deletion of /opt/stack/data/nova/instances/00af3d8e-bd93-4520-91e7-29c135c03e55_del complete
Aug 09 10:19:44 user nova-compute[72362]: INFO nova.compute.manager [None req-08e50000-a814-4951-9264-23609359fc93 tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Took 1.57 seconds to destroy the instance on the hypervisor.
Aug 09 10:19:44 user nova-compute[72362]: DEBUG oslo.service.loopingcall [None req-08e50000-a814-4951-9264-23609359fc93 tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72362) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 10:19:44 user nova-compute[72362]: DEBUG nova.compute.manager [-] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Deallocating network for instance {{(pid=72362) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 10:19:44 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] deallocate_for_instance() {{(pid=72362) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 10:19:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:44 user nova-compute[72362]: INFO nova.compute.manager [None req-0fdf3fee-5b00-4398-8cbb-464642723b4d tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Took 1.23 seconds to destroy the instance on the hypervisor.
Aug 09 10:19:44 user nova-compute[72362]: DEBUG oslo.service.loopingcall [None req-0fdf3fee-5b00-4398-8cbb-464642723b4d tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72362) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 10:19:44 user nova-compute[72362]: DEBUG nova.compute.manager [-] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Deallocating network for instance {{(pid=72362) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 10:19:44 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] deallocate_for_instance() {{(pid=72362) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 10:19:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:45 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:19:45 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Took 0.82 seconds to deallocate network for instance.
Aug 09 10:19:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-08e50000-a814-4951-9264-23609359fc93 tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:19:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-08e50000-a814-4951-9264-23609359fc93 tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:19:45 user nova-compute[72362]: DEBUG nova.compute.manager [req-44608658-8c04-4c81-975d-718c86a1ac48 req-723ba0d4-7d1b-4e69-9fe7-7b66ff9a984b service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Received event network-vif-plugged-1efbc456-6c56-4367-845f-0afa8acdcec4 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:19:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-44608658-8c04-4c81-975d-718c86a1ac48 req-723ba0d4-7d1b-4e69-9fe7-7b66ff9a984b service nova] Acquiring lock "00af3d8e-bd93-4520-91e7-29c135c03e55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:19:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-44608658-8c04-4c81-975d-718c86a1ac48 req-723ba0d4-7d1b-4e69-9fe7-7b66ff9a984b service nova] Lock "00af3d8e-bd93-4520-91e7-29c135c03e55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:19:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-44608658-8c04-4c81-975d-718c86a1ac48 req-723ba0d4-7d1b-4e69-9fe7-7b66ff9a984b service nova] Lock "00af3d8e-bd93-4520-91e7-29c135c03e55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:19:45 user nova-compute[72362]: DEBUG nova.compute.manager [req-44608658-8c04-4c81-975d-718c86a1ac48 req-723ba0d4-7d1b-4e69-9fe7-7b66ff9a984b service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] No waiting events found dispatching network-vif-plugged-1efbc456-6c56-4367-845f-0afa8acdcec4 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:19:45 user nova-compute[72362]: WARNING nova.compute.manager [req-44608658-8c04-4c81-975d-718c86a1ac48 req-723ba0d4-7d1b-4e69-9fe7-7b66ff9a984b service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Received unexpected event network-vif-plugged-1efbc456-6c56-4367-845f-0afa8acdcec4 for instance with vm_state active and task_state deleting.
Aug 09 10:19:45 user nova-compute[72362]: DEBUG nova.compute.manager [req-44608658-8c04-4c81-975d-718c86a1ac48 req-723ba0d4-7d1b-4e69-9fe7-7b66ff9a984b service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Received event network-vif-plugged-1efbc456-6c56-4367-845f-0afa8acdcec4 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:19:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-44608658-8c04-4c81-975d-718c86a1ac48 req-723ba0d4-7d1b-4e69-9fe7-7b66ff9a984b service nova] Acquiring lock "00af3d8e-bd93-4520-91e7-29c135c03e55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:19:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-44608658-8c04-4c81-975d-718c86a1ac48 req-723ba0d4-7d1b-4e69-9fe7-7b66ff9a984b service nova] Lock "00af3d8e-bd93-4520-91e7-29c135c03e55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:19:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-44608658-8c04-4c81-975d-718c86a1ac48 req-723ba0d4-7d1b-4e69-9fe7-7b66ff9a984b service nova] Lock "00af3d8e-bd93-4520-91e7-29c135c03e55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:19:45 user nova-compute[72362]: DEBUG nova.compute.manager [req-44608658-8c04-4c81-975d-718c86a1ac48 req-723ba0d4-7d1b-4e69-9fe7-7b66ff9a984b service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] No waiting events found dispatching network-vif-plugged-1efbc456-6c56-4367-845f-0afa8acdcec4 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:19:45 user nova-compute[72362]: WARNING nova.compute.manager [req-44608658-8c04-4c81-975d-718c86a1ac48 req-723ba0d4-7d1b-4e69-9fe7-7b66ff9a984b service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Received unexpected event network-vif-plugged-1efbc456-6c56-4367-845f-0afa8acdcec4 for instance with vm_state active and task_state deleting.
Aug 09 10:19:45 user nova-compute[72362]: DEBUG nova.compute.manager [req-44608658-8c04-4c81-975d-718c86a1ac48 req-723ba0d4-7d1b-4e69-9fe7-7b66ff9a984b service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Received event network-vif-plugged-1efbc456-6c56-4367-845f-0afa8acdcec4 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:19:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-44608658-8c04-4c81-975d-718c86a1ac48 req-723ba0d4-7d1b-4e69-9fe7-7b66ff9a984b service nova] Acquiring lock "00af3d8e-bd93-4520-91e7-29c135c03e55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:19:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-44608658-8c04-4c81-975d-718c86a1ac48 req-723ba0d4-7d1b-4e69-9fe7-7b66ff9a984b service nova] Lock "00af3d8e-bd93-4520-91e7-29c135c03e55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:19:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-44608658-8c04-4c81-975d-718c86a1ac48 req-723ba0d4-7d1b-4e69-9fe7-7b66ff9a984b service nova] Lock "00af3d8e-bd93-4520-91e7-29c135c03e55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:19:45 user nova-compute[72362]: DEBUG nova.compute.manager [req-44608658-8c04-4c81-975d-718c86a1ac48 req-723ba0d4-7d1b-4e69-9fe7-7b66ff9a984b service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] No waiting events found dispatching network-vif-plugged-1efbc456-6c56-4367-845f-0afa8acdcec4 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:19:45 user nova-compute[72362]: WARNING nova.compute.manager [req-44608658-8c04-4c81-975d-718c86a1ac48 req-723ba0d4-7d1b-4e69-9fe7-7b66ff9a984b service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Received unexpected event network-vif-plugged-1efbc456-6c56-4367-845f-0afa8acdcec4 for instance with vm_state active and task_state deleting.
Aug 09 10:19:45 user nova-compute[72362]: DEBUG nova.compute.manager [req-44608658-8c04-4c81-975d-718c86a1ac48 req-723ba0d4-7d1b-4e69-9fe7-7b66ff9a984b service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Received event network-vif-unplugged-1efbc456-6c56-4367-845f-0afa8acdcec4 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:19:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-44608658-8c04-4c81-975d-718c86a1ac48 req-723ba0d4-7d1b-4e69-9fe7-7b66ff9a984b service nova] Acquiring lock "00af3d8e-bd93-4520-91e7-29c135c03e55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:19:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-44608658-8c04-4c81-975d-718c86a1ac48 req-723ba0d4-7d1b-4e69-9fe7-7b66ff9a984b service nova] Lock "00af3d8e-bd93-4520-91e7-29c135c03e55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:19:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-44608658-8c04-4c81-975d-718c86a1ac48 req-723ba0d4-7d1b-4e69-9fe7-7b66ff9a984b service nova] Lock "00af3d8e-bd93-4520-91e7-29c135c03e55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:19:45 user nova-compute[72362]: DEBUG nova.compute.manager [req-44608658-8c04-4c81-975d-718c86a1ac48 req-723ba0d4-7d1b-4e69-9fe7-7b66ff9a984b service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] No waiting events found dispatching network-vif-unplugged-1efbc456-6c56-4367-845f-0afa8acdcec4 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:19:45 user nova-compute[72362]: DEBUG nova.compute.manager [req-44608658-8c04-4c81-975d-718c86a1ac48 req-723ba0d4-7d1b-4e69-9fe7-7b66ff9a984b service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Received event network-vif-unplugged-1efbc456-6c56-4367-845f-0afa8acdcec4 for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:19:45 user nova-compute[72362]: DEBUG nova.compute.manager [req-cf8b4cf9-d5f3-44ed-a764-76047460b1b3 req-17f4e8dd-8dc4-4273-8bfd-cc75755ce478 service nova] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Received event network-vif-plugged-d9a9926b-0688-4bc0-ad84-d04d1c11e889 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:19:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-cf8b4cf9-d5f3-44ed-a764-76047460b1b3 req-17f4e8dd-8dc4-4273-8bfd-cc75755ce478 service nova] Acquiring lock "93faa4d2-324e-4373-9706-99ef83cd6f9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:19:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-cf8b4cf9-d5f3-44ed-a764-76047460b1b3 req-17f4e8dd-8dc4-4273-8bfd-cc75755ce478 service nova] Lock "93faa4d2-324e-4373-9706-99ef83cd6f9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:19:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-cf8b4cf9-d5f3-44ed-a764-76047460b1b3 req-17f4e8dd-8dc4-4273-8bfd-cc75755ce478 service nova] Lock "93faa4d2-324e-4373-9706-99ef83cd6f9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:19:45 user nova-compute[72362]: DEBUG nova.compute.manager [req-cf8b4cf9-d5f3-44ed-a764-76047460b1b3 req-17f4e8dd-8dc4-4273-8bfd-cc75755ce478 service nova] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] No waiting events found dispatching network-vif-plugged-d9a9926b-0688-4bc0-ad84-d04d1c11e889 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:19:45 user nova-compute[72362]: WARNING nova.compute.manager [req-cf8b4cf9-d5f3-44ed-a764-76047460b1b3 req-17f4e8dd-8dc4-4273-8bfd-cc75755ce478 service nova] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Received unexpected event network-vif-plugged-d9a9926b-0688-4bc0-ad84-d04d1c11e889 for instance with vm_state deleted and task_state None.
Aug 09 10:19:45 user nova-compute[72362]: DEBUG nova.compute.manager [req-cf8b4cf9-d5f3-44ed-a764-76047460b1b3 req-17f4e8dd-8dc4-4273-8bfd-cc75755ce478 service nova] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Received event network-vif-deleted-d9a9926b-0688-4bc0-ad84-d04d1c11e889 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:19:45 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-08e50000-a814-4951-9264-23609359fc93 tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:19:45 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:45 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-08e50000-a814-4951-9264-23609359fc93 tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:19:45 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:45 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-08e50000-a814-4951-9264-23609359fc93 tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.670s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:19:45 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-08e50000-a814-4951-9264-23609359fc93 tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Deleted allocations for instance 93faa4d2-324e-4373-9706-99ef83cd6f9d
Aug 09 10:19:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-08e50000-a814-4951-9264-23609359fc93 tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Lock "93faa4d2-324e-4373-9706-99ef83cd6f9d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.318s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:19:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0944b927-61e9-4ebe-8cd5-08bfb1c760af tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Acquiring lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:19:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0944b927-61e9-4ebe-8cd5-08bfb1c760af tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:19:46 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691576371.0888436, 8f0c62c9-aa84-4a5b-b909-af5535e87c83 => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:19:46 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] VM Stopped (Lifecycle Event)
Aug 09 10:19:46 user nova-compute[72362]: DEBUG nova.objects.instance [None req-0944b927-61e9-4ebe-8cd5-08bfb1c760af tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lazy-loading 'flavor' on Instance uuid 0e8a7668-1635-4cbc-8c09-ece19ff67d4f {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:19:46 user nova-compute[72362]: DEBUG nova.compute.manager [None req-0d4e9092-9ecb-4991-9eb2-80be693d5cfe None None] [instance: 8f0c62c9-aa84-4a5b-b909-af5535e87c83] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:19:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0944b927-61e9-4ebe-8cd5-08bfb1c760af tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:19:46 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:19:46 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Took 1.99 seconds to deallocate network for instance.
Aug 09 10:19:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0944b927-61e9-4ebe-8cd5-08bfb1c760af tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Acquiring lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:19:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0944b927-61e9-4ebe-8cd5-08bfb1c760af tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:19:46 user nova-compute[72362]: INFO nova.compute.manager [None req-0944b927-61e9-4ebe-8cd5-08bfb1c760af tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Attaching volume 8ef319fe-2472-41ac-86a6-0e4f3522e7c7 to /dev/vdb
Aug 09 10:19:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0fdf3fee-5b00-4398-8cbb-464642723b4d tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:19:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0fdf3fee-5b00-4398-8cbb-464642723b4d tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:19:46 user nova-compute[72362]: DEBUG os_brick.utils [None req-0944b927-61e9-4ebe-8cd5-08bfb1c760af tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:19:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:46 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f08047-ef93-4aba-8f21-4d3b7f343ab1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:19:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:46 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2b527b-1f6b-449e-bf97-27c3b2b246f0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:19:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:46 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6597a1-7f97-4262-9efc-47d1c4ea39a7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:19:46 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e2436b-4f7f-428f-a77f-4e2271b6bc49]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:19:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-0944b927-61e9-4ebe-8cd5-08bfb1c760af tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-0944b927-61e9-4ebe-8cd5-08bfb1c760af tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:19:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0944b927-61e9-4ebe-8cd5-08bfb1c760af tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:19:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:19:46 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:19:46 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[86dd40f3-a33f-4eac-8b46-d518ebe4990e]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:19:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-0944b927-61e9-4ebe-8cd5-08bfb1c760af tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:19:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-0944b927-61e9-4ebe-8cd5-08bfb1c760af tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:19:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-0944b927-61e9-4ebe-8cd5-08bfb1c760af tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:19:46 user nova-compute[72362]: DEBUG os_brick.utils [None req-0944b927-61e9-4ebe-8cd5-08bfb1c760af tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:19:46 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-0944b927-61e9-4ebe-8cd5-08bfb1c760af tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Updating existing volume attachment record: cdb1e04a-789a-4b79-9709-b0e1375231dd {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 10:19:46 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-0fdf3fee-5b00-4398-8cbb-464642723b4d tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:19:46 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-0fdf3fee-5b00-4398-8cbb-464642723b4d tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:19:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0fdf3fee-5b00-4398-8cbb-464642723b4d tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.473s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:19:46 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-0fdf3fee-5b00-4398-8cbb-464642723b4d tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Deleted allocations for instance 00af3d8e-bd93-4520-91e7-29c135c03e55
Aug 09 10:19:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0fdf3fee-5b00-4398-8cbb-464642723b4d tempest-TaggedAttachmentsTest-202820908 tempest-TaggedAttachmentsTest-202820908-project-member] Lock "00af3d8e-bd93-4520-91e7-29c135c03e55" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.920s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:19:47 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576387.0427759, d5b048c8-a329-4fe3-ab62-a06ab6401230 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:19:47 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] VM Resumed (Lifecycle Event)
Aug 09 10:19:47 user nova-compute[72362]: DEBUG nova.compute.manager [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:19:47 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:19:47 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Instance spawned successfully.
Aug 09 10:19:47 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 10:19:47 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:19:47 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:19:47 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Found default for hw_cdrom_bus of ide {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:19:47 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Found default for hw_disk_bus of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:19:47 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:19:47 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:19:47 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Found default for hw_video_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:19:47 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Found default for hw_vif_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:19:47 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:19:47 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576387.0474854, d5b048c8-a329-4fe3-ab62-a06ab6401230 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:19:47 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] VM Started (Lifecycle Event)
Aug 09 10:19:47 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:19:47 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:19:47 user nova-compute[72362]: INFO nova.compute.manager [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Took 7.17 seconds to spawn the instance on the hypervisor.
Aug 09 10:19:47 user nova-compute[72362]: DEBUG nova.compute.manager [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:19:47 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:19:47 user nova-compute[72362]: INFO nova.compute.manager [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Took 8.06 seconds to build instance.
Aug 09 10:19:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-15bd66a0-1397-4f37-90ea-7b002cdf8924 tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Lock "d5b048c8-a329-4fe3-ab62-a06ab6401230" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.171s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:19:47 user nova-compute[72362]: DEBUG nova.compute.manager [req-80e6627e-9b8f-40d6-baad-6c8376fc09fc req-63c8a062-eb42-4ac9-88d2-80ba5e62ae19 service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Received event network-vif-plugged-1efbc456-6c56-4367-845f-0afa8acdcec4 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:19:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-80e6627e-9b8f-40d6-baad-6c8376fc09fc req-63c8a062-eb42-4ac9-88d2-80ba5e62ae19 service nova] Acquiring lock "00af3d8e-bd93-4520-91e7-29c135c03e55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:19:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-80e6627e-9b8f-40d6-baad-6c8376fc09fc req-63c8a062-eb42-4ac9-88d2-80ba5e62ae19 service nova] Lock "00af3d8e-bd93-4520-91e7-29c135c03e55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:19:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-80e6627e-9b8f-40d6-baad-6c8376fc09fc req-63c8a062-eb42-4ac9-88d2-80ba5e62ae19 service nova] Lock "00af3d8e-bd93-4520-91e7-29c135c03e55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:19:47 user nova-compute[72362]: DEBUG nova.compute.manager [req-80e6627e-9b8f-40d6-baad-6c8376fc09fc req-63c8a062-eb42-4ac9-88d2-80ba5e62ae19 service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] No waiting events found dispatching network-vif-plugged-1efbc456-6c56-4367-845f-0afa8acdcec4 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:19:47 user nova-compute[72362]: WARNING nova.compute.manager [req-80e6627e-9b8f-40d6-baad-6c8376fc09fc req-63c8a062-eb42-4ac9-88d2-80ba5e62ae19 service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Received unexpected event network-vif-plugged-1efbc456-6c56-4367-845f-0afa8acdcec4 for instance with vm_state deleted and task_state None.
Aug 09 10:19:47 user nova-compute[72362]: DEBUG nova.compute.manager [req-80e6627e-9b8f-40d6-baad-6c8376fc09fc req-63c8a062-eb42-4ac9-88d2-80ba5e62ae19 service nova] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Received event network-vif-deleted-1efbc456-6c56-4367-845f-0afa8acdcec4 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:19:47 user nova-compute[72362]: DEBUG nova.compute.manager [req-80e6627e-9b8f-40d6-baad-6c8376fc09fc req-63c8a062-eb42-4ac9-88d2-80ba5e62ae19 service nova] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Received event network-vif-plugged-c6f3f94c-4160-4103-8784-d86042b30f45 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:19:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-80e6627e-9b8f-40d6-baad-6c8376fc09fc req-63c8a062-eb42-4ac9-88d2-80ba5e62ae19 service nova] Acquiring lock "d5b048c8-a329-4fe3-ab62-a06ab6401230-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:19:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-80e6627e-9b8f-40d6-baad-6c8376fc09fc req-63c8a062-eb42-4ac9-88d2-80ba5e62ae19 service nova] Lock "d5b048c8-a329-4fe3-ab62-a06ab6401230-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:19:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-80e6627e-9b8f-40d6-baad-6c8376fc09fc req-63c8a062-eb42-4ac9-88d2-80ba5e62ae19 service nova] Lock "d5b048c8-a329-4fe3-ab62-a06ab6401230-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:19:47 user nova-compute[72362]: DEBUG nova.compute.manager [req-80e6627e-9b8f-40d6-baad-6c8376fc09fc req-63c8a062-eb42-4ac9-88d2-80ba5e62ae19 service nova] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] No waiting events found dispatching network-vif-plugged-c6f3f94c-4160-4103-8784-d86042b30f45 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:19:47 user nova-compute[72362]: WARNING nova.compute.manager [req-80e6627e-9b8f-40d6-baad-6c8376fc09fc req-63c8a062-eb42-4ac9-88d2-80ba5e62ae19 service nova] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Received unexpected event network-vif-plugged-c6f3f94c-4160-4103-8784-d86042b30f45 for instance with vm_state active and task_state None.
Aug 09 10:19:47 user nova-compute[72362]: DEBUG nova.compute.manager [req-80e6627e-9b8f-40d6-baad-6c8376fc09fc req-63c8a062-eb42-4ac9-88d2-80ba5e62ae19 service nova] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Received event network-vif-plugged-c6f3f94c-4160-4103-8784-d86042b30f45 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:19:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-80e6627e-9b8f-40d6-baad-6c8376fc09fc req-63c8a062-eb42-4ac9-88d2-80ba5e62ae19 service nova] Acquiring lock "d5b048c8-a329-4fe3-ab62-a06ab6401230-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:19:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-80e6627e-9b8f-40d6-baad-6c8376fc09fc req-63c8a062-eb42-4ac9-88d2-80ba5e62ae19 service nova] Lock "d5b048c8-a329-4fe3-ab62-a06ab6401230-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:19:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-80e6627e-9b8f-40d6-baad-6c8376fc09fc req-63c8a062-eb42-4ac9-88d2-80ba5e62ae19 service nova] Lock "d5b048c8-a329-4fe3-ab62-a06ab6401230-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:19:47 user nova-compute[72362]: DEBUG nova.compute.manager [req-80e6627e-9b8f-40d6-baad-6c8376fc09fc req-63c8a062-eb42-4ac9-88d2-80ba5e62ae19 service nova] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] No waiting events found dispatching network-vif-plugged-c6f3f94c-4160-4103-8784-d86042b30f45 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:19:47 user nova-compute[72362]: WARNING nova.compute.manager [req-80e6627e-9b8f-40d6-baad-6c8376fc09fc req-63c8a062-eb42-4ac9-88d2-80ba5e62ae19 service nova] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Received unexpected event network-vif-plugged-c6f3f94c-4160-4103-8784-d86042b30f45 for instance with vm_state active and task_state None.
Aug 09 10:19:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:50 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:51 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:19:51 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:19:51 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:19:52 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:19:53 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:19:53 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 10:19:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "refresh_cache-ea95226c-40fe-4408-a9f0-5538659261a6" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:19:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquired lock "refresh_cache-ea95226c-40fe-4408-a9f0-5538659261a6" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:19:54 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Forcefully refreshing network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 10:19:54 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:54 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Updating instance_info_cache with network_info: [{"id": "fc1688e4-e2d3-4f8f-be55-4a6793ae4497", "address": "fa:16:3e:31:49:f0", "network": {"id": "c32d66f0-0db4-4c6b-a45d-8c1eb6f4b510", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-858657617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2e7ca3484c64611b9573ba0b86592b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc1688e4-e2", "ovs_interfaceid": "fc1688e4-e2d3-4f8f-be55-4a6793ae4497", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:19:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Releasing lock "refresh_cache-ea95226c-40fe-4408-a9f0-5538659261a6" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:19:54 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Updated the network info_cache for instance {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 10:19:54 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:19:54 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 10:19:54 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:19:55 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:55 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0944b927-61e9-4ebe-8cd5-08bfb1c760af tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:19:55 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-0944b927-61e9-4ebe-8cd5-08bfb1c760af tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MhmCwvOG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:19:55 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-0944b927-61e9-4ebe-8cd5-08bfb1c760af tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:19:55 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-0944b927-61e9-4ebe-8cd5-08bfb1c760af tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:19:55 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-0944b927-61e9-4ebe-8cd5-08bfb1c760af tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:19:55 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-0944b927-61e9-4ebe-8cd5-08bfb1c760af tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:19:55 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-0944b927-61e9-4ebe-8cd5-08bfb1c760af tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:19:55 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-0944b927-61e9-4ebe-8cd5-08bfb1c760af tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:19:55 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-0944b927-61e9-4ebe-8cd5-08bfb1c760af tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:19:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:55 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f6eb8d-5030-4822-ad51-ff33bca1f9de]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:19:55 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-0944b927-61e9-4ebe-8cd5-08bfb1c760af tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:19:55 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:19:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:55 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a12f5c-b873-4052-bab2-06455bd4460f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:19:55 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-0944b927-61e9-4ebe-8cd5-08bfb1c760af tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7] added
Aug 09 10:19:55 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:19:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:55 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f59cce-185f-4fca-b7d9-f24325f89413]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:19:55 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-0944b927-61e9-4ebe-8cd5-08bfb1c760af tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:19:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:55 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed35850-275b-497d-b9f6-f4011bc18ed1]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:19:55 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-0944b927-61e9-4ebe-8cd5-08bfb1c760af tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:19:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MhmCwvOG {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:55 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:19:55 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:19:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MhmCwvOG" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:55 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47199f6-5486-4264-9602-212417d71c40]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:19:55 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-0944b927-61e9-4ebe-8cd5-08bfb1c760af tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MhmCwvOG'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:19:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:56 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[01dbd5c4-3f96-4d14-b706-8d5f9b0d7873]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:19:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-0944b927-61e9-4ebe-8cd5-08bfb1c760af tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:19:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:56 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3212ea-3fa2-4e6f-bf9a-cbb54247d5e6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b61407a-3bab-4323-8fc8-442e4f379dba (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:19:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-0944b927-61e9-4ebe-8cd5-08bfb1c760af tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b61407a-3bab-4323-8fc8-442e4f379dba (non-flash)
Aug 09 10:19:56 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:19:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-0944b927-61e9-4ebe-8cd5-08bfb1c760af tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b61407a-3bab-4323-8fc8-442e4f379dba (non-flash)
Aug 09 10:19:56 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:19:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:56 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[686d4b33-a5b0-4922-a043-44e53b37122b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:19:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-0944b927-61e9-4ebe-8cd5-08bfb1c760af tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7, portal: 172.16.0.220,3260]
Aug 09 10:19:56 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7, portal: 172.16.0.220,3260] successful.
Aug 09 10:19:56 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:19:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:56 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf2d030-0682-4346-8e9c-92717f6edfe9]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:19:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-0944b927-61e9-4ebe-8cd5-08bfb1c760af tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:19:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:56 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9bb3ee-74b3-4791-8a5b-d9c3afcbe902]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b61407a-3bab-4323-8fc8-442e4f379dba (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:19:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-0944b927-61e9-4ebe-8cd5-08bfb1c760af tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b61407a-3bab-4323-8fc8-442e4f379dba (non-flash)
Aug 09 10:19:56 user nova-compute[72362]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:19:56 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:19:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-0944b927-61e9-4ebe-8cd5-08bfb1c760af tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b61407a-3bab-4323-8fc8-442e4f379dba (non-flash)
Aug 09 10:19:56 user nova-compute[72362]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:19:56 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:19:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-0944b927-61e9-4ebe-8cd5-08bfb1c760af tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:19:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-0944b927-61e9-4ebe-8cd5-08bfb1c760af tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:19:56 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-0944b927-61e9-4ebe-8cd5-08bfb1c760af tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] HCTL ('34', '-', '-', 0) found on session 11 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:19:56 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-0944b927-61e9-4ebe-8cd5-08bfb1c760af tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:19:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:56 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe98efb-d3d8-4b4f-a7cd-b603ba3ffebf]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:19:56 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-0944b927-61e9-4ebe-8cd5-08bfb1c760af tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Searching for a device in session 11 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:19:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-0944b927-61e9-4ebe-8cd5-08bfb1c760af tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MhmCwvOG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:19:56 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:56 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:19:57 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:19:57 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:19:57 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:19:57 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 10:19:57 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-0944b927-61e9-4ebe-8cd5-08bfb1c760af tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:19:57 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-0944b927-61e9-4ebe-8cd5-08bfb1c760af tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23533383563306638', 'path': '/dev/sdc'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:19:57 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0944b927-61e9-4ebe-8cd5-08bfb1c760af tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533383563306638', 'path': '/dev/sdc'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:19:57 user nova-compute[72362]: DEBUG nova.objects.instance [None req-0944b927-61e9-4ebe-8cd5-08bfb1c760af tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lazy-loading 'flavor' on Instance uuid 0e8a7668-1635-4cbc-8c09-ece19ff67d4f {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:19:57 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:57 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-0944b927-61e9-4ebe-8cd5-08bfb1c760af tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 10:19:57 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:19:57 user nova-compute[72362]:   <source dev="/dev/sdc"/>
Aug 09 10:19:57 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:19:57 user nova-compute[72362]:   <serial>8ef319fe-2472-41ac-86a6-0e4f3522e7c7</serial>
Aug 09 10:19:57 user nova-compute[72362]: </disk>
Aug 09 10:19:57 user nova-compute[72362]:  {{(pid=72362) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 10:19:57 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:57 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:57 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-bac73d91-9e85-4be7-868d-ffcfb8227ac7 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Acquiring lock "b17b317a-409e-45ad-ac7c-0c298f4f564b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:19:57 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-bac73d91-9e85-4be7-868d-ffcfb8227ac7 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Lock "b17b317a-409e-45ad-ac7c-0c298f4f564b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:19:57 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-bac73d91-9e85-4be7-868d-ffcfb8227ac7 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Acquiring lock "b17b317a-409e-45ad-ac7c-0c298f4f564b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:19:57 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-bac73d91-9e85-4be7-868d-ffcfb8227ac7 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Lock "b17b317a-409e-45ad-ac7c-0c298f4f564b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:19:57 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-bac73d91-9e85-4be7-868d-ffcfb8227ac7 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Lock "b17b317a-409e-45ad-ac7c-0c298f4f564b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:19:57 user nova-compute[72362]: INFO nova.compute.manager [None req-bac73d91-9e85-4be7-868d-ffcfb8227ac7 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Terminating instance
Aug 09 10:19:57 user nova-compute[72362]: DEBUG nova.compute.manager [None req-bac73d91-9e85-4be7-868d-ffcfb8227ac7 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Start destroying the instance on the hypervisor. {{(pid=72362) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 10:19:57 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:57 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45316ca8-e866-4e2f-a92d-d1b256613dd1/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:57 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45316ca8-e866-4e2f-a92d-d1b256613dd1/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:57 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45316ca8-e866-4e2f-a92d-d1b256613dd1/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:57 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-0944b927-61e9-4ebe-8cd5-08bfb1c760af tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:19:57 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-0944b927-61e9-4ebe-8cd5-08bfb1c760af tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:19:57 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-0944b927-61e9-4ebe-8cd5-08bfb1c760af tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] No VIF found with MAC fa:16:3e:16:b7:79, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:19:57 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45316ca8-e866-4e2f-a92d-d1b256613dd1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:57 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca002e73-ddf7-4452-82b6-0d831d984756/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:57 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0944b927-61e9-4ebe-8cd5-08bfb1c760af tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.613s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:19:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca002e73-ddf7-4452-82b6-0d831d984756/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca002e73-ddf7-4452-82b6-0d831d984756/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca002e73-ddf7-4452-82b6-0d831d984756/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b17b317a-409e-45ad-ac7c-0c298f4f564b/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:58 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Instance destroyed successfully.
Aug 09 10:19:58 user nova-compute[72362]: DEBUG nova.objects.instance [None req-bac73d91-9e85-4be7-868d-ffcfb8227ac7 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Lazy-loading 'resources' on Instance uuid b17b317a-409e-45ad-ac7c-0c298f4f564b {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:19:58 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-bac73d91-9e85-4be7-868d-ffcfb8227ac7 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:16:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1809299077',display_name='tempest-TestVolumeSwap-server-1809299077',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1809299077',id=6,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2Gz8XzDN7Je5NY8tGYVDzF64Yimgs6RHbgxOC5jc5XitNw/UEqfbDiCSmudIZcuCTMrfrI0dJXdCkL9cdctYTZFfc5bZMwGF/evkmd65qtVZXMhhdU2Kqaif1mmANddw==',key_name='tempest-keypair-920893137',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:16:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9eadf3da29124620a2ec066a13cbf2c8',ramdisk_id='',reservation_id='r-9ua0am2z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1355303837',owner_user_name='tempest-TestVolumeSwap-1355303837-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:16:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9cb836c99dd84cd2a8cddefaca58a3c9',uuid=b17b317a-409e-45ad-ac7c-0c298f4f564b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "76c0daec-94af-49ef-b33c-73925b6fb175", "address": "fa:16:3e:0d:a8:5c", "network": {"id": "8cf43717-164f-47a3-859d-66488f6725ea", "bridge": "br-int", "label": "tempest-TestVolumeSwap-365627362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eadf3da29124620a2ec066a13cbf2c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76c0daec-94", "ovs_interfaceid": "76c0daec-94af-49ef-b33c-73925b6fb175", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:19:58 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-bac73d91-9e85-4be7-868d-ffcfb8227ac7 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Converting VIF {"id": "76c0daec-94af-49ef-b33c-73925b6fb175", "address": "fa:16:3e:0d:a8:5c", "network": {"id": "8cf43717-164f-47a3-859d-66488f6725ea", "bridge": "br-int", "label": "tempest-TestVolumeSwap-365627362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eadf3da29124620a2ec066a13cbf2c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76c0daec-94", "ovs_interfaceid": "76c0daec-94af-49ef-b33c-73925b6fb175", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:19:58 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-bac73d91-9e85-4be7-868d-ffcfb8227ac7 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:a8:5c,bridge_name='br-int',has_traffic_filtering=True,id=76c0daec-94af-49ef-b33c-73925b6fb175,network=Network(8cf43717-164f-47a3-859d-66488f6725ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76c0daec-94') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:19:58 user nova-compute[72362]: DEBUG os_vif [None req-bac73d91-9e85-4be7-868d-ffcfb8227ac7 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:a8:5c,bridge_name='br-int',has_traffic_filtering=True,id=76c0daec-94af-49ef-b33c-73925b6fb175,network=Network(8cf43717-164f-47a3-859d-66488f6725ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76c0daec-94') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:19:58 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:58 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap76c0daec-94, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:19:58 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:19:58 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:19:58 user nova-compute[72362]: INFO os_vif [None req-bac73d91-9e85-4be7-868d-ffcfb8227ac7 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:a8:5c,bridge_name='br-int',has_traffic_filtering=True,id=76c0daec-94af-49ef-b33c-73925b6fb175,network=Network(8cf43717-164f-47a3-859d-66488f6725ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76c0daec-94')
Aug 09 10:19:58 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-bac73d91-9e85-4be7-868d-ffcfb8227ac7 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Deleting instance files /opt/stack/data/nova/instances/b17b317a-409e-45ad-ac7c-0c298f4f564b_del
Aug 09 10:19:58 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-bac73d91-9e85-4be7-868d-ffcfb8227ac7 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Deletion of /opt/stack/data/nova/instances/b17b317a-409e-45ad-ac7c-0c298f4f564b_del complete
Aug 09 10:19:58 user nova-compute[72362]: INFO nova.compute.manager [None req-bac73d91-9e85-4be7-868d-ffcfb8227ac7 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 09 10:19:58 user nova-compute[72362]: DEBUG oslo.service.loopingcall [None req-bac73d91-9e85-4be7-868d-ffcfb8227ac7 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72362) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 10:19:58 user nova-compute[72362]: DEBUG nova.compute.manager [-] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Deallocating network for instance {{(pid=72362) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 10:19:58 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] deallocate_for_instance() {{(pid=72362) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 10:19:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b17b317a-409e-45ad-ac7c-0c298f4f564b/disk --force-share --output=json" returned: 1 in 0.189s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] '/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b17b317a-409e-45ad-ac7c-0c298f4f564b/disk --force-share --output=json' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:19:58 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000006, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/b17b317a-409e-45ad-ac7c-0c298f4f564b/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/b17b317a-409e-45ad-ac7c-0c298f4f564b/disk
Aug 09 10:19:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea95226c-40fe-4408-a9f0-5538659261a6/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea95226c-40fe-4408-a9f0-5538659261a6/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea95226c-40fe-4408-a9f0-5538659261a6/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea95226c-40fe-4408-a9f0-5538659261a6/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:58 user nova-compute[72362]: DEBUG nova.compute.manager [req-dafee272-ca9b-40ce-b5fc-a073a1b2124f req-81bbd86b-8caf-4fa5-9467-c712fb892b45 service nova] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Received event network-vif-unplugged-76c0daec-94af-49ef-b33c-73925b6fb175 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:19:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-dafee272-ca9b-40ce-b5fc-a073a1b2124f req-81bbd86b-8caf-4fa5-9467-c712fb892b45 service nova] Acquiring lock "b17b317a-409e-45ad-ac7c-0c298f4f564b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:19:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-dafee272-ca9b-40ce-b5fc-a073a1b2124f req-81bbd86b-8caf-4fa5-9467-c712fb892b45 service nova] Lock "b17b317a-409e-45ad-ac7c-0c298f4f564b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:19:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-dafee272-ca9b-40ce-b5fc-a073a1b2124f req-81bbd86b-8caf-4fa5-9467-c712fb892b45 service nova] Lock "b17b317a-409e-45ad-ac7c-0c298f4f564b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:19:58 user nova-compute[72362]: DEBUG nova.compute.manager [req-dafee272-ca9b-40ce-b5fc-a073a1b2124f req-81bbd86b-8caf-4fa5-9467-c712fb892b45 service nova] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] No waiting events found dispatching network-vif-unplugged-76c0daec-94af-49ef-b33c-73925b6fb175 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:19:58 user nova-compute[72362]: DEBUG nova.compute.manager [req-dafee272-ca9b-40ce-b5fc-a073a1b2124f req-81bbd86b-8caf-4fa5-9467-c712fb892b45 service nova] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Received event network-vif-unplugged-76c0daec-94af-49ef-b33c-73925b6fb175 for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:19:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:59 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691576384.0845563, 93faa4d2-324e-4373-9706-99ef83cd6f9d => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:19:59 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] VM Stopped (Lifecycle Event)
Aug 09 10:19:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:19:59 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691576384.109208, 00af3d8e-bd93-4520-91e7-29c135c03e55 => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:19:59 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] VM Stopped (Lifecycle Event)
Aug 09 10:19:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5b048c8-a329-4fe3-ab62-a06ab6401230/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:59 user nova-compute[72362]: DEBUG nova.compute.manager [None req-eb0e1eab-1bc5-400d-82ff-c3bda3f81f41 None None] [instance: 93faa4d2-324e-4373-9706-99ef83cd6f9d] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:19:59 user nova-compute[72362]: DEBUG nova.compute.manager [None req-d8bf250b-4fc5-4629-bed1-7f6e282870c6 None None] [instance: 00af3d8e-bd93-4520-91e7-29c135c03e55] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:19:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5b048c8-a329-4fe3-ab62-a06ab6401230/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5b048c8-a329-4fe3-ab62-a06ab6401230/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5b048c8-a329-4fe3-ab62-a06ab6401230/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b731e53-3436-44d2-b674-841871804c80/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:59 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:19:59 user nova-compute[72362]: DEBUG nova.compute.manager [req-f67081f3-0255-4fbb-bab6-0759abab5b5e req-ad32da77-7aaa-4801-91df-c6aff81bef91 service nova] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Received event network-vif-deleted-76c0daec-94af-49ef-b33c-73925b6fb175 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:19:59 user nova-compute[72362]: INFO nova.compute.manager [req-f67081f3-0255-4fbb-bab6-0759abab5b5e req-ad32da77-7aaa-4801-91df-c6aff81bef91 service nova] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Neutron deleted interface 76c0daec-94af-49ef-b33c-73925b6fb175; detaching it from the instance and deleting it from the info cache
Aug 09 10:19:59 user nova-compute[72362]: DEBUG nova.network.neutron [req-f67081f3-0255-4fbb-bab6-0759abab5b5e req-ad32da77-7aaa-4801-91df-c6aff81bef91 service nova] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:19:59 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Took 1.16 seconds to deallocate network for instance.
Aug 09 10:19:59 user nova-compute[72362]: DEBUG nova.compute.manager [req-f67081f3-0255-4fbb-bab6-0759abab5b5e req-ad32da77-7aaa-4801-91df-c6aff81bef91 service nova] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Detach interface failed, port_id=76c0daec-94af-49ef-b33c-73925b6fb175, reason: Instance b17b317a-409e-45ad-ac7c-0c298f4f564b could not be found. {{(pid=72362) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 10:19:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b731e53-3436-44d2-b674-841871804c80/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:19:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b731e53-3436-44d2-b674-841871804c80/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:19:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-bac73d91-9e85-4be7-868d-ffcfb8227ac7 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:19:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-bac73d91-9e85-4be7-868d-ffcfb8227ac7 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:19:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b731e53-3436-44d2-b674-841871804c80/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:20:00 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:20:00 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:20:00 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=7645MB free_disk=25.524433135986328GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 10:20:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:20:00 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-bac73d91-9e85-4be7-868d-ffcfb8227ac7 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:20:00 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-bac73d91-9e85-4be7-868d-ffcfb8227ac7 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:20:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-bac73d91-9e85-4be7-868d-ffcfb8227ac7 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.943s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:20:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.235s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:20:00 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-bac73d91-9e85-4be7-868d-ffcfb8227ac7 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Deleted allocations for instance b17b317a-409e-45ad-ac7c-0c298f4f564b
Aug 09 10:20:00 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:00 user nova-compute[72362]: DEBUG nova.compute.manager [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Stashing vm_state: active {{(pid=72362) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 09 10:20:00 user nova-compute[72362]: INFO nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Updating resource usage from migration b612e21a-eb0a-4569-a87c-38f119262c85
Aug 09 10:20:00 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:00 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance ca002e73-ddf7-4452-82b6-0d831d984756 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:20:00 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance ea95226c-40fe-4408-a9f0-5538659261a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:20:00 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 9b731e53-3436-44d2-b674-841871804c80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:20:00 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 8e055c58-a365-4f18-a6e3-377e32e2189d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:20:00 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 45316ca8-e866-4e2f-a92d-d1b256613dd1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:20:00 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance d5b048c8-a329-4fe3-ab62-a06ab6401230 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:20:00 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Migration b612e21a-eb0a-4569-a87c-38f119262c85 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 09 10:20:00 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 0e8a7668-1635-4cbc-8c09-ece19ff67d4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:20:00 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 10:20:00 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 10:20:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-bac73d91-9e85-4be7-868d-ffcfb8227ac7 tempest-TestVolumeSwap-1355303837 tempest-TestVolumeSwap-1355303837-project-member] Lock "b17b317a-409e-45ad-ac7c-0c298f4f564b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.382s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:20:00 user nova-compute[72362]: DEBUG nova.compute.manager [req-9e1e1310-eb6d-4b59-91cd-aa9c3b71f23f req-876f2b7b-bc43-4b54-bb19-2a0b8c11d0b4 service nova] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Received event network-vif-plugged-76c0daec-94af-49ef-b33c-73925b6fb175 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:20:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-9e1e1310-eb6d-4b59-91cd-aa9c3b71f23f req-876f2b7b-bc43-4b54-bb19-2a0b8c11d0b4 service nova] Acquiring lock "b17b317a-409e-45ad-ac7c-0c298f4f564b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:20:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-9e1e1310-eb6d-4b59-91cd-aa9c3b71f23f req-876f2b7b-bc43-4b54-bb19-2a0b8c11d0b4 service nova] Lock "b17b317a-409e-45ad-ac7c-0c298f4f564b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:20:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-9e1e1310-eb6d-4b59-91cd-aa9c3b71f23f req-876f2b7b-bc43-4b54-bb19-2a0b8c11d0b4 service nova] Lock "b17b317a-409e-45ad-ac7c-0c298f4f564b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:20:00 user nova-compute[72362]: DEBUG nova.compute.manager [req-9e1e1310-eb6d-4b59-91cd-aa9c3b71f23f req-876f2b7b-bc43-4b54-bb19-2a0b8c11d0b4 service nova] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] No waiting events found dispatching network-vif-plugged-76c0daec-94af-49ef-b33c-73925b6fb175 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:20:00 user nova-compute[72362]: WARNING nova.compute.manager [req-9e1e1310-eb6d-4b59-91cd-aa9c3b71f23f req-876f2b7b-bc43-4b54-bb19-2a0b8c11d0b4 service nova] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Received unexpected event network-vif-plugged-76c0daec-94af-49ef-b33c-73925b6fb175 for instance with vm_state deleted and task_state None.
Aug 09 10:20:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:20:01 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:20:01 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:20:01 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 10:20:01 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.482s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:20:01 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.198s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:20:01 user nova-compute[72362]: DEBUG nova.objects.instance [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lazy-loading 'pci_requests' on Instance uuid 0e8a7668-1635-4cbc-8c09-ece19ff67d4f {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:20:01 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:20:01 user nova-compute[72362]: INFO nova.compute.claims [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Claim successful on node user
Aug 09 10:20:01 user nova-compute[72362]: DEBUG nova.objects.instance [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lazy-loading 'resources' on Instance uuid 0e8a7668-1635-4cbc-8c09-ece19ff67d4f {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:20:01 user nova-compute[72362]: DEBUG nova.objects.instance [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lazy-loading 'pci_devices' on Instance uuid 0e8a7668-1635-4cbc-8c09-ece19ff67d4f {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:20:01 user nova-compute[72362]: INFO nova.compute.resource_tracker [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Updating resource usage from migration b612e21a-eb0a-4569-a87c-38f119262c85
Aug 09 10:20:01 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:20:01 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:20:01 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.526s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:20:01 user nova-compute[72362]: INFO nova.compute.manager [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Migrating
Aug 09 10:20:01 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:20:01 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Acquired lock "compute-rpcapi-router" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:20:01 user nova-compute[72362]: INFO nova.compute.rpcapi [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 09 10:20:01 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Releasing lock "compute-rpcapi-router" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:20:01 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Acquiring lock "refresh_cache-0e8a7668-1635-4cbc-8c09-ece19ff67d4f" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:20:01 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Acquired lock "refresh_cache-0e8a7668-1635-4cbc-8c09-ece19ff67d4f" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:20:01 user nova-compute[72362]: DEBUG nova.network.neutron [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:20:02 user nova-compute[72362]: DEBUG nova.network.neutron [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Updating instance_info_cache with network_info: [{"id": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "address": "fa:16:3e:16:b7:79", "network": {"id": "446f0622-648e-499f-bbb1-e4c0d89ab4df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-409995858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5438525a82b4ab08734e363ab1f80ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec7889ae-0c", "ovs_interfaceid": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:20:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Releasing lock "refresh_cache-0e8a7668-1635-4cbc-8c09-ece19ff67d4f" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:20:02 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Starting migrate_disk_and_power_off {{(pid=72362) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 09 10:20:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG nova.compute.manager [req-b614075d-28ce-4d5e-84ef-6cea61015156 req-e672306b-7ab6-488a-bf19-1df015639ca9 service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Received event network-vif-unplugged-ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b614075d-28ce-4d5e-84ef-6cea61015156 req-e672306b-7ab6-488a-bf19-1df015639ca9 service nova] Acquiring lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b614075d-28ce-4d5e-84ef-6cea61015156 req-e672306b-7ab6-488a-bf19-1df015639ca9 service nova] Lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b614075d-28ce-4d5e-84ef-6cea61015156 req-e672306b-7ab6-488a-bf19-1df015639ca9 service nova] Lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG nova.compute.manager [req-b614075d-28ce-4d5e-84ef-6cea61015156 req-e672306b-7ab6-488a-bf19-1df015639ca9 service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] No waiting events found dispatching network-vif-unplugged-ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:20:03 user nova-compute[72362]: WARNING nova.compute.manager [req-b614075d-28ce-4d5e-84ef-6cea61015156 req-e672306b-7ab6-488a-bf19-1df015639ca9 service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Received unexpected event network-vif-unplugged-ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 for instance with vm_state active and task_state resize_migrating.
Aug 09 10:20:03 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:03 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Instance destroyed successfully.
Aug 09 10:20:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:15:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-419570951',display_name='tempest-ServerActionsTestOtherB-server-419570951',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-419570951',id=2,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAlSzovB4mzuHqVxORdW0QCnCxzvtrYywTRh5RUAkSVJoqhjnBo5zwvIiDyhRaMXzyUvfprKRDpBxT96lz++BVUa0Y8Z7q5AuzttS0DGZzN7x8fIo5ox8C7rVw5EduEeQ==',key_name='tempest-keypair-2060096321',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:16:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b5438525a82b4ab08734e363ab1f80ec',ramdisk_id='',reservation_id='r-gepn5vk7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-767949360',owner_user_name='tempest-ServerActionsTestOtherB-767949360-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:20:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ffd407a36c74b8ea1bc88b98366876e',uuid=0e8a7668-1635-4cbc-8c09-ece19ff67d4f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "address": "fa:16:3e:16:b7:79", "network": {"id": "446f0622-648e-499f-bbb1-e4c0d89ab4df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-409995858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-409995858-network", "vif_mac": "fa:16:3e:16:b7:79"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5438525a82b4ab08734e363ab1f80ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec7889ae-0c", "ovs_interfaceid": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Converting VIF {"id": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "address": "fa:16:3e:16:b7:79", "network": {"id": "446f0622-648e-499f-bbb1-e4c0d89ab4df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-409995858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-409995858-network", "vif_mac": "fa:16:3e:16:b7:79"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5438525a82b4ab08734e363ab1f80ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec7889ae-0c", "ovs_interfaceid": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:b7:79,bridge_name='br-int',has_traffic_filtering=True,id=ec7889ae-0cbc-41e3-a750-a5cb2b522ce9,network=Network(446f0622-648e-499f-bbb1-e4c0d89ab4df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec7889ae-0c') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG os_vif [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:b7:79,bridge_name='br-int',has_traffic_filtering=True,id=ec7889ae-0cbc-41e3-a750-a5cb2b522ce9,network=Network(446f0622-648e-499f-bbb1-e4c0d89ab4df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec7889ae-0c') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec7889ae-0c, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:03 user nova-compute[72362]: INFO os_vif [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:b7:79,bridge_name='br-int',has_traffic_filtering=True,id=ec7889ae-0cbc-41e3-a750-a5cb2b522ce9,network=Network(446f0622-648e-499f-bbb1-e4c0d89ab4df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec7889ae-0c')
Aug 09 10:20:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MhmCwvOG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:20:03 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:20:03 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb759a82-842b-4f42-ae11-35a48f4032eb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b61407a-3bab-4323-8fc8-442e4f379dba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90afd491-a612-49dc-ae3e-950506dbf7de\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c19349d-fdda-4d18-b692-9589fa10b963]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b61407a-3bab-4323-8fc8-442e4f379dba (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90afd491-a612-49dc-ae3e-950506dbf7de (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b61407a-3bab-4323-8fc8-442e4f379dba (non-flash)
Aug 09 10:20:03 user nova-compute[72362]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:20:03 user nova-compute[72362]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90afd491-a612-49dc-ae3e-950506dbf7de (non-flash)
Aug 09 10:20:03 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b61407a-3bab-4323-8fc8-442e4f379dba (non-flash)
Aug 09 10:20:03 user nova-compute[72362]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:20:03 user nova-compute[72362]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90afd491-a612-49dc-ae3e-950506dbf7de (non-flash)
Aug 09 10:20:03 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e4306170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7'): ({'sdc'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Removing single pathed devices sdc {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab7159e-e02b-4482-a1f4-22de862bc9c1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e660de-c10f-4bb0-9724-986c5253db94]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Flushing IO for device /dev/sdc {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c46be2d-1d28-40de-a1ac-8fcba2a423be]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7f022a-1b76-441e-9e24-250ea088db54]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] SCSI volumes sdc have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2dd2a7-eed1-4d26-9f26-af72d3171769]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8014cb1-ceb0-4c20-b33a-131d3eae2521]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7, portal: 172.16.0.220,3260]
Aug 09 10:20:03 user nova-compute[72362]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7, portal: 172.16.0.220,3260] successful.
Aug 09 10:20:03 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c9d128-0e7d-4978-b27d-d881aa25e338]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] <== disconnect_volume: return (310ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:20:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:20:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:20:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:20:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:20:04 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:20:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f_resize/disk /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/disk {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:20:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] CMD "cp -r /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f_resize/disk /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/disk" returned: 0 in 0.483s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:20:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f_resize/disk.info /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/disk.info {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:20:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] CMD "cp -r /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f_resize/disk.info /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/disk.info" returned: 0 in 0.047s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:20:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5d9fe13b-c951-43ba-991e-956d59b570f8 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Acquiring lock "9b731e53-3436-44d2-b674-841871804c80" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:20:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5d9fe13b-c951-43ba-991e-956d59b570f8 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Lock "9b731e53-3436-44d2-b674-841871804c80" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:20:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5d9fe13b-c951-43ba-991e-956d59b570f8 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Acquiring lock "9b731e53-3436-44d2-b674-841871804c80-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:20:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5d9fe13b-c951-43ba-991e-956d59b570f8 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Lock "9b731e53-3436-44d2-b674-841871804c80-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:20:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5d9fe13b-c951-43ba-991e-956d59b570f8 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Lock "9b731e53-3436-44d2-b674-841871804c80-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:20:04 user nova-compute[72362]: INFO nova.compute.manager [None req-5d9fe13b-c951-43ba-991e-956d59b570f8 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] [instance: 9b731e53-3436-44d2-b674-841871804c80] Terminating instance
Aug 09 10:20:04 user nova-compute[72362]: DEBUG nova.compute.manager [None req-5d9fe13b-c951-43ba-991e-956d59b570f8 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] [instance: 9b731e53-3436-44d2-b674-841871804c80] Start destroying the instance on the hypervisor. {{(pid=72362) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 10:20:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:05 user nova-compute[72362]: DEBUG nova.compute.manager [req-1b95dfa4-9716-4507-a1ff-c9f5a213dfa9 req-99695df7-6edd-48e1-8a1d-a6374b6e960f service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Received event network-vif-plugged-ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:20:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-1b95dfa4-9716-4507-a1ff-c9f5a213dfa9 req-99695df7-6edd-48e1-8a1d-a6374b6e960f service nova] Acquiring lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:20:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-1b95dfa4-9716-4507-a1ff-c9f5a213dfa9 req-99695df7-6edd-48e1-8a1d-a6374b6e960f service nova] Lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:20:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-1b95dfa4-9716-4507-a1ff-c9f5a213dfa9 req-99695df7-6edd-48e1-8a1d-a6374b6e960f service nova] Lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:20:05 user nova-compute[72362]: DEBUG nova.compute.manager [req-1b95dfa4-9716-4507-a1ff-c9f5a213dfa9 req-99695df7-6edd-48e1-8a1d-a6374b6e960f service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] No waiting events found dispatching network-vif-plugged-ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:20:05 user nova-compute[72362]: WARNING nova.compute.manager [req-1b95dfa4-9716-4507-a1ff-c9f5a213dfa9 req-99695df7-6edd-48e1-8a1d-a6374b6e960f service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Received unexpected event network-vif-plugged-ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 for instance with vm_state active and task_state resize_migrating.
Aug 09 10:20:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:05 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 9b731e53-3436-44d2-b674-841871804c80] Instance destroyed successfully.
Aug 09 10:20:05 user nova-compute[72362]: DEBUG nova.objects.instance [None req-5d9fe13b-c951-43ba-991e-956d59b570f8 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Lazy-loading 'resources' on Instance uuid 9b731e53-3436-44d2-b674-841871804c80 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:20:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-5d9fe13b-c951-43ba-991e-956d59b570f8 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:18:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-490422599',display_name='tempest-VolumesActionsTest-instance-490422599',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-490422599',id=11,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:18:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7bf8f7f0d90e4cdaacc82ef0ca2bb6f0',ramdisk_id='',reservation_id='r-shlvf065',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1694979699',owner_user_name='tempest-VolumesActionsTest-1694979699-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:18:10Z,user_data=None,user_id='5b07543d712f4b8299f25508ec88a705',uuid=9b731e53-3436-44d2-b674-841871804c80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f62ea1bc-bdf0-4f55-8364-b48bcaf3fcd6", "address": "fa:16:3e:42:29:7d", "network": {"id": "0c430946-544b-4a74-91c7-a532c31a242b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-265088703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bf8f7f0d90e4cdaacc82ef0ca2bb6f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf62ea1bc-bd", "ovs_interfaceid": "f62ea1bc-bdf0-4f55-8364-b48bcaf3fcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:20:05 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-5d9fe13b-c951-43ba-991e-956d59b570f8 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Converting VIF {"id": "f62ea1bc-bdf0-4f55-8364-b48bcaf3fcd6", "address": "fa:16:3e:42:29:7d", "network": {"id": "0c430946-544b-4a74-91c7-a532c31a242b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-265088703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bf8f7f0d90e4cdaacc82ef0ca2bb6f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf62ea1bc-bd", "ovs_interfaceid": "f62ea1bc-bdf0-4f55-8364-b48bcaf3fcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:20:05 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-5d9fe13b-c951-43ba-991e-956d59b570f8 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:29:7d,bridge_name='br-int',has_traffic_filtering=True,id=f62ea1bc-bdf0-4f55-8364-b48bcaf3fcd6,network=Network(0c430946-544b-4a74-91c7-a532c31a242b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf62ea1bc-bd') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:20:05 user nova-compute[72362]: DEBUG os_vif [None req-5d9fe13b-c951-43ba-991e-956d59b570f8 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:29:7d,bridge_name='br-int',has_traffic_filtering=True,id=f62ea1bc-bdf0-4f55-8364-b48bcaf3fcd6,network=Network(0c430946-544b-4a74-91c7-a532c31a242b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf62ea1bc-bd') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:20:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf62ea1bc-bd, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:20:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:20:05 user nova-compute[72362]: INFO os_vif [None req-5d9fe13b-c951-43ba-991e-956d59b570f8 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:29:7d,bridge_name='br-int',has_traffic_filtering=True,id=f62ea1bc-bdf0-4f55-8364-b48bcaf3fcd6,network=Network(0c430946-544b-4a74-91c7-a532c31a242b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf62ea1bc-bd')
Aug 09 10:20:05 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-5d9fe13b-c951-43ba-991e-956d59b570f8 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] [instance: 9b731e53-3436-44d2-b674-841871804c80] Deleting instance files /opt/stack/data/nova/instances/9b731e53-3436-44d2-b674-841871804c80_del
Aug 09 10:20:05 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-5d9fe13b-c951-43ba-991e-956d59b570f8 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] [instance: 9b731e53-3436-44d2-b674-841871804c80] Deletion of /opt/stack/data/nova/instances/9b731e53-3436-44d2-b674-841871804c80_del complete
Aug 09 10:20:05 user nova-compute[72362]: DEBUG nova.compute.manager [req-c3cd16a0-173d-4ce1-a6aa-812f139b2209 req-7b1a0328-a2df-4b5d-be60-0b48533276bf service nova] [instance: 9b731e53-3436-44d2-b674-841871804c80] Received event network-vif-unplugged-f62ea1bc-bdf0-4f55-8364-b48bcaf3fcd6 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:20:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c3cd16a0-173d-4ce1-a6aa-812f139b2209 req-7b1a0328-a2df-4b5d-be60-0b48533276bf service nova] Acquiring lock "9b731e53-3436-44d2-b674-841871804c80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:20:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c3cd16a0-173d-4ce1-a6aa-812f139b2209 req-7b1a0328-a2df-4b5d-be60-0b48533276bf service nova] Lock "9b731e53-3436-44d2-b674-841871804c80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:20:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c3cd16a0-173d-4ce1-a6aa-812f139b2209 req-7b1a0328-a2df-4b5d-be60-0b48533276bf service nova] Lock "9b731e53-3436-44d2-b674-841871804c80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:20:05 user nova-compute[72362]: DEBUG nova.compute.manager [req-c3cd16a0-173d-4ce1-a6aa-812f139b2209 req-7b1a0328-a2df-4b5d-be60-0b48533276bf service nova] [instance: 9b731e53-3436-44d2-b674-841871804c80] No waiting events found dispatching network-vif-unplugged-f62ea1bc-bdf0-4f55-8364-b48bcaf3fcd6 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:20:05 user nova-compute[72362]: DEBUG nova.compute.manager [req-c3cd16a0-173d-4ce1-a6aa-812f139b2209 req-7b1a0328-a2df-4b5d-be60-0b48533276bf service nova] [instance: 9b731e53-3436-44d2-b674-841871804c80] Received event network-vif-unplugged-f62ea1bc-bdf0-4f55-8364-b48bcaf3fcd6 for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:20:05 user nova-compute[72362]: INFO nova.compute.manager [None req-5d9fe13b-c951-43ba-991e-956d59b570f8 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] [instance: 9b731e53-3436-44d2-b674-841871804c80] Took 0.82 seconds to destroy the instance on the hypervisor.
Aug 09 10:20:05 user nova-compute[72362]: DEBUG oslo.service.loopingcall [None req-5d9fe13b-c951-43ba-991e-956d59b570f8 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72362) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 10:20:05 user nova-compute[72362]: DEBUG nova.compute.manager [-] [instance: 9b731e53-3436-44d2-b674-841871804c80] Deallocating network for instance {{(pid=72362) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 10:20:05 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 9b731e53-3436-44d2-b674-841871804c80] deallocate_for_instance() {{(pid=72362) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 10:20:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:06 user nova-compute[72362]: DEBUG nova.network.neutron [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Port ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 binding to destination host user is already ACTIVE {{(pid=72362) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 09 10:20:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Acquiring lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:20:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.008s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:20:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.006s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:20:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:06 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 9b731e53-3436-44d2-b674-841871804c80] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:20:06 user nova-compute[72362]: DEBUG nova.compute.manager [req-90cb48d8-4991-429e-a887-3d34c546de80 req-0e592ac4-ad34-4143-92a6-73478c200783 service nova] [instance: 9b731e53-3436-44d2-b674-841871804c80] Received event network-vif-deleted-f62ea1bc-bdf0-4f55-8364-b48bcaf3fcd6 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:20:06 user nova-compute[72362]: INFO nova.compute.manager [req-90cb48d8-4991-429e-a887-3d34c546de80 req-0e592ac4-ad34-4143-92a6-73478c200783 service nova] [instance: 9b731e53-3436-44d2-b674-841871804c80] Neutron deleted interface f62ea1bc-bdf0-4f55-8364-b48bcaf3fcd6; detaching it from the instance and deleting it from the info cache
Aug 09 10:20:06 user nova-compute[72362]: DEBUG nova.network.neutron [req-90cb48d8-4991-429e-a887-3d34c546de80 req-0e592ac4-ad34-4143-92a6-73478c200783 service nova] [instance: 9b731e53-3436-44d2-b674-841871804c80] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:20:06 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 9b731e53-3436-44d2-b674-841871804c80] Took 0.70 seconds to deallocate network for instance.
Aug 09 10:20:06 user nova-compute[72362]: DEBUG nova.compute.manager [req-90cb48d8-4991-429e-a887-3d34c546de80 req-0e592ac4-ad34-4143-92a6-73478c200783 service nova] [instance: 9b731e53-3436-44d2-b674-841871804c80] Detach interface failed, port_id=f62ea1bc-bdf0-4f55-8364-b48bcaf3fcd6, reason: Instance 9b731e53-3436-44d2-b674-841871804c80 could not be found. {{(pid=72362) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 10:20:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5d9fe13b-c951-43ba-991e-956d59b570f8 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:20:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5d9fe13b-c951-43ba-991e-956d59b570f8 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:20:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Acquiring lock "refresh_cache-0e8a7668-1635-4cbc-8c09-ece19ff67d4f" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:20:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Acquired lock "refresh_cache-0e8a7668-1635-4cbc-8c09-ece19ff67d4f" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:20:06 user nova-compute[72362]: DEBUG nova.network.neutron [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:20:06 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-5d9fe13b-c951-43ba-991e-956d59b570f8 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:20:06 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-5d9fe13b-c951-43ba-991e-956d59b570f8 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:20:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5d9fe13b-c951-43ba-991e-956d59b570f8 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.487s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:20:06 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-5d9fe13b-c951-43ba-991e-956d59b570f8 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Deleted allocations for instance 9b731e53-3436-44d2-b674-841871804c80
Aug 09 10:20:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5d9fe13b-c951-43ba-991e-956d59b570f8 tempest-VolumesActionsTest-1694979699 tempest-VolumesActionsTest-1694979699-project-member] Lock "9b731e53-3436-44d2-b674-841871804c80" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.315s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:20:07 user nova-compute[72362]: DEBUG nova.network.neutron [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Updating instance_info_cache with network_info: [{"id": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "address": "fa:16:3e:16:b7:79", "network": {"id": "446f0622-648e-499f-bbb1-e4c0d89ab4df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-409995858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5438525a82b4ab08734e363ab1f80ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec7889ae-0c", "ovs_interfaceid": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:20:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Releasing lock "refresh_cache-0e8a7668-1635-4cbc-8c09-ece19ff67d4f" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:20:07 user nova-compute[72362]: DEBUG os_brick.utils [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:20:07 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:20:07 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:20:07 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[71bd1609-930a-49de-b7bd-f5c8c7ed635e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:20:07 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:20:07 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:20:07 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7849f32-b417-4379-a4d0-81b1cf5b126f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:20:07 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:20:07 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:20:07 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f886c8cd-8b4c-4463-aa7f-b338b02762fa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:20:07 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[021588d1-5aad-43fd-80b5-996bdcb68b0e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:20:07 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:20:07 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:20:07 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:20:07 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:20:07 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:20:07 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:20:07 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d4a0bf-15a1-44f4-8228-27423aec78f2]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:20:07 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:20:07 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:20:07 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:20:07 user nova-compute[72362]: DEBUG os_brick.utils [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:20:07 user nova-compute[72362]: DEBUG nova.compute.manager [req-5efebb34-3187-4099-b43b-38673ccea6fd req-fc97163e-ea4d-4759-802b-741f446bc3a4 service nova] [instance: 9b731e53-3436-44d2-b674-841871804c80] Received event network-vif-plugged-f62ea1bc-bdf0-4f55-8364-b48bcaf3fcd6 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:20:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-5efebb34-3187-4099-b43b-38673ccea6fd req-fc97163e-ea4d-4759-802b-741f446bc3a4 service nova] Acquiring lock "9b731e53-3436-44d2-b674-841871804c80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:20:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-5efebb34-3187-4099-b43b-38673ccea6fd req-fc97163e-ea4d-4759-802b-741f446bc3a4 service nova] Lock "9b731e53-3436-44d2-b674-841871804c80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:20:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-5efebb34-3187-4099-b43b-38673ccea6fd req-fc97163e-ea4d-4759-802b-741f446bc3a4 service nova] Lock "9b731e53-3436-44d2-b674-841871804c80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:20:07 user nova-compute[72362]: DEBUG nova.compute.manager [req-5efebb34-3187-4099-b43b-38673ccea6fd req-fc97163e-ea4d-4759-802b-741f446bc3a4 service nova] [instance: 9b731e53-3436-44d2-b674-841871804c80] No waiting events found dispatching network-vif-plugged-f62ea1bc-bdf0-4f55-8364-b48bcaf3fcd6 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:20:07 user nova-compute[72362]: WARNING nova.compute.manager [req-5efebb34-3187-4099-b43b-38673ccea6fd req-fc97163e-ea4d-4759-802b-741f446bc3a4 service nova] [instance: 9b731e53-3436-44d2-b674-841871804c80] Received unexpected event network-vif-plugged-f62ea1bc-bdf0-4f55-8364-b48bcaf3fcd6 for instance with vm_state deleted and task_state None.
Aug 09 10:20:10 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:10 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:13 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691576398.2569659, b17b317a-409e-45ad-ac7c-0c298f4f564b => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:20:13 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] VM Stopped (Lifecycle Event)
Aug 09 10:20:13 user nova-compute[72362]: DEBUG nova.compute.manager [None req-849a3000-9f7d-49de-9699-37af519dfc60 None None] [instance: b17b317a-409e-45ad-ac7c-0c298f4f564b] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:20:15 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:15 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:15 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Starting finish_migration {{(pid=72362) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Instance directory exists: not creating {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 10:20:17 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Creating image(s)
Aug 09 10:20:17 user nova-compute[72362]: DEBUG nova.objects.instance [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0e8a7668-1635-4cbc-8c09-ece19ff67d4f {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.145s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/disk. size=21474836480 {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/disk 21474836480 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/disk 21474836480" returned: 0 in 0.043s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Did not create local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Ensure instance console log exists: /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Start _get_guest_xml network_info=[{"id": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "address": "fa:16:3e:16:b7:79", "network": {"id": "446f0622-648e-499f-bbb1-e4c0d89ab4df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-409995858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-409995858-network", "vif_mac": "fa:16:3e:16:b7:79"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5438525a82b4ab08734e363ab1f80ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec7889ae-0c", "ovs_interfaceid": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': 'a08d1a11-49eb-4212-a351-e11ee9553b95'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '3ed9df77-0c27-478c-acf8-2d0270561f91', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MhmCwvOG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '0e8a7668-1635-4cbc-8c09-ece19ff67d4f', 'attached_at': '2023-08-09T10:20:17.000000', 'detached_at': '', 'volume_id': '8ef319fe-2472-41ac-86a6-0e4f3522e7c7', 'serial': '8ef319fe-2472-41ac-86a6-0e4f3522e7c7'}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:20:17 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:20:17 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:20:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:05Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG nova.objects.instance [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0e8a7668-1635-4cbc-8c09-ece19ff67d4f {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MhmCwvOG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:20:17 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:20:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:20:17 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:20:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:20:17 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:20:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ab7a9a-aea4-45bf-84ea-80a65cb4da4c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:20:17 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[765ee260-d82b-4d42-9c46-d3d60aaa59d8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7] added
Aug 09 10:20:17 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[180b4112-764f-4eab-b222-a54ac7c0173c]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bbef82-63dd-4f4b-befd-aa9d4af37758]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MhmCwvOG {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MhmCwvOG" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8d6b88-4a62-4648-8546-82dade91da94]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MhmCwvOG'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[564ac8af-1cf0-4c18-a1a7-d21b2d4eb75e]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f7e9ff-9dab-4c87-97bc-5d5e71837feb]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 10:20:17 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 10:20:17 user nova-compute[72362]:  {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:20:17 user nova-compute[72362]: WARNING os_brick.initiator.connectors.iscsi [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 10:20:17 user nova-compute[72362]: 
Aug 09 10:20:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee59627b-9189-4942-88de-6059208937e6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7, portal: 172.16.0.220,3260]
Aug 09 10:20:17 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7, portal: 172.16.0.220,3260] successful.
Aug 09 10:20:17 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3a05a6-5b11-44f9-9320-e3f1fbec336b]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6431272-f384-4dba-882d-3ebac898d3f7]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:20:17 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:20:17 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd98d1dd-0da6-4ce9-bbed-5fb26c8a6d62]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:20:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MhmCwvOG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:20:18 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691576403.5531569, 0e8a7668-1635-4cbc-8c09-ece19ff67d4f => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:20:18 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] VM Stopped (Lifecycle Event)
Aug 09 10:20:18 user nova-compute[72362]: DEBUG nova.compute.manager [None req-a60c9cde-8db0-4b5f-a4c7-084597c471de None None] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:20:18 user nova-compute[72362]: DEBUG nova.compute.manager [None req-a60c9cde-8db0-4b5f-a4c7-084597c471de None None] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:20:18 user nova-compute[72362]: INFO nova.compute.manager [None req-a60c9cde-8db0-4b5f-a4c7-084597c471de None None] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 09 10:20:18 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:20:18 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23533383563306638', 'path': '/dev/sdb'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:20:18 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533383563306638', 'path': '/dev/sdb'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:20:18 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:15:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-419570951',display_name='tempest-ServerActionsTestOtherB-server-419570951',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-419570951',id=2,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAlSzovB4mzuHqVxORdW0QCnCxzvtrYywTRh5RUAkSVJoqhjnBo5zwvIiDyhRaMXzyUvfprKRDpBxT96lz++BVUa0Y8Z7q5AuzttS0DGZzN7x8fIo5ox8C7rVw5EduEeQ==',key_name='tempest-keypair-2060096321',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:16:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b5438525a82b4ab08734e363ab1f80ec',ramdisk_id='',reservation_id='r-gepn5vk7',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-767949360',owner_user_name='tempest-ServerActionsTestOtherB-767949360-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:20:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ffd407a36c74b8ea1bc88b98366876e',uuid=0e8a7668-1635-4cbc-8c09-ece19ff67d4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "address": "fa:16:3e:16:b7:79", "network": {"id": "446f0622-648e-499f-bbb1-e4c0d89ab4df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-409995858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-409995858-network", "vif_mac": "fa:16:3e:16:b7:79"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5438525a82b4ab08734e363ab1f80ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec7889ae-0c", "ovs_interfaceid": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:20:18 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Converting VIF {"id": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "address": "fa:16:3e:16:b7:79", "network": {"id": "446f0622-648e-499f-bbb1-e4c0d89ab4df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-409995858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-409995858-network", "vif_mac": "fa:16:3e:16:b7:79"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5438525a82b4ab08734e363ab1f80ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec7889ae-0c", "ovs_interfaceid": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:20:18 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:b7:79,bridge_name='br-int',has_traffic_filtering=True,id=ec7889ae-0cbc-41e3-a750-a5cb2b522ce9,network=Network(446f0622-648e-499f-bbb1-e4c0d89ab4df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec7889ae-0c') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:20:18 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:20:18 user nova-compute[72362]:   <uuid>0e8a7668-1635-4cbc-8c09-ece19ff67d4f</uuid>
Aug 09 10:20:18 user nova-compute[72362]:   <name>instance-00000002</name>
Aug 09 10:20:18 user nova-compute[72362]:   <memory>2097152</memory>
Aug 09 10:20:18 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:20:18 user nova-compute[72362]:   <metadata>
Aug 09 10:20:18 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:20:18 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:20:18 user nova-compute[72362]:       <nova:name>tempest-ServerActionsTestOtherB-server-419570951</nova:name>
Aug 09 10:20:18 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:20:17</nova:creationTime>
Aug 09 10:20:18 user nova-compute[72362]:       <nova:flavor name="m1.small">
Aug 09 10:20:18 user nova-compute[72362]:         <nova:memory>2048</nova:memory>
Aug 09 10:20:18 user nova-compute[72362]:         <nova:disk>20</nova:disk>
Aug 09 10:20:18 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:20:18 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:20:18 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:20:18 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:20:18 user nova-compute[72362]:       <nova:owner>
Aug 09 10:20:18 user nova-compute[72362]:         <nova:user uuid="9ffd407a36c74b8ea1bc88b98366876e">tempest-ServerActionsTestOtherB-767949360-project-member</nova:user>
Aug 09 10:20:18 user nova-compute[72362]:         <nova:project uuid="b5438525a82b4ab08734e363ab1f80ec">tempest-ServerActionsTestOtherB-767949360</nova:project>
Aug 09 10:20:18 user nova-compute[72362]:       </nova:owner>
Aug 09 10:20:18 user nova-compute[72362]:       <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:20:18 user nova-compute[72362]:       <nova:ports>
Aug 09 10:20:18 user nova-compute[72362]:         <nova:port uuid="ec7889ae-0cbc-41e3-a750-a5cb2b522ce9">
Aug 09 10:20:18 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 09 10:20:18 user nova-compute[72362]:         </nova:port>
Aug 09 10:20:18 user nova-compute[72362]:       </nova:ports>
Aug 09 10:20:18 user nova-compute[72362]:     </nova:instance>
Aug 09 10:20:18 user nova-compute[72362]:   </metadata>
Aug 09 10:20:18 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:20:18 user nova-compute[72362]:     <system>
Aug 09 10:20:18 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:20:18 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:20:18 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:20:18 user nova-compute[72362]:       <entry name="serial">0e8a7668-1635-4cbc-8c09-ece19ff67d4f</entry>
Aug 09 10:20:18 user nova-compute[72362]:       <entry name="uuid">0e8a7668-1635-4cbc-8c09-ece19ff67d4f</entry>
Aug 09 10:20:18 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:20:18 user nova-compute[72362]:     </system>
Aug 09 10:20:18 user nova-compute[72362]:   </sysinfo>
Aug 09 10:20:18 user nova-compute[72362]:   <os>
Aug 09 10:20:18 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:20:18 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:20:18 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:20:18 user nova-compute[72362]:   </os>
Aug 09 10:20:18 user nova-compute[72362]:   <features>
Aug 09 10:20:18 user nova-compute[72362]:     <acpi/>
Aug 09 10:20:18 user nova-compute[72362]:     <apic/>
Aug 09 10:20:18 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:20:18 user nova-compute[72362]:   </features>
Aug 09 10:20:18 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:20:18 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:20:18 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:20:18 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:20:18 user nova-compute[72362]:   </clock>
Aug 09 10:20:18 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:20:18 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:20:18 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:20:18 user nova-compute[72362]:   </cpu>
Aug 09 10:20:18 user nova-compute[72362]:   <devices>
Aug 09 10:20:18 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:20:18 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:20:18 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/disk"/>
Aug 09 10:20:18 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:20:18 user nova-compute[72362]:     </disk>
Aug 09 10:20:18 user nova-compute[72362]:     <disk type="block" device="disk">
Aug 09 10:20:18 user nova-compute[72362]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:20:18 user nova-compute[72362]:       <source dev="/dev/sdb"/>
Aug 09 10:20:18 user nova-compute[72362]:       <target dev="vdb" bus="virtio"/>
Aug 09 10:20:18 user nova-compute[72362]:       <serial>8ef319fe-2472-41ac-86a6-0e4f3522e7c7</serial>
Aug 09 10:20:18 user nova-compute[72362]:     </disk>
Aug 09 10:20:18 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:20:18 user nova-compute[72362]:       <mac address="fa:16:3e:16:b7:79"/>
Aug 09 10:20:18 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:20:18 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:20:18 user nova-compute[72362]:       <target dev="tapec7889ae-0c"/>
Aug 09 10:20:18 user nova-compute[72362]:     </interface>
Aug 09 10:20:18 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:20:18 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/console.log" append="off"/>
Aug 09 10:20:18 user nova-compute[72362]:     </serial>
Aug 09 10:20:18 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:20:18 user nova-compute[72362]:     <video>
Aug 09 10:20:18 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:20:18 user nova-compute[72362]:     </video>
Aug 09 10:20:18 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:20:18 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:20:18 user nova-compute[72362]:     </rng>
Aug 09 10:20:18 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:20:18 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:20:18 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:20:18 user nova-compute[72362]:     </memballoon>
Aug 09 10:20:18 user nova-compute[72362]:   </devices>
Aug 09 10:20:18 user nova-compute[72362]: </domain>
Aug 09 10:20:18 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:20:18 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:15:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-419570951',display_name='tempest-ServerActionsTestOtherB-server-419570951',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-419570951',id=2,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAlSzovB4mzuHqVxORdW0QCnCxzvtrYywTRh5RUAkSVJoqhjnBo5zwvIiDyhRaMXzyUvfprKRDpBxT96lz++BVUa0Y8Z7q5AuzttS0DGZzN7x8fIo5ox8C7rVw5EduEeQ==',key_name='tempest-keypair-2060096321',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:16:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b5438525a82b4ab08734e363ab1f80ec',ramdisk_id='',reservation_id='r-gepn5vk7',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-767949360',owner_user_name='tempest-ServerActionsTestOtherB-767949360-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:20:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ffd407a36c74b8ea1bc88b98366876e',uuid=0e8a7668-1635-4cbc-8c09-ece19ff67d4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "address": "fa:16:3e:16:b7:79", "network": {"id": "446f0622-648e-499f-bbb1-e4c0d89ab4df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-409995858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-409995858-network", "vif_mac": "fa:16:3e:16:b7:79"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5438525a82b4ab08734e363ab1f80ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec7889ae-0c", "ovs_interfaceid": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:20:18 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Converting VIF {"id": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "address": "fa:16:3e:16:b7:79", "network": {"id": "446f0622-648e-499f-bbb1-e4c0d89ab4df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-409995858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-409995858-network", "vif_mac": "fa:16:3e:16:b7:79"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5438525a82b4ab08734e363ab1f80ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec7889ae-0c", "ovs_interfaceid": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:20:18 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:b7:79,bridge_name='br-int',has_traffic_filtering=True,id=ec7889ae-0cbc-41e3-a750-a5cb2b522ce9,network=Network(446f0622-648e-499f-bbb1-e4c0d89ab4df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec7889ae-0c') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:20:18 user nova-compute[72362]: DEBUG os_vif [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:b7:79,bridge_name='br-int',has_traffic_filtering=True,id=ec7889ae-0cbc-41e3-a750-a5cb2b522ce9,network=Network(446f0622-648e-499f-bbb1-e4c0d89ab4df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec7889ae-0c') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:20:18 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:18 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:20:18 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:20:18 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:18 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec7889ae-0c, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:20:18 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapec7889ae-0c, col_values=(('external_ids', {'iface-id': 'ec7889ae-0cbc-41e3-a750-a5cb2b522ce9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:b7:79', 'vm-uuid': '0e8a7668-1635-4cbc-8c09-ece19ff67d4f'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:20:18 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:18 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:20:18 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:18 user nova-compute[72362]: INFO os_vif [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:b7:79,bridge_name='br-int',has_traffic_filtering=True,id=ec7889ae-0cbc-41e3-a750-a5cb2b522ce9,network=Network(446f0622-648e-499f-bbb1-e4c0d89ab4df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec7889ae-0c')
Aug 09 10:20:19 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:20:19 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:20:19 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] No VIF found with MAC fa:16:3e:16:b7:79, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:20:19 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:20 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691576405.4461706, 9b731e53-3436-44d2-b674-841871804c80 => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:20:20 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 9b731e53-3436-44d2-b674-841871804c80] VM Stopped (Lifecycle Event)
Aug 09 10:20:20 user nova-compute[72362]: DEBUG nova.compute.manager [None req-6a0c6675-3a0a-4bf6-83b5-fab68326381e None None] [instance: 9b731e53-3436-44d2-b674-841871804c80] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:20:20 user nova-compute[72362]: DEBUG nova.compute.manager [req-bc8ac8c3-f8d1-4e76-a629-cdea8a4e114a req-82dcca51-7eb6-440f-9aca-07492d755dd3 service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Received event network-vif-plugged-ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:20:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-bc8ac8c3-f8d1-4e76-a629-cdea8a4e114a req-82dcca51-7eb6-440f-9aca-07492d755dd3 service nova] Acquiring lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:20:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-bc8ac8c3-f8d1-4e76-a629-cdea8a4e114a req-82dcca51-7eb6-440f-9aca-07492d755dd3 service nova] Lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:20:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-bc8ac8c3-f8d1-4e76-a629-cdea8a4e114a req-82dcca51-7eb6-440f-9aca-07492d755dd3 service nova] Lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:20:20 user nova-compute[72362]: DEBUG nova.compute.manager [req-bc8ac8c3-f8d1-4e76-a629-cdea8a4e114a req-82dcca51-7eb6-440f-9aca-07492d755dd3 service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] No waiting events found dispatching network-vif-plugged-ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:20:20 user nova-compute[72362]: WARNING nova.compute.manager [req-bc8ac8c3-f8d1-4e76-a629-cdea8a4e114a req-82dcca51-7eb6-440f-9aca-07492d755dd3 service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Received unexpected event network-vif-plugged-ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 for instance with vm_state active and task_state resize_finish.
Aug 09 10:20:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:21 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:21 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:22 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576422.5889757, 0e8a7668-1635-4cbc-8c09-ece19ff67d4f => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:20:22 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] VM Resumed (Lifecycle Event)
Aug 09 10:20:22 user nova-compute[72362]: DEBUG nova.compute.manager [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:20:22 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Instance running successfully.
Aug 09 10:20:22 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Failed to set time: agent not configured {{(pid=72362) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 09 10:20:22 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3639d4c1-bdd9-4bab-b253-3e7f0f5b2276 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] finish_migration finished successfully. {{(pid=72362) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 09 10:20:22 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:20:22 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:20:22 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 09 10:20:22 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576422.592145, 0e8a7668-1635-4cbc-8c09-ece19ff67d4f => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:20:22 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] VM Started (Lifecycle Event)
Aug 09 10:20:22 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:20:22 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:20:22 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 09 10:20:22 user nova-compute[72362]: DEBUG nova.compute.manager [req-48f22664-0965-4382-befd-d8ef4436f052 req-033fc307-429e-4293-8e9e-7c1a31c30c61 service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Received event network-vif-plugged-ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:20:22 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-48f22664-0965-4382-befd-d8ef4436f052 req-033fc307-429e-4293-8e9e-7c1a31c30c61 service nova] Acquiring lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:20:22 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-48f22664-0965-4382-befd-d8ef4436f052 req-033fc307-429e-4293-8e9e-7c1a31c30c61 service nova] Lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:20:22 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-48f22664-0965-4382-befd-d8ef4436f052 req-033fc307-429e-4293-8e9e-7c1a31c30c61 service nova] Lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:20:22 user nova-compute[72362]: DEBUG nova.compute.manager [req-48f22664-0965-4382-befd-d8ef4436f052 req-033fc307-429e-4293-8e9e-7c1a31c30c61 service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] No waiting events found dispatching network-vif-plugged-ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:20:22 user nova-compute[72362]: WARNING nova.compute.manager [req-48f22664-0965-4382-befd-d8ef4436f052 req-033fc307-429e-4293-8e9e-7c1a31c30c61 service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Received unexpected event network-vif-plugged-ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 for instance with vm_state active and task_state resize_finish.
Aug 09 10:20:23 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:25 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:33 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:35 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Acquiring lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:20:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:20:43 user nova-compute[72362]: DEBUG nova.compute.manager [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Starting instance... {{(pid=72362) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 10:20:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:20:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:20:43 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:20:43 user nova-compute[72362]: INFO nova.compute.claims [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Claim successful on node user
Aug 09 10:20:43 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:44 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:20:44 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:20:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.375s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:20:44 user nova-compute[72362]: DEBUG nova.compute.manager [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Start building networks asynchronously for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 10:20:44 user nova-compute[72362]: DEBUG nova.compute.manager [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Allocating IP information in the background. {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 10:20:44 user nova-compute[72362]: DEBUG nova.network.neutron [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] allocate_for_instance() {{(pid=72362) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 10:20:44 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 10:20:44 user nova-compute[72362]: DEBUG nova.compute.manager [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Start building block device mappings for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 10:20:44 user nova-compute[72362]: DEBUG nova.policy [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '990e2d160fdc4c599cee9f65d6d4e41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac22022944542c0b52dd912d3dbcce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72362) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 10:20:44 user nova-compute[72362]: DEBUG nova.compute.manager [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Start spawning the instance on the hypervisor. {{(pid=72362) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 10:20:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:20:44 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Creating image(s)
Aug 09 10:20:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Acquiring lock "/opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:20:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "/opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:20:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "/opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:20:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:20:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.251s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:20:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Acquiring lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:20:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:20:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:20:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.142s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:20:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk 1073741824 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:20:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk 1073741824" returned: 0 in 0.054s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:20:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:20:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:20:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.143s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:20:45 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk. size=1073741824 {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 10:20:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:20:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:20:45 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Cannot resize image /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk to a smaller size. {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 10:20:45 user nova-compute[72362]: DEBUG nova.objects.instance [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lazy-loading 'migration_context' on Instance uuid 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:20:45 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Created local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 10:20:45 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Ensure instance console log exists: /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:20:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:20:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:20:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:20:45 user nova-compute[72362]: DEBUG nova.network.neutron [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Successfully created port: 9735e8ce-a2bd-49c8-adcf-846c05b7427e {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:20:45 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:46 user nova-compute[72362]: DEBUG nova.network.neutron [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Successfully updated port: 9735e8ce-a2bd-49c8-adcf-846c05b7427e {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:20:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Acquiring lock "refresh_cache-3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:20:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Acquired lock "refresh_cache-3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:20:46 user nova-compute[72362]: DEBUG nova.network.neutron [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:20:46 user nova-compute[72362]: DEBUG nova.compute.manager [req-bacda107-857e-4fff-aa36-c8f282add9e4 req-63a6513e-ed2d-48c2-a75e-cde96b3c8fc6 service nova] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Received event network-changed-9735e8ce-a2bd-49c8-adcf-846c05b7427e {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:20:46 user nova-compute[72362]: DEBUG nova.compute.manager [req-bacda107-857e-4fff-aa36-c8f282add9e4 req-63a6513e-ed2d-48c2-a75e-cde96b3c8fc6 service nova] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Refreshing instance network info cache due to event network-changed-9735e8ce-a2bd-49c8-adcf-846c05b7427e. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:20:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-bacda107-857e-4fff-aa36-c8f282add9e4 req-63a6513e-ed2d-48c2-a75e-cde96b3c8fc6 service nova] Acquiring lock "refresh_cache-3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:20:46 user nova-compute[72362]: DEBUG nova.network.neutron [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:20:47 user nova-compute[72362]: DEBUG nova.network.neutron [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Updating instance_info_cache with network_info: [{"id": "9735e8ce-a2bd-49c8-adcf-846c05b7427e", "address": "fa:16:3e:91:34:e3", "network": {"id": "e6c54663-74e3-43e2-8f0d-61b300c1f68d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1222286883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ac22022944542c0b52dd912d3dbcce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9735e8ce-a2", "ovs_interfaceid": "9735e8ce-a2bd-49c8-adcf-846c05b7427e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:20:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Releasing lock "refresh_cache-3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:20:47 user nova-compute[72362]: DEBUG nova.compute.manager [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Instance network_info: |[{"id": "9735e8ce-a2bd-49c8-adcf-846c05b7427e", "address": "fa:16:3e:91:34:e3", "network": {"id": "e6c54663-74e3-43e2-8f0d-61b300c1f68d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1222286883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ac22022944542c0b52dd912d3dbcce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9735e8ce-a2", "ovs_interfaceid": "9735e8ce-a2bd-49c8-adcf-846c05b7427e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 10:20:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-bacda107-857e-4fff-aa36-c8f282add9e4 req-63a6513e-ed2d-48c2-a75e-cde96b3c8fc6 service nova] Acquired lock "refresh_cache-3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:20:47 user nova-compute[72362]: DEBUG nova.network.neutron [req-bacda107-857e-4fff-aa36-c8f282add9e4 req-63a6513e-ed2d-48c2-a75e-cde96b3c8fc6 service nova] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Refreshing network info cache for port 9735e8ce-a2bd-49c8-adcf-846c05b7427e {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:20:47 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Start _get_guest_xml network_info=[{"id": "9735e8ce-a2bd-49c8-adcf-846c05b7427e", "address": "fa:16:3e:91:34:e3", "network": {"id": "e6c54663-74e3-43e2-8f0d-61b300c1f68d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1222286883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ac22022944542c0b52dd912d3dbcce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9735e8ce-a2", "ovs_interfaceid": "9735e8ce-a2bd-49c8-adcf-846c05b7427e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': 'a08d1a11-49eb-4212-a351-e11ee9553b95'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:20:47 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:20:47 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:20:47 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:20:47 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:20:47 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:20:47 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:20:47 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:20:47 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:20:47 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:20:47 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:20:47 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:20:47 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:20:47 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:20:47 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:20:47 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:20:47 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:20:47 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:20:47 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:20:47 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:20:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-992323535',display_name='tempest-ServerActionsTestOtherA-server-992323535',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-992323535',id=15,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwSFF251eQti/qkoXtJtG/hsB95elMyv8iaeRUjgcdf3ZQpb25r9rbEB2fGNjqP3pvOqQxJNR/NqVUD62omNMx/akMv5+i7VAu1R/GqhP2vqtVAvdiRNee4z2ROG7Jd8w==',key_name='tempest-keypair-122703468',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ac22022944542c0b52dd912d3dbcce2',ramdisk_id='',reservation_id='r-aza1h2p7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2101881579',owner_user_name='tempest-ServerActionsTestOtherA-2101881579-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:20:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='990e2d160fdc4c599cee9f65d6d4e41d',uuid=3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9735e8ce-a2bd-49c8-adcf-846c05b7427e", "address": "fa:16:3e:91:34:e3", "network": {"id": "e6c54663-74e3-43e2-8f0d-61b300c1f68d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1222286883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ac22022944542c0b52dd912d3dbcce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9735e8ce-a2", "ovs_interfaceid": "9735e8ce-a2bd-49c8-adcf-846c05b7427e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:20:47 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Converting VIF {"id": "9735e8ce-a2bd-49c8-adcf-846c05b7427e", "address": "fa:16:3e:91:34:e3", "network": {"id": "e6c54663-74e3-43e2-8f0d-61b300c1f68d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1222286883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ac22022944542c0b52dd912d3dbcce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9735e8ce-a2", "ovs_interfaceid": "9735e8ce-a2bd-49c8-adcf-846c05b7427e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:20:47 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:34:e3,bridge_name='br-int',has_traffic_filtering=True,id=9735e8ce-a2bd-49c8-adcf-846c05b7427e,network=Network(e6c54663-74e3-43e2-8f0d-61b300c1f68d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9735e8ce-a2') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:20:47 user nova-compute[72362]: DEBUG nova.objects.instance [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:20:47 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:20:47 user nova-compute[72362]:   <uuid>3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f</uuid>
Aug 09 10:20:47 user nova-compute[72362]:   <name>instance-0000000f</name>
Aug 09 10:20:47 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:20:47 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:20:47 user nova-compute[72362]:   <metadata>
Aug 09 10:20:47 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:20:47 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:20:47 user nova-compute[72362]:       <nova:name>tempest-ServerActionsTestOtherA-server-992323535</nova:name>
Aug 09 10:20:47 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:20:47</nova:creationTime>
Aug 09 10:20:47 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:20:47 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:20:47 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:20:47 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:20:47 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:20:47 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:20:47 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:20:47 user nova-compute[72362]:       <nova:owner>
Aug 09 10:20:47 user nova-compute[72362]:         <nova:user uuid="990e2d160fdc4c599cee9f65d6d4e41d">tempest-ServerActionsTestOtherA-2101881579-project-member</nova:user>
Aug 09 10:20:47 user nova-compute[72362]:         <nova:project uuid="8ac22022944542c0b52dd912d3dbcce2">tempest-ServerActionsTestOtherA-2101881579</nova:project>
Aug 09 10:20:47 user nova-compute[72362]:       </nova:owner>
Aug 09 10:20:47 user nova-compute[72362]:       <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:20:47 user nova-compute[72362]:       <nova:ports>
Aug 09 10:20:47 user nova-compute[72362]:         <nova:port uuid="9735e8ce-a2bd-49c8-adcf-846c05b7427e">
Aug 09 10:20:47 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 10:20:47 user nova-compute[72362]:         </nova:port>
Aug 09 10:20:47 user nova-compute[72362]:       </nova:ports>
Aug 09 10:20:47 user nova-compute[72362]:     </nova:instance>
Aug 09 10:20:47 user nova-compute[72362]:   </metadata>
Aug 09 10:20:47 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:20:47 user nova-compute[72362]:     <system>
Aug 09 10:20:47 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:20:47 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:20:47 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:20:47 user nova-compute[72362]:       <entry name="serial">3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f</entry>
Aug 09 10:20:47 user nova-compute[72362]:       <entry name="uuid">3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f</entry>
Aug 09 10:20:47 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:20:47 user nova-compute[72362]:     </system>
Aug 09 10:20:47 user nova-compute[72362]:   </sysinfo>
Aug 09 10:20:47 user nova-compute[72362]:   <os>
Aug 09 10:20:47 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:20:47 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:20:47 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:20:47 user nova-compute[72362]:   </os>
Aug 09 10:20:47 user nova-compute[72362]:   <features>
Aug 09 10:20:47 user nova-compute[72362]:     <acpi/>
Aug 09 10:20:47 user nova-compute[72362]:     <apic/>
Aug 09 10:20:47 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:20:47 user nova-compute[72362]:   </features>
Aug 09 10:20:47 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:20:47 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:20:47 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:20:47 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:20:47 user nova-compute[72362]:   </clock>
Aug 09 10:20:47 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:20:47 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:20:47 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:20:47 user nova-compute[72362]:   </cpu>
Aug 09 10:20:47 user nova-compute[72362]:   <devices>
Aug 09 10:20:47 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:20:47 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:20:47 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk"/>
Aug 09 10:20:47 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:20:47 user nova-compute[72362]:     </disk>
Aug 09 10:20:47 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:20:47 user nova-compute[72362]:       <mac address="fa:16:3e:91:34:e3"/>
Aug 09 10:20:47 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:20:47 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:20:47 user nova-compute[72362]:       <target dev="tap9735e8ce-a2"/>
Aug 09 10:20:47 user nova-compute[72362]:     </interface>
Aug 09 10:20:47 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:20:47 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/console.log" append="off"/>
Aug 09 10:20:47 user nova-compute[72362]:     </serial>
Aug 09 10:20:47 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:20:47 user nova-compute[72362]:     <video>
Aug 09 10:20:47 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:20:47 user nova-compute[72362]:     </video>
Aug 09 10:20:47 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:20:47 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:20:47 user nova-compute[72362]:     </rng>
Aug 09 10:20:47 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:20:47 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:20:47 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:20:47 user nova-compute[72362]:     </memballoon>
Aug 09 10:20:47 user nova-compute[72362]:   </devices>
Aug 09 10:20:47 user nova-compute[72362]: </domain>
Aug 09 10:20:47 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:20:47 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:20:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-992323535',display_name='tempest-ServerActionsTestOtherA-server-992323535',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-992323535',id=15,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwSFF251eQti/qkoXtJtG/hsB95elMyv8iaeRUjgcdf3ZQpb25r9rbEB2fGNjqP3pvOqQxJNR/NqVUD62omNMx/akMv5+i7VAu1R/GqhP2vqtVAvdiRNee4z2ROG7Jd8w==',key_name='tempest-keypair-122703468',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ac22022944542c0b52dd912d3dbcce2',ramdisk_id='',reservation_id='r-aza1h2p7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2101881579',owner_user_name='tempest-ServerActionsTestOtherA-2101881579-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:20:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='990e2d160fdc4c599cee9f65d6d4e41d',uuid=3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9735e8ce-a2bd-49c8-adcf-846c05b7427e", "address": "fa:16:3e:91:34:e3", "network": {"id": "e6c54663-74e3-43e2-8f0d-61b300c1f68d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1222286883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ac22022944542c0b52dd912d3dbcce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9735e8ce-a2", "ovs_interfaceid": "9735e8ce-a2bd-49c8-adcf-846c05b7427e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:20:47 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Converting VIF {"id": "9735e8ce-a2bd-49c8-adcf-846c05b7427e", "address": "fa:16:3e:91:34:e3", "network": {"id": "e6c54663-74e3-43e2-8f0d-61b300c1f68d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1222286883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ac22022944542c0b52dd912d3dbcce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9735e8ce-a2", "ovs_interfaceid": "9735e8ce-a2bd-49c8-adcf-846c05b7427e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:20:47 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:34:e3,bridge_name='br-int',has_traffic_filtering=True,id=9735e8ce-a2bd-49c8-adcf-846c05b7427e,network=Network(e6c54663-74e3-43e2-8f0d-61b300c1f68d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9735e8ce-a2') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:20:47 user nova-compute[72362]: DEBUG os_vif [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:34:e3,bridge_name='br-int',has_traffic_filtering=True,id=9735e8ce-a2bd-49c8-adcf-846c05b7427e,network=Network(e6c54663-74e3-43e2-8f0d-61b300c1f68d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9735e8ce-a2') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:20:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:20:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:20:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9735e8ce-a2, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:20:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9735e8ce-a2, col_values=(('external_ids', {'iface-id': '9735e8ce-a2bd-49c8-adcf-846c05b7427e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:34:e3', 'vm-uuid': '3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:20:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:20:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:47 user nova-compute[72362]: INFO os_vif [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:34:e3,bridge_name='br-int',has_traffic_filtering=True,id=9735e8ce-a2bd-49c8-adcf-846c05b7427e,network=Network(e6c54663-74e3-43e2-8f0d-61b300c1f68d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9735e8ce-a2')
Aug 09 10:20:47 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:20:47 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] No VIF found with MAC fa:16:3e:91:34:e3, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:20:47 user nova-compute[72362]: DEBUG nova.network.neutron [req-bacda107-857e-4fff-aa36-c8f282add9e4 req-63a6513e-ed2d-48c2-a75e-cde96b3c8fc6 service nova] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Updated VIF entry in instance network info cache for port 9735e8ce-a2bd-49c8-adcf-846c05b7427e. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:20:47 user nova-compute[72362]: DEBUG nova.network.neutron [req-bacda107-857e-4fff-aa36-c8f282add9e4 req-63a6513e-ed2d-48c2-a75e-cde96b3c8fc6 service nova] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Updating instance_info_cache with network_info: [{"id": "9735e8ce-a2bd-49c8-adcf-846c05b7427e", "address": "fa:16:3e:91:34:e3", "network": {"id": "e6c54663-74e3-43e2-8f0d-61b300c1f68d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1222286883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ac22022944542c0b52dd912d3dbcce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9735e8ce-a2", "ovs_interfaceid": "9735e8ce-a2bd-49c8-adcf-846c05b7427e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:20:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-bacda107-857e-4fff-aa36-c8f282add9e4 req-63a6513e-ed2d-48c2-a75e-cde96b3c8fc6 service nova] Releasing lock "refresh_cache-3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:20:48 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:48 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:48 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:48 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:49 user nova-compute[72362]: DEBUG nova.compute.manager [req-4902c4fd-408c-4a01-b6bd-a423eb7d9384 req-dfdd191f-e5f6-44a3-9abb-3bc460f9505a service nova] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Received event network-vif-plugged-9735e8ce-a2bd-49c8-adcf-846c05b7427e {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:20:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-4902c4fd-408c-4a01-b6bd-a423eb7d9384 req-dfdd191f-e5f6-44a3-9abb-3bc460f9505a service nova] Acquiring lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:20:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-4902c4fd-408c-4a01-b6bd-a423eb7d9384 req-dfdd191f-e5f6-44a3-9abb-3bc460f9505a service nova] Lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:20:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-4902c4fd-408c-4a01-b6bd-a423eb7d9384 req-dfdd191f-e5f6-44a3-9abb-3bc460f9505a service nova] Lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:20:49 user nova-compute[72362]: DEBUG nova.compute.manager [req-4902c4fd-408c-4a01-b6bd-a423eb7d9384 req-dfdd191f-e5f6-44a3-9abb-3bc460f9505a service nova] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] No waiting events found dispatching network-vif-plugged-9735e8ce-a2bd-49c8-adcf-846c05b7427e {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:20:49 user nova-compute[72362]: WARNING nova.compute.manager [req-4902c4fd-408c-4a01-b6bd-a423eb7d9384 req-dfdd191f-e5f6-44a3-9abb-3bc460f9505a service nova] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Received unexpected event network-vif-plugged-9735e8ce-a2bd-49c8-adcf-846c05b7427e for instance with vm_state building and task_state spawning.
Aug 09 10:20:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:50 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Acquiring lock "09a20950-bce9-4c83-82db-e058872ae358" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:20:50 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Lock "09a20950-bce9-4c83-82db-e058872ae358" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:20:50 user nova-compute[72362]: DEBUG nova.compute.manager [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Starting instance... {{(pid=72362) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 10:20:50 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:20:50 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:20:50 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:20:50 user nova-compute[72362]: INFO nova.compute.claims [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Claim successful on node user
Aug 09 10:20:50 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:51 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:20:51 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:20:51 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576451.0830085, 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:20:51 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] VM Resumed (Lifecycle Event)
Aug 09 10:20:51 user nova-compute[72362]: DEBUG nova.compute.manager [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:20:51 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:20:51 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Instance spawned successfully.
Aug 09 10:20:51 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 10:20:51 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:20:51 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.431s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:20:51 user nova-compute[72362]: DEBUG nova.compute.manager [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Start building networks asynchronously for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 10:20:51 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:20:51 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Found default for hw_cdrom_bus of ide {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:20:51 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Found default for hw_disk_bus of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:20:51 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:20:51 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:20:51 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Found default for hw_video_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:20:51 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Found default for hw_vif_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:20:51 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:20:51 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576451.0852985, 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:20:51 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] VM Started (Lifecycle Event)
Aug 09 10:20:51 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:20:51 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:20:51 user nova-compute[72362]: DEBUG nova.compute.manager [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Allocating IP information in the background. {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 10:20:51 user nova-compute[72362]: DEBUG nova.network.neutron [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] allocate_for_instance() {{(pid=72362) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 10:20:51 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:20:51 user nova-compute[72362]: DEBUG nova.compute.manager [req-54d59946-0395-4120-90ec-88c8e9ee2c48 req-c622ed9b-f82d-4ea2-b088-614cc3fd56fe service nova] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Received event network-vif-plugged-9735e8ce-a2bd-49c8-adcf-846c05b7427e {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:20:51 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-54d59946-0395-4120-90ec-88c8e9ee2c48 req-c622ed9b-f82d-4ea2-b088-614cc3fd56fe service nova] Acquiring lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:20:51 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-54d59946-0395-4120-90ec-88c8e9ee2c48 req-c622ed9b-f82d-4ea2-b088-614cc3fd56fe service nova] Lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:20:51 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-54d59946-0395-4120-90ec-88c8e9ee2c48 req-c622ed9b-f82d-4ea2-b088-614cc3fd56fe service nova] Lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:20:51 user nova-compute[72362]: DEBUG nova.compute.manager [req-54d59946-0395-4120-90ec-88c8e9ee2c48 req-c622ed9b-f82d-4ea2-b088-614cc3fd56fe service nova] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] No waiting events found dispatching network-vif-plugged-9735e8ce-a2bd-49c8-adcf-846c05b7427e {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:20:51 user nova-compute[72362]: WARNING nova.compute.manager [req-54d59946-0395-4120-90ec-88c8e9ee2c48 req-c622ed9b-f82d-4ea2-b088-614cc3fd56fe service nova] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Received unexpected event network-vif-plugged-9735e8ce-a2bd-49c8-adcf-846c05b7427e for instance with vm_state building and task_state spawning.
Aug 09 10:20:51 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 10:20:51 user nova-compute[72362]: INFO nova.compute.manager [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Took 6.68 seconds to spawn the instance on the hypervisor.
Aug 09 10:20:51 user nova-compute[72362]: DEBUG nova.compute.manager [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:20:51 user nova-compute[72362]: DEBUG nova.compute.manager [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Start building block device mappings for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 10:20:51 user nova-compute[72362]: INFO nova.compute.manager [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Took 7.52 seconds to build instance.
Aug 09 10:20:51 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2f66e808-96ed-4dd2-8e15-37656a22514e tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.620s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:20:51 user nova-compute[72362]: INFO nova.virt.block_device [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Booting with volume deb67b62-54b5-4129-bf15-580c82d0ab28 at /dev/vda
Aug 09 10:20:51 user nova-compute[72362]: DEBUG nova.policy [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b306455ac86f4464b585007877c7fc97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18e5da818db4bbab4359c2b6f13f93f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72362) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 10:20:51 user nova-compute[72362]: DEBUG os_brick.utils [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:20:51 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:20:51 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:20:51 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b54575-e5bf-425e-942b-d922e38f4c7d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:20:51 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:20:51 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:20:51 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2290b96-8559-4b1b-a80a-967ce112425b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:20:51 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:20:51 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:20:51 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[461627b8-e852-47a9-b4df-22298ca1815d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:20:51 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63f4b14-807e-4133-b999-5429a92cdd15]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:20:51 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:20:51 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:20:51 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:20:51 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:20:51 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:20:51 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:20:51 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[981be03c-e2ec-4e5b-8be2-f88a91a890b0]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:20:51 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:20:51 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:20:51 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:20:51 user nova-compute[72362]: DEBUG os_brick.utils [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:20:51 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Updating existing volume attachment record: dd4bcec2-7a27-4a62-b05c-d85c71798c60 {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 10:20:52 user nova-compute[72362]: DEBUG nova.network.neutron [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Successfully created port: 5fd897a8-78c2-49be-b1d6-867bab82082d {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:20:52 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:53 user nova-compute[72362]: DEBUG nova.network.neutron [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Successfully created port: 32d1ff81-fed5-47fe-88ce-04bd2777f1e5 {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:20:53 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:20:53 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:20:53 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:20:53 user nova-compute[72362]: DEBUG nova.network.neutron [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Successfully created port: 41551d54-2c78-4fbe-9b7a-43452c5e94da {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:20:53 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:20:53 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:20:53 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 10:20:54 user nova-compute[72362]: DEBUG nova.network.neutron [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Successfully created port: de067d87-6780-4c38-bf69-7d976cbde30a {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:20:54 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:20:55 user nova-compute[72362]: DEBUG nova.network.neutron [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Successfully created port: cb0c5adb-40d5-4fb6-b458-35a85c670333 {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:20:55 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:55 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:55 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:20:55 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 10:20:56 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Didn't find any instances for network info cache update. {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 10:20:56 user nova-compute[72362]: DEBUG nova.network.neutron [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Successfully updated port: 5fd897a8-78c2-49be-b1d6-867bab82082d {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:20:56 user nova-compute[72362]: DEBUG nova.compute.manager [req-04c38a03-c0e1-44d6-9d78-70f5bcdfd5bd req-4e3e8e47-2f78-4244-ba8f-349750ea9916 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received event network-changed-5fd897a8-78c2-49be-b1d6-867bab82082d {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:20:56 user nova-compute[72362]: DEBUG nova.compute.manager [req-04c38a03-c0e1-44d6-9d78-70f5bcdfd5bd req-4e3e8e47-2f78-4244-ba8f-349750ea9916 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Refreshing instance network info cache due to event network-changed-5fd897a8-78c2-49be-b1d6-867bab82082d. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:20:56 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-04c38a03-c0e1-44d6-9d78-70f5bcdfd5bd req-4e3e8e47-2f78-4244-ba8f-349750ea9916 service nova] Acquiring lock "refresh_cache-09a20950-bce9-4c83-82db-e058872ae358" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:20:56 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-04c38a03-c0e1-44d6-9d78-70f5bcdfd5bd req-4e3e8e47-2f78-4244-ba8f-349750ea9916 service nova] Acquired lock "refresh_cache-09a20950-bce9-4c83-82db-e058872ae358" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:20:56 user nova-compute[72362]: DEBUG nova.network.neutron [req-04c38a03-c0e1-44d6-9d78-70f5bcdfd5bd req-4e3e8e47-2f78-4244-ba8f-349750ea9916 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Refreshing network info cache for port 5fd897a8-78c2-49be-b1d6-867bab82082d {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:20:56 user nova-compute[72362]: DEBUG nova.network.neutron [req-04c38a03-c0e1-44d6-9d78-70f5bcdfd5bd req-4e3e8e47-2f78-4244-ba8f-349750ea9916 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:20:56 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:20:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:57 user nova-compute[72362]: DEBUG nova.network.neutron [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Successfully updated port: f1457dd7-06e1-43ac-a55d-3f4f9fe150f8 {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:20:57 user nova-compute[72362]: DEBUG nova.network.neutron [req-04c38a03-c0e1-44d6-9d78-70f5bcdfd5bd req-4e3e8e47-2f78-4244-ba8f-349750ea9916 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:20:57 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-04c38a03-c0e1-44d6-9d78-70f5bcdfd5bd req-4e3e8e47-2f78-4244-ba8f-349750ea9916 service nova] Releasing lock "refresh_cache-09a20950-bce9-4c83-82db-e058872ae358" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:20:58 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:20:58 user nova-compute[72362]: DEBUG nova.compute.manager [req-6f6c5ad0-3fb7-4486-8aca-ee1d7f183716 req-dec1a048-b29f-4877-9c31-0e9cbde17c4a service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received event network-changed-f1457dd7-06e1-43ac-a55d-3f4f9fe150f8 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:20:58 user nova-compute[72362]: DEBUG nova.compute.manager [req-6f6c5ad0-3fb7-4486-8aca-ee1d7f183716 req-dec1a048-b29f-4877-9c31-0e9cbde17c4a service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Refreshing instance network info cache due to event network-changed-f1457dd7-06e1-43ac-a55d-3f4f9fe150f8. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:20:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-6f6c5ad0-3fb7-4486-8aca-ee1d7f183716 req-dec1a048-b29f-4877-9c31-0e9cbde17c4a service nova] Acquiring lock "refresh_cache-09a20950-bce9-4c83-82db-e058872ae358" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:20:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-6f6c5ad0-3fb7-4486-8aca-ee1d7f183716 req-dec1a048-b29f-4877-9c31-0e9cbde17c4a service nova] Acquired lock "refresh_cache-09a20950-bce9-4c83-82db-e058872ae358" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:20:58 user nova-compute[72362]: DEBUG nova.network.neutron [req-6f6c5ad0-3fb7-4486-8aca-ee1d7f183716 req-dec1a048-b29f-4877-9c31-0e9cbde17c4a service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Refreshing network info cache for port f1457dd7-06e1-43ac-a55d-3f4f9fe150f8 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:20:58 user nova-compute[72362]: DEBUG nova.network.neutron [req-6f6c5ad0-3fb7-4486-8aca-ee1d7f183716 req-dec1a048-b29f-4877-9c31-0e9cbde17c4a service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:20:58 user nova-compute[72362]: DEBUG nova.network.neutron [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Successfully updated port: 21baa9dd-a7b0-445e-be2e-ab8b953bae49 {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:20:58 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:20:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:20:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:20:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:20:59 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 10:20:59 user nova-compute[72362]: DEBUG nova.network.neutron [req-6f6c5ad0-3fb7-4486-8aca-ee1d7f183716 req-dec1a048-b29f-4877-9c31-0e9cbde17c4a service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:20:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:20:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-6f6c5ad0-3fb7-4486-8aca-ee1d7f183716 req-dec1a048-b29f-4877-9c31-0e9cbde17c4a service nova] Releasing lock "refresh_cache-09a20950-bce9-4c83-82db-e058872ae358" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:20:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:20:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:20:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:20:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:20:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:20:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:20:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:20:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45316ca8-e866-4e2f-a92d-d1b256613dd1/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:00 user nova-compute[72362]: DEBUG nova.network.neutron [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Successfully updated port: 32d1ff81-fed5-47fe-88ce-04bd2777f1e5 {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:21:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45316ca8-e866-4e2f-a92d-d1b256613dd1/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45316ca8-e866-4e2f-a92d-d1b256613dd1/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45316ca8-e866-4e2f-a92d-d1b256613dd1/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca002e73-ddf7-4452-82b6-0d831d984756/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca002e73-ddf7-4452-82b6-0d831d984756/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca002e73-ddf7-4452-82b6-0d831d984756/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:00 user nova-compute[72362]: DEBUG nova.compute.manager [req-4709ada8-a920-4b71-abd7-1a2831d6be9c req-da1346ed-ffed-4131-a04e-9907f07a9812 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received event network-changed-21baa9dd-a7b0-445e-be2e-ab8b953bae49 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:21:00 user nova-compute[72362]: DEBUG nova.compute.manager [req-4709ada8-a920-4b71-abd7-1a2831d6be9c req-da1346ed-ffed-4131-a04e-9907f07a9812 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Refreshing instance network info cache due to event network-changed-21baa9dd-a7b0-445e-be2e-ab8b953bae49. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:21:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-4709ada8-a920-4b71-abd7-1a2831d6be9c req-da1346ed-ffed-4131-a04e-9907f07a9812 service nova] Acquiring lock "refresh_cache-09a20950-bce9-4c83-82db-e058872ae358" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:21:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-4709ada8-a920-4b71-abd7-1a2831d6be9c req-da1346ed-ffed-4131-a04e-9907f07a9812 service nova] Acquired lock "refresh_cache-09a20950-bce9-4c83-82db-e058872ae358" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:21:00 user nova-compute[72362]: DEBUG nova.network.neutron [req-4709ada8-a920-4b71-abd7-1a2831d6be9c req-da1346ed-ffed-4131-a04e-9907f07a9812 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Refreshing network info cache for port 21baa9dd-a7b0-445e-be2e-ab8b953bae49 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:21:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca002e73-ddf7-4452-82b6-0d831d984756/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea95226c-40fe-4408-a9f0-5538659261a6/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:00 user nova-compute[72362]: DEBUG nova.network.neutron [req-4709ada8-a920-4b71-abd7-1a2831d6be9c req-da1346ed-ffed-4131-a04e-9907f07a9812 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:21:00 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea95226c-40fe-4408-a9f0-5538659261a6/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea95226c-40fe-4408-a9f0-5538659261a6/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea95226c-40fe-4408-a9f0-5538659261a6/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:01 user nova-compute[72362]: DEBUG nova.network.neutron [req-4709ada8-a920-4b71-abd7-1a2831d6be9c req-da1346ed-ffed-4131-a04e-9907f07a9812 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:21:01 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-4709ada8-a920-4b71-abd7-1a2831d6be9c req-da1346ed-ffed-4131-a04e-9907f07a9812 service nova] Releasing lock "refresh_cache-09a20950-bce9-4c83-82db-e058872ae358" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:21:01 user nova-compute[72362]: DEBUG nova.compute.manager [req-4709ada8-a920-4b71-abd7-1a2831d6be9c req-da1346ed-ffed-4131-a04e-9907f07a9812 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received event network-changed-32d1ff81-fed5-47fe-88ce-04bd2777f1e5 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:21:01 user nova-compute[72362]: DEBUG nova.compute.manager [req-4709ada8-a920-4b71-abd7-1a2831d6be9c req-da1346ed-ffed-4131-a04e-9907f07a9812 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Refreshing instance network info cache due to event network-changed-32d1ff81-fed5-47fe-88ce-04bd2777f1e5. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:21:01 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-4709ada8-a920-4b71-abd7-1a2831d6be9c req-da1346ed-ffed-4131-a04e-9907f07a9812 service nova] Acquiring lock "refresh_cache-09a20950-bce9-4c83-82db-e058872ae358" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:21:01 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-4709ada8-a920-4b71-abd7-1a2831d6be9c req-da1346ed-ffed-4131-a04e-9907f07a9812 service nova] Acquired lock "refresh_cache-09a20950-bce9-4c83-82db-e058872ae358" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:21:01 user nova-compute[72362]: DEBUG nova.network.neutron [req-4709ada8-a920-4b71-abd7-1a2831d6be9c req-da1346ed-ffed-4131-a04e-9907f07a9812 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Refreshing network info cache for port 32d1ff81-fed5-47fe-88ce-04bd2777f1e5 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:21:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:01 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:21:01 user nova-compute[72362]: DEBUG nova.network.neutron [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Successfully updated port: 41551d54-2c78-4fbe-9b7a-43452c5e94da {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:21:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5b048c8-a329-4fe3-ab62-a06ab6401230/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5b048c8-a329-4fe3-ab62-a06ab6401230/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5b048c8-a329-4fe3-ab62-a06ab6401230/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:01 user nova-compute[72362]: DEBUG nova.network.neutron [req-4709ada8-a920-4b71-abd7-1a2831d6be9c req-da1346ed-ffed-4131-a04e-9907f07a9812 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:21:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5b048c8-a329-4fe3-ab62-a06ab6401230/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:02 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:21:02 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:21:02 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=7690MB free_disk=25.49716567993164GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 10:21:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:21:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:21:02 user nova-compute[72362]: DEBUG nova.network.neutron [req-4709ada8-a920-4b71-abd7-1a2831d6be9c req-da1346ed-ffed-4131-a04e-9907f07a9812 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:21:02 user nova-compute[72362]: INFO nova.virt.block_device [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Booting with volume 2f562c44-6d2f-49a0-ac17-a67fed224b31 at /dev/vdb
Aug 09 10:21:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-4709ada8-a920-4b71-abd7-1a2831d6be9c req-da1346ed-ffed-4131-a04e-9907f07a9812 service nova] Releasing lock "refresh_cache-09a20950-bce9-4c83-82db-e058872ae358" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:21:02 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Applying migration context for instance 0e8a7668-1635-4cbc-8c09-ece19ff67d4f as it has an incoming, in-progress migration b612e21a-eb0a-4569-a87c-38f119262c85. Migration status is finished {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 09 10:21:02 user nova-compute[72362]: INFO nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Updating resource usage from migration b612e21a-eb0a-4569-a87c-38f119262c85
Aug 09 10:21:02 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance ca002e73-ddf7-4452-82b6-0d831d984756 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:21:02 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance ea95226c-40fe-4408-a9f0-5538659261a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:21:02 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 8e055c58-a365-4f18-a6e3-377e32e2189d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:21:02 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 45316ca8-e866-4e2f-a92d-d1b256613dd1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:21:02 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance d5b048c8-a329-4fe3-ab62-a06ab6401230 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:21:02 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Migration b612e21a-eb0a-4569-a87c-38f119262c85 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 09 10:21:02 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 0e8a7668-1635-4cbc-8c09-ece19ff67d4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:21:02 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:21:02 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 09a20950-bce9-4c83-82db-e058872ae358 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:21:02 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 10:21:02 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 10:21:02 user nova-compute[72362]: DEBUG os_brick.utils [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:21:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:02 user nova-compute[72362]: DEBUG nova.network.neutron [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Successfully updated port: de067d87-6780-4c38-bf69-7d976cbde30a {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:21:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:02 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e712527-5fe9-4130-94d8-c730ff336108]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.027s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:02 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[da02e401-d628-4faf-9f9c-4496c0183bc0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:02 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[23acc176-dd86-43aa-b877-564003e6d34e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:02 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3ac3d6-5f04-470b-8681-d92f292f9fa6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:21:02 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:21:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:21:02 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:21:02 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4bde25-e28f-47ad-a869-95488140c349]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:02 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:21:02 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:21:02 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:21:02 user nova-compute[72362]: DEBUG os_brick.utils [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] <== get_connector_properties: return (169ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:21:02 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Updating existing volume attachment record: 6c9a8d87-1960-4fda-98ff-9602cd0057d4 {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 10:21:02 user nova-compute[72362]: DEBUG nova.compute.manager [req-e4f0f640-d19e-473f-91c8-b96744d3cd5f req-4ba67333-158c-48a7-b52c-de31e5068279 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received event network-changed-41551d54-2c78-4fbe-9b7a-43452c5e94da {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:21:02 user nova-compute[72362]: DEBUG nova.compute.manager [req-e4f0f640-d19e-473f-91c8-b96744d3cd5f req-4ba67333-158c-48a7-b52c-de31e5068279 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Refreshing instance network info cache due to event network-changed-41551d54-2c78-4fbe-9b7a-43452c5e94da. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:21:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e4f0f640-d19e-473f-91c8-b96744d3cd5f req-4ba67333-158c-48a7-b52c-de31e5068279 service nova] Acquiring lock "refresh_cache-09a20950-bce9-4c83-82db-e058872ae358" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:21:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e4f0f640-d19e-473f-91c8-b96744d3cd5f req-4ba67333-158c-48a7-b52c-de31e5068279 service nova] Acquired lock "refresh_cache-09a20950-bce9-4c83-82db-e058872ae358" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:21:02 user nova-compute[72362]: DEBUG nova.network.neutron [req-e4f0f640-d19e-473f-91c8-b96744d3cd5f req-4ba67333-158c-48a7-b52c-de31e5068279 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Refreshing network info cache for port 41551d54-2c78-4fbe-9b7a-43452c5e94da {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:21:02 user nova-compute[72362]: DEBUG nova.network.neutron [req-e4f0f640-d19e-473f-91c8-b96744d3cd5f req-4ba67333-158c-48a7-b52c-de31e5068279 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:21:02 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:21:02 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:21:02 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 10:21:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.716s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:21:03 user nova-compute[72362]: DEBUG nova.network.neutron [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Successfully updated port: cb0c5adb-40d5-4fb6-b458-35a85c670333 {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:21:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Acquiring lock "refresh_cache-09a20950-bce9-4c83-82db-e058872ae358" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:21:03 user nova-compute[72362]: DEBUG nova.network.neutron [req-e4f0f640-d19e-473f-91c8-b96744d3cd5f req-4ba67333-158c-48a7-b52c-de31e5068279 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:21:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e4f0f640-d19e-473f-91c8-b96744d3cd5f req-4ba67333-158c-48a7-b52c-de31e5068279 service nova] Releasing lock "refresh_cache-09a20950-bce9-4c83-82db-e058872ae358" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:21:03 user nova-compute[72362]: DEBUG nova.compute.manager [req-e4f0f640-d19e-473f-91c8-b96744d3cd5f req-4ba67333-158c-48a7-b52c-de31e5068279 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received event network-changed-de067d87-6780-4c38-bf69-7d976cbde30a {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:21:03 user nova-compute[72362]: DEBUG nova.compute.manager [req-e4f0f640-d19e-473f-91c8-b96744d3cd5f req-4ba67333-158c-48a7-b52c-de31e5068279 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Refreshing instance network info cache due to event network-changed-de067d87-6780-4c38-bf69-7d976cbde30a. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:21:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e4f0f640-d19e-473f-91c8-b96744d3cd5f req-4ba67333-158c-48a7-b52c-de31e5068279 service nova] Acquiring lock "refresh_cache-09a20950-bce9-4c83-82db-e058872ae358" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:21:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e4f0f640-d19e-473f-91c8-b96744d3cd5f req-4ba67333-158c-48a7-b52c-de31e5068279 service nova] Acquired lock "refresh_cache-09a20950-bce9-4c83-82db-e058872ae358" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:21:03 user nova-compute[72362]: DEBUG nova.network.neutron [req-e4f0f640-d19e-473f-91c8-b96744d3cd5f req-4ba67333-158c-48a7-b52c-de31e5068279 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Refreshing network info cache for port de067d87-6780-4c38-bf69-7d976cbde30a {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:21:03 user nova-compute[72362]: DEBUG nova.network.neutron [req-e4f0f640-d19e-473f-91c8-b96744d3cd5f req-4ba67333-158c-48a7-b52c-de31e5068279 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:21:04 user nova-compute[72362]: DEBUG nova.network.neutron [req-e4f0f640-d19e-473f-91c8-b96744d3cd5f req-4ba67333-158c-48a7-b52c-de31e5068279 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:21:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e4f0f640-d19e-473f-91c8-b96744d3cd5f req-4ba67333-158c-48a7-b52c-de31e5068279 service nova] Releasing lock "refresh_cache-09a20950-bce9-4c83-82db-e058872ae358" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:21:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Acquired lock "refresh_cache-09a20950-bce9-4c83-82db-e058872ae358" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:21:04 user nova-compute[72362]: DEBUG nova.network.neutron [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:21:04 user nova-compute[72362]: DEBUG nova.network.neutron [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:21:04 user nova-compute[72362]: DEBUG nova.compute.manager [req-4e0ce233-4f06-464d-b184-d3a4e879c029 req-1fc4644b-8a06-4b53-a63c-0bca76704e92 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received event network-changed-cb0c5adb-40d5-4fb6-b458-35a85c670333 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:21:04 user nova-compute[72362]: DEBUG nova.compute.manager [req-4e0ce233-4f06-464d-b184-d3a4e879c029 req-1fc4644b-8a06-4b53-a63c-0bca76704e92 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Refreshing instance network info cache due to event network-changed-cb0c5adb-40d5-4fb6-b458-35a85c670333. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:21:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-4e0ce233-4f06-464d-b184-d3a4e879c029 req-1fc4644b-8a06-4b53-a63c-0bca76704e92 service nova] Acquiring lock "refresh_cache-09a20950-bce9-4c83-82db-e058872ae358" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:21:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:08 user nova-compute[72362]: DEBUG nova.network.neutron [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Updating instance_info_cache with network_info: [{"id": "5fd897a8-78c2-49be-b1d6-867bab82082d", "address": "fa:16:3e:ae:3a:4a", "network": {"id": "e2b9dab7-85be-4e72-a3a9-14cd26990b44", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1356785765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd897a8-78", "ovs_interfaceid": "5fd897a8-78c2-49be-b1d6-867bab82082d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f1457dd7-06e1-43ac-a55d-3f4f9fe150f8", "address": "fa:16:3e:f2:a7:dd", "network": {"id": "b1aa635b-9b29-45b6-8cd4-06ccd9e0f545", "bridge": "br-int", "label": "tempest-device-tagging-net1-2012050279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1457dd7-06", "ovs_interfaceid": "f1457dd7-06e1-43ac-a55d-3f4f9fe150f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "21baa9dd-a7b0-445e-be2e-ab8b953bae49", "address": "fa:16:3e:55:ce:ef", "network": {"id": "b1aa635b-9b29-45b6-8cd4-06ccd9e0f545", "bridge": "br-int", "label": "tempest-device-tagging-net1-2012050279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21baa9dd-a7", "ovs_interfaceid": "21baa9dd-a7b0-445e-be2e-ab8b953bae49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "32d1ff81-fed5-47fe-88ce-04bd2777f1e5", "address": "fa:16:3e:b5:df:02", "network": {"id": "b1aa635b-9b29-45b6-8cd4-06ccd9e0f545", "bridge": "br-int", "label": "tempest-device-tagging-net1-2012050279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d1ff81-fe", "ovs_interfaceid": "32d1ff81-fed5-47fe-88ce-04bd2777f1e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41551d54-2c78-4fbe-9b7a-43452c5e94da", "address": "fa:16:3e:d8:11:91", "network": {"id": "b1aa635b-9b29-45b6-8cd4-06ccd9e0f545", "bridge": "br-int", "label": "tempest-device-tagging-net1-2012050279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41551d54-2c", "ovs_interfaceid": "41551d54-2c78-4fbe-9b7a-43452c5e94da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "de067d87-6780-4c38-bf69-7d976cbde30a", "address": "fa:16:3e:e1:62:57", "network": {"id": "6e7161bb-3d35-4adb-89d3-aa23f97adbfa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1214229212", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde067d87-67", "ovs_interfaceid": "de067d87-6780-4c38-bf69-7d976cbde30a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cb0c5adb-40d5-4fb6-b458-35a85c670333", "address": "fa:16:3e:8a:63:cf", "network": {"id": "6e7161bb-3d35-4adb-89d3-aa23f97adbfa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1214229212", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb0c5adb-40", "ovs_interfaceid": "cb0c5adb-40d5-4fb6-b458-35a85c670333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:21:08 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Releasing lock "refresh_cache-09a20950-bce9-4c83-82db-e058872ae358" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:21:08 user nova-compute[72362]: DEBUG nova.compute.manager [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Instance network_info: |[{"id": "5fd897a8-78c2-49be-b1d6-867bab82082d", "address": "fa:16:3e:ae:3a:4a", "network": {"id": "e2b9dab7-85be-4e72-a3a9-14cd26990b44", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1356785765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd897a8-78", "ovs_interfaceid": "5fd897a8-78c2-49be-b1d6-867bab82082d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f1457dd7-06e1-43ac-a55d-3f4f9fe150f8", "address": "fa:16:3e:f2:a7:dd", "network": {"id": "b1aa635b-9b29-45b6-8cd4-06ccd9e0f545", "bridge": "br-int", "label": "tempest-device-tagging-net1-2012050279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1457dd7-06", "ovs_interfaceid": "f1457dd7-06e1-43ac-a55d-3f4f9fe150f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "21baa9dd-a7b0-445e-be2e-ab8b953bae49", "address": "fa:16:3e:55:ce:ef", "network": {"id": "b1aa635b-9b29-45b6-8cd4-06ccd9e0f545", "bridge": "br-int", "label": "tempest-device-tagging-net1-2012050279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21baa9dd-a7", "ovs_interfaceid": "21baa9dd-a7b0-445e-be2e-ab8b953bae49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "32d1ff81-fed5-47fe-88ce-04bd2777f1e5", "address": "fa:16:3e:b5:df:02", "network": {"id": "b1aa635b-9b29-45b6-8cd4-06ccd9e0f545", "bridge": "br-int", "label": "tempest-device-tagging-net1-2012050279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d1ff81-fe", "ovs_interfaceid": "32d1ff81-fed5-47fe-88ce-04bd2777f1e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41551d54-2c78-4fbe-9b7a-43452c5e94da", "address": "fa:16:3e:d8:11:91", "network": {"id": "b1aa635b-9b29-45b6-8cd4-06ccd9e0f545", "bridge": "br-int", "label": "tempest-device-tagging-net1-2012050279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41551d54-2c", "ovs_interfaceid": "41551d54-2c78-4fbe-9b7a-43452c5e94da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "de067d87-6780-4c38-bf69-7d976cbde30a", "address": "fa:16:3e:e1:62:57", "network": {"id": "6e7161bb-3d35-4adb-89d3-aa23f97adbfa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1214229212", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde067d87-67", "ovs_interfaceid": "de067d87-6780-4c38-bf69-7d976cbde30a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cb0c5adb-40d5-4fb6-b458-35a85c670333", "address": "fa:16:3e:8a:63:cf", "network": {"id": "6e7161bb-3d35-4adb-89d3-aa23f97adbfa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1214229212", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb0c5adb-40", "ovs_interfaceid": "cb0c5adb-40d5-4fb6-b458-35a85c670333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 10:21:08 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-4e0ce233-4f06-464d-b184-d3a4e879c029 req-1fc4644b-8a06-4b53-a63c-0bca76704e92 service nova] Acquired lock "refresh_cache-09a20950-bce9-4c83-82db-e058872ae358" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:21:08 user nova-compute[72362]: DEBUG nova.network.neutron [req-4e0ce233-4f06-464d-b184-d3a4e879c029 req-1fc4644b-8a06-4b53-a63c-0bca76704e92 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Refreshing network info cache for port cb0c5adb-40d5-4fb6-b458-35a85c670333 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:21:09 user nova-compute[72362]: DEBUG nova.network.neutron [req-4e0ce233-4f06-464d-b184-d3a4e879c029 req-1fc4644b-8a06-4b53-a63c-0bca76704e92 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Updated VIF entry in instance network info cache for port cb0c5adb-40d5-4fb6-b458-35a85c670333. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:21:09 user nova-compute[72362]: DEBUG nova.network.neutron [req-4e0ce233-4f06-464d-b184-d3a4e879c029 req-1fc4644b-8a06-4b53-a63c-0bca76704e92 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Updating instance_info_cache with network_info: [{"id": "5fd897a8-78c2-49be-b1d6-867bab82082d", "address": "fa:16:3e:ae:3a:4a", "network": {"id": "e2b9dab7-85be-4e72-a3a9-14cd26990b44", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1356785765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd897a8-78", "ovs_interfaceid": "5fd897a8-78c2-49be-b1d6-867bab82082d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f1457dd7-06e1-43ac-a55d-3f4f9fe150f8", "address": "fa:16:3e:f2:a7:dd", "network": {"id": "b1aa635b-9b29-45b6-8cd4-06ccd9e0f545", "bridge": "br-int", "label": "tempest-device-tagging-net1-2012050279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1457dd7-06", "ovs_interfaceid": "f1457dd7-06e1-43ac-a55d-3f4f9fe150f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "21baa9dd-a7b0-445e-be2e-ab8b953bae49", "address": "fa:16:3e:55:ce:ef", "network": {"id": "b1aa635b-9b29-45b6-8cd4-06ccd9e0f545", "bridge": "br-int", "label": "tempest-device-tagging-net1-2012050279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21baa9dd-a7", "ovs_interfaceid": "21baa9dd-a7b0-445e-be2e-ab8b953bae49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "32d1ff81-fed5-47fe-88ce-04bd2777f1e5", "address": "fa:16:3e:b5:df:02", "network": {"id": "b1aa635b-9b29-45b6-8cd4-06ccd9e0f545", "bridge": "br-int", "label": "tempest-device-tagging-net1-2012050279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d1ff81-fe", "ovs_interfaceid": "32d1ff81-fed5-47fe-88ce-04bd2777f1e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41551d54-2c78-4fbe-9b7a-43452c5e94da", "address": "fa:16:3e:d8:11:91", "network": {"id": "b1aa635b-9b29-45b6-8cd4-06ccd9e0f545", "bridge": "br-int", "label": "tempest-device-tagging-net1-2012050279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41551d54-2c", "ovs_interfaceid": "41551d54-2c78-4fbe-9b7a-43452c5e94da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "de067d87-6780-4c38-bf69-7d976cbde30a", "address": "fa:16:3e:e1:62:57", "network": {"id": "6e7161bb-3d35-4adb-89d3-aa23f97adbfa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1214229212", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde067d87-67", "ovs_interfaceid": "de067d87-6780-4c38-bf69-7d976cbde30a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cb0c5adb-40d5-4fb6-b458-35a85c670333", "address": "fa:16:3e:8a:63:cf", "network": {"id": "6e7161bb-3d35-4adb-89d3-aa23f97adbfa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1214229212", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb0c5adb-40", "ovs_interfaceid": "cb0c5adb-40d5-4fb6-b458-35a85c670333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:21:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-4e0ce233-4f06-464d-b184-d3a4e879c029 req-1fc4644b-8a06-4b53-a63c-0bca76704e92 service nova] Releasing lock "refresh_cache-09a20950-bce9-4c83-82db-e058872ae358" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:21:09 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:10 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:10 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Acquiring lock "6493ab9a-4d69-434d-bed7-e51f1c5f3497" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:21:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Lock "6493ab9a-4d69-434d-bed7-e51f1c5f3497" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:21:11 user nova-compute[72362]: DEBUG nova.compute.manager [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Starting instance... {{(pid=72362) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 10:21:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:21:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:21:11 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:21:11 user nova-compute[72362]: INFO nova.compute.claims [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Claim successful on node user
Aug 09 10:21:11 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:21:11 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:21:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.622s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:21:11 user nova-compute[72362]: DEBUG nova.compute.manager [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Start building networks asynchronously for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 10:21:11 user nova-compute[72362]: DEBUG nova.compute.manager [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Allocating IP information in the background. {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 10:21:11 user nova-compute[72362]: DEBUG nova.network.neutron [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] allocate_for_instance() {{(pid=72362) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 10:21:11 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 10:21:12 user nova-compute[72362]: DEBUG nova.compute.manager [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Start building block device mappings for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 10:21:12 user nova-compute[72362]: DEBUG nova.policy [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '731b08d22e494215be0dd798362a6f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec98263d80c34ed19b02d7c8cdb8a627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72362) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 10:21:12 user nova-compute[72362]: INFO nova.virt.block_device [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Booting with volume b2bcc794-ae54-4b73-8b5e-751599d537f6 at /dev/vda
Aug 09 10:21:12 user nova-compute[72362]: DEBUG os_brick.utils [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:21:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:12 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0237ee7e-8bc9-418e-a6d5-c3666f3a84f6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:12 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ec84d2-5f2a-4908-948a-ae867e353382]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:12 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2c14ba-2c13-4e6c-a937-b98d058eea68]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:12 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c0bc63-82cf-4549-8ece-955636c9ea30]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:21:12 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:21:12 user nova-compute[72362]: INFO nova.virt.block_device [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Booting with volume ccfac3d0-b7f2-45e7-951c-60781c8515e5 at /dev/vdc
Aug 09 10:21:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:21:12 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:21:12 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea35ee4-abff-4f1a-8593-aa147009619f]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:12 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:21:12 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:21:12 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:21:12 user nova-compute[72362]: DEBUG os_brick.utils [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:21:12 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Updating existing volume attachment record: 55ec8d73-a5c7-4806-bacd-ba7aa40da65c {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 10:21:12 user nova-compute[72362]: DEBUG os_brick.utils [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:21:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:12 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[55bbaa5b-1700-4336-8de0-e25e8a03def8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:12 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96bde4f-40ee-4c0e-940e-c8c26a70f76d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:12 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3237cb7-fe32-420e-bcbc-3beee64a8d11]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:12 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6932622-fb86-4b3d-9b8c-527a0bca306b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:21:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:12 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:21:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:21:12 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:21:12 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[333ed9e9-9886-4802-a6fd-cc7e0750cf72]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:12 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:21:12 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:21:12 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:21:12 user nova-compute[72362]: DEBUG os_brick.utils [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:21:12 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Updating existing volume attachment record: eab5d9e2-a096-4497-9cbb-81f8ca60b10a {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 10:21:12 user nova-compute[72362]: DEBUG nova.network.neutron [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Successfully created port: a9017bf2-874f-419a-aae5-43f2ce4a63dd {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:21:13 user nova-compute[72362]: DEBUG nova.network.neutron [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Successfully updated port: a9017bf2-874f-419a-aae5-43f2ce4a63dd {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:21:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Acquiring lock "refresh_cache-6493ab9a-4d69-434d-bed7-e51f1c5f3497" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:21:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Acquired lock "refresh_cache-6493ab9a-4d69-434d-bed7-e51f1c5f3497" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:21:13 user nova-compute[72362]: DEBUG nova.network.neutron [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:21:13 user nova-compute[72362]: DEBUG nova.network.neutron [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:21:14 user nova-compute[72362]: DEBUG nova.compute.manager [req-715a14d5-d3d2-405e-be67-8fb758a1bcde req-2a1e3acb-34b2-47ff-98dd-53e57ad6b0ca service nova] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Received event network-changed-a9017bf2-874f-419a-aae5-43f2ce4a63dd {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:21:14 user nova-compute[72362]: DEBUG nova.compute.manager [req-715a14d5-d3d2-405e-be67-8fb758a1bcde req-2a1e3acb-34b2-47ff-98dd-53e57ad6b0ca service nova] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Refreshing instance network info cache due to event network-changed-a9017bf2-874f-419a-aae5-43f2ce4a63dd. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:21:14 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-715a14d5-d3d2-405e-be67-8fb758a1bcde req-2a1e3acb-34b2-47ff-98dd-53e57ad6b0ca service nova] Acquiring lock "refresh_cache-6493ab9a-4d69-434d-bed7-e51f1c5f3497" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:21:14 user nova-compute[72362]: DEBUG nova.network.neutron [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Updating instance_info_cache with network_info: [{"id": "a9017bf2-874f-419a-aae5-43f2ce4a63dd", "address": "fa:16:3e:ac:ef:70", "network": {"id": "0f5e6621-493c-440d-aaec-419fc6111969", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1795951162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec98263d80c34ed19b02d7c8cdb8a627", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9017bf2-87", "ovs_interfaceid": "a9017bf2-874f-419a-aae5-43f2ce4a63dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:21:14 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Releasing lock "refresh_cache-6493ab9a-4d69-434d-bed7-e51f1c5f3497" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:21:14 user nova-compute[72362]: DEBUG nova.compute.manager [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Instance network_info: |[{"id": "a9017bf2-874f-419a-aae5-43f2ce4a63dd", "address": "fa:16:3e:ac:ef:70", "network": {"id": "0f5e6621-493c-440d-aaec-419fc6111969", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1795951162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec98263d80c34ed19b02d7c8cdb8a627", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9017bf2-87", "ovs_interfaceid": "a9017bf2-874f-419a-aae5-43f2ce4a63dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 10:21:14 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-715a14d5-d3d2-405e-be67-8fb758a1bcde req-2a1e3acb-34b2-47ff-98dd-53e57ad6b0ca service nova] Acquired lock "refresh_cache-6493ab9a-4d69-434d-bed7-e51f1c5f3497" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:21:14 user nova-compute[72362]: DEBUG nova.network.neutron [req-715a14d5-d3d2-405e-be67-8fb758a1bcde req-2a1e3acb-34b2-47ff-98dd-53e57ad6b0ca service nova] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Refreshing network info cache for port a9017bf2-874f-419a-aae5-43f2ce4a63dd {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:21:14 user nova-compute[72362]: DEBUG nova.network.neutron [req-715a14d5-d3d2-405e-be67-8fb758a1bcde req-2a1e3acb-34b2-47ff-98dd-53e57ad6b0ca service nova] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Updated VIF entry in instance network info cache for port a9017bf2-874f-419a-aae5-43f2ce4a63dd. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:21:14 user nova-compute[72362]: DEBUG nova.network.neutron [req-715a14d5-d3d2-405e-be67-8fb758a1bcde req-2a1e3acb-34b2-47ff-98dd-53e57ad6b0ca service nova] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Updating instance_info_cache with network_info: [{"id": "a9017bf2-874f-419a-aae5-43f2ce4a63dd", "address": "fa:16:3e:ac:ef:70", "network": {"id": "0f5e6621-493c-440d-aaec-419fc6111969", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1795951162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec98263d80c34ed19b02d7c8cdb8a627", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9017bf2-87", "ovs_interfaceid": "a9017bf2-874f-419a-aae5-43f2ce4a63dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:21:14 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-715a14d5-d3d2-405e-be67-8fb758a1bcde req-2a1e3acb-34b2-47ff-98dd-53e57ad6b0ca service nova] Releasing lock "refresh_cache-6493ab9a-4d69-434d-bed7-e51f1c5f3497" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:21:14 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:15 user nova-compute[72362]: DEBUG nova.compute.manager [None req-b586d591-1ad9-4d8f-9f32-34968de5a87a tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:21:15 user nova-compute[72362]: INFO nova.compute.manager [None req-b586d591-1ad9-4d8f-9f32-34968de5a87a tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] instance snapshotting
Aug 09 10:21:15 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:15 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-b586d591-1ad9-4d8f-9f32-34968de5a87a tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Beginning live snapshot process
Aug 09 10:21:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-b586d591-1ad9-4d8f-9f32-34968de5a87a tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json -f qcow2 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-b586d591-1ad9-4d8f-9f32-34968de5a87a tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json -f qcow2" returned: 0 in 0.156s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-b586d591-1ad9-4d8f-9f32-34968de5a87a tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json -f qcow2 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-b586d591-1ad9-4d8f-9f32-34968de5a87a tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json -f qcow2" returned: 0 in 0.155s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-b586d591-1ad9-4d8f-9f32-34968de5a87a tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-b586d591-1ad9-4d8f-9f32-34968de5a87a tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.163s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-b586d591-1ad9-4d8f-9f32-34968de5a87a tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpifqh2ymo/1cec1dbe57664c2bbae1ce4de04859f9.delta 1073741824 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-b586d591-1ad9-4d8f-9f32-34968de5a87a tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpifqh2ymo/1cec1dbe57664c2bbae1ce4de04859f9.delta 1073741824" returned: 0 in 0.067s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:16 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-b586d591-1ad9-4d8f-9f32-34968de5a87a tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 09 10:21:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-b586d591-1ad9-4d8f-9f32-34968de5a87a tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72362) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 10:21:17 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:17 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-b586d591-1ad9-4d8f-9f32-34968de5a87a tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72362) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 10:21:17 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-b586d591-1ad9-4d8f-9f32-34968de5a87a tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 09 10:21:18 user nova-compute[72362]: DEBUG nova.privsep.utils [None req-b586d591-1ad9-4d8f-9f32-34968de5a87a tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72362) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 10:21:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-b586d591-1ad9-4d8f-9f32-34968de5a87a tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpifqh2ymo/1cec1dbe57664c2bbae1ce4de04859f9.delta /opt/stack/data/nova/instances/snapshots/tmpifqh2ymo/1cec1dbe57664c2bbae1ce4de04859f9 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-b586d591-1ad9-4d8f-9f32-34968de5a87a tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpifqh2ymo/1cec1dbe57664c2bbae1ce4de04859f9.delta /opt/stack/data/nova/instances/snapshots/tmpifqh2ymo/1cec1dbe57664c2bbae1ce4de04859f9" returned: 0 in 0.310s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:18 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-b586d591-1ad9-4d8f-9f32-34968de5a87a tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Snapshot extracted, beginning image upload
Aug 09 10:21:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:21 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-b586d591-1ad9-4d8f-9f32-34968de5a87a tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Snapshot image upload complete
Aug 09 10:21:21 user nova-compute[72362]: INFO nova.compute.manager [None req-b586d591-1ad9-4d8f-9f32-34968de5a87a tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Took 5.61 seconds to snapshot the instance on the hypervisor.
Aug 09 10:21:22 user nova-compute[72362]: DEBUG nova.compute.manager [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Start spawning the instance on the hypervisor. {{(pid=72362) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:21:22 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Creating image(s)
Aug 09 10:21:22 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Did not create local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Ensure instance console log exists: /opt/stack/data/nova/instances/6493ab9a-4d69-434d-bed7-e51f1c5f3497/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Start _get_guest_xml network_info=[{"id": "a9017bf2-874f-419a-aae5-43f2ce4a63dd", "address": "fa:16:3e:ac:ef:70", "network": {"id": "0f5e6621-493c-440d-aaec-419fc6111969", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1795951162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec98263d80c34ed19b02d7c8cdb8a627", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9017bf2-87", "ovs_interfaceid": "a9017bf2-874f-419a-aae5-43f2ce4a63dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '55ec8d73-a5c7-4806-bacd-ba7aa40da65c', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KJEmzxkc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6493ab9a-4d69-434d-bed7-e51f1c5f3497', 'attached_at': '', 'detached_at': '', 'volume_id': 'b2bcc794-ae54-4b73-8b5e-751599d537f6', 'serial': 'b2bcc794-ae54-4b73-8b5e-751599d537f6'}, 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:21:22 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:21:22 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:21:22 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KJEmzxkc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:21:22 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:21:22 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:21:22 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:21:22 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:21:22 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:21:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e47650a-084b-47a2-b376-04b783390c77]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:21:22 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[875eb84b-ecd1-4cf3-8e45-615f47f9427b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6] added
Aug 09 10:21:22 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[691275d1-c9f4-4d31-8951-807aa22007b3]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81aab47-f858-4c83-b855-2bc1796f8d3b]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KJEmzxkc {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KJEmzxkc" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[92cd1b05-aecb-447d-9516-70eabacb03c8]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KJEmzxkc'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a76c21-04eb-473b-913e-55dcea352e3a]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9a9d35-c57f-4115-9117-ce3755428f8c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:21:22 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:21:22 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee816f9b-a8ac-4f7b-85b8-04bad3f66161]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6, portal: 172.16.0.220,3260]
Aug 09 10:21:22 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6, portal: 172.16.0.220,3260] successful.
Aug 09 10:21:22 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f791aa-c038-49f2-8ab8-c96a7e29ae71]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6405b2-aa21-491e-8b40-67754723a5cd]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:21:22 user nova-compute[72362]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)
Aug 09 10:21:22 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:21:22 user nova-compute[72362]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)
Aug 09 10:21:22 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b23f905-f9e8-402c-a122-dd343e993481]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: None {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG nova.compute.manager [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Start spawning the instance on the hypervisor. {{(pid=72362) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:21:22 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Creating image(s)
Aug 09 10:21:22 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Did not create local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Ensure instance console log exists: /opt/stack/data/nova/instances/09a20950-bce9-4c83-82db-e058872ae358/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Start _get_guest_xml network_info=[{"id": "5fd897a8-78c2-49be-b1d6-867bab82082d", "address": "fa:16:3e:ae:3a:4a", "network": {"id": "e2b9dab7-85be-4e72-a3a9-14cd26990b44", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1356785765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd897a8-78", "ovs_interfaceid": "5fd897a8-78c2-49be-b1d6-867bab82082d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f1457dd7-06e1-43ac-a55d-3f4f9fe150f8", "address": "fa:16:3e:f2:a7:dd", "network": {"id": "b1aa635b-9b29-45b6-8cd4-06ccd9e0f545", "bridge": "br-int", "label": "tempest-device-tagging-net1-2012050279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1457dd7-06", "ovs_interfaceid": "f1457dd7-06e1-43ac-a55d-3f4f9fe150f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "21baa9dd-a7b0-445e-be2e-ab8b953bae49", "address": "fa:16:3e:55:ce:ef", "network": {"id": "b1aa635b-9b29-45b6-8cd4-06ccd9e0f545", "bridge": "br-int", "label": "tempest-device-tagging-net1-2012050279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21baa9dd-a7", "ovs_interfaceid": "21baa9dd-a7b0-445e-be2e-ab8b953bae49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "32d1ff81-fed5-47fe-88ce-04bd2777f1e5", "address": "fa:16:3e:b5:df:02", "network": {"id": "b1aa635b-9b29-45b6-8cd4-06ccd9e0f545", "bridge": "br-int", "label": "tempest-device-tagging-net1-2012050279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d1ff81-fe", "ovs_interfaceid": "32d1ff81-fed5-47fe-88ce-04bd2777f1e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41551d54-2c78-4fbe-9b7a-43452c5e94da", "address": "fa:16:3e:d8:11:91", "network": {"id": "b1aa635b-9b29-45b6-8cd4-06ccd9e0f545", "bridge": "br-int", "label": "tempest-device-tagging-net1-2012050279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41551d54-2c", "ovs_interfaceid": "41551d54-2c78-4fbe-9b7a-43452c5e94da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "de067d87-6780-4c38-bf69-7d976cbde30a", "address": "fa:16:3e:e1:62:57", "network": {"id": "6e7161bb-3d35-4adb-89d3-aa23f97adbfa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1214229212", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde067d87-67", "ovs_interfaceid": "de067d87-6780-4c38-bf69-7d976cbde30a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cb0c5adb-40d5-4fb6-b458-35a85c670333", "address": "fa:16:3e:8a:63:cf", "network": {"id": "6e7161bb-3d35-4adb-89d3-aa23f97adbfa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1214229212", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb0c5adb-40", "ovs_interfaceid": "cb0c5adb-40d5-4fb6-b458-35a85c670333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'dd4bcec2-7a27-4a62-b05c-d85c71798c60', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KMUpNhnz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '09a20950-bce9-4c83-82db-e058872ae358', 'attached_at': '', 'detached_at': '', 'volume_id': 'deb67b62-54b5-4129-bf15-580c82d0ab28', 'serial': 'deb67b62-54b5-4129-bf15-580c82d0ab28'}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None}, {'attachment_id': '6c9a8d87-1960-4fda-98ff-9602cd0057d4', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tISMzEJk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '09a20950-bce9-4c83-82db-e058872ae358', 'attached_at': '', 'detached_at': '', 'volume_id': '2f562c44-6d2f-49a0-ac17-a67fed224b31', 'serial': '2f562c44-6d2f-49a0-ac17-a67fed224b31'}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 1, 'volume_type': None}, {'attachment_id': 'eab5d9e2-a096-4497-9cbb-81f8ca60b10a', 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OTsbPwVa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '09a20950-bce9-4c83-82db-e058872ae358', 'attached_at': '', 'detached_at': '', 'volume_id': 'ccfac3d0-b7f2-45e7-951c-60781c8515e5', 'serial': 'ccfac3d0-b7f2-45e7-951c-60781c8515e5'}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 2, 'volume_type': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:21:22 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:21:22 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:21:22 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:21:22 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KMUpNhnz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:21:22 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:21:22 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Acquiring lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG nova.compute.manager [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Starting instance... {{(pid=72362) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:21:23 user nova-compute[72362]: INFO nova.compute.claims [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Claim successful on node user
Aug 09 10:21:23 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KJEmzxkc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '26338623666333432', 'path': '/dev/sdc'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338623666333432', 'path': '/dev/sdc'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.900s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:21:23 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:21:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:21:23 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:21:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f114276c-deb3-478b-982e-f105df0a55ef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:21:23 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:21:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-794271322',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-794271322',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFPlCV+krNMhby8imZncFRp5DGbA/vMmO2zNpzm0Pvmj5dU73J2HkJnfxWbQ3K2RYIgrwe8xBwFNEDCwdB9IYNqQGuPlU9V+VeI/1xppVZd/VycFGQoWDxVC9NrPc4QD9w==',key_name='tempest-keypair-286170421',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec98263d80c34ed19b02d7c8cdb8a627',ramdisk_id='',reservation_id='r-8d9h038f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-773277146',owner_user_name='tempest-ServerActionsV293TestJSON-773277146-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:21:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='731b08d22e494215be0dd798362a6f91',uuid=6493ab9a-4d69-434d-bed7-e51f1c5f3497,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9017bf2-874f-419a-aae5-43f2ce4a63dd", "address": "fa:16:3e:ac:ef:70", "network": {"id": "0f5e6621-493c-440d-aaec-419fc6111969", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1795951162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec98263d80c34ed19b02d7c8cdb8a627", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9017bf2-87", "ovs_interfaceid": "a9017bf2-874f-419a-aae5-43f2ce4a63dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Converting VIF {"id": "a9017bf2-874f-419a-aae5-43f2ce4a63dd", "address": "fa:16:3e:ac:ef:70", "network": {"id": "0f5e6621-493c-440d-aaec-419fc6111969", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1795951162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec98263d80c34ed19b02d7c8cdb8a627", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9017bf2-87", "ovs_interfaceid": "a9017bf2-874f-419a-aae5-43f2ce4a63dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:ef:70,bridge_name='br-int',has_traffic_filtering=True,id=a9017bf2-874f-419a-aae5-43f2ce4a63dd,network=Network(0f5e6621-493c-440d-aaec-419fc6111969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9017bf2-87') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG nova.objects.instance [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Lazy-loading 'pci_devices' on Instance uuid 6493ab9a-4d69-434d-bed7-e51f1c5f3497 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:21:23 user nova-compute[72362]:   <uuid>6493ab9a-4d69-434d-bed7-e51f1c5f3497</uuid>
Aug 09 10:21:23 user nova-compute[72362]:   <name>instance-00000011</name>
Aug 09 10:21:23 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:21:23 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:21:23 user nova-compute[72362]:   <metadata>
Aug 09 10:21:23 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:21:23 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:21:23 user nova-compute[72362]:       <nova:name>tempest-ServerActionsV293TestJSON-server-794271322</nova:name>
Aug 09 10:21:23 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:21:22</nova:creationTime>
Aug 09 10:21:23 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:21:23 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:21:23 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:21:23 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:21:23 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:21:23 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:21:23 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:21:23 user nova-compute[72362]:       <nova:owner>
Aug 09 10:21:23 user nova-compute[72362]:         <nova:user uuid="731b08d22e494215be0dd798362a6f91">tempest-ServerActionsV293TestJSON-773277146-project-member</nova:user>
Aug 09 10:21:23 user nova-compute[72362]:         <nova:project uuid="ec98263d80c34ed19b02d7c8cdb8a627">tempest-ServerActionsV293TestJSON-773277146</nova:project>
Aug 09 10:21:23 user nova-compute[72362]:       </nova:owner>
Aug 09 10:21:23 user nova-compute[72362]:       <nova:ports>
Aug 09 10:21:23 user nova-compute[72362]:         <nova:port uuid="a9017bf2-874f-419a-aae5-43f2ce4a63dd">
Aug 09 10:21:23 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 10:21:23 user nova-compute[72362]:         </nova:port>
Aug 09 10:21:23 user nova-compute[72362]:       </nova:ports>
Aug 09 10:21:23 user nova-compute[72362]:     </nova:instance>
Aug 09 10:21:23 user nova-compute[72362]:   </metadata>
Aug 09 10:21:23 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:21:23 user nova-compute[72362]:     <system>
Aug 09 10:21:23 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:21:23 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:21:23 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:21:23 user nova-compute[72362]:       <entry name="serial">6493ab9a-4d69-434d-bed7-e51f1c5f3497</entry>
Aug 09 10:21:23 user nova-compute[72362]:       <entry name="uuid">6493ab9a-4d69-434d-bed7-e51f1c5f3497</entry>
Aug 09 10:21:23 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:21:23 user nova-compute[72362]:     </system>
Aug 09 10:21:23 user nova-compute[72362]:   </sysinfo>
Aug 09 10:21:23 user nova-compute[72362]:   <os>
Aug 09 10:21:23 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:21:23 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:21:23 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:21:23 user nova-compute[72362]:   </os>
Aug 09 10:21:23 user nova-compute[72362]:   <features>
Aug 09 10:21:23 user nova-compute[72362]:     <acpi/>
Aug 09 10:21:23 user nova-compute[72362]:     <apic/>
Aug 09 10:21:23 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:21:23 user nova-compute[72362]:   </features>
Aug 09 10:21:23 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:21:23 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:21:23 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:21:23 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:21:23 user nova-compute[72362]:   </clock>
Aug 09 10:21:23 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:21:23 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:21:23 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:21:23 user nova-compute[72362]:   </cpu>
Aug 09 10:21:23 user nova-compute[72362]:   <devices>
Aug 09 10:21:23 user nova-compute[72362]:     <disk type="block" device="disk">
Aug 09 10:21:23 user nova-compute[72362]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:21:23 user nova-compute[72362]:       <source dev="/dev/sdc"/>
Aug 09 10:21:23 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:21:23 user nova-compute[72362]:       <serial>b2bcc794-ae54-4b73-8b5e-751599d537f6</serial>
Aug 09 10:21:23 user nova-compute[72362]:     </disk>
Aug 09 10:21:23 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:21:23 user nova-compute[72362]:       <mac address="fa:16:3e:ac:ef:70"/>
Aug 09 10:21:23 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:21:23 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:21:23 user nova-compute[72362]:       <target dev="tapa9017bf2-87"/>
Aug 09 10:21:23 user nova-compute[72362]:     </interface>
Aug 09 10:21:23 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:21:23 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/6493ab9a-4d69-434d-bed7-e51f1c5f3497/console.log" append="off"/>
Aug 09 10:21:23 user nova-compute[72362]:     </serial>
Aug 09 10:21:23 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:21:23 user nova-compute[72362]:     <video>
Aug 09 10:21:23 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:21:23 user nova-compute[72362]:     </video>
Aug 09 10:21:23 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:21:23 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:21:23 user nova-compute[72362]:     </rng>
Aug 09 10:21:23 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:21:23 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:21:23 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:21:23 user nova-compute[72362]:     </memballoon>
Aug 09 10:21:23 user nova-compute[72362]:   </devices>
Aug 09 10:21:23 user nova-compute[72362]: </domain>
Aug 09 10:21:23 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:21:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-794271322',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-794271322',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFPlCV+krNMhby8imZncFRp5DGbA/vMmO2zNpzm0Pvmj5dU73J2HkJnfxWbQ3K2RYIgrwe8xBwFNEDCwdB9IYNqQGuPlU9V+VeI/1xppVZd/VycFGQoWDxVC9NrPc4QD9w==',key_name='tempest-keypair-286170421',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec98263d80c34ed19b02d7c8cdb8a627',ramdisk_id='',reservation_id='r-8d9h038f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-773277146',owner_user_name='tempest-ServerActionsV293TestJSON-773277146-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:21:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='731b08d22e494215be0dd798362a6f91',uuid=6493ab9a-4d69-434d-bed7-e51f1c5f3497,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9017bf2-874f-419a-aae5-43f2ce4a63dd", "address": "fa:16:3e:ac:ef:70", "network": {"id": "0f5e6621-493c-440d-aaec-419fc6111969", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1795951162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec98263d80c34ed19b02d7c8cdb8a627", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9017bf2-87", "ovs_interfaceid": "a9017bf2-874f-419a-aae5-43f2ce4a63dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Converting VIF {"id": "a9017bf2-874f-419a-aae5-43f2ce4a63dd", "address": "fa:16:3e:ac:ef:70", "network": {"id": "0f5e6621-493c-440d-aaec-419fc6111969", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1795951162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec98263d80c34ed19b02d7c8cdb8a627", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9017bf2-87", "ovs_interfaceid": "a9017bf2-874f-419a-aae5-43f2ce4a63dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:ef:70,bridge_name='br-int',has_traffic_filtering=True,id=a9017bf2-874f-419a-aae5-43f2ce4a63dd,network=Network(0f5e6621-493c-440d-aaec-419fc6111969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9017bf2-87') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG os_vif [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:ef:70,bridge_name='br-int',has_traffic_filtering=True,id=a9017bf2-874f-419a-aae5-43f2ce4a63dd,network=Network(0f5e6621-493c-440d-aaec-419fc6111969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9017bf2-87') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[899753f5-da8c-4852-b2e2-185396834940]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28] added
Aug 09 10:21:23 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa9017bf2-87, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa9017bf2-87, col_values=(('external_ids', {'iface-id': 'a9017bf2-874f-419a-aae5-43f2ce4a63dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:ef:70', 'vm-uuid': '6493ab9a-4d69-434d-bed7-e51f1c5f3497'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b1f4a8-1b30-4871-bb46-501120e82b05]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:23 user nova-compute[72362]: INFO os_vif [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:ef:70,bridge_name='br-int',has_traffic_filtering=True,id=a9017bf2-874f-419a-aae5-43f2ce4a63dd,network=Network(0f5e6621-493c-440d-aaec-419fc6111969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9017bf2-87')
Aug 09 10:21:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c185889-0925-4c29-8b5a-8baed79abba4]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KMUpNhnz {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KMUpNhnz" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01a502c-d400-4fee-93e2-af1d44366a82]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KMUpNhnz'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] No VIF found with MAC fa:16:3e:ac:ef:70, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6f43bb-f352-40ca-b04b-ef55fa1998a2]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5180cdd1-8c22-4af8-adfc-5cb464847b0d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:21:23 user nova-compute[72362]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)
Aug 09 10:21:23 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:21:23 user nova-compute[72362]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)
Aug 09 10:21:23 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fa78a9-5e45-4608-931f-c5260a964b9b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28, portal: 172.16.0.220,3260]
Aug 09 10:21:23 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28, portal: 172.16.0.220,3260] successful.
Aug 09 10:21:23 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[958edd5b-8f81-4601-8376-a60693e350ed]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac26f5ea-65d5-4a1c-a1c1-5519c5a64ed4]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:21:23 user nova-compute[72362]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)
Aug 09 10:21:23 user nova-compute[72362]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 (non-flash)
Aug 09 10:21:23 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:21:23 user nova-compute[72362]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)
Aug 09 10:21:23 user nova-compute[72362]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 (non-flash)
Aug 09 10:21:23 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] HCTL ('35', '-', '-', 0) found on session 15 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.069s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5151b027-ac70-40da-b7f9-9eba9adfd091]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:21:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KMUpNhnz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:21:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:24 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:21:24 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:21:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.697s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:21:24 user nova-compute[72362]: DEBUG nova.compute.manager [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Start building networks asynchronously for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 10:21:24 user nova-compute[72362]: DEBUG nova.compute.manager [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Allocating IP information in the background. {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 10:21:24 user nova-compute[72362]: DEBUG nova.network.neutron [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] allocate_for_instance() {{(pid=72362) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 10:21:24 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 10:21:24 user nova-compute[72362]: DEBUG nova.compute.manager [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Start building block device mappings for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 10:21:24 user nova-compute[72362]: DEBUG nova.compute.manager [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Start spawning the instance on the hypervisor. {{(pid=72362) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 10:21:24 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:21:24 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Creating image(s)
Aug 09 10:21:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Acquiring lock "/opt/stack/data/nova/instances/4746beb1-d313-4cea-bf7b-75b507ebbdd2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:21:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "/opt/stack/data/nova/instances/4746beb1-d313-4cea-bf7b-75b507ebbdd2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:21:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "/opt/stack/data/nova/instances/4746beb1-d313-4cea-bf7b-75b507ebbdd2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:21:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:24 user nova-compute[72362]: DEBUG nova.policy [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '14aafde2fed648b8a0431d4f32c4c7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99716e91e68b4abfba3a4c9335e42955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72362) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 10:21:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.145s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Acquiring lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:21:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:21:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.131s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/4746beb1-d313-4cea-bf7b-75b507ebbdd2/disk 1073741824 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/4746beb1-d313-4cea-bf7b-75b507ebbdd2/disk 1073741824" returned: 0 in 0.052s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:21:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.155s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:24 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4746beb1-d313-4cea-bf7b-75b507ebbdd2/disk. size=1073741824 {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 10:21:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4746beb1-d313-4cea-bf7b-75b507ebbdd2/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.430s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] <== connect_volume: return (2332ms) {'type': 'block', 'scsi_wwn': '23931396132666334', 'path': '/dev/sdd'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931396132666334', 'path': '/dev/sdd'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tISMzEJk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:21:25 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:21:25 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:21:25 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:21:25 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:21:25 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:21:25 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c497e772-8573-4e9b-95ec-875e0213dd0f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:21:25 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b99b88-73a1-4164-9a1f-a09087859c9c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31] added
Aug 09 10:21:25 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4746beb1-d313-4cea-bf7b-75b507ebbdd2/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Cannot resize image /opt/stack/data/nova/instances/4746beb1-d313-4cea-bf7b-75b507ebbdd2/disk to a smaller size. {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG nova.objects.instance [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lazy-loading 'migration_context' on Instance uuid 4746beb1-d313-4cea-bf7b-75b507ebbdd2 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6430440-ea7a-417b-92df-ff5e7de3bebd]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Created local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Ensure instance console log exists: /opt/stack/data/nova/instances/4746beb1-d313-4cea-bf7b-75b507ebbdd2/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7fa9a2-e675-40e4-b844-792e87852a95]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tISMzEJk {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tISMzEJk" returned: 0 in 0.035s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c81b953-2a2c-45cd-89a4-7cd16570fa4e]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tISMzEJk'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.037s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7e5280-93e0-4742-b42b-4ae8e6fbbdf3]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[7118a5ac-abe9-43ff-8b8e-13c1ae5ee9de]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:21:25 user nova-compute[72362]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)
Aug 09 10:21:25 user nova-compute[72362]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 (non-flash)
Aug 09 10:21:25 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:21:25 user nova-compute[72362]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)
Aug 09 10:21:25 user nova-compute[72362]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 (non-flash)
Aug 09 10:21:25 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70cbbdc-8012-4366-a571-8d87bf2d97c5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31, portal: 172.16.0.220,3260]
Aug 09 10:21:25 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31, portal: 172.16.0.220,3260] successful.
Aug 09 10:21:25 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a2311a-7526-4d45-bee2-bf306d0dd14c]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c363f03-8196-4733-91e6-047083c03328]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:21:25 user nova-compute[72362]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)
Aug 09 10:21:25 user nova-compute[72362]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 (non-flash)
Aug 09 10:21:25 user nova-compute[72362]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 (non-flash)
Aug 09 10:21:25 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:21:25 user nova-compute[72362]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)
Aug 09 10:21:25 user nova-compute[72362]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 (non-flash)
Aug 09 10:21:25 user nova-compute[72362]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 (non-flash)
Aug 09 10:21:25 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.388s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] HCTL ('36', '-', '-', 0) found on session 16 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.035s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9a67ad-cdd5-4478-8512-109271438130]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Searching for a device in session 16 and hctl ['36', '*', '*', 0] yield: None {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG nova.compute.manager [req-f0b3beda-ceab-4a6d-847f-00251e5c2ae4 req-499a10e5-4aa9-48b1-9717-0fd2f2782484 service nova] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Received event network-vif-plugged-a9017bf2-874f-419a-aae5-43f2ce4a63dd {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f0b3beda-ceab-4a6d-847f-00251e5c2ae4 req-499a10e5-4aa9-48b1-9717-0fd2f2782484 service nova] Acquiring lock "6493ab9a-4d69-434d-bed7-e51f1c5f3497-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f0b3beda-ceab-4a6d-847f-00251e5c2ae4 req-499a10e5-4aa9-48b1-9717-0fd2f2782484 service nova] Lock "6493ab9a-4d69-434d-bed7-e51f1c5f3497-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f0b3beda-ceab-4a6d-847f-00251e5c2ae4 req-499a10e5-4aa9-48b1-9717-0fd2f2782484 service nova] Lock "6493ab9a-4d69-434d-bed7-e51f1c5f3497-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG nova.compute.manager [req-f0b3beda-ceab-4a6d-847f-00251e5c2ae4 req-499a10e5-4aa9-48b1-9717-0fd2f2782484 service nova] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] No waiting events found dispatching network-vif-plugged-a9017bf2-874f-419a-aae5-43f2ce4a63dd {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:21:25 user nova-compute[72362]: WARNING nova.compute.manager [req-f0b3beda-ceab-4a6d-847f-00251e5c2ae4 req-499a10e5-4aa9-48b1-9717-0fd2f2782484 service nova] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Received unexpected event network-vif-plugged-a9017bf2-874f-419a-aae5-43f2ce4a63dd for instance with vm_state building and task_state spawning.
Aug 09 10:21:25 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG nova.network.neutron [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Successfully created port: a10771ea-ee0f-4376-88cc-97dd0eb98d8d {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:25 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Searching for a device in session 16 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tISMzEJk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.456s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] <== connect_volume: return (1459ms) {'type': 'block', 'scsi_wwn': '23936353063653738', 'path': '/dev/sde'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936353063653738', 'path': '/dev/sde'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OTsbPwVa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:21:26 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:21:26 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:21:26 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:21:26 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:21:26 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:21:26 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[968d2f0d-4426-4b1e-9249-2914b3699465]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:21:26 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[7815f7e9-c663-4bdd-a084-6d4daaeb4227]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5] added
Aug 09 10:21:26 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[04660e72-5d49-491b-994e-ed509033817a]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[30df14b1-0968-4230-8d0e-a9c2187bd778]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OTsbPwVa {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OTsbPwVa" returned: 0 in 0.026s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea80b5c-0078-4e78-8837-156c6d00f3c7]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OTsbPwVa'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[208f700d-6208-4dca-bfc6-a1c6fe9b66e7]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e937957e-d7d8-44e8-8aa2-7346603f5a74]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:21:26 user nova-compute[72362]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)
Aug 09 10:21:26 user nova-compute[72362]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 (non-flash)
Aug 09 10:21:26 user nova-compute[72362]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 (non-flash)
Aug 09 10:21:26 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:21:26 user nova-compute[72362]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)
Aug 09 10:21:26 user nova-compute[72362]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 (non-flash)
Aug 09 10:21:26 user nova-compute[72362]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 (non-flash)
Aug 09 10:21:26 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[097c5626-7c0b-4199-8276-028fc5832e2c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5, portal: 172.16.0.220,3260]
Aug 09 10:21:26 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5, portal: 172.16.0.220,3260] successful.
Aug 09 10:21:26 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2ead84-dd1b-4c1d-b055-4c9ecd4140ad]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[eccdee71-d725-416a-a6f2-4f5826fe40fb]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:21:26 user nova-compute[72362]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)
Aug 09 10:21:26 user nova-compute[72362]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 (non-flash)
Aug 09 10:21:26 user nova-compute[72362]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 (non-flash)
Aug 09 10:21:26 user nova-compute[72362]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 (non-flash)
Aug 09 10:21:26 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:21:26 user nova-compute[72362]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)
Aug 09 10:21:26 user nova-compute[72362]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 (non-flash)
Aug 09 10:21:26 user nova-compute[72362]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 (non-flash)
Aug 09 10:21:26 user nova-compute[72362]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 (non-flash)
Aug 09 10:21:26 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] HCTL ('37', '-', '-', 0) found on session 17 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:21:26 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:27 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a18b551-accf-405d-8d76-c822bdf69ac3]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:27 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Searching for a device in session 17 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:21:27 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OTsbPwVa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:21:27 user nova-compute[72362]: DEBUG nova.network.neutron [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Successfully updated port: a10771ea-ee0f-4376-88cc-97dd0eb98d8d {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:21:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Acquiring lock "refresh_cache-4746beb1-d313-4cea-bf7b-75b507ebbdd2" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:21:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Acquired lock "refresh_cache-4746beb1-d313-4cea-bf7b-75b507ebbdd2" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:21:27 user nova-compute[72362]: DEBUG nova.network.neutron [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:21:27 user nova-compute[72362]: DEBUG nova.compute.manager [req-c390d219-ea05-44fb-b2ef-1d7c4decd230 req-d34f818b-db10-4855-ac27-16053b4d89f1 service nova] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Received event network-changed-a10771ea-ee0f-4376-88cc-97dd0eb98d8d {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:21:27 user nova-compute[72362]: DEBUG nova.compute.manager [req-c390d219-ea05-44fb-b2ef-1d7c4decd230 req-d34f818b-db10-4855-ac27-16053b4d89f1 service nova] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Refreshing instance network info cache due to event network-changed-a10771ea-ee0f-4376-88cc-97dd0eb98d8d. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:21:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c390d219-ea05-44fb-b2ef-1d7c4decd230 req-d34f818b-db10-4855-ac27-16053b4d89f1 service nova] Acquiring lock "refresh_cache-4746beb1-d313-4cea-bf7b-75b507ebbdd2" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:21:27 user nova-compute[72362]: DEBUG nova.network.neutron [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:21:27 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576487.551953, 6493ab9a-4d69-434d-bed7-e51f1c5f3497 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:21:27 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] VM Resumed (Lifecycle Event)
Aug 09 10:21:27 user nova-compute[72362]: DEBUG nova.compute.manager [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:21:27 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:21:27 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Instance spawned successfully.
Aug 09 10:21:27 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 10:21:27 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:21:27 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:21:27 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Found default for hw_cdrom_bus of ide {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:21:27 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Found default for hw_disk_bus of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:21:27 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:21:27 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:21:27 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Found default for hw_video_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:21:27 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Found default for hw_vif_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:21:27 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:21:27 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576487.5523684, 6493ab9a-4d69-434d-bed7-e51f1c5f3497 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:21:27 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] VM Started (Lifecycle Event)
Aug 09 10:21:27 user nova-compute[72362]: DEBUG nova.compute.manager [req-58f209a9-8699-46ff-8215-31cb5c945ca4 req-115cfc65-0253-468f-bbad-9c1e82bff1d8 service nova] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Received event network-vif-plugged-a9017bf2-874f-419a-aae5-43f2ce4a63dd {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:21:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-58f209a9-8699-46ff-8215-31cb5c945ca4 req-115cfc65-0253-468f-bbad-9c1e82bff1d8 service nova] Acquiring lock "6493ab9a-4d69-434d-bed7-e51f1c5f3497-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:21:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-58f209a9-8699-46ff-8215-31cb5c945ca4 req-115cfc65-0253-468f-bbad-9c1e82bff1d8 service nova] Lock "6493ab9a-4d69-434d-bed7-e51f1c5f3497-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:21:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-58f209a9-8699-46ff-8215-31cb5c945ca4 req-115cfc65-0253-468f-bbad-9c1e82bff1d8 service nova] Lock "6493ab9a-4d69-434d-bed7-e51f1c5f3497-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:21:27 user nova-compute[72362]: DEBUG nova.compute.manager [req-58f209a9-8699-46ff-8215-31cb5c945ca4 req-115cfc65-0253-468f-bbad-9c1e82bff1d8 service nova] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] No waiting events found dispatching network-vif-plugged-a9017bf2-874f-419a-aae5-43f2ce4a63dd {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:21:27 user nova-compute[72362]: WARNING nova.compute.manager [req-58f209a9-8699-46ff-8215-31cb5c945ca4 req-115cfc65-0253-468f-bbad-9c1e82bff1d8 service nova] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Received unexpected event network-vif-plugged-a9017bf2-874f-419a-aae5-43f2ce4a63dd for instance with vm_state building and task_state spawning.
Aug 09 10:21:27 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:21:27 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:21:27 user nova-compute[72362]: INFO nova.compute.manager [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Took 5.51 seconds to spawn the instance on the hypervisor.
Aug 09 10:21:27 user nova-compute[72362]: DEBUG nova.compute.manager [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:21:27 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:21:27 user nova-compute[72362]: INFO nova.compute.manager [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Took 16.67 seconds to build instance.
Aug 09 10:21:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4ff9ef9a-a4a8-4649-97bd-14245a685dfe tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Lock "6493ab9a-4d69-434d-bed7-e51f1c5f3497" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.808s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:21:27 user nova-compute[72362]: DEBUG nova.network.neutron [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Updating instance_info_cache with network_info: [{"id": "a10771ea-ee0f-4376-88cc-97dd0eb98d8d", "address": "fa:16:3e:03:05:4e", "network": {"id": "557d516c-f355-4cc8-ae2e-5dbec7ce9762", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1511437856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99716e91e68b4abfba3a4c9335e42955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa10771ea-ee", "ovs_interfaceid": "a10771ea-ee0f-4376-88cc-97dd0eb98d8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:21:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Releasing lock "refresh_cache-4746beb1-d313-4cea-bf7b-75b507ebbdd2" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:21:27 user nova-compute[72362]: DEBUG nova.compute.manager [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Instance network_info: |[{"id": "a10771ea-ee0f-4376-88cc-97dd0eb98d8d", "address": "fa:16:3e:03:05:4e", "network": {"id": "557d516c-f355-4cc8-ae2e-5dbec7ce9762", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1511437856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99716e91e68b4abfba3a4c9335e42955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa10771ea-ee", "ovs_interfaceid": "a10771ea-ee0f-4376-88cc-97dd0eb98d8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 10:21:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c390d219-ea05-44fb-b2ef-1d7c4decd230 req-d34f818b-db10-4855-ac27-16053b4d89f1 service nova] Acquired lock "refresh_cache-4746beb1-d313-4cea-bf7b-75b507ebbdd2" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:21:27 user nova-compute[72362]: DEBUG nova.network.neutron [req-c390d219-ea05-44fb-b2ef-1d7c4decd230 req-d34f818b-db10-4855-ac27-16053b4d89f1 service nova] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Refreshing network info cache for port a10771ea-ee0f-4376-88cc-97dd0eb98d8d {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:21:27 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Start _get_guest_xml network_info=[{"id": "a10771ea-ee0f-4376-88cc-97dd0eb98d8d", "address": "fa:16:3e:03:05:4e", "network": {"id": "557d516c-f355-4cc8-ae2e-5dbec7ce9762", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1511437856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99716e91e68b4abfba3a4c9335e42955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa10771ea-ee", "ovs_interfaceid": "a10771ea-ee0f-4376-88cc-97dd0eb98d8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': 'a08d1a11-49eb-4212-a351-e11ee9553b95'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:21:28 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:21:28 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:21:28 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.425s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] <== connect_volume: return (1426ms) {'type': 'block', 'scsi_wwn': '26232373436643431', 'path': '/dev/sdf'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232373436643431', 'path': '/dev/sdf'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:21:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1960873030',display_name='tempest-SnapshotDataIntegrityTests-server-1960873030',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1960873030',id=18,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsbdYtIq0/mw7Fz1AEtFgj9LJ6+IPseOi3WvAz5FrhvGNhmhuAri0RS0nhBd7cMv8MK+EjPrnff6yoSiHj84V9pxhjpoZujEn9n4/ijqqa/A57YW+EpWgDR8UzmAswx1g==',key_name='tempest-keypair-876253172',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99716e91e68b4abfba3a4c9335e42955',ramdisk_id='',reservation_id='r-54npuj45',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-68329215',owner_user_name='tempest-SnapshotDataIntegrityTests-68329215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:21:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14aafde2fed648b8a0431d4f32c4c7ac',uuid=4746beb1-d313-4cea-bf7b-75b507ebbdd2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a10771ea-ee0f-4376-88cc-97dd0eb98d8d", "address": "fa:16:3e:03:05:4e", "network": {"id": "557d516c-f355-4cc8-ae2e-5dbec7ce9762", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1511437856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99716e91e68b4abfba3a4c9335e42955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa10771ea-ee", "ovs_interfaceid": "a10771ea-ee0f-4376-88cc-97dd0eb98d8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Converting VIF {"id": "a10771ea-ee0f-4376-88cc-97dd0eb98d8d", "address": "fa:16:3e:03:05:4e", "network": {"id": "557d516c-f355-4cc8-ae2e-5dbec7ce9762", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1511437856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99716e91e68b4abfba3a4c9335e42955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa10771ea-ee", "ovs_interfaceid": "a10771ea-ee0f-4376-88cc-97dd0eb98d8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:05:4e,bridge_name='br-int',has_traffic_filtering=True,id=a10771ea-ee0f-4376-88cc-97dd0eb98d8d,network=Network(557d516c-f355-4cc8-ae2e-5dbec7ce9762),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa10771ea-ee') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.objects.instance [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lazy-loading 'pci_devices' on Instance uuid 4746beb1-d313-4cea-bf7b-75b507ebbdd2 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:21:28 user nova-compute[72362]:   <uuid>4746beb1-d313-4cea-bf7b-75b507ebbdd2</uuid>
Aug 09 10:21:28 user nova-compute[72362]:   <name>instance-00000012</name>
Aug 09 10:21:28 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:21:28 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:21:28 user nova-compute[72362]:   <metadata>
Aug 09 10:21:28 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:21:28 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:21:28 user nova-compute[72362]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1960873030</nova:name>
Aug 09 10:21:28 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:21:28</nova:creationTime>
Aug 09 10:21:28 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:21:28 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:21:28 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:21:28 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:21:28 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:21:28 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:21:28 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:21:28 user nova-compute[72362]:       <nova:owner>
Aug 09 10:21:28 user nova-compute[72362]:         <nova:user uuid="14aafde2fed648b8a0431d4f32c4c7ac">tempest-SnapshotDataIntegrityTests-68329215-project-member</nova:user>
Aug 09 10:21:28 user nova-compute[72362]:         <nova:project uuid="99716e91e68b4abfba3a4c9335e42955">tempest-SnapshotDataIntegrityTests-68329215</nova:project>
Aug 09 10:21:28 user nova-compute[72362]:       </nova:owner>
Aug 09 10:21:28 user nova-compute[72362]:       <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:21:28 user nova-compute[72362]:       <nova:ports>
Aug 09 10:21:28 user nova-compute[72362]:         <nova:port uuid="a10771ea-ee0f-4376-88cc-97dd0eb98d8d">
Aug 09 10:21:28 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 10:21:28 user nova-compute[72362]:         </nova:port>
Aug 09 10:21:28 user nova-compute[72362]:       </nova:ports>
Aug 09 10:21:28 user nova-compute[72362]:     </nova:instance>
Aug 09 10:21:28 user nova-compute[72362]:   </metadata>
Aug 09 10:21:28 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:21:28 user nova-compute[72362]:     <system>
Aug 09 10:21:28 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:21:28 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:21:28 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:21:28 user nova-compute[72362]:       <entry name="serial">4746beb1-d313-4cea-bf7b-75b507ebbdd2</entry>
Aug 09 10:21:28 user nova-compute[72362]:       <entry name="uuid">4746beb1-d313-4cea-bf7b-75b507ebbdd2</entry>
Aug 09 10:21:28 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:21:28 user nova-compute[72362]:     </system>
Aug 09 10:21:28 user nova-compute[72362]:   </sysinfo>
Aug 09 10:21:28 user nova-compute[72362]:   <os>
Aug 09 10:21:28 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:21:28 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:21:28 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:21:28 user nova-compute[72362]:   </os>
Aug 09 10:21:28 user nova-compute[72362]:   <features>
Aug 09 10:21:28 user nova-compute[72362]:     <acpi/>
Aug 09 10:21:28 user nova-compute[72362]:     <apic/>
Aug 09 10:21:28 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:21:28 user nova-compute[72362]:   </features>
Aug 09 10:21:28 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:21:28 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:21:28 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:21:28 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:21:28 user nova-compute[72362]:   </clock>
Aug 09 10:21:28 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:21:28 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:21:28 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:21:28 user nova-compute[72362]:   </cpu>
Aug 09 10:21:28 user nova-compute[72362]:   <devices>
Aug 09 10:21:28 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:21:28 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:21:28 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/4746beb1-d313-4cea-bf7b-75b507ebbdd2/disk"/>
Aug 09 10:21:28 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:21:28 user nova-compute[72362]:     </disk>
Aug 09 10:21:28 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:21:28 user nova-compute[72362]:       <mac address="fa:16:3e:03:05:4e"/>
Aug 09 10:21:28 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:21:28 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:21:28 user nova-compute[72362]:       <target dev="tapa10771ea-ee"/>
Aug 09 10:21:28 user nova-compute[72362]:     </interface>
Aug 09 10:21:28 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:21:28 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/4746beb1-d313-4cea-bf7b-75b507ebbdd2/console.log" append="off"/>
Aug 09 10:21:28 user nova-compute[72362]:     </serial>
Aug 09 10:21:28 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:21:28 user nova-compute[72362]:     <video>
Aug 09 10:21:28 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:21:28 user nova-compute[72362]:     </video>
Aug 09 10:21:28 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:21:28 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:21:28 user nova-compute[72362]:     </rng>
Aug 09 10:21:28 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:21:28 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:21:28 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:21:28 user nova-compute[72362]:     </memballoon>
Aug 09 10:21:28 user nova-compute[72362]:   </devices>
Aug 09 10:21:28 user nova-compute[72362]: </domain>
Aug 09 10:21:28 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:21:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1960873030',display_name='tempest-SnapshotDataIntegrityTests-server-1960873030',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1960873030',id=18,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsbdYtIq0/mw7Fz1AEtFgj9LJ6+IPseOi3WvAz5FrhvGNhmhuAri0RS0nhBd7cMv8MK+EjPrnff6yoSiHj84V9pxhjpoZujEn9n4/ijqqa/A57YW+EpWgDR8UzmAswx1g==',key_name='tempest-keypair-876253172',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99716e91e68b4abfba3a4c9335e42955',ramdisk_id='',reservation_id='r-54npuj45',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-68329215',owner_user_name='tempest-SnapshotDataIntegrityTests-68329215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:21:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14aafde2fed648b8a0431d4f32c4c7ac',uuid=4746beb1-d313-4cea-bf7b-75b507ebbdd2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a10771ea-ee0f-4376-88cc-97dd0eb98d8d", "address": "fa:16:3e:03:05:4e", "network": {"id": "557d516c-f355-4cc8-ae2e-5dbec7ce9762", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1511437856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99716e91e68b4abfba3a4c9335e42955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa10771ea-ee", "ovs_interfaceid": "a10771ea-ee0f-4376-88cc-97dd0eb98d8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Converting VIF {"id": "a10771ea-ee0f-4376-88cc-97dd0eb98d8d", "address": "fa:16:3e:03:05:4e", "network": {"id": "557d516c-f355-4cc8-ae2e-5dbec7ce9762", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1511437856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99716e91e68b4abfba3a4c9335e42955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa10771ea-ee", "ovs_interfaceid": "a10771ea-ee0f-4376-88cc-97dd0eb98d8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:05:4e,bridge_name='br-int',has_traffic_filtering=True,id=a10771ea-ee0f-4376-88cc-97dd0eb98d8d,network=Network(557d516c-f355-4cc8-ae2e-5dbec7ce9762),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa10771ea-ee') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG os_vif [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:05:4e,bridge_name='br-int',has_traffic_filtering=True,id=a10771ea-ee0f-4376-88cc-97dd0eb98d8d,network=Network(557d516c-f355-4cc8-ae2e-5dbec7ce9762),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa10771ea-ee') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa10771ea-ee, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa10771ea-ee, col_values=(('external_ids', {'iface-id': 'a10771ea-ee0f-4376-88cc-97dd0eb98d8d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:05:4e', 'vm-uuid': '4746beb1-d313-4cea-bf7b-75b507ebbdd2'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-445751592',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-445751592',id=16,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjmyWbMuiYwF3FarfTsEVQBll5AtEBHU5mcq0TNfpZjnm47NEOTKkLyChcDjkjpAKpX4t5dZ90uBnn976//CfCicnjiqQH8Rf/FqLWCYp0xuTRU8vwDe8CWZFymiWd5Cw==',key_name='tempest-keypair-2092297342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d18e5da818db4bbab4359c2b6f13f93f',ramdisk_id='',reservation_id='r-d84dx2ud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1095709842',owner_user_name='tempest-TaggedBootDevicesTest-1095709842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:20:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b306455ac86f4464b585007877c7fc97',uuid=09a20950-bce9-4c83-82db-e058872ae358,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5fd897a8-78c2-49be-b1d6-867bab82082d", "address": "fa:16:3e:ae:3a:4a", "network": {"id": "e2b9dab7-85be-4e72-a3a9-14cd26990b44", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1356785765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd897a8-78", "ovs_interfaceid": "5fd897a8-78c2-49be-b1d6-867bab82082d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Converting VIF {"id": "5fd897a8-78c2-49be-b1d6-867bab82082d", "address": "fa:16:3e:ae:3a:4a", "network": {"id": "e2b9dab7-85be-4e72-a3a9-14cd26990b44", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1356785765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd897a8-78", "ovs_interfaceid": "5fd897a8-78c2-49be-b1d6-867bab82082d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:3a:4a,bridge_name='br-int',has_traffic_filtering=True,id=5fd897a8-78c2-49be-b1d6-867bab82082d,network=Network(e2b9dab7-85be-4e72-a3a9-14cd26990b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fd897a8-78') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-445751592',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-445751592',id=16,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjmyWbMuiYwF3FarfTsEVQBll5AtEBHU5mcq0TNfpZjnm47NEOTKkLyChcDjkjpAKpX4t5dZ90uBnn976//CfCicnjiqQH8Rf/FqLWCYp0xuTRU8vwDe8CWZFymiWd5Cw==',key_name='tempest-keypair-2092297342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d18e5da818db4bbab4359c2b6f13f93f',ramdisk_id='',reservation_id='r-d84dx2ud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1095709842',owner_user_name='tempest-TaggedBootDevicesTest-1095709842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:20:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b306455ac86f4464b585007877c7fc97',uuid=09a20950-bce9-4c83-82db-e058872ae358,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1457dd7-06e1-43ac-a55d-3f4f9fe150f8", "address": "fa:16:3e:f2:a7:dd", "network": {"id": "b1aa635b-9b29-45b6-8cd4-06ccd9e0f545", "bridge": "br-int", "label": "tempest-device-tagging-net1-2012050279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1457dd7-06", "ovs_interfaceid": "f1457dd7-06e1-43ac-a55d-3f4f9fe150f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Converting VIF {"id": "f1457dd7-06e1-43ac-a55d-3f4f9fe150f8", "address": "fa:16:3e:f2:a7:dd", "network": {"id": "b1aa635b-9b29-45b6-8cd4-06ccd9e0f545", "bridge": "br-int", "label": "tempest-device-tagging-net1-2012050279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1457dd7-06", "ovs_interfaceid": "f1457dd7-06e1-43ac-a55d-3f4f9fe150f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:a7:dd,bridge_name='br-int',has_traffic_filtering=True,id=f1457dd7-06e1-43ac-a55d-3f4f9fe150f8,network=Network(b1aa635b-9b29-45b6-8cd4-06ccd9e0f545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf1457dd7-06') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-445751592',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-445751592',id=16,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjmyWbMuiYwF3FarfTsEVQBll5AtEBHU5mcq0TNfpZjnm47NEOTKkLyChcDjkjpAKpX4t5dZ90uBnn976//CfCicnjiqQH8Rf/FqLWCYp0xuTRU8vwDe8CWZFymiWd5Cw==',key_name='tempest-keypair-2092297342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d18e5da818db4bbab4359c2b6f13f93f',ramdisk_id='',reservation_id='r-d84dx2ud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1095709842',owner_user_name='tempest-TaggedBootDevicesTest-1095709842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:20:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b306455ac86f4464b585007877c7fc97',uuid=09a20950-bce9-4c83-82db-e058872ae358,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21baa9dd-a7b0-445e-be2e-ab8b953bae49", "address": "fa:16:3e:55:ce:ef", "network": {"id": "b1aa635b-9b29-45b6-8cd4-06ccd9e0f545", "bridge": "br-int", "label": "tempest-device-tagging-net1-2012050279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21baa9dd-a7", "ovs_interfaceid": "21baa9dd-a7b0-445e-be2e-ab8b953bae49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Converting VIF {"id": "21baa9dd-a7b0-445e-be2e-ab8b953bae49", "address": "fa:16:3e:55:ce:ef", "network": {"id": "b1aa635b-9b29-45b6-8cd4-06ccd9e0f545", "bridge": "br-int", "label": "tempest-device-tagging-net1-2012050279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21baa9dd-a7", "ovs_interfaceid": "21baa9dd-a7b0-445e-be2e-ab8b953bae49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:ce:ef,bridge_name='br-int',has_traffic_filtering=True,id=21baa9dd-a7b0-445e-be2e-ab8b953bae49,network=Network(b1aa635b-9b29-45b6-8cd4-06ccd9e0f545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap21baa9dd-a7') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-445751592',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-445751592',id=16,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjmyWbMuiYwF3FarfTsEVQBll5AtEBHU5mcq0TNfpZjnm47NEOTKkLyChcDjkjpAKpX4t5dZ90uBnn976//CfCicnjiqQH8Rf/FqLWCYp0xuTRU8vwDe8CWZFymiWd5Cw==',key_name='tempest-keypair-2092297342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d18e5da818db4bbab4359c2b6f13f93f',ramdisk_id='',reservation_id='r-d84dx2ud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1095709842',owner_user_name='tempest-TaggedBootDevicesTest-1095709842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:20:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b306455ac86f4464b585007877c7fc97',uuid=09a20950-bce9-4c83-82db-e058872ae358,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32d1ff81-fed5-47fe-88ce-04bd2777f1e5", "address": "fa:16:3e:b5:df:02", "network": {"id": "b1aa635b-9b29-45b6-8cd4-06ccd9e0f545", "bridge": "br-int", "label": "tempest-device-tagging-net1-2012050279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d1ff81-fe", "ovs_interfaceid": "32d1ff81-fed5-47fe-88ce-04bd2777f1e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Converting VIF {"id": "32d1ff81-fed5-47fe-88ce-04bd2777f1e5", "address": "fa:16:3e:b5:df:02", "network": {"id": "b1aa635b-9b29-45b6-8cd4-06ccd9e0f545", "bridge": "br-int", "label": "tempest-device-tagging-net1-2012050279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d1ff81-fe", "ovs_interfaceid": "32d1ff81-fed5-47fe-88ce-04bd2777f1e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:df:02,bridge_name='br-int',has_traffic_filtering=True,id=32d1ff81-fed5-47fe-88ce-04bd2777f1e5,network=Network(b1aa635b-9b29-45b6-8cd4-06ccd9e0f545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32d1ff81-fe') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-445751592',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-445751592',id=16,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjmyWbMuiYwF3FarfTsEVQBll5AtEBHU5mcq0TNfpZjnm47NEOTKkLyChcDjkjpAKpX4t5dZ90uBnn976//CfCicnjiqQH8Rf/FqLWCYp0xuTRU8vwDe8CWZFymiWd5Cw==',key_name='tempest-keypair-2092297342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d18e5da818db4bbab4359c2b6f13f93f',ramdisk_id='',reservation_id='r-d84dx2ud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1095709842',owner_user_name='tempest-TaggedBootDevicesTest-1095709842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:20:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b306455ac86f4464b585007877c7fc97',uuid=09a20950-bce9-4c83-82db-e058872ae358,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41551d54-2c78-4fbe-9b7a-43452c5e94da", "address": "fa:16:3e:d8:11:91", "network": {"id": "b1aa635b-9b29-45b6-8cd4-06ccd9e0f545", "bridge": "br-int", "label": "tempest-device-tagging-net1-2012050279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41551d54-2c", "ovs_interfaceid": "41551d54-2c78-4fbe-9b7a-43452c5e94da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Converting VIF {"id": "41551d54-2c78-4fbe-9b7a-43452c5e94da", "address": "fa:16:3e:d8:11:91", "network": {"id": "b1aa635b-9b29-45b6-8cd4-06ccd9e0f545", "bridge": "br-int", "label": "tempest-device-tagging-net1-2012050279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41551d54-2c", "ovs_interfaceid": "41551d54-2c78-4fbe-9b7a-43452c5e94da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:11:91,bridge_name='br-int',has_traffic_filtering=True,id=41551d54-2c78-4fbe-9b7a-43452c5e94da,network=Network(b1aa635b-9b29-45b6-8cd4-06ccd9e0f545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41551d54-2c') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-445751592',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-445751592',id=16,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjmyWbMuiYwF3FarfTsEVQBll5AtEBHU5mcq0TNfpZjnm47NEOTKkLyChcDjkjpAKpX4t5dZ90uBnn976//CfCicnjiqQH8Rf/FqLWCYp0xuTRU8vwDe8CWZFymiWd5Cw==',key_name='tempest-keypair-2092297342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d18e5da818db4bbab4359c2b6f13f93f',ramdisk_id='',reservation_id='r-d84dx2ud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1095709842',owner_user_name='tempest-TaggedBootDevicesTest-1095709842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:20:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b306455ac86f4464b585007877c7fc97',uuid=09a20950-bce9-4c83-82db-e058872ae358,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de067d87-6780-4c38-bf69-7d976cbde30a", "address": "fa:16:3e:e1:62:57", "network": {"id": "6e7161bb-3d35-4adb-89d3-aa23f97adbfa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1214229212", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde067d87-67", "ovs_interfaceid": "de067d87-6780-4c38-bf69-7d976cbde30a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Converting VIF {"id": "de067d87-6780-4c38-bf69-7d976cbde30a", "address": "fa:16:3e:e1:62:57", "network": {"id": "6e7161bb-3d35-4adb-89d3-aa23f97adbfa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1214229212", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde067d87-67", "ovs_interfaceid": "de067d87-6780-4c38-bf69-7d976cbde30a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:62:57,bridge_name='br-int',has_traffic_filtering=True,id=de067d87-6780-4c38-bf69-7d976cbde30a,network=Network(6e7161bb-3d35-4adb-89d3-aa23f97adbfa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde067d87-67') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-445751592',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-445751592',id=16,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjmyWbMuiYwF3FarfTsEVQBll5AtEBHU5mcq0TNfpZjnm47NEOTKkLyChcDjkjpAKpX4t5dZ90uBnn976//CfCicnjiqQH8Rf/FqLWCYp0xuTRU8vwDe8CWZFymiWd5Cw==',key_name='tempest-keypair-2092297342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d18e5da818db4bbab4359c2b6f13f93f',ramdisk_id='',reservation_id='r-d84dx2ud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1095709842',owner_user_name='tempest-TaggedBootDevicesTest-1095709842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:20:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b306455ac86f4464b585007877c7fc97',uuid=09a20950-bce9-4c83-82db-e058872ae358,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb0c5adb-40d5-4fb6-b458-35a85c670333", "address": "fa:16:3e:8a:63:cf", "network": {"id": "6e7161bb-3d35-4adb-89d3-aa23f97adbfa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1214229212", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb0c5adb-40", "ovs_interfaceid": "cb0c5adb-40d5-4fb6-b458-35a85c670333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Converting VIF {"id": "cb0c5adb-40d5-4fb6-b458-35a85c670333", "address": "fa:16:3e:8a:63:cf", "network": {"id": "6e7161bb-3d35-4adb-89d3-aa23f97adbfa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1214229212", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb0c5adb-40", "ovs_interfaceid": "cb0c5adb-40d5-4fb6-b458-35a85c670333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:63:cf,bridge_name='br-int',has_traffic_filtering=True,id=cb0c5adb-40d5-4fb6-b458-35a85c670333,network=Network(6e7161bb-3d35-4adb-89d3-aa23f97adbfa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb0c5adb-40') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.objects.instance [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Lazy-loading 'pci_devices' on Instance uuid 09a20950-bce9-4c83-82db-e058872ae358 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:28 user nova-compute[72362]: INFO os_vif [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:05:4e,bridge_name='br-int',has_traffic_filtering=True,id=a10771ea-ee0f-4376-88cc-97dd0eb98d8d,network=Network(557d516c-f355-4cc8-ae2e-5dbec7ce9762),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa10771ea-ee')
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:21:28 user nova-compute[72362]:   <uuid>09a20950-bce9-4c83-82db-e058872ae358</uuid>
Aug 09 10:21:28 user nova-compute[72362]:   <name>instance-00000010</name>
Aug 09 10:21:28 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:21:28 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:21:28 user nova-compute[72362]:   <metadata>
Aug 09 10:21:28 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:21:28 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:21:28 user nova-compute[72362]:       <nova:name>tempest-device-tagging-server-445751592</nova:name>
Aug 09 10:21:28 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:21:22</nova:creationTime>
Aug 09 10:21:28 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:21:28 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:21:28 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:21:28 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:21:28 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:21:28 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:21:28 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:21:28 user nova-compute[72362]:       <nova:owner>
Aug 09 10:21:28 user nova-compute[72362]:         <nova:user uuid="b306455ac86f4464b585007877c7fc97">tempest-TaggedBootDevicesTest-1095709842-project-member</nova:user>
Aug 09 10:21:28 user nova-compute[72362]:         <nova:project uuid="d18e5da818db4bbab4359c2b6f13f93f">tempest-TaggedBootDevicesTest-1095709842</nova:project>
Aug 09 10:21:28 user nova-compute[72362]:       </nova:owner>
Aug 09 10:21:28 user nova-compute[72362]:       <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:21:28 user nova-compute[72362]:       <nova:ports>
Aug 09 10:21:28 user nova-compute[72362]:         <nova:port uuid="5fd897a8-78c2-49be-b1d6-867bab82082d">
Aug 09 10:21:28 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 09 10:21:28 user nova-compute[72362]:         </nova:port>
Aug 09 10:21:28 user nova-compute[72362]:         <nova:port uuid="f1457dd7-06e1-43ac-a55d-3f4f9fe150f8">
Aug 09 10:21:28 user nova-compute[72362]:           <nova:ip type="fixed" address="10.1.1.33" ipVersion="4"/>
Aug 09 10:21:28 user nova-compute[72362]:         </nova:port>
Aug 09 10:21:28 user nova-compute[72362]:         <nova:port uuid="21baa9dd-a7b0-445e-be2e-ab8b953bae49">
Aug 09 10:21:28 user nova-compute[72362]:           <nova:ip type="fixed" address="10.1.1.159" ipVersion="4"/>
Aug 09 10:21:28 user nova-compute[72362]:         </nova:port>
Aug 09 10:21:28 user nova-compute[72362]:         <nova:port uuid="32d1ff81-fed5-47fe-88ce-04bd2777f1e5">
Aug 09 10:21:28 user nova-compute[72362]:           <nova:ip type="fixed" address="10.1.1.187" ipVersion="4"/>
Aug 09 10:21:28 user nova-compute[72362]:         </nova:port>
Aug 09 10:21:28 user nova-compute[72362]:         <nova:port uuid="41551d54-2c78-4fbe-9b7a-43452c5e94da">
Aug 09 10:21:28 user nova-compute[72362]:           <nova:ip type="fixed" address="10.1.1.32" ipVersion="4"/>
Aug 09 10:21:28 user nova-compute[72362]:         </nova:port>
Aug 09 10:21:28 user nova-compute[72362]:         <nova:port uuid="de067d87-6780-4c38-bf69-7d976cbde30a">
Aug 09 10:21:28 user nova-compute[72362]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 09 10:21:28 user nova-compute[72362]:         </nova:port>
Aug 09 10:21:28 user nova-compute[72362]:         <nova:port uuid="cb0c5adb-40d5-4fb6-b458-35a85c670333">
Aug 09 10:21:28 user nova-compute[72362]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 09 10:21:28 user nova-compute[72362]:         </nova:port>
Aug 09 10:21:28 user nova-compute[72362]:       </nova:ports>
Aug 09 10:21:28 user nova-compute[72362]:     </nova:instance>
Aug 09 10:21:28 user nova-compute[72362]:   </metadata>
Aug 09 10:21:28 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:21:28 user nova-compute[72362]:     <system>
Aug 09 10:21:28 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:21:28 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:21:28 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:21:28 user nova-compute[72362]:       <entry name="serial">09a20950-bce9-4c83-82db-e058872ae358</entry>
Aug 09 10:21:28 user nova-compute[72362]:       <entry name="uuid">09a20950-bce9-4c83-82db-e058872ae358</entry>
Aug 09 10:21:28 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:21:28 user nova-compute[72362]:     </system>
Aug 09 10:21:28 user nova-compute[72362]:   </sysinfo>
Aug 09 10:21:28 user nova-compute[72362]:   <os>
Aug 09 10:21:28 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:21:28 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:21:28 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:21:28 user nova-compute[72362]:   </os>
Aug 09 10:21:28 user nova-compute[72362]:   <features>
Aug 09 10:21:28 user nova-compute[72362]:     <acpi/>
Aug 09 10:21:28 user nova-compute[72362]:     <apic/>
Aug 09 10:21:28 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:21:28 user nova-compute[72362]:   </features>
Aug 09 10:21:28 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:21:28 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:21:28 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:21:28 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:21:28 user nova-compute[72362]:   </clock>
Aug 09 10:21:28 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:21:28 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:21:28 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:21:28 user nova-compute[72362]:   </cpu>
Aug 09 10:21:28 user nova-compute[72362]:   <devices>
Aug 09 10:21:28 user nova-compute[72362]:     <disk type="file" device="cdrom">
Aug 09 10:21:28 user nova-compute[72362]:       <driver name="qemu" type="raw" cache="none"/>
Aug 09 10:21:28 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/09a20950-bce9-4c83-82db-e058872ae358/disk.config"/>
Aug 09 10:21:28 user nova-compute[72362]:       <target dev="hda" bus="ide"/>
Aug 09 10:21:28 user nova-compute[72362]:     </disk>
Aug 09 10:21:28 user nova-compute[72362]:     <disk type="block" device="disk">
Aug 09 10:21:28 user nova-compute[72362]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:21:28 user nova-compute[72362]:       <source dev="/dev/sdd"/>
Aug 09 10:21:28 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:21:28 user nova-compute[72362]:       <serial>deb67b62-54b5-4129-bf15-580c82d0ab28</serial>
Aug 09 10:21:28 user nova-compute[72362]:     </disk>
Aug 09 10:21:28 user nova-compute[72362]:     <disk type="block" device="disk">
Aug 09 10:21:28 user nova-compute[72362]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:21:28 user nova-compute[72362]:       <source dev="/dev/sde"/>
Aug 09 10:21:28 user nova-compute[72362]:       <target dev="vdb" bus="virtio"/>
Aug 09 10:21:28 user nova-compute[72362]:       <serial>2f562c44-6d2f-49a0-ac17-a67fed224b31</serial>
Aug 09 10:21:28 user nova-compute[72362]:     </disk>
Aug 09 10:21:28 user nova-compute[72362]:     <disk type="block" device="disk">
Aug 09 10:21:28 user nova-compute[72362]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:21:28 user nova-compute[72362]:       <source dev="/dev/sdf"/>
Aug 09 10:21:28 user nova-compute[72362]:       <target dev="vdc" bus="virtio"/>
Aug 09 10:21:28 user nova-compute[72362]:       <serial>ccfac3d0-b7f2-45e7-951c-60781c8515e5</serial>
Aug 09 10:21:28 user nova-compute[72362]:     </disk>
Aug 09 10:21:28 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:21:28 user nova-compute[72362]:       <mac address="fa:16:3e:ae:3a:4a"/>
Aug 09 10:21:28 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:21:28 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:21:28 user nova-compute[72362]:       <target dev="tap5fd897a8-78"/>
Aug 09 10:21:28 user nova-compute[72362]:     </interface>
Aug 09 10:21:28 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:21:28 user nova-compute[72362]:       <mac address="fa:16:3e:f2:a7:dd"/>
Aug 09 10:21:28 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:21:28 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:21:28 user nova-compute[72362]:       <target dev="tapf1457dd7-06"/>
Aug 09 10:21:28 user nova-compute[72362]:     </interface>
Aug 09 10:21:28 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:21:28 user nova-compute[72362]:       <mac address="fa:16:3e:55:ce:ef"/>
Aug 09 10:21:28 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:21:28 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:21:28 user nova-compute[72362]:       <target dev="tap21baa9dd-a7"/>
Aug 09 10:21:28 user nova-compute[72362]:     </interface>
Aug 09 10:21:28 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:21:28 user nova-compute[72362]:       <mac address="fa:16:3e:b5:df:02"/>
Aug 09 10:21:28 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:21:28 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:21:28 user nova-compute[72362]:       <target dev="tap32d1ff81-fe"/>
Aug 09 10:21:28 user nova-compute[72362]:     </interface>
Aug 09 10:21:28 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:21:28 user nova-compute[72362]:       <mac address="fa:16:3e:d8:11:91"/>
Aug 09 10:21:28 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:21:28 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:21:28 user nova-compute[72362]:       <target dev="tap41551d54-2c"/>
Aug 09 10:21:28 user nova-compute[72362]:     </interface>
Aug 09 10:21:28 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:21:28 user nova-compute[72362]:       <mac address="fa:16:3e:e1:62:57"/>
Aug 09 10:21:28 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:21:28 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:21:28 user nova-compute[72362]:       <target dev="tapde067d87-67"/>
Aug 09 10:21:28 user nova-compute[72362]:     </interface>
Aug 09 10:21:28 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:21:28 user nova-compute[72362]:       <mac address="fa:16:3e:8a:63:cf"/>
Aug 09 10:21:28 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:21:28 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:21:28 user nova-compute[72362]:       <target dev="tapcb0c5adb-40"/>
Aug 09 10:21:28 user nova-compute[72362]:     </interface>
Aug 09 10:21:28 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:21:28 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/09a20950-bce9-4c83-82db-e058872ae358/console.log" append="off"/>
Aug 09 10:21:28 user nova-compute[72362]:     </serial>
Aug 09 10:21:28 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:21:28 user nova-compute[72362]:     <video>
Aug 09 10:21:28 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:21:28 user nova-compute[72362]:     </video>
Aug 09 10:21:28 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:21:28 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:21:28 user nova-compute[72362]:     </rng>
Aug 09 10:21:28 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:21:28 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:21:28 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:21:28 user nova-compute[72362]:     </memballoon>
Aug 09 10:21:28 user nova-compute[72362]:   </devices>
Aug 09 10:21:28 user nova-compute[72362]: </domain>
Aug 09 10:21:28 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-445751592',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-445751592',id=16,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjmyWbMuiYwF3FarfTsEVQBll5AtEBHU5mcq0TNfpZjnm47NEOTKkLyChcDjkjpAKpX4t5dZ90uBnn976//CfCicnjiqQH8Rf/FqLWCYp0xuTRU8vwDe8CWZFymiWd5Cw==',key_name='tempest-keypair-2092297342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d18e5da818db4bbab4359c2b6f13f93f',ramdisk_id='',reservation_id='r-d84dx2ud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1095709842',owner_user_name='tempest-TaggedBootDevicesTest-1095709842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:20:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b306455ac86f4464b585007877c7fc97',uuid=09a20950-bce9-4c83-82db-e058872ae358,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5fd897a8-78c2-49be-b1d6-867bab82082d", "address": "fa:16:3e:ae:3a:4a", "network": {"id": "e2b9dab7-85be-4e72-a3a9-14cd26990b44", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1356785765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd897a8-78", "ovs_interfaceid": "5fd897a8-78c2-49be-b1d6-867bab82082d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Converting VIF {"id": "5fd897a8-78c2-49be-b1d6-867bab82082d", "address": "fa:16:3e:ae:3a:4a", "network": {"id": "e2b9dab7-85be-4e72-a3a9-14cd26990b44", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1356785765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd897a8-78", "ovs_interfaceid": "5fd897a8-78c2-49be-b1d6-867bab82082d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:3a:4a,bridge_name='br-int',has_traffic_filtering=True,id=5fd897a8-78c2-49be-b1d6-867bab82082d,network=Network(e2b9dab7-85be-4e72-a3a9-14cd26990b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fd897a8-78') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG os_vif [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:3a:4a,bridge_name='br-int',has_traffic_filtering=True,id=5fd897a8-78c2-49be-b1d6-867bab82082d,network=Network(e2b9dab7-85be-4e72-a3a9-14cd26990b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fd897a8-78') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Acquiring lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5fd897a8-78, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5fd897a8-78, col_values=(('external_ids', {'iface-id': '5fd897a8-78c2-49be-b1d6-867bab82082d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:3a:4a', 'vm-uuid': '09a20950-bce9-4c83-82db-e058872ae358'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.compute.manager [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Starting instance... {{(pid=72362) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:28 user nova-compute[72362]: INFO os_vif [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:3a:4a,bridge_name='br-int',has_traffic_filtering=True,id=5fd897a8-78c2-49be-b1d6-867bab82082d,network=Network(e2b9dab7-85be-4e72-a3a9-14cd26990b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fd897a8-78')
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-445751592',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-445751592',id=16,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjmyWbMuiYwF3FarfTsEVQBll5AtEBHU5mcq0TNfpZjnm47NEOTKkLyChcDjkjpAKpX4t5dZ90uBnn976//CfCicnjiqQH8Rf/FqLWCYp0xuTRU8vwDe8CWZFymiWd5Cw==',key_name='tempest-keypair-2092297342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d18e5da818db4bbab4359c2b6f13f93f',ramdisk_id='',reservation_id='r-d84dx2ud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1095709842',owner_user_name='tempest-TaggedBootDevicesTest-1095709842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:20:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b306455ac86f4464b585007877c7fc97',uuid=09a20950-bce9-4c83-82db-e058872ae358,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1457dd7-06e1-43ac-a55d-3f4f9fe150f8", "address": "fa:16:3e:f2:a7:dd", "network": {"id": "b1aa635b-9b29-45b6-8cd4-06ccd9e0f545", "bridge": "br-int", "label": "tempest-device-tagging-net1-2012050279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1457dd7-06", "ovs_interfaceid": "f1457dd7-06e1-43ac-a55d-3f4f9fe150f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Converting VIF {"id": "f1457dd7-06e1-43ac-a55d-3f4f9fe150f8", "address": "fa:16:3e:f2:a7:dd", "network": {"id": "b1aa635b-9b29-45b6-8cd4-06ccd9e0f545", "bridge": "br-int", "label": "tempest-device-tagging-net1-2012050279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1457dd7-06", "ovs_interfaceid": "f1457dd7-06e1-43ac-a55d-3f4f9fe150f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:a7:dd,bridge_name='br-int',has_traffic_filtering=True,id=f1457dd7-06e1-43ac-a55d-3f4f9fe150f8,network=Network(b1aa635b-9b29-45b6-8cd4-06ccd9e0f545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf1457dd7-06') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG os_vif [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:a7:dd,bridge_name='br-int',has_traffic_filtering=True,id=f1457dd7-06e1-43ac-a55d-3f4f9fe150f8,network=Network(b1aa635b-9b29-45b6-8cd4-06ccd9e0f545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf1457dd7-06') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf1457dd7-06, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf1457dd7-06, col_values=(('external_ids', {'iface-id': 'f1457dd7-06e1-43ac-a55d-3f4f9fe150f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:a7:dd', 'vm-uuid': '09a20950-bce9-4c83-82db-e058872ae358'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] No VIF found with MAC fa:16:3e:03:05:4e, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:28 user nova-compute[72362]: INFO os_vif [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:a7:dd,bridge_name='br-int',has_traffic_filtering=True,id=f1457dd7-06e1-43ac-a55d-3f4f9fe150f8,network=Network(b1aa635b-9b29-45b6-8cd4-06ccd9e0f545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf1457dd7-06')
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-445751592',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-445751592',id=16,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjmyWbMuiYwF3FarfTsEVQBll5AtEBHU5mcq0TNfpZjnm47NEOTKkLyChcDjkjpAKpX4t5dZ90uBnn976//CfCicnjiqQH8Rf/FqLWCYp0xuTRU8vwDe8CWZFymiWd5Cw==',key_name='tempest-keypair-2092297342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d18e5da818db4bbab4359c2b6f13f93f',ramdisk_id='',reservation_id='r-d84dx2ud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1095709842',owner_user_name='tempest-TaggedBootDevicesTest-1095709842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:20:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b306455ac86f4464b585007877c7fc97',uuid=09a20950-bce9-4c83-82db-e058872ae358,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21baa9dd-a7b0-445e-be2e-ab8b953bae49", "address": "fa:16:3e:55:ce:ef", "network": {"id": "b1aa635b-9b29-45b6-8cd4-06ccd9e0f545", "bridge": "br-int", "label": "tempest-device-tagging-net1-2012050279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21baa9dd-a7", "ovs_interfaceid": "21baa9dd-a7b0-445e-be2e-ab8b953bae49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Converting VIF {"id": "21baa9dd-a7b0-445e-be2e-ab8b953bae49", "address": "fa:16:3e:55:ce:ef", "network": {"id": "b1aa635b-9b29-45b6-8cd4-06ccd9e0f545", "bridge": "br-int", "label": "tempest-device-tagging-net1-2012050279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21baa9dd-a7", "ovs_interfaceid": "21baa9dd-a7b0-445e-be2e-ab8b953bae49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:ce:ef,bridge_name='br-int',has_traffic_filtering=True,id=21baa9dd-a7b0-445e-be2e-ab8b953bae49,network=Network(b1aa635b-9b29-45b6-8cd4-06ccd9e0f545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap21baa9dd-a7') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG os_vif [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:ce:ef,bridge_name='br-int',has_traffic_filtering=True,id=21baa9dd-a7b0-445e-be2e-ab8b953bae49,network=Network(b1aa635b-9b29-45b6-8cd4-06ccd9e0f545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap21baa9dd-a7') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap21baa9dd-a7, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap21baa9dd-a7, col_values=(('external_ids', {'iface-id': '21baa9dd-a7b0-445e-be2e-ab8b953bae49', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:ce:ef', 'vm-uuid': '09a20950-bce9-4c83-82db-e058872ae358'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:28 user nova-compute[72362]: INFO os_vif [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:ce:ef,bridge_name='br-int',has_traffic_filtering=True,id=21baa9dd-a7b0-445e-be2e-ab8b953bae49,network=Network(b1aa635b-9b29-45b6-8cd4-06ccd9e0f545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap21baa9dd-a7')
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-445751592',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-445751592',id=16,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjmyWbMuiYwF3FarfTsEVQBll5AtEBHU5mcq0TNfpZjnm47NEOTKkLyChcDjkjpAKpX4t5dZ90uBnn976//CfCicnjiqQH8Rf/FqLWCYp0xuTRU8vwDe8CWZFymiWd5Cw==',key_name='tempest-keypair-2092297342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d18e5da818db4bbab4359c2b6f13f93f',ramdisk_id='',reservation_id='r-d84dx2ud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1095709842',owner_user_name='tempest-TaggedBootDevicesTest-1095709842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:20:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b306455ac86f4464b585007877c7fc97',uuid=09a20950-bce9-4c83-82db-e058872ae358,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32d1ff81-fed5-47fe-88ce-04bd2777f1e5", "address": "fa:16:3e:b5:df:02", "network": {"id": "b1aa635b-9b29-45b6-8cd4-06ccd9e0f545", "bridge": "br-int", "label": "tempest-device-tagging-net1-2012050279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d1ff81-fe", "ovs_interfaceid": "32d1ff81-fed5-47fe-88ce-04bd2777f1e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Converting VIF {"id": "32d1ff81-fed5-47fe-88ce-04bd2777f1e5", "address": "fa:16:3e:b5:df:02", "network": {"id": "b1aa635b-9b29-45b6-8cd4-06ccd9e0f545", "bridge": "br-int", "label": "tempest-device-tagging-net1-2012050279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d1ff81-fe", "ovs_interfaceid": "32d1ff81-fed5-47fe-88ce-04bd2777f1e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:df:02,bridge_name='br-int',has_traffic_filtering=True,id=32d1ff81-fed5-47fe-88ce-04bd2777f1e5,network=Network(b1aa635b-9b29-45b6-8cd4-06ccd9e0f545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32d1ff81-fe') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG os_vif [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:df:02,bridge_name='br-int',has_traffic_filtering=True,id=32d1ff81-fed5-47fe-88ce-04bd2777f1e5,network=Network(b1aa635b-9b29-45b6-8cd4-06ccd9e0f545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32d1ff81-fe') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap32d1ff81-fe, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap32d1ff81-fe, col_values=(('external_ids', {'iface-id': '32d1ff81-fed5-47fe-88ce-04bd2777f1e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:df:02', 'vm-uuid': '09a20950-bce9-4c83-82db-e058872ae358'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:21:28 user nova-compute[72362]: INFO nova.compute.claims [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Claim successful on node user
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:28 user nova-compute[72362]: INFO os_vif [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:df:02,bridge_name='br-int',has_traffic_filtering=True,id=32d1ff81-fed5-47fe-88ce-04bd2777f1e5,network=Network(b1aa635b-9b29-45b6-8cd4-06ccd9e0f545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32d1ff81-fe')
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-445751592',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-445751592',id=16,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjmyWbMuiYwF3FarfTsEVQBll5AtEBHU5mcq0TNfpZjnm47NEOTKkLyChcDjkjpAKpX4t5dZ90uBnn976//CfCicnjiqQH8Rf/FqLWCYp0xuTRU8vwDe8CWZFymiWd5Cw==',key_name='tempest-keypair-2092297342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d18e5da818db4bbab4359c2b6f13f93f',ramdisk_id='',reservation_id='r-d84dx2ud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1095709842',owner_user_name='tempest-TaggedBootDevicesTest-1095709842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:20:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b306455ac86f4464b585007877c7fc97',uuid=09a20950-bce9-4c83-82db-e058872ae358,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41551d54-2c78-4fbe-9b7a-43452c5e94da", "address": "fa:16:3e:d8:11:91", "network": {"id": "b1aa635b-9b29-45b6-8cd4-06ccd9e0f545", "bridge": "br-int", "label": "tempest-device-tagging-net1-2012050279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41551d54-2c", "ovs_interfaceid": "41551d54-2c78-4fbe-9b7a-43452c5e94da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Converting VIF {"id": "41551d54-2c78-4fbe-9b7a-43452c5e94da", "address": "fa:16:3e:d8:11:91", "network": {"id": "b1aa635b-9b29-45b6-8cd4-06ccd9e0f545", "bridge": "br-int", "label": "tempest-device-tagging-net1-2012050279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41551d54-2c", "ovs_interfaceid": "41551d54-2c78-4fbe-9b7a-43452c5e94da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:11:91,bridge_name='br-int',has_traffic_filtering=True,id=41551d54-2c78-4fbe-9b7a-43452c5e94da,network=Network(b1aa635b-9b29-45b6-8cd4-06ccd9e0f545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41551d54-2c') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG os_vif [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:11:91,bridge_name='br-int',has_traffic_filtering=True,id=41551d54-2c78-4fbe-9b7a-43452c5e94da,network=Network(b1aa635b-9b29-45b6-8cd4-06ccd9e0f545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41551d54-2c') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap41551d54-2c, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap41551d54-2c, col_values=(('external_ids', {'iface-id': '41551d54-2c78-4fbe-9b7a-43452c5e94da', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:11:91', 'vm-uuid': '09a20950-bce9-4c83-82db-e058872ae358'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:28 user nova-compute[72362]: INFO os_vif [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:11:91,bridge_name='br-int',has_traffic_filtering=True,id=41551d54-2c78-4fbe-9b7a-43452c5e94da,network=Network(b1aa635b-9b29-45b6-8cd4-06ccd9e0f545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41551d54-2c')
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-445751592',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-445751592',id=16,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjmyWbMuiYwF3FarfTsEVQBll5AtEBHU5mcq0TNfpZjnm47NEOTKkLyChcDjkjpAKpX4t5dZ90uBnn976//CfCicnjiqQH8Rf/FqLWCYp0xuTRU8vwDe8CWZFymiWd5Cw==',key_name='tempest-keypair-2092297342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d18e5da818db4bbab4359c2b6f13f93f',ramdisk_id='',reservation_id='r-d84dx2ud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1095709842',owner_user_name='tempest-TaggedBootDevicesTest-1095709842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:20:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b306455ac86f4464b585007877c7fc97',uuid=09a20950-bce9-4c83-82db-e058872ae358,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de067d87-6780-4c38-bf69-7d976cbde30a", "address": "fa:16:3e:e1:62:57", "network": {"id": "6e7161bb-3d35-4adb-89d3-aa23f97adbfa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1214229212", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde067d87-67", "ovs_interfaceid": "de067d87-6780-4c38-bf69-7d976cbde30a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Converting VIF {"id": "de067d87-6780-4c38-bf69-7d976cbde30a", "address": "fa:16:3e:e1:62:57", "network": {"id": "6e7161bb-3d35-4adb-89d3-aa23f97adbfa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1214229212", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde067d87-67", "ovs_interfaceid": "de067d87-6780-4c38-bf69-7d976cbde30a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:62:57,bridge_name='br-int',has_traffic_filtering=True,id=de067d87-6780-4c38-bf69-7d976cbde30a,network=Network(6e7161bb-3d35-4adb-89d3-aa23f97adbfa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde067d87-67') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG os_vif [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:62:57,bridge_name='br-int',has_traffic_filtering=True,id=de067d87-6780-4c38-bf69-7d976cbde30a,network=Network(6e7161bb-3d35-4adb-89d3-aa23f97adbfa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde067d87-67') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde067d87-67, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapde067d87-67, col_values=(('external_ids', {'iface-id': 'de067d87-6780-4c38-bf69-7d976cbde30a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:62:57', 'vm-uuid': '09a20950-bce9-4c83-82db-e058872ae358'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.network.neutron [req-c390d219-ea05-44fb-b2ef-1d7c4decd230 req-d34f818b-db10-4855-ac27-16053b4d89f1 service nova] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Updated VIF entry in instance network info cache for port a10771ea-ee0f-4376-88cc-97dd0eb98d8d. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.network.neutron [req-c390d219-ea05-44fb-b2ef-1d7c4decd230 req-d34f818b-db10-4855-ac27-16053b4d89f1 service nova] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Updating instance_info_cache with network_info: [{"id": "a10771ea-ee0f-4376-88cc-97dd0eb98d8d", "address": "fa:16:3e:03:05:4e", "network": {"id": "557d516c-f355-4cc8-ae2e-5dbec7ce9762", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1511437856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99716e91e68b4abfba3a4c9335e42955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa10771ea-ee", "ovs_interfaceid": "a10771ea-ee0f-4376-88cc-97dd0eb98d8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:28 user nova-compute[72362]: INFO os_vif [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:62:57,bridge_name='br-int',has_traffic_filtering=True,id=de067d87-6780-4c38-bf69-7d976cbde30a,network=Network(6e7161bb-3d35-4adb-89d3-aa23f97adbfa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde067d87-67')
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-445751592',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-445751592',id=16,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjmyWbMuiYwF3FarfTsEVQBll5AtEBHU5mcq0TNfpZjnm47NEOTKkLyChcDjkjpAKpX4t5dZ90uBnn976//CfCicnjiqQH8Rf/FqLWCYp0xuTRU8vwDe8CWZFymiWd5Cw==',key_name='tempest-keypair-2092297342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d18e5da818db4bbab4359c2b6f13f93f',ramdisk_id='',reservation_id='r-d84dx2ud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1095709842',owner_user_name='tempest-TaggedBootDevicesTest-1095709842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:20:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b306455ac86f4464b585007877c7fc97',uuid=09a20950-bce9-4c83-82db-e058872ae358,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb0c5adb-40d5-4fb6-b458-35a85c670333", "address": "fa:16:3e:8a:63:cf", "network": {"id": "6e7161bb-3d35-4adb-89d3-aa23f97adbfa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1214229212", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb0c5adb-40", "ovs_interfaceid": "cb0c5adb-40d5-4fb6-b458-35a85c670333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Converting VIF {"id": "cb0c5adb-40d5-4fb6-b458-35a85c670333", "address": "fa:16:3e:8a:63:cf", "network": {"id": "6e7161bb-3d35-4adb-89d3-aa23f97adbfa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1214229212", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb0c5adb-40", "ovs_interfaceid": "cb0c5adb-40d5-4fb6-b458-35a85c670333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:63:cf,bridge_name='br-int',has_traffic_filtering=True,id=cb0c5adb-40d5-4fb6-b458-35a85c670333,network=Network(6e7161bb-3d35-4adb-89d3-aa23f97adbfa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb0c5adb-40') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG os_vif [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:63:cf,bridge_name='br-int',has_traffic_filtering=True,id=cb0c5adb-40d5-4fb6-b458-35a85c670333,network=Network(6e7161bb-3d35-4adb-89d3-aa23f97adbfa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb0c5adb-40') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c390d219-ea05-44fb-b2ef-1d7c4decd230 req-d34f818b-db10-4855-ac27-16053b4d89f1 service nova] Releasing lock "refresh_cache-4746beb1-d313-4cea-bf7b-75b507ebbdd2" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb0c5adb-40, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcb0c5adb-40, col_values=(('external_ids', {'iface-id': 'cb0c5adb-40d5-4fb6-b458-35a85c670333', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:63:cf', 'vm-uuid': '09a20950-bce9-4c83-82db-e058872ae358'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:28 user nova-compute[72362]: INFO os_vif [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:63:cf,bridge_name='br-int',has_traffic_filtering=True,id=cb0c5adb-40d5-4fb6-b458-35a85c670333,network=Network(6e7161bb-3d35-4adb-89d3-aa23f97adbfa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb0c5adb-40')
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] No BDM found with device name hda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] No VIF found with MAC fa:16:3e:ae:3a:4a, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] No VIF found with MAC fa:16:3e:d8:11:91, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:21:28 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Using config drive
Aug 09 10:21:28 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:21:29 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:21:29 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Creating config drive at /opt/stack/data/nova/instances/09a20950-bce9-4c83-82db-e058872ae358/disk.config
Aug 09 10:21:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/09a20950-bce9-4c83-82db-e058872ae358/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpb6hqu70_ {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.697s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:21:29 user nova-compute[72362]: DEBUG nova.compute.manager [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Start building networks asynchronously for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 10:21:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/09a20950-bce9-4c83-82db-e058872ae358/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpb6hqu70_" returned: 0 in 0.063s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:29 user nova-compute[72362]: DEBUG nova.compute.manager [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Allocating IP information in the background. {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 10:21:29 user nova-compute[72362]: DEBUG nova.network.neutron [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] allocate_for_instance() {{(pid=72362) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 10:21:29 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 10:21:29 user nova-compute[72362]: DEBUG nova.compute.manager [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Start building block device mappings for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 10:21:29 user nova-compute[72362]: DEBUG nova.policy [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec007d0aa3c144f5a24a4913cc336ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dac04663e2f45378cc0e466740342d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72362) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 10:21:29 user nova-compute[72362]: DEBUG nova.compute.manager [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Start spawning the instance on the hypervisor. {{(pid=72362) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 10:21:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:21:29 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Creating image(s)
Aug 09 10:21:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Acquiring lock "/opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:21:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "/opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:21:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "/opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:21:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.188s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Acquiring lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:21:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:21:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.182s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk 1073741824 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk 1073741824" returned: 0 in 0.061s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:21:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.185s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:30 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk. size=1073741824 {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 10:21:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c478f3f1-9eeb-483c-875f-c2af164a560d tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Acquiring lock "d5b048c8-a329-4fe3-ab62-a06ab6401230" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:21:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c478f3f1-9eeb-483c-875f-c2af164a560d tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Lock "d5b048c8-a329-4fe3-ab62-a06ab6401230" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:21:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c478f3f1-9eeb-483c-875f-c2af164a560d tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Acquiring lock "d5b048c8-a329-4fe3-ab62-a06ab6401230-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:21:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c478f3f1-9eeb-483c-875f-c2af164a560d tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Lock "d5b048c8-a329-4fe3-ab62-a06ab6401230-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:21:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c478f3f1-9eeb-483c-875f-c2af164a560d tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Lock "d5b048c8-a329-4fe3-ab62-a06ab6401230-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:21:30 user nova-compute[72362]: INFO nova.compute.manager [None req-c478f3f1-9eeb-483c-875f-c2af164a560d tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Terminating instance
Aug 09 10:21:30 user nova-compute[72362]: DEBUG nova.compute.manager [None req-c478f3f1-9eeb-483c-875f-c2af164a560d tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Start destroying the instance on the hypervisor. {{(pid=72362) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 10:21:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:30 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Cannot resize image /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk to a smaller size. {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 10:21:30 user nova-compute[72362]: DEBUG nova.objects.instance [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lazy-loading 'migration_context' on Instance uuid a6000393-6044-4b54-ac0b-1d631e2ed0ae {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:21:30 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Created local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 10:21:30 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Ensure instance console log exists: /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:21:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:21:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:21:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:21:30 user nova-compute[72362]: DEBUG nova.network.neutron [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Successfully created port: 8c0230bc-c7a7-4497-af9a-2fafb259605c {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:21:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:30 user nova-compute[72362]: DEBUG nova.compute.manager [req-e611ac8f-91e4-4c8c-88df-b02b0234e448 req-3c63c14e-71c5-4513-8341-0c4c5dc0e118 service nova] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Received event network-vif-unplugged-c6f3f94c-4160-4103-8784-d86042b30f45 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:21:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e611ac8f-91e4-4c8c-88df-b02b0234e448 req-3c63c14e-71c5-4513-8341-0c4c5dc0e118 service nova] Acquiring lock "d5b048c8-a329-4fe3-ab62-a06ab6401230-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:21:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e611ac8f-91e4-4c8c-88df-b02b0234e448 req-3c63c14e-71c5-4513-8341-0c4c5dc0e118 service nova] Lock "d5b048c8-a329-4fe3-ab62-a06ab6401230-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:21:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e611ac8f-91e4-4c8c-88df-b02b0234e448 req-3c63c14e-71c5-4513-8341-0c4c5dc0e118 service nova] Lock "d5b048c8-a329-4fe3-ab62-a06ab6401230-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:21:30 user nova-compute[72362]: DEBUG nova.compute.manager [req-e611ac8f-91e4-4c8c-88df-b02b0234e448 req-3c63c14e-71c5-4513-8341-0c4c5dc0e118 service nova] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] No waiting events found dispatching network-vif-unplugged-c6f3f94c-4160-4103-8784-d86042b30f45 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:21:30 user nova-compute[72362]: DEBUG nova.compute.manager [req-e611ac8f-91e4-4c8c-88df-b02b0234e448 req-3c63c14e-71c5-4513-8341-0c4c5dc0e118 service nova] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Received event network-vif-unplugged-c6f3f94c-4160-4103-8784-d86042b30f45 for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:21:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:31 user nova-compute[72362]: DEBUG nova.network.neutron [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Successfully updated port: 8c0230bc-c7a7-4497-af9a-2fafb259605c {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:21:31 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Acquiring lock "refresh_cache-a6000393-6044-4b54-ac0b-1d631e2ed0ae" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:21:31 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Acquired lock "refresh_cache-a6000393-6044-4b54-ac0b-1d631e2ed0ae" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:21:31 user nova-compute[72362]: DEBUG nova.network.neutron [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:21:31 user nova-compute[72362]: DEBUG nova.compute.manager [req-e1139065-0e91-447c-aa36-962822cd69e0 req-0806aca4-3e21-4fbe-b25d-3fc2ed05468c service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Received event network-changed-8c0230bc-c7a7-4497-af9a-2fafb259605c {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:21:31 user nova-compute[72362]: DEBUG nova.compute.manager [req-e1139065-0e91-447c-aa36-962822cd69e0 req-0806aca4-3e21-4fbe-b25d-3fc2ed05468c service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Refreshing instance network info cache due to event network-changed-8c0230bc-c7a7-4497-af9a-2fafb259605c. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:21:31 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e1139065-0e91-447c-aa36-962822cd69e0 req-0806aca4-3e21-4fbe-b25d-3fc2ed05468c service nova] Acquiring lock "refresh_cache-a6000393-6044-4b54-ac0b-1d631e2ed0ae" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:21:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:31 user nova-compute[72362]: DEBUG nova.network.neutron [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:21:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG nova.network.neutron [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Updating instance_info_cache with network_info: [{"id": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "address": "fa:16:3e:6e:b0:73", "network": {"id": "7358b925-3211-4419-84eb-df6967f5ea8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1360753488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dac04663e2f45378cc0e466740342d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c0230bc-c7", "ovs_interfaceid": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Releasing lock "refresh_cache-a6000393-6044-4b54-ac0b-1d631e2ed0ae" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG nova.compute.manager [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Instance network_info: |[{"id": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "address": "fa:16:3e:6e:b0:73", "network": {"id": "7358b925-3211-4419-84eb-df6967f5ea8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1360753488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dac04663e2f45378cc0e466740342d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c0230bc-c7", "ovs_interfaceid": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e1139065-0e91-447c-aa36-962822cd69e0 req-0806aca4-3e21-4fbe-b25d-3fc2ed05468c service nova] Acquired lock "refresh_cache-a6000393-6044-4b54-ac0b-1d631e2ed0ae" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG nova.network.neutron [req-e1139065-0e91-447c-aa36-962822cd69e0 req-0806aca4-3e21-4fbe-b25d-3fc2ed05468c service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Refreshing network info cache for port 8c0230bc-c7a7-4497-af9a-2fafb259605c {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Start _get_guest_xml network_info=[{"id": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "address": "fa:16:3e:6e:b0:73", "network": {"id": "7358b925-3211-4419-84eb-df6967f5ea8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1360753488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dac04663e2f45378cc0e466740342d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c0230bc-c7", "ovs_interfaceid": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': 'a08d1a11-49eb-4212-a351-e11ee9553b95'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:21:32 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:21:32 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:21:32 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:21:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1940264170',display_name='tempest-AttachVolumeTestJSON-server-1940264170',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1940264170',id=19,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuD55hFJGS6ztpZ3pMNhoMVTtkOPfZJVd+6jLMFkU6lpGS3ntRkyZ61ihETUV7/q4X01P1baNsnIzL7TV/XH9281YGmZSyK/sCWwApv9GpxS0U8aCjbpuFwgIK7/Y1Z9Q==',key_name='tempest-keypair-208455084',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9dac04663e2f45378cc0e466740342d2',ramdisk_id='',reservation_id='r-i0cbsd0z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-986857971',owner_user_name='tempest-AttachVolumeTestJSON-986857971-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:21:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec007d0aa3c144f5a24a4913cc336ebb',uuid=a6000393-6044-4b54-ac0b-1d631e2ed0ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "address": "fa:16:3e:6e:b0:73", "network": {"id": "7358b925-3211-4419-84eb-df6967f5ea8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1360753488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dac04663e2f45378cc0e466740342d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c0230bc-c7", "ovs_interfaceid": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Converting VIF {"id": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "address": "fa:16:3e:6e:b0:73", "network": {"id": "7358b925-3211-4419-84eb-df6967f5ea8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1360753488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dac04663e2f45378cc0e466740342d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c0230bc-c7", "ovs_interfaceid": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:b0:73,bridge_name='br-int',has_traffic_filtering=True,id=8c0230bc-c7a7-4497-af9a-2fafb259605c,network=Network(7358b925-3211-4419-84eb-df6967f5ea8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c0230bc-c7') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG nova.objects.instance [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lazy-loading 'pci_devices' on Instance uuid a6000393-6044-4b54-ac0b-1d631e2ed0ae {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:21:32 user nova-compute[72362]:   <uuid>a6000393-6044-4b54-ac0b-1d631e2ed0ae</uuid>
Aug 09 10:21:32 user nova-compute[72362]:   <name>instance-00000013</name>
Aug 09 10:21:32 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:21:32 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:21:32 user nova-compute[72362]:   <metadata>
Aug 09 10:21:32 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:21:32 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:21:32 user nova-compute[72362]:       <nova:name>tempest-AttachVolumeTestJSON-server-1940264170</nova:name>
Aug 09 10:21:32 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:21:32</nova:creationTime>
Aug 09 10:21:32 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:21:32 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:21:32 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:21:32 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:21:32 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:21:32 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:21:32 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:21:32 user nova-compute[72362]:       <nova:owner>
Aug 09 10:21:32 user nova-compute[72362]:         <nova:user uuid="ec007d0aa3c144f5a24a4913cc336ebb">tempest-AttachVolumeTestJSON-986857971-project-member</nova:user>
Aug 09 10:21:32 user nova-compute[72362]:         <nova:project uuid="9dac04663e2f45378cc0e466740342d2">tempest-AttachVolumeTestJSON-986857971</nova:project>
Aug 09 10:21:32 user nova-compute[72362]:       </nova:owner>
Aug 09 10:21:32 user nova-compute[72362]:       <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:21:32 user nova-compute[72362]:       <nova:ports>
Aug 09 10:21:32 user nova-compute[72362]:         <nova:port uuid="8c0230bc-c7a7-4497-af9a-2fafb259605c">
Aug 09 10:21:32 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 10:21:32 user nova-compute[72362]:         </nova:port>
Aug 09 10:21:32 user nova-compute[72362]:       </nova:ports>
Aug 09 10:21:32 user nova-compute[72362]:     </nova:instance>
Aug 09 10:21:32 user nova-compute[72362]:   </metadata>
Aug 09 10:21:32 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:21:32 user nova-compute[72362]:     <system>
Aug 09 10:21:32 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:21:32 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:21:32 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:21:32 user nova-compute[72362]:       <entry name="serial">a6000393-6044-4b54-ac0b-1d631e2ed0ae</entry>
Aug 09 10:21:32 user nova-compute[72362]:       <entry name="uuid">a6000393-6044-4b54-ac0b-1d631e2ed0ae</entry>
Aug 09 10:21:32 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:21:32 user nova-compute[72362]:     </system>
Aug 09 10:21:32 user nova-compute[72362]:   </sysinfo>
Aug 09 10:21:32 user nova-compute[72362]:   <os>
Aug 09 10:21:32 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:21:32 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:21:32 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:21:32 user nova-compute[72362]:   </os>
Aug 09 10:21:32 user nova-compute[72362]:   <features>
Aug 09 10:21:32 user nova-compute[72362]:     <acpi/>
Aug 09 10:21:32 user nova-compute[72362]:     <apic/>
Aug 09 10:21:32 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:21:32 user nova-compute[72362]:   </features>
Aug 09 10:21:32 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:21:32 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:21:32 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:21:32 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:21:32 user nova-compute[72362]:   </clock>
Aug 09 10:21:32 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:21:32 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:21:32 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:21:32 user nova-compute[72362]:   </cpu>
Aug 09 10:21:32 user nova-compute[72362]:   <devices>
Aug 09 10:21:32 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:21:32 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:21:32 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk"/>
Aug 09 10:21:32 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:21:32 user nova-compute[72362]:     </disk>
Aug 09 10:21:32 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:21:32 user nova-compute[72362]:       <mac address="fa:16:3e:6e:b0:73"/>
Aug 09 10:21:32 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:21:32 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:21:32 user nova-compute[72362]:       <target dev="tap8c0230bc-c7"/>
Aug 09 10:21:32 user nova-compute[72362]:     </interface>
Aug 09 10:21:32 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:21:32 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/console.log" append="off"/>
Aug 09 10:21:32 user nova-compute[72362]:     </serial>
Aug 09 10:21:32 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:21:32 user nova-compute[72362]:     <video>
Aug 09 10:21:32 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:21:32 user nova-compute[72362]:     </video>
Aug 09 10:21:32 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:21:32 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:21:32 user nova-compute[72362]:     </rng>
Aug 09 10:21:32 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:21:32 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:21:32 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:21:32 user nova-compute[72362]:     </memballoon>
Aug 09 10:21:32 user nova-compute[72362]:   </devices>
Aug 09 10:21:32 user nova-compute[72362]: </domain>
Aug 09 10:21:32 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:21:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1940264170',display_name='tempest-AttachVolumeTestJSON-server-1940264170',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1940264170',id=19,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuD55hFJGS6ztpZ3pMNhoMVTtkOPfZJVd+6jLMFkU6lpGS3ntRkyZ61ihETUV7/q4X01P1baNsnIzL7TV/XH9281YGmZSyK/sCWwApv9GpxS0U8aCjbpuFwgIK7/Y1Z9Q==',key_name='tempest-keypair-208455084',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9dac04663e2f45378cc0e466740342d2',ramdisk_id='',reservation_id='r-i0cbsd0z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-986857971',owner_user_name='tempest-AttachVolumeTestJSON-986857971-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:21:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec007d0aa3c144f5a24a4913cc336ebb',uuid=a6000393-6044-4b54-ac0b-1d631e2ed0ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "address": "fa:16:3e:6e:b0:73", "network": {"id": "7358b925-3211-4419-84eb-df6967f5ea8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1360753488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dac04663e2f45378cc0e466740342d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c0230bc-c7", "ovs_interfaceid": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Converting VIF {"id": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "address": "fa:16:3e:6e:b0:73", "network": {"id": "7358b925-3211-4419-84eb-df6967f5ea8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1360753488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dac04663e2f45378cc0e466740342d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c0230bc-c7", "ovs_interfaceid": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:b0:73,bridge_name='br-int',has_traffic_filtering=True,id=8c0230bc-c7a7-4497-af9a-2fafb259605c,network=Network(7358b925-3211-4419-84eb-df6967f5ea8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c0230bc-c7') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG os_vif [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:b0:73,bridge_name='br-int',has_traffic_filtering=True,id=8c0230bc-c7a7-4497-af9a-2fafb259605c,network=Network(7358b925-3211-4419-84eb-df6967f5ea8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c0230bc-c7') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c0230bc-c7, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8c0230bc-c7, col_values=(('external_ids', {'iface-id': '8c0230bc-c7a7-4497-af9a-2fafb259605c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:b0:73', 'vm-uuid': 'a6000393-6044-4b54-ac0b-1d631e2ed0ae'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:32 user nova-compute[72362]: INFO os_vif [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:b0:73,bridge_name='br-int',has_traffic_filtering=True,id=8c0230bc-c7a7-4497-af9a-2fafb259605c,network=Network(7358b925-3211-4419-84eb-df6967f5ea8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c0230bc-c7')
Aug 09 10:21:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] No VIF found with MAC fa:16:3e:6e:b0:73, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG nova.compute.manager [req-88da969e-2604-48a4-9bf1-61c4a9939e7a req-12bffe01-d310-4cd7-b039-cdc734ae74a8 service nova] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Received event network-vif-plugged-c6f3f94c-4160-4103-8784-d86042b30f45 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-88da969e-2604-48a4-9bf1-61c4a9939e7a req-12bffe01-d310-4cd7-b039-cdc734ae74a8 service nova] Acquiring lock "d5b048c8-a329-4fe3-ab62-a06ab6401230-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-88da969e-2604-48a4-9bf1-61c4a9939e7a req-12bffe01-d310-4cd7-b039-cdc734ae74a8 service nova] Lock "d5b048c8-a329-4fe3-ab62-a06ab6401230-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-88da969e-2604-48a4-9bf1-61c4a9939e7a req-12bffe01-d310-4cd7-b039-cdc734ae74a8 service nova] Lock "d5b048c8-a329-4fe3-ab62-a06ab6401230-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG nova.compute.manager [req-88da969e-2604-48a4-9bf1-61c4a9939e7a req-12bffe01-d310-4cd7-b039-cdc734ae74a8 service nova] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] No waiting events found dispatching network-vif-plugged-c6f3f94c-4160-4103-8784-d86042b30f45 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:21:32 user nova-compute[72362]: WARNING nova.compute.manager [req-88da969e-2604-48a4-9bf1-61c4a9939e7a req-12bffe01-d310-4cd7-b039-cdc734ae74a8 service nova] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Received unexpected event network-vif-plugged-c6f3f94c-4160-4103-8784-d86042b30f45 for instance with vm_state active and task_state deleting.
Aug 09 10:21:32 user nova-compute[72362]: DEBUG nova.compute.manager [req-88da969e-2604-48a4-9bf1-61c4a9939e7a req-12bffe01-d310-4cd7-b039-cdc734ae74a8 service nova] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Received event network-vif-plugged-a10771ea-ee0f-4376-88cc-97dd0eb98d8d {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-88da969e-2604-48a4-9bf1-61c4a9939e7a req-12bffe01-d310-4cd7-b039-cdc734ae74a8 service nova] Acquiring lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-88da969e-2604-48a4-9bf1-61c4a9939e7a req-12bffe01-d310-4cd7-b039-cdc734ae74a8 service nova] Lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-88da969e-2604-48a4-9bf1-61c4a9939e7a req-12bffe01-d310-4cd7-b039-cdc734ae74a8 service nova] Lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG nova.compute.manager [req-88da969e-2604-48a4-9bf1-61c4a9939e7a req-12bffe01-d310-4cd7-b039-cdc734ae74a8 service nova] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] No waiting events found dispatching network-vif-plugged-a10771ea-ee0f-4376-88cc-97dd0eb98d8d {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:21:32 user nova-compute[72362]: WARNING nova.compute.manager [req-88da969e-2604-48a4-9bf1-61c4a9939e7a req-12bffe01-d310-4cd7-b039-cdc734ae74a8 service nova] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Received unexpected event network-vif-plugged-a10771ea-ee0f-4376-88cc-97dd0eb98d8d for instance with vm_state building and task_state spawning.
Aug 09 10:21:32 user nova-compute[72362]: DEBUG nova.compute.manager [req-88da969e-2604-48a4-9bf1-61c4a9939e7a req-12bffe01-d310-4cd7-b039-cdc734ae74a8 service nova] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Received event network-vif-plugged-a10771ea-ee0f-4376-88cc-97dd0eb98d8d {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-88da969e-2604-48a4-9bf1-61c4a9939e7a req-12bffe01-d310-4cd7-b039-cdc734ae74a8 service nova] Acquiring lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-88da969e-2604-48a4-9bf1-61c4a9939e7a req-12bffe01-d310-4cd7-b039-cdc734ae74a8 service nova] Lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-88da969e-2604-48a4-9bf1-61c4a9939e7a req-12bffe01-d310-4cd7-b039-cdc734ae74a8 service nova] Lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG nova.compute.manager [req-88da969e-2604-48a4-9bf1-61c4a9939e7a req-12bffe01-d310-4cd7-b039-cdc734ae74a8 service nova] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] No waiting events found dispatching network-vif-plugged-a10771ea-ee0f-4376-88cc-97dd0eb98d8d {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:21:32 user nova-compute[72362]: WARNING nova.compute.manager [req-88da969e-2604-48a4-9bf1-61c4a9939e7a req-12bffe01-d310-4cd7-b039-cdc734ae74a8 service nova] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Received unexpected event network-vif-plugged-a10771ea-ee0f-4376-88cc-97dd0eb98d8d for instance with vm_state building and task_state spawning.
Aug 09 10:21:32 user nova-compute[72362]: DEBUG nova.compute.manager [req-88da969e-2604-48a4-9bf1-61c4a9939e7a req-12bffe01-d310-4cd7-b039-cdc734ae74a8 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received event network-vif-plugged-5fd897a8-78c2-49be-b1d6-867bab82082d {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-88da969e-2604-48a4-9bf1-61c4a9939e7a req-12bffe01-d310-4cd7-b039-cdc734ae74a8 service nova] Acquiring lock "09a20950-bce9-4c83-82db-e058872ae358-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-88da969e-2604-48a4-9bf1-61c4a9939e7a req-12bffe01-d310-4cd7-b039-cdc734ae74a8 service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-88da969e-2604-48a4-9bf1-61c4a9939e7a req-12bffe01-d310-4cd7-b039-cdc734ae74a8 service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG nova.compute.manager [req-88da969e-2604-48a4-9bf1-61c4a9939e7a req-12bffe01-d310-4cd7-b039-cdc734ae74a8 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] No waiting events found dispatching network-vif-plugged-5fd897a8-78c2-49be-b1d6-867bab82082d {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:21:32 user nova-compute[72362]: WARNING nova.compute.manager [req-88da969e-2604-48a4-9bf1-61c4a9939e7a req-12bffe01-d310-4cd7-b039-cdc734ae74a8 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received unexpected event network-vif-plugged-5fd897a8-78c2-49be-b1d6-867bab82082d for instance with vm_state building and task_state spawning.
Aug 09 10:21:32 user nova-compute[72362]: DEBUG nova.compute.manager [req-88da969e-2604-48a4-9bf1-61c4a9939e7a req-12bffe01-d310-4cd7-b039-cdc734ae74a8 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received event network-vif-plugged-5fd897a8-78c2-49be-b1d6-867bab82082d {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-88da969e-2604-48a4-9bf1-61c4a9939e7a req-12bffe01-d310-4cd7-b039-cdc734ae74a8 service nova] Acquiring lock "09a20950-bce9-4c83-82db-e058872ae358-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-88da969e-2604-48a4-9bf1-61c4a9939e7a req-12bffe01-d310-4cd7-b039-cdc734ae74a8 service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-88da969e-2604-48a4-9bf1-61c4a9939e7a req-12bffe01-d310-4cd7-b039-cdc734ae74a8 service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG nova.compute.manager [req-88da969e-2604-48a4-9bf1-61c4a9939e7a req-12bffe01-d310-4cd7-b039-cdc734ae74a8 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] No waiting events found dispatching network-vif-plugged-5fd897a8-78c2-49be-b1d6-867bab82082d {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:21:32 user nova-compute[72362]: WARNING nova.compute.manager [req-88da969e-2604-48a4-9bf1-61c4a9939e7a req-12bffe01-d310-4cd7-b039-cdc734ae74a8 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received unexpected event network-vif-plugged-5fd897a8-78c2-49be-b1d6-867bab82082d for instance with vm_state building and task_state spawning.
Aug 09 10:21:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:32 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Instance destroyed successfully.
Aug 09 10:21:32 user nova-compute[72362]: DEBUG nova.objects.instance [None req-c478f3f1-9eeb-483c-875f-c2af164a560d tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Lazy-loading 'resources' on Instance uuid d5b048c8-a329-4fe3-ab62-a06ab6401230 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-c478f3f1-9eeb-483c-875f-c2af164a560d tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:19:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1624554120',display_name='tempest-VolumesActionsTest-instance-1624554120',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1624554120',id=14,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:19:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0bb89934454244f5a3438b5a8a74926a',ramdisk_id='',reservation_id='r-lu4c6f1e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-2128587251',owner_user_name='tempest-VolumesActionsTest-2128587251-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:19:47Z,user_data=None,user_id='fcbf88df1bf143c1b46cbf8d8ca879e4',uuid=d5b048c8-a329-4fe3-ab62-a06ab6401230,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c6f3f94c-4160-4103-8784-d86042b30f45", "address": "fa:16:3e:b6:ef:e1", "network": {"id": "65e9155d-dde9-47bb-aa24-e6331f2dc71e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1221293796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bb89934454244f5a3438b5a8a74926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f3f94c-41", "ovs_interfaceid": "c6f3f94c-4160-4103-8784-d86042b30f45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-c478f3f1-9eeb-483c-875f-c2af164a560d tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Converting VIF {"id": "c6f3f94c-4160-4103-8784-d86042b30f45", "address": "fa:16:3e:b6:ef:e1", "network": {"id": "65e9155d-dde9-47bb-aa24-e6331f2dc71e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1221293796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bb89934454244f5a3438b5a8a74926a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f3f94c-41", "ovs_interfaceid": "c6f3f94c-4160-4103-8784-d86042b30f45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-c478f3f1-9eeb-483c-875f-c2af164a560d tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:ef:e1,bridge_name='br-int',has_traffic_filtering=True,id=c6f3f94c-4160-4103-8784-d86042b30f45,network=Network(65e9155d-dde9-47bb-aa24-e6331f2dc71e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6f3f94c-41') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG os_vif [None req-c478f3f1-9eeb-483c-875f-c2af164a560d tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:ef:e1,bridge_name='br-int',has_traffic_filtering=True,id=c6f3f94c-4160-4103-8784-d86042b30f45,network=Network(65e9155d-dde9-47bb-aa24-e6331f2dc71e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6f3f94c-41') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG nova.network.neutron [req-e1139065-0e91-447c-aa36-962822cd69e0 req-0806aca4-3e21-4fbe-b25d-3fc2ed05468c service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Updated VIF entry in instance network info cache for port 8c0230bc-c7a7-4497-af9a-2fafb259605c. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG nova.network.neutron [req-e1139065-0e91-447c-aa36-962822cd69e0 req-0806aca4-3e21-4fbe-b25d-3fc2ed05468c service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Updating instance_info_cache with network_info: [{"id": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "address": "fa:16:3e:6e:b0:73", "network": {"id": "7358b925-3211-4419-84eb-df6967f5ea8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1360753488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dac04663e2f45378cc0e466740342d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c0230bc-c7", "ovs_interfaceid": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc6f3f94c-41, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:21:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e1139065-0e91-447c-aa36-962822cd69e0 req-0806aca4-3e21-4fbe-b25d-3fc2ed05468c service nova] Releasing lock "refresh_cache-a6000393-6044-4b54-ac0b-1d631e2ed0ae" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:21:33 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:33 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:33 user nova-compute[72362]: INFO os_vif [None req-c478f3f1-9eeb-483c-875f-c2af164a560d tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:ef:e1,bridge_name='br-int',has_traffic_filtering=True,id=c6f3f94c-4160-4103-8784-d86042b30f45,network=Network(65e9155d-dde9-47bb-aa24-e6331f2dc71e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6f3f94c-41')
Aug 09 10:21:33 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-c478f3f1-9eeb-483c-875f-c2af164a560d tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Deleting instance files /opt/stack/data/nova/instances/d5b048c8-a329-4fe3-ab62-a06ab6401230_del
Aug 09 10:21:33 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-c478f3f1-9eeb-483c-875f-c2af164a560d tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Deletion of /opt/stack/data/nova/instances/d5b048c8-a329-4fe3-ab62-a06ab6401230_del complete
Aug 09 10:21:33 user nova-compute[72362]: INFO nova.compute.manager [None req-c478f3f1-9eeb-483c-875f-c2af164a560d tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Took 3.01 seconds to destroy the instance on the hypervisor.
Aug 09 10:21:33 user nova-compute[72362]: DEBUG oslo.service.loopingcall [None req-c478f3f1-9eeb-483c-875f-c2af164a560d tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72362) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 10:21:33 user nova-compute[72362]: DEBUG nova.compute.manager [-] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Deallocating network for instance {{(pid=72362) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 10:21:33 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] deallocate_for_instance() {{(pid=72362) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 10:21:33 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:33 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:33 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:33 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:33 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:33 user nova-compute[72362]: DEBUG nova.compute.manager [req-5dd37202-0f60-4d35-8644-2bcc44f782b3 req-fe852d97-ae57-4f0b-bae4-b4c4a026b7cf service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received event network-vif-plugged-f1457dd7-06e1-43ac-a55d-3f4f9fe150f8 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:21:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-5dd37202-0f60-4d35-8644-2bcc44f782b3 req-fe852d97-ae57-4f0b-bae4-b4c4a026b7cf service nova] Acquiring lock "09a20950-bce9-4c83-82db-e058872ae358-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:21:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-5dd37202-0f60-4d35-8644-2bcc44f782b3 req-fe852d97-ae57-4f0b-bae4-b4c4a026b7cf service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:21:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-5dd37202-0f60-4d35-8644-2bcc44f782b3 req-fe852d97-ae57-4f0b-bae4-b4c4a026b7cf service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:21:33 user nova-compute[72362]: DEBUG nova.compute.manager [req-5dd37202-0f60-4d35-8644-2bcc44f782b3 req-fe852d97-ae57-4f0b-bae4-b4c4a026b7cf service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] No waiting events found dispatching network-vif-plugged-f1457dd7-06e1-43ac-a55d-3f4f9fe150f8 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:21:33 user nova-compute[72362]: WARNING nova.compute.manager [req-5dd37202-0f60-4d35-8644-2bcc44f782b3 req-fe852d97-ae57-4f0b-bae4-b4c4a026b7cf service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received unexpected event network-vif-plugged-f1457dd7-06e1-43ac-a55d-3f4f9fe150f8 for instance with vm_state building and task_state spawning.
Aug 09 10:21:33 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:34 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:34 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:34 user nova-compute[72362]: DEBUG nova.compute.manager [req-97a505c5-417e-4c79-bac1-9015cd8f6cc8 req-9e0faaae-0c4d-4652-bd38-d69a915e64a4 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received event network-vif-plugged-32d1ff81-fed5-47fe-88ce-04bd2777f1e5 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:21:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-97a505c5-417e-4c79-bac1-9015cd8f6cc8 req-9e0faaae-0c4d-4652-bd38-d69a915e64a4 service nova] Acquiring lock "09a20950-bce9-4c83-82db-e058872ae358-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:21:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-97a505c5-417e-4c79-bac1-9015cd8f6cc8 req-9e0faaae-0c4d-4652-bd38-d69a915e64a4 service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:21:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-97a505c5-417e-4c79-bac1-9015cd8f6cc8 req-9e0faaae-0c4d-4652-bd38-d69a915e64a4 service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:21:34 user nova-compute[72362]: DEBUG nova.compute.manager [req-97a505c5-417e-4c79-bac1-9015cd8f6cc8 req-9e0faaae-0c4d-4652-bd38-d69a915e64a4 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] No waiting events found dispatching network-vif-plugged-32d1ff81-fed5-47fe-88ce-04bd2777f1e5 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:21:34 user nova-compute[72362]: WARNING nova.compute.manager [req-97a505c5-417e-4c79-bac1-9015cd8f6cc8 req-9e0faaae-0c4d-4652-bd38-d69a915e64a4 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received unexpected event network-vif-plugged-32d1ff81-fed5-47fe-88ce-04bd2777f1e5 for instance with vm_state building and task_state spawning.
Aug 09 10:21:34 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:34 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:34 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:34 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:34 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:34 user nova-compute[72362]: DEBUG nova.compute.manager [req-3fa20006-1937-4297-af4c-88100f9ca20e req-d41db1ac-3018-4343-b5dd-96f36b9b63cc service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received event network-vif-plugged-41551d54-2c78-4fbe-9b7a-43452c5e94da {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:21:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3fa20006-1937-4297-af4c-88100f9ca20e req-d41db1ac-3018-4343-b5dd-96f36b9b63cc service nova] Acquiring lock "09a20950-bce9-4c83-82db-e058872ae358-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:21:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3fa20006-1937-4297-af4c-88100f9ca20e req-d41db1ac-3018-4343-b5dd-96f36b9b63cc service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:21:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3fa20006-1937-4297-af4c-88100f9ca20e req-d41db1ac-3018-4343-b5dd-96f36b9b63cc service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:21:34 user nova-compute[72362]: DEBUG nova.compute.manager [req-3fa20006-1937-4297-af4c-88100f9ca20e req-d41db1ac-3018-4343-b5dd-96f36b9b63cc service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] No waiting events found dispatching network-vif-plugged-41551d54-2c78-4fbe-9b7a-43452c5e94da {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:21:34 user nova-compute[72362]: WARNING nova.compute.manager [req-3fa20006-1937-4297-af4c-88100f9ca20e req-d41db1ac-3018-4343-b5dd-96f36b9b63cc service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received unexpected event network-vif-plugged-41551d54-2c78-4fbe-9b7a-43452c5e94da for instance with vm_state building and task_state spawning.
Aug 09 10:21:35 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:21:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-082b6bd2-ee54-44fa-85fe-d06f7daaa78e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Acquiring lock "45316ca8-e866-4e2f-a92d-d1b256613dd1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:21:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-082b6bd2-ee54-44fa-85fe-d06f7daaa78e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Lock "45316ca8-e866-4e2f-a92d-d1b256613dd1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:21:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-082b6bd2-ee54-44fa-85fe-d06f7daaa78e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Acquiring lock "45316ca8-e866-4e2f-a92d-d1b256613dd1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:21:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-082b6bd2-ee54-44fa-85fe-d06f7daaa78e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Lock "45316ca8-e866-4e2f-a92d-d1b256613dd1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:21:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-082b6bd2-ee54-44fa-85fe-d06f7daaa78e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Lock "45316ca8-e866-4e2f-a92d-d1b256613dd1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:21:35 user nova-compute[72362]: INFO nova.compute.manager [None req-082b6bd2-ee54-44fa-85fe-d06f7daaa78e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Terminating instance
Aug 09 10:21:35 user nova-compute[72362]: DEBUG nova.compute.manager [None req-082b6bd2-ee54-44fa-85fe-d06f7daaa78e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Start destroying the instance on the hypervisor. {{(pid=72362) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 10:21:35 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Took 1.89 seconds to deallocate network for instance.
Aug 09 10:21:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c478f3f1-9eeb-483c-875f-c2af164a560d tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:21:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c478f3f1-9eeb-483c-875f-c2af164a560d tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:21:35 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:35 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:35 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:35 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:35 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:35 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:35 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:35 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-c478f3f1-9eeb-483c-875f-c2af164a560d tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:21:35 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:35 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-c478f3f1-9eeb-483c-875f-c2af164a560d tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:21:35 user nova-compute[72362]: DEBUG nova.compute.manager [req-37a538cf-9378-4c9e-8fad-7dd6497a5bf2 req-7dfb2fbb-740c-4027-acd5-643a433c9958 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received event network-vif-plugged-f1457dd7-06e1-43ac-a55d-3f4f9fe150f8 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:21:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-37a538cf-9378-4c9e-8fad-7dd6497a5bf2 req-7dfb2fbb-740c-4027-acd5-643a433c9958 service nova] Acquiring lock "09a20950-bce9-4c83-82db-e058872ae358-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:21:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-37a538cf-9378-4c9e-8fad-7dd6497a5bf2 req-7dfb2fbb-740c-4027-acd5-643a433c9958 service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:21:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-37a538cf-9378-4c9e-8fad-7dd6497a5bf2 req-7dfb2fbb-740c-4027-acd5-643a433c9958 service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:21:35 user nova-compute[72362]: DEBUG nova.compute.manager [req-37a538cf-9378-4c9e-8fad-7dd6497a5bf2 req-7dfb2fbb-740c-4027-acd5-643a433c9958 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] No waiting events found dispatching network-vif-plugged-f1457dd7-06e1-43ac-a55d-3f4f9fe150f8 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:21:35 user nova-compute[72362]: WARNING nova.compute.manager [req-37a538cf-9378-4c9e-8fad-7dd6497a5bf2 req-7dfb2fbb-740c-4027-acd5-643a433c9958 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received unexpected event network-vif-plugged-f1457dd7-06e1-43ac-a55d-3f4f9fe150f8 for instance with vm_state building and task_state spawning.
Aug 09 10:21:35 user nova-compute[72362]: DEBUG nova.compute.manager [req-37a538cf-9378-4c9e-8fad-7dd6497a5bf2 req-7dfb2fbb-740c-4027-acd5-643a433c9958 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received event network-vif-plugged-21baa9dd-a7b0-445e-be2e-ab8b953bae49 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:21:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-37a538cf-9378-4c9e-8fad-7dd6497a5bf2 req-7dfb2fbb-740c-4027-acd5-643a433c9958 service nova] Acquiring lock "09a20950-bce9-4c83-82db-e058872ae358-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:21:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-37a538cf-9378-4c9e-8fad-7dd6497a5bf2 req-7dfb2fbb-740c-4027-acd5-643a433c9958 service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:21:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-37a538cf-9378-4c9e-8fad-7dd6497a5bf2 req-7dfb2fbb-740c-4027-acd5-643a433c9958 service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:21:35 user nova-compute[72362]: DEBUG nova.compute.manager [req-37a538cf-9378-4c9e-8fad-7dd6497a5bf2 req-7dfb2fbb-740c-4027-acd5-643a433c9958 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] No waiting events found dispatching network-vif-plugged-21baa9dd-a7b0-445e-be2e-ab8b953bae49 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:21:35 user nova-compute[72362]: WARNING nova.compute.manager [req-37a538cf-9378-4c9e-8fad-7dd6497a5bf2 req-7dfb2fbb-740c-4027-acd5-643a433c9958 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received unexpected event network-vif-plugged-21baa9dd-a7b0-445e-be2e-ab8b953bae49 for instance with vm_state building and task_state spawning.
Aug 09 10:21:35 user nova-compute[72362]: DEBUG nova.compute.manager [req-37a538cf-9378-4c9e-8fad-7dd6497a5bf2 req-7dfb2fbb-740c-4027-acd5-643a433c9958 service nova] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Received event network-vif-deleted-c6f3f94c-4160-4103-8784-d86042b30f45 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:21:35 user nova-compute[72362]: DEBUG nova.compute.manager [req-37a538cf-9378-4c9e-8fad-7dd6497a5bf2 req-7dfb2fbb-740c-4027-acd5-643a433c9958 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received event network-vif-plugged-21baa9dd-a7b0-445e-be2e-ab8b953bae49 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:21:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-37a538cf-9378-4c9e-8fad-7dd6497a5bf2 req-7dfb2fbb-740c-4027-acd5-643a433c9958 service nova] Acquiring lock "09a20950-bce9-4c83-82db-e058872ae358-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:21:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-37a538cf-9378-4c9e-8fad-7dd6497a5bf2 req-7dfb2fbb-740c-4027-acd5-643a433c9958 service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:21:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-37a538cf-9378-4c9e-8fad-7dd6497a5bf2 req-7dfb2fbb-740c-4027-acd5-643a433c9958 service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:21:35 user nova-compute[72362]: DEBUG nova.compute.manager [req-37a538cf-9378-4c9e-8fad-7dd6497a5bf2 req-7dfb2fbb-740c-4027-acd5-643a433c9958 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] No waiting events found dispatching network-vif-plugged-21baa9dd-a7b0-445e-be2e-ab8b953bae49 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:21:35 user nova-compute[72362]: WARNING nova.compute.manager [req-37a538cf-9378-4c9e-8fad-7dd6497a5bf2 req-7dfb2fbb-740c-4027-acd5-643a433c9958 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received unexpected event network-vif-plugged-21baa9dd-a7b0-445e-be2e-ab8b953bae49 for instance with vm_state building and task_state spawning.
Aug 09 10:21:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c478f3f1-9eeb-483c-875f-c2af164a560d tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.653s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:21:35 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-c478f3f1-9eeb-483c-875f-c2af164a560d tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Deleted allocations for instance d5b048c8-a329-4fe3-ab62-a06ab6401230
Aug 09 10:21:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c478f3f1-9eeb-483c-875f-c2af164a560d tempest-VolumesActionsTest-2128587251 tempest-VolumesActionsTest-2128587251-project-member] Lock "d5b048c8-a329-4fe3-ab62-a06ab6401230" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.060s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:21:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:36 user nova-compute[72362]: DEBUG nova.compute.manager [req-2170209d-a7d1-466d-af51-4a5bb29ae4be req-f14e8bd7-9404-41ad-8e72-32dcf98d507b service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received event network-vif-plugged-32d1ff81-fed5-47fe-88ce-04bd2777f1e5 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:21:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-2170209d-a7d1-466d-af51-4a5bb29ae4be req-f14e8bd7-9404-41ad-8e72-32dcf98d507b service nova] Acquiring lock "09a20950-bce9-4c83-82db-e058872ae358-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:21:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-2170209d-a7d1-466d-af51-4a5bb29ae4be req-f14e8bd7-9404-41ad-8e72-32dcf98d507b service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:21:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-2170209d-a7d1-466d-af51-4a5bb29ae4be req-f14e8bd7-9404-41ad-8e72-32dcf98d507b service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:21:36 user nova-compute[72362]: DEBUG nova.compute.manager [req-2170209d-a7d1-466d-af51-4a5bb29ae4be req-f14e8bd7-9404-41ad-8e72-32dcf98d507b service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] No waiting events found dispatching network-vif-plugged-32d1ff81-fed5-47fe-88ce-04bd2777f1e5 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:21:36 user nova-compute[72362]: WARNING nova.compute.manager [req-2170209d-a7d1-466d-af51-4a5bb29ae4be req-f14e8bd7-9404-41ad-8e72-32dcf98d507b service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received unexpected event network-vif-plugged-32d1ff81-fed5-47fe-88ce-04bd2777f1e5 for instance with vm_state building and task_state spawning.
Aug 09 10:21:36 user nova-compute[72362]: DEBUG nova.compute.manager [req-2170209d-a7d1-466d-af51-4a5bb29ae4be req-f14e8bd7-9404-41ad-8e72-32dcf98d507b service nova] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Received event network-vif-unplugged-682ae965-7271-4f0d-819e-c01800656086 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:21:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-2170209d-a7d1-466d-af51-4a5bb29ae4be req-f14e8bd7-9404-41ad-8e72-32dcf98d507b service nova] Acquiring lock "45316ca8-e866-4e2f-a92d-d1b256613dd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:21:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-2170209d-a7d1-466d-af51-4a5bb29ae4be req-f14e8bd7-9404-41ad-8e72-32dcf98d507b service nova] Lock "45316ca8-e866-4e2f-a92d-d1b256613dd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:21:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-2170209d-a7d1-466d-af51-4a5bb29ae4be req-f14e8bd7-9404-41ad-8e72-32dcf98d507b service nova] Lock "45316ca8-e866-4e2f-a92d-d1b256613dd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:21:36 user nova-compute[72362]: DEBUG nova.compute.manager [req-2170209d-a7d1-466d-af51-4a5bb29ae4be req-f14e8bd7-9404-41ad-8e72-32dcf98d507b service nova] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] No waiting events found dispatching network-vif-unplugged-682ae965-7271-4f0d-819e-c01800656086 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:21:36 user nova-compute[72362]: DEBUG nova.compute.manager [req-2170209d-a7d1-466d-af51-4a5bb29ae4be req-f14e8bd7-9404-41ad-8e72-32dcf98d507b service nova] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Received event network-vif-unplugged-682ae965-7271-4f0d-819e-c01800656086 for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:21:36 user nova-compute[72362]: DEBUG nova.compute.manager [req-2170209d-a7d1-466d-af51-4a5bb29ae4be req-f14e8bd7-9404-41ad-8e72-32dcf98d507b service nova] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Received event network-vif-plugged-682ae965-7271-4f0d-819e-c01800656086 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:21:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-2170209d-a7d1-466d-af51-4a5bb29ae4be req-f14e8bd7-9404-41ad-8e72-32dcf98d507b service nova] Acquiring lock "45316ca8-e866-4e2f-a92d-d1b256613dd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:21:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-2170209d-a7d1-466d-af51-4a5bb29ae4be req-f14e8bd7-9404-41ad-8e72-32dcf98d507b service nova] Lock "45316ca8-e866-4e2f-a92d-d1b256613dd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:21:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-2170209d-a7d1-466d-af51-4a5bb29ae4be req-f14e8bd7-9404-41ad-8e72-32dcf98d507b service nova] Lock "45316ca8-e866-4e2f-a92d-d1b256613dd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:21:36 user nova-compute[72362]: DEBUG nova.compute.manager [req-2170209d-a7d1-466d-af51-4a5bb29ae4be req-f14e8bd7-9404-41ad-8e72-32dcf98d507b service nova] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] No waiting events found dispatching network-vif-plugged-682ae965-7271-4f0d-819e-c01800656086 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:21:36 user nova-compute[72362]: WARNING nova.compute.manager [req-2170209d-a7d1-466d-af51-4a5bb29ae4be req-f14e8bd7-9404-41ad-8e72-32dcf98d507b service nova] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Received unexpected event network-vif-plugged-682ae965-7271-4f0d-819e-c01800656086 for instance with vm_state active and task_state deleting.
Aug 09 10:21:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:36 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Instance destroyed successfully.
Aug 09 10:21:36 user nova-compute[72362]: DEBUG nova.objects.instance [None req-082b6bd2-ee54-44fa-85fe-d06f7daaa78e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Lazy-loading 'resources' on Instance uuid 45316ca8-e866-4e2f-a92d-d1b256613dd1 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:21:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-082b6bd2-ee54-44fa-85fe-d06f7daaa78e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:19:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-694801406',display_name='tempest-VolumesAdminNegativeTest-server-694801406',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-694801406',id=13,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:19:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b2e7ca3484c64611b9573ba0b86592b5',ramdisk_id='',reservation_id='r-rbtna33a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-240994046',owner_user_name='tempest-VolumesAdminNegativeTest-240994046-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:19:41Z,user_data=None,user_id='c6220335c74b4c78a0d1a86efc98ebcb',uuid=45316ca8-e866-4e2f-a92d-d1b256613dd1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "682ae965-7271-4f0d-819e-c01800656086", "address": "fa:16:3e:a4:a7:54", "network": {"id": "c32d66f0-0db4-4c6b-a45d-8c1eb6f4b510", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-858657617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2e7ca3484c64611b9573ba0b86592b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap682ae965-72", "ovs_interfaceid": "682ae965-7271-4f0d-819e-c01800656086", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:21:36 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-082b6bd2-ee54-44fa-85fe-d06f7daaa78e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Converting VIF {"id": "682ae965-7271-4f0d-819e-c01800656086", "address": "fa:16:3e:a4:a7:54", "network": {"id": "c32d66f0-0db4-4c6b-a45d-8c1eb6f4b510", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-858657617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2e7ca3484c64611b9573ba0b86592b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap682ae965-72", "ovs_interfaceid": "682ae965-7271-4f0d-819e-c01800656086", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:21:36 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-082b6bd2-ee54-44fa-85fe-d06f7daaa78e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:a7:54,bridge_name='br-int',has_traffic_filtering=True,id=682ae965-7271-4f0d-819e-c01800656086,network=Network(c32d66f0-0db4-4c6b-a45d-8c1eb6f4b510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap682ae965-72') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:21:36 user nova-compute[72362]: DEBUG os_vif [None req-082b6bd2-ee54-44fa-85fe-d06f7daaa78e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:a7:54,bridge_name='br-int',has_traffic_filtering=True,id=682ae965-7271-4f0d-819e-c01800656086,network=Network(c32d66f0-0db4-4c6b-a45d-8c1eb6f4b510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap682ae965-72') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:21:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap682ae965-72, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:21:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:36 user nova-compute[72362]: INFO os_vif [None req-082b6bd2-ee54-44fa-85fe-d06f7daaa78e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:a7:54,bridge_name='br-int',has_traffic_filtering=True,id=682ae965-7271-4f0d-819e-c01800656086,network=Network(c32d66f0-0db4-4c6b-a45d-8c1eb6f4b510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap682ae965-72')
Aug 09 10:21:36 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-082b6bd2-ee54-44fa-85fe-d06f7daaa78e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Deleting instance files /opt/stack/data/nova/instances/45316ca8-e866-4e2f-a92d-d1b256613dd1_del
Aug 09 10:21:36 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-082b6bd2-ee54-44fa-85fe-d06f7daaa78e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Deletion of /opt/stack/data/nova/instances/45316ca8-e866-4e2f-a92d-d1b256613dd1_del complete
Aug 09 10:21:36 user nova-compute[72362]: INFO nova.compute.manager [None req-082b6bd2-ee54-44fa-85fe-d06f7daaa78e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Took 1.86 seconds to destroy the instance on the hypervisor.
Aug 09 10:21:36 user nova-compute[72362]: DEBUG oslo.service.loopingcall [None req-082b6bd2-ee54-44fa-85fe-d06f7daaa78e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72362) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 10:21:36 user nova-compute[72362]: DEBUG nova.compute.manager [-] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Deallocating network for instance {{(pid=72362) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 10:21:36 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] deallocate_for_instance() {{(pid=72362) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 10:21:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:37 user nova-compute[72362]: DEBUG nova.compute.manager [req-8e454ac8-043f-44fd-8087-51cdfd7c7f92 req-1c8290a9-d18e-4863-991d-717aefaf305b service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received event network-vif-plugged-41551d54-2c78-4fbe-9b7a-43452c5e94da {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:21:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8e454ac8-043f-44fd-8087-51cdfd7c7f92 req-1c8290a9-d18e-4863-991d-717aefaf305b service nova] Acquiring lock "09a20950-bce9-4c83-82db-e058872ae358-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:21:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8e454ac8-043f-44fd-8087-51cdfd7c7f92 req-1c8290a9-d18e-4863-991d-717aefaf305b service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:21:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8e454ac8-043f-44fd-8087-51cdfd7c7f92 req-1c8290a9-d18e-4863-991d-717aefaf305b service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:21:37 user nova-compute[72362]: DEBUG nova.compute.manager [req-8e454ac8-043f-44fd-8087-51cdfd7c7f92 req-1c8290a9-d18e-4863-991d-717aefaf305b service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] No waiting events found dispatching network-vif-plugged-41551d54-2c78-4fbe-9b7a-43452c5e94da {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:21:37 user nova-compute[72362]: WARNING nova.compute.manager [req-8e454ac8-043f-44fd-8087-51cdfd7c7f92 req-1c8290a9-d18e-4863-991d-717aefaf305b service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received unexpected event network-vif-plugged-41551d54-2c78-4fbe-9b7a-43452c5e94da for instance with vm_state building and task_state spawning.
Aug 09 10:21:37 user nova-compute[72362]: DEBUG nova.compute.manager [req-8e454ac8-043f-44fd-8087-51cdfd7c7f92 req-1c8290a9-d18e-4863-991d-717aefaf305b service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received event network-vif-plugged-cb0c5adb-40d5-4fb6-b458-35a85c670333 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:21:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8e454ac8-043f-44fd-8087-51cdfd7c7f92 req-1c8290a9-d18e-4863-991d-717aefaf305b service nova] Acquiring lock "09a20950-bce9-4c83-82db-e058872ae358-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:21:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8e454ac8-043f-44fd-8087-51cdfd7c7f92 req-1c8290a9-d18e-4863-991d-717aefaf305b service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:21:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8e454ac8-043f-44fd-8087-51cdfd7c7f92 req-1c8290a9-d18e-4863-991d-717aefaf305b service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:21:37 user nova-compute[72362]: DEBUG nova.compute.manager [req-8e454ac8-043f-44fd-8087-51cdfd7c7f92 req-1c8290a9-d18e-4863-991d-717aefaf305b service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] No waiting events found dispatching network-vif-plugged-cb0c5adb-40d5-4fb6-b458-35a85c670333 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:21:37 user nova-compute[72362]: WARNING nova.compute.manager [req-8e454ac8-043f-44fd-8087-51cdfd7c7f92 req-1c8290a9-d18e-4863-991d-717aefaf305b service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received unexpected event network-vif-plugged-cb0c5adb-40d5-4fb6-b458-35a85c670333 for instance with vm_state building and task_state spawning.
Aug 09 10:21:37 user nova-compute[72362]: DEBUG nova.compute.manager [req-8e454ac8-043f-44fd-8087-51cdfd7c7f92 req-1c8290a9-d18e-4863-991d-717aefaf305b service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received event network-vif-plugged-cb0c5adb-40d5-4fb6-b458-35a85c670333 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:21:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8e454ac8-043f-44fd-8087-51cdfd7c7f92 req-1c8290a9-d18e-4863-991d-717aefaf305b service nova] Acquiring lock "09a20950-bce9-4c83-82db-e058872ae358-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:21:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8e454ac8-043f-44fd-8087-51cdfd7c7f92 req-1c8290a9-d18e-4863-991d-717aefaf305b service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:21:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8e454ac8-043f-44fd-8087-51cdfd7c7f92 req-1c8290a9-d18e-4863-991d-717aefaf305b service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:21:37 user nova-compute[72362]: DEBUG nova.compute.manager [req-8e454ac8-043f-44fd-8087-51cdfd7c7f92 req-1c8290a9-d18e-4863-991d-717aefaf305b service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] No waiting events found dispatching network-vif-plugged-cb0c5adb-40d5-4fb6-b458-35a85c670333 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:21:37 user nova-compute[72362]: WARNING nova.compute.manager [req-8e454ac8-043f-44fd-8087-51cdfd7c7f92 req-1c8290a9-d18e-4863-991d-717aefaf305b service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received unexpected event network-vif-plugged-cb0c5adb-40d5-4fb6-b458-35a85c670333 for instance with vm_state building and task_state spawning.
Aug 09 10:21:37 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576497.5625656, 4746beb1-d313-4cea-bf7b-75b507ebbdd2 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:21:37 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] VM Resumed (Lifecycle Event)
Aug 09 10:21:37 user nova-compute[72362]: DEBUG nova.compute.manager [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:21:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:21:37 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Instance spawned successfully.
Aug 09 10:21:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 10:21:37 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:21:37 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:21:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Found default for hw_cdrom_bus of ide {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:21:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Found default for hw_disk_bus of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:21:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:21:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:21:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Found default for hw_video_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:21:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Found default for hw_vif_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:21:37 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:21:37 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576497.5726538, 4746beb1-d313-4cea-bf7b-75b507ebbdd2 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:21:37 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] VM Started (Lifecycle Event)
Aug 09 10:21:37 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:21:37 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:21:37 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:21:37 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:21:37 user nova-compute[72362]: INFO nova.compute.manager [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Took 13.31 seconds to spawn the instance on the hypervisor.
Aug 09 10:21:37 user nova-compute[72362]: DEBUG nova.compute.manager [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:21:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:37 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Took 0.89 seconds to deallocate network for instance.
Aug 09 10:21:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:37 user nova-compute[72362]: DEBUG nova.compute.manager [req-af2f2e7d-960f-4c27-ac9a-83c01df1a2d9 req-59c4a3f8-2e21-482f-a6cf-efb243719672 service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Received event network-vif-plugged-8c0230bc-c7a7-4497-af9a-2fafb259605c {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:21:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-af2f2e7d-960f-4c27-ac9a-83c01df1a2d9 req-59c4a3f8-2e21-482f-a6cf-efb243719672 service nova] Acquiring lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:21:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-af2f2e7d-960f-4c27-ac9a-83c01df1a2d9 req-59c4a3f8-2e21-482f-a6cf-efb243719672 service nova] Lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:21:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-af2f2e7d-960f-4c27-ac9a-83c01df1a2d9 req-59c4a3f8-2e21-482f-a6cf-efb243719672 service nova] Lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:21:37 user nova-compute[72362]: DEBUG nova.compute.manager [req-af2f2e7d-960f-4c27-ac9a-83c01df1a2d9 req-59c4a3f8-2e21-482f-a6cf-efb243719672 service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] No waiting events found dispatching network-vif-plugged-8c0230bc-c7a7-4497-af9a-2fafb259605c {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:21:37 user nova-compute[72362]: WARNING nova.compute.manager [req-af2f2e7d-960f-4c27-ac9a-83c01df1a2d9 req-59c4a3f8-2e21-482f-a6cf-efb243719672 service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Received unexpected event network-vif-plugged-8c0230bc-c7a7-4497-af9a-2fafb259605c for instance with vm_state building and task_state spawning.
Aug 09 10:21:37 user nova-compute[72362]: DEBUG nova.compute.manager [req-af2f2e7d-960f-4c27-ac9a-83c01df1a2d9 req-59c4a3f8-2e21-482f-a6cf-efb243719672 service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Received event network-vif-plugged-8c0230bc-c7a7-4497-af9a-2fafb259605c {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:21:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-af2f2e7d-960f-4c27-ac9a-83c01df1a2d9 req-59c4a3f8-2e21-482f-a6cf-efb243719672 service nova] Acquiring lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:21:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-af2f2e7d-960f-4c27-ac9a-83c01df1a2d9 req-59c4a3f8-2e21-482f-a6cf-efb243719672 service nova] Lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:21:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-af2f2e7d-960f-4c27-ac9a-83c01df1a2d9 req-59c4a3f8-2e21-482f-a6cf-efb243719672 service nova] Lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:21:37 user nova-compute[72362]: DEBUG nova.compute.manager [req-af2f2e7d-960f-4c27-ac9a-83c01df1a2d9 req-59c4a3f8-2e21-482f-a6cf-efb243719672 service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] No waiting events found dispatching network-vif-plugged-8c0230bc-c7a7-4497-af9a-2fafb259605c {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:21:37 user nova-compute[72362]: WARNING nova.compute.manager [req-af2f2e7d-960f-4c27-ac9a-83c01df1a2d9 req-59c4a3f8-2e21-482f-a6cf-efb243719672 service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Received unexpected event network-vif-plugged-8c0230bc-c7a7-4497-af9a-2fafb259605c for instance with vm_state building and task_state spawning.
Aug 09 10:21:37 user nova-compute[72362]: DEBUG nova.compute.manager [req-af2f2e7d-960f-4c27-ac9a-83c01df1a2d9 req-59c4a3f8-2e21-482f-a6cf-efb243719672 service nova] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Received event network-vif-deleted-682ae965-7271-4f0d-819e-c01800656086 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:21:37 user nova-compute[72362]: INFO nova.compute.manager [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Took 14.39 seconds to build instance.
Aug 09 10:21:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-082b6bd2-ee54-44fa-85fe-d06f7daaa78e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:21:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-082b6bd2-ee54-44fa-85fe-d06f7daaa78e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:21:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-88a29fcc-8db8-49d6-af2b-afe61affa792 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.490s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:21:38 user nova-compute[72362]: DEBUG nova.compute.manager [req-4747a1c4-aa4a-4c14-8faa-4274c694e32b req-29d87158-4ffb-4f39-a21e-c993389b26af service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received event network-vif-plugged-de067d87-6780-4c38-bf69-7d976cbde30a {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:21:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-4747a1c4-aa4a-4c14-8faa-4274c694e32b req-29d87158-4ffb-4f39-a21e-c993389b26af service nova] Acquiring lock "09a20950-bce9-4c83-82db-e058872ae358-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:21:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-4747a1c4-aa4a-4c14-8faa-4274c694e32b req-29d87158-4ffb-4f39-a21e-c993389b26af service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:21:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-4747a1c4-aa4a-4c14-8faa-4274c694e32b req-29d87158-4ffb-4f39-a21e-c993389b26af service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:21:38 user nova-compute[72362]: DEBUG nova.compute.manager [req-4747a1c4-aa4a-4c14-8faa-4274c694e32b req-29d87158-4ffb-4f39-a21e-c993389b26af service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] No waiting events found dispatching network-vif-plugged-de067d87-6780-4c38-bf69-7d976cbde30a {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:21:38 user nova-compute[72362]: WARNING nova.compute.manager [req-4747a1c4-aa4a-4c14-8faa-4274c694e32b req-29d87158-4ffb-4f39-a21e-c993389b26af service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received unexpected event network-vif-plugged-de067d87-6780-4c38-bf69-7d976cbde30a for instance with vm_state building and task_state spawning.
Aug 09 10:21:38 user nova-compute[72362]: DEBUG nova.compute.manager [req-4747a1c4-aa4a-4c14-8faa-4274c694e32b req-29d87158-4ffb-4f39-a21e-c993389b26af service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received event network-vif-plugged-de067d87-6780-4c38-bf69-7d976cbde30a {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:21:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-4747a1c4-aa4a-4c14-8faa-4274c694e32b req-29d87158-4ffb-4f39-a21e-c993389b26af service nova] Acquiring lock "09a20950-bce9-4c83-82db-e058872ae358-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:21:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-4747a1c4-aa4a-4c14-8faa-4274c694e32b req-29d87158-4ffb-4f39-a21e-c993389b26af service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:21:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-4747a1c4-aa4a-4c14-8faa-4274c694e32b req-29d87158-4ffb-4f39-a21e-c993389b26af service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:21:38 user nova-compute[72362]: DEBUG nova.compute.manager [req-4747a1c4-aa4a-4c14-8faa-4274c694e32b req-29d87158-4ffb-4f39-a21e-c993389b26af service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] No waiting events found dispatching network-vif-plugged-de067d87-6780-4c38-bf69-7d976cbde30a {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:21:38 user nova-compute[72362]: WARNING nova.compute.manager [req-4747a1c4-aa4a-4c14-8faa-4274c694e32b req-29d87158-4ffb-4f39-a21e-c993389b26af service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received unexpected event network-vif-plugged-de067d87-6780-4c38-bf69-7d976cbde30a for instance with vm_state building and task_state spawning.
Aug 09 10:21:38 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-082b6bd2-ee54-44fa-85fe-d06f7daaa78e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:21:38 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-082b6bd2-ee54-44fa-85fe-d06f7daaa78e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:21:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-082b6bd2-ee54-44fa-85fe-d06f7daaa78e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.785s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:21:38 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-082b6bd2-ee54-44fa-85fe-d06f7daaa78e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Deleted allocations for instance 45316ca8-e866-4e2f-a92d-d1b256613dd1
Aug 09 10:21:39 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-082b6bd2-ee54-44fa-85fe-d06f7daaa78e tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Lock "45316ca8-e866-4e2f-a92d-d1b256613dd1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.952s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:21:39 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576499.8414187, a6000393-6044-4b54-ac0b-1d631e2ed0ae => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:21:39 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] VM Resumed (Lifecycle Event)
Aug 09 10:21:39 user nova-compute[72362]: DEBUG nova.compute.manager [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:21:39 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:21:39 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Instance spawned successfully.
Aug 09 10:21:39 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 10:21:39 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:21:39 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:21:39 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Found default for hw_cdrom_bus of ide {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:21:39 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Found default for hw_disk_bus of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:21:39 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:21:39 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:21:39 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Found default for hw_video_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:21:39 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Found default for hw_vif_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:21:39 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:21:39 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576499.8426442, a6000393-6044-4b54-ac0b-1d631e2ed0ae => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:21:39 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] VM Started (Lifecycle Event)
Aug 09 10:21:39 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:21:39 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:21:39 user nova-compute[72362]: DEBUG nova.compute.manager [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:21:39 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:21:39 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Instance spawned successfully.
Aug 09 10:21:39 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 10:21:40 user nova-compute[72362]: INFO nova.compute.manager [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Took 10.58 seconds to spawn the instance on the hypervisor.
Aug 09 10:21:40 user nova-compute[72362]: DEBUG nova.compute.manager [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:21:40 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:21:40 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576499.9721253, 09a20950-bce9-4c83-82db-e058872ae358 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:21:40 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 09a20950-bce9-4c83-82db-e058872ae358] VM Resumed (Lifecycle Event)
Aug 09 10:21:40 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:21:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Found default for hw_cdrom_bus of ide {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:21:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Found default for hw_disk_bus of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:21:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:21:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:21:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Found default for hw_video_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:21:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Found default for hw_vif_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:21:40 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:21:40 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 09a20950-bce9-4c83-82db-e058872ae358] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:21:40 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576499.979824, 09a20950-bce9-4c83-82db-e058872ae358 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:21:40 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 09a20950-bce9-4c83-82db-e058872ae358] VM Started (Lifecycle Event)
Aug 09 10:21:40 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:21:40 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:21:40 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 09a20950-bce9-4c83-82db-e058872ae358] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:21:40 user nova-compute[72362]: INFO nova.compute.manager [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Took 17.74 seconds to spawn the instance on the hypervisor.
Aug 09 10:21:40 user nova-compute[72362]: DEBUG nova.compute.manager [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:21:40 user nova-compute[72362]: INFO nova.compute.manager [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Took 12.02 seconds to build instance.
Aug 09 10:21:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3b10afd5-1ed6-4477-83f0-e85bdf514c75 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.180s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:21:40 user nova-compute[72362]: INFO nova.compute.manager [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Took 49.85 seconds to build instance.
Aug 09 10:21:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-49a7d10a-6b20-4432-8568-812326f8bfd6 tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Lock "09a20950-bce9-4c83-82db-e058872ae358" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 49.960s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:21:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:45 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:45 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:21:45 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Cleaning up deleted instances {{(pid=72362) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 10:21:46 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] There are 0 instances to clean {{(pid=72362) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 10:21:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:47 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691576492.838303, d5b048c8-a329-4fe3-ab62-a06ab6401230 => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:21:47 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] VM Stopped (Lifecycle Event)
Aug 09 10:21:47 user nova-compute[72362]: DEBUG nova.compute.manager [None req-4bb8c2d5-aebe-468d-b5f6-56ed09e2b30a None None] [instance: d5b048c8-a329-4fe3-ab62-a06ab6401230] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:21:47 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:21:49 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:21:50 user nova-compute[72362]: DEBUG nova.network.neutron [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Port ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 binding to destination host user is already ACTIVE {{(pid=72362) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 09 10:21:50 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Acquiring lock "refresh_cache-0e8a7668-1635-4cbc-8c09-ece19ff67d4f" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:21:50 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Acquired lock "refresh_cache-0e8a7668-1635-4cbc-8c09-ece19ff67d4f" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:21:50 user nova-compute[72362]: DEBUG nova.network.neutron [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:21:50 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:51 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691576496.799915, 45316ca8-e866-4e2f-a92d-d1b256613dd1 => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:21:51 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] VM Stopped (Lifecycle Event)
Aug 09 10:21:51 user nova-compute[72362]: DEBUG nova.compute.manager [None req-27240f73-a27e-49bf-bb96-ddae46b6a6f6 None None] [instance: 45316ca8-e866-4e2f-a92d-d1b256613dd1] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:21:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:51 user nova-compute[72362]: DEBUG nova.network.neutron [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Updating instance_info_cache with network_info: [{"id": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "address": "fa:16:3e:16:b7:79", "network": {"id": "446f0622-648e-499f-bbb1-e4c0d89ab4df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-409995858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5438525a82b4ab08734e363ab1f80ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec7889ae-0c", "ovs_interfaceid": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:21:51 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Releasing lock "refresh_cache-0e8a7668-1635-4cbc-8c09-ece19ff67d4f" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:21:51 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Creating tmpfile /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/tmpwjing0lt to verify with other compute node that the instance is on the same shared storage. {{(pid=72362) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 09 10:21:52 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:52 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:52 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:52 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:52 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:52 user nova-compute[72362]: DEBUG nova.compute.manager [req-bc54b0b5-598d-4133-927b-a27557112f7c req-2027899f-c878-4d5b-a80b-bb8124d22543 service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Received event network-vif-unplugged-ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:21:52 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-bc54b0b5-598d-4133-927b-a27557112f7c req-2027899f-c878-4d5b-a80b-bb8124d22543 service nova] Acquiring lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:21:52 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-bc54b0b5-598d-4133-927b-a27557112f7c req-2027899f-c878-4d5b-a80b-bb8124d22543 service nova] Lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:21:52 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-bc54b0b5-598d-4133-927b-a27557112f7c req-2027899f-c878-4d5b-a80b-bb8124d22543 service nova] Lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:21:52 user nova-compute[72362]: DEBUG nova.compute.manager [req-bc54b0b5-598d-4133-927b-a27557112f7c req-2027899f-c878-4d5b-a80b-bb8124d22543 service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] No waiting events found dispatching network-vif-unplugged-ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:21:52 user nova-compute[72362]: WARNING nova.compute.manager [req-bc54b0b5-598d-4133-927b-a27557112f7c req-2027899f-c878-4d5b-a80b-bb8124d22543 service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Received unexpected event network-vif-unplugged-ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 for instance with vm_state resized and task_state resize_reverting.
Aug 09 10:21:52 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:52 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:52 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:52 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:52 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Instance destroyed successfully.
Aug 09 10:21:52 user nova-compute[72362]: DEBUG nova.objects.instance [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lazy-loading 'resources' on Instance uuid 0e8a7668-1635-4cbc-8c09-ece19ff67d4f {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:21:52 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:15:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-419570951',display_name='tempest-ServerActionsTestOtherB-server-419570951',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-419570951',id=2,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAlSzovB4mzuHqVxORdW0QCnCxzvtrYywTRh5RUAkSVJoqhjnBo5zwvIiDyhRaMXzyUvfprKRDpBxT96lz++BVUa0Y8Z7q5AuzttS0DGZzN7x8fIo5ox8C7rVw5EduEeQ==',key_name='tempest-keypair-2060096321',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:20:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5438525a82b4ab08734e363ab1f80ec',ramdisk_id='',reservation_id='r-gepn5vk7',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-767949360',owner_user_name='tempest-ServerActionsTestOtherB-767949360-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:20:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ffd407a36c74b8ea1bc88b98366876e',uuid=0e8a7668-1635-4cbc-8c09-ece19ff67d4f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "address": "fa:16:3e:16:b7:79", "network": {"id": "446f0622-648e-499f-bbb1-e4c0d89ab4df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-409995858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5438525a82b4ab08734e363ab1f80ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec7889ae-0c", "ovs_interfaceid": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:21:52 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Converting VIF {"id": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "address": "fa:16:3e:16:b7:79", "network": {"id": "446f0622-648e-499f-bbb1-e4c0d89ab4df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-409995858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5438525a82b4ab08734e363ab1f80ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec7889ae-0c", "ovs_interfaceid": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:21:52 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:b7:79,bridge_name='br-int',has_traffic_filtering=True,id=ec7889ae-0cbc-41e3-a750-a5cb2b522ce9,network=Network(446f0622-648e-499f-bbb1-e4c0d89ab4df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec7889ae-0c') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:21:52 user nova-compute[72362]: DEBUG os_vif [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:b7:79,bridge_name='br-int',has_traffic_filtering=True,id=ec7889ae-0cbc-41e3-a750-a5cb2b522ce9,network=Network(446f0622-648e-499f-bbb1-e4c0d89ab4df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec7889ae-0c') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:21:52 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:52 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec7889ae-0c, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:21:52 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:52 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:53 user nova-compute[72362]: INFO os_vif [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:b7:79,bridge_name='br-int',has_traffic_filtering=True,id=ec7889ae-0cbc-41e3-a750-a5cb2b522ce9,network=Network(446f0622-648e-499f-bbb1-e4c0d89ab4df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec7889ae-0c')
Aug 09 10:21:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MhmCwvOG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:21:53 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:21:53 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[51962995-a861-4a10-8220-f66104acc884]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.052s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3e1036-939f-4694-af2c-9a0c2ddb3234]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:21:53 user nova-compute[72362]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)
Aug 09 10:21:53 user nova-compute[72362]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 (non-flash)
Aug 09 10:21:53 user nova-compute[72362]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 (non-flash)
Aug 09 10:21:53 user nova-compute[72362]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 (non-flash)
Aug 09 10:21:53 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:21:53 user nova-compute[72362]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)
Aug 09 10:21:53 user nova-compute[72362]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 (non-flash)
Aug 09 10:21:53 user nova-compute[72362]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 (non-flash)
Aug 09 10:21:53 user nova-compute[72362]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 (non-flash)
Aug 09 10:21:53 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e42e1e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7'): ({'sdb'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Removing single pathed devices sdb {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.035s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d0b82e-9d45-4eff-bfe6-30b08d5ecbaa]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4fb2365-a5ab-4b39-8df6-3f48a405b49e]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Flushing IO for device /dev/sdb {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd0c21c-3bf2-454a-b9a4-dd4deb297d0e]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca854764-8315-431b-9b16-02c015b4f3c7]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] SCSI volumes sdb have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd870007-cb75-4c0f-9974-89ffe2c08458]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc342a84-5661-4884-8f78-ef6dfbbf1b15]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7, portal: 172.16.0.220,3260]
Aug 09 10:21:53 user nova-compute[72362]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7, portal: 172.16.0.220,3260] successful.
Aug 09 10:21:53 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08446ef-c6c6-498a-b956-3797f01031f0]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.406s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] <== disconnect_volume: return (408ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:21:53 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 10:21:54 user nova-compute[72362]: DEBUG nova.compute.manager [req-67efb32c-7ea3-4a77-91c1-7bf0a5e9dd20 req-6a8c0d7c-db55-4485-b6a6-ec53192bfb7f service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Received event network-vif-plugged-ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:21:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-67efb32c-7ea3-4a77-91c1-7bf0a5e9dd20 req-6a8c0d7c-db55-4485-b6a6-ec53192bfb7f service nova] Acquiring lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:21:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-67efb32c-7ea3-4a77-91c1-7bf0a5e9dd20 req-6a8c0d7c-db55-4485-b6a6-ec53192bfb7f service nova] Lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:21:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-67efb32c-7ea3-4a77-91c1-7bf0a5e9dd20 req-6a8c0d7c-db55-4485-b6a6-ec53192bfb7f service nova] Lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:21:54 user nova-compute[72362]: DEBUG nova.compute.manager [req-67efb32c-7ea3-4a77-91c1-7bf0a5e9dd20 req-6a8c0d7c-db55-4485-b6a6-ec53192bfb7f service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] No waiting events found dispatching network-vif-plugged-ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:21:54 user nova-compute[72362]: WARNING nova.compute.manager [req-67efb32c-7ea3-4a77-91c1-7bf0a5e9dd20 req-6a8c0d7c-db55-4485-b6a6-ec53192bfb7f service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Received unexpected event network-vif-plugged-ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 for instance with vm_state resized and task_state resize_reverting.
Aug 09 10:21:54 user nova-compute[72362]: DEBUG nova.compute.manager [req-67efb32c-7ea3-4a77-91c1-7bf0a5e9dd20 req-6a8c0d7c-db55-4485-b6a6-ec53192bfb7f service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Received event network-vif-plugged-ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:21:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-67efb32c-7ea3-4a77-91c1-7bf0a5e9dd20 req-6a8c0d7c-db55-4485-b6a6-ec53192bfb7f service nova] Acquiring lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:21:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-67efb32c-7ea3-4a77-91c1-7bf0a5e9dd20 req-6a8c0d7c-db55-4485-b6a6-ec53192bfb7f service nova] Lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:21:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-67efb32c-7ea3-4a77-91c1-7bf0a5e9dd20 req-6a8c0d7c-db55-4485-b6a6-ec53192bfb7f service nova] Lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:21:54 user nova-compute[72362]: DEBUG nova.compute.manager [req-67efb32c-7ea3-4a77-91c1-7bf0a5e9dd20 req-6a8c0d7c-db55-4485-b6a6-ec53192bfb7f service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] No waiting events found dispatching network-vif-plugged-ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:21:54 user nova-compute[72362]: WARNING nova.compute.manager [req-67efb32c-7ea3-4a77-91c1-7bf0a5e9dd20 req-6a8c0d7c-db55-4485-b6a6-ec53192bfb7f service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Received unexpected event network-vif-plugged-ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 for instance with vm_state resized and task_state resize_reverting.
Aug 09 10:21:54 user nova-compute[72362]: DEBUG nova.compute.manager [req-67efb32c-7ea3-4a77-91c1-7bf0a5e9dd20 req-6a8c0d7c-db55-4485-b6a6-ec53192bfb7f service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Received event network-vif-plugged-ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:21:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-67efb32c-7ea3-4a77-91c1-7bf0a5e9dd20 req-6a8c0d7c-db55-4485-b6a6-ec53192bfb7f service nova] Acquiring lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:21:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-67efb32c-7ea3-4a77-91c1-7bf0a5e9dd20 req-6a8c0d7c-db55-4485-b6a6-ec53192bfb7f service nova] Lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:21:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-67efb32c-7ea3-4a77-91c1-7bf0a5e9dd20 req-6a8c0d7c-db55-4485-b6a6-ec53192bfb7f service nova] Lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:21:54 user nova-compute[72362]: DEBUG nova.compute.manager [req-67efb32c-7ea3-4a77-91c1-7bf0a5e9dd20 req-6a8c0d7c-db55-4485-b6a6-ec53192bfb7f service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] No waiting events found dispatching network-vif-plugged-ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:21:54 user nova-compute[72362]: WARNING nova.compute.manager [req-67efb32c-7ea3-4a77-91c1-7bf0a5e9dd20 req-6a8c0d7c-db55-4485-b6a6-ec53192bfb7f service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Received unexpected event network-vif-plugged-ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 for instance with vm_state resized and task_state resize_reverting.
Aug 09 10:21:54 user nova-compute[72362]: DEBUG nova.compute.manager [req-67efb32c-7ea3-4a77-91c1-7bf0a5e9dd20 req-6a8c0d7c-db55-4485-b6a6-ec53192bfb7f service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Received event network-vif-unplugged-ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:21:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-67efb32c-7ea3-4a77-91c1-7bf0a5e9dd20 req-6a8c0d7c-db55-4485-b6a6-ec53192bfb7f service nova] Acquiring lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:21:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-67efb32c-7ea3-4a77-91c1-7bf0a5e9dd20 req-6a8c0d7c-db55-4485-b6a6-ec53192bfb7f service nova] Lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:21:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-67efb32c-7ea3-4a77-91c1-7bf0a5e9dd20 req-6a8c0d7c-db55-4485-b6a6-ec53192bfb7f service nova] Lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:21:54 user nova-compute[72362]: DEBUG nova.compute.manager [req-67efb32c-7ea3-4a77-91c1-7bf0a5e9dd20 req-6a8c0d7c-db55-4485-b6a6-ec53192bfb7f service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] No waiting events found dispatching network-vif-unplugged-ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:21:54 user nova-compute[72362]: WARNING nova.compute.manager [req-67efb32c-7ea3-4a77-91c1-7bf0a5e9dd20 req-6a8c0d7c-db55-4485-b6a6-ec53192bfb7f service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Received unexpected event network-vif-unplugged-ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 for instance with vm_state resized and task_state resize_reverting.
Aug 09 10:21:54 user nova-compute[72362]: DEBUG nova.compute.manager [req-67efb32c-7ea3-4a77-91c1-7bf0a5e9dd20 req-6a8c0d7c-db55-4485-b6a6-ec53192bfb7f service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Received event network-vif-plugged-ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:21:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-67efb32c-7ea3-4a77-91c1-7bf0a5e9dd20 req-6a8c0d7c-db55-4485-b6a6-ec53192bfb7f service nova] Acquiring lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:21:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-67efb32c-7ea3-4a77-91c1-7bf0a5e9dd20 req-6a8c0d7c-db55-4485-b6a6-ec53192bfb7f service nova] Lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:21:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-67efb32c-7ea3-4a77-91c1-7bf0a5e9dd20 req-6a8c0d7c-db55-4485-b6a6-ec53192bfb7f service nova] Lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:21:54 user nova-compute[72362]: DEBUG nova.compute.manager [req-67efb32c-7ea3-4a77-91c1-7bf0a5e9dd20 req-6a8c0d7c-db55-4485-b6a6-ec53192bfb7f service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] No waiting events found dispatching network-vif-plugged-ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:21:54 user nova-compute[72362]: WARNING nova.compute.manager [req-67efb32c-7ea3-4a77-91c1-7bf0a5e9dd20 req-6a8c0d7c-db55-4485-b6a6-ec53192bfb7f service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Received unexpected event network-vif-plugged-ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 for instance with vm_state resized and task_state resize_reverting.
Aug 09 10:21:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:21:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:21:54 user nova-compute[72362]: DEBUG nova.objects.instance [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lazy-loading 'migration_context' on Instance uuid 0e8a7668-1635-4cbc-8c09-ece19ff67d4f {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:21:54 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:21:54 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:21:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.443s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:21:54 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:21:54 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:21:54 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:21:55 user nova-compute[72362]: INFO nova.compute.manager [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Swapping old allocation on dict_keys(['6a678ae9-d474-4dd0-a246-9ae5a9a7108d']) held by migration b612e21a-eb0a-4569-a87c-38f119262c85 for instance
Aug 09 10:21:55 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Overwriting current allocation {'allocations': {'6a678ae9-d474-4dd0-a246-9ae5a9a7108d': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 23}}, 'project_id': 'b5438525a82b4ab08734e363ab1f80ec', 'user_id': '9ffd407a36c74b8ea1bc88b98366876e', 'consumer_generation': 1} on consumer 0e8a7668-1635-4cbc-8c09-ece19ff67d4f {{(pid=72362) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 09 10:21:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Acquiring lock "refresh_cache-0e8a7668-1635-4cbc-8c09-ece19ff67d4f" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:21:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Acquired lock "refresh_cache-0e8a7668-1635-4cbc-8c09-ece19ff67d4f" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:21:55 user nova-compute[72362]: DEBUG nova.network.neutron [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:21:55 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:55 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:21:55 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:21:55 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 10:21:55 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Rebuilding the list of instances to heal {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 10:21:55 user nova-compute[72362]: DEBUG nova.network.neutron [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Updating instance_info_cache with network_info: [{"id": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "address": "fa:16:3e:16:b7:79", "network": {"id": "446f0622-648e-499f-bbb1-e4c0d89ab4df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-409995858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5438525a82b4ab08734e363ab1f80ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec7889ae-0c", "ovs_interfaceid": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:21:56 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Releasing lock "refresh_cache-0e8a7668-1635-4cbc-8c09-ece19ff67d4f" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:21:56 user nova-compute[72362]: DEBUG os_brick.utils [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:21:56 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "refresh_cache-0e8a7668-1635-4cbc-8c09-ece19ff67d4f" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:21:56 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquired lock "refresh_cache-0e8a7668-1635-4cbc-8c09-ece19ff67d4f" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:21:56 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Forcefully refreshing network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 10:21:56 user nova-compute[72362]: DEBUG nova.objects.instance [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lazy-loading 'info_cache' on Instance uuid 0e8a7668-1635-4cbc-8c09-ece19ff67d4f {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:21:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:56 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf8593f-5d9c-48a1-bf1d-fce11e50bcbc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:56 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8258190-f2cd-4e01-906b-42269d1f10c7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:21:56 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c453d3f-67be-4da2-8e8a-ccf9df723501]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:56 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de2da4f-d457-42b4-a275-0b670c0cf937]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:21:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:21:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:21:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:21:56 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:21:56 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03450ce-3d1a-4cc6-9a9a-e9add60897f1]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:21:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:21:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:21:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:21:56 user nova-compute[72362]: DEBUG os_brick.utils [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:21:56 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Updating instance_info_cache with network_info: [{"id": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "address": "fa:16:3e:16:b7:79", "network": {"id": "446f0622-648e-499f-bbb1-e4c0d89ab4df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-409995858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5438525a82b4ab08734e363ab1f80ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec7889ae-0c", "ovs_interfaceid": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:21:56 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Releasing lock "refresh_cache-0e8a7668-1635-4cbc-8c09-ece19ff67d4f" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:21:56 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Updated the network info_cache for instance {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 10:21:56 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:57 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:21:57 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72362) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 10:21:58 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:21:58 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:22:00 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:00 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:22:01 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:22:01 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:22:01 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:22:01 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 10:22:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:22:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:22:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:22:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:22:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:22:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:22:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:22:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:22:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:22:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:22:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:22:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:22:02 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:22:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca002e73-ddf7-4452-82b6-0d831d984756/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:22:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca002e73-ddf7-4452-82b6-0d831d984756/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:22:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca002e73-ddf7-4452-82b6-0d831d984756/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:22:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca002e73-ddf7-4452-82b6-0d831d984756/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:22:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4746beb1-d313-4cea-bf7b-75b507ebbdd2/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:22:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4746beb1-d313-4cea-bf7b-75b507ebbdd2/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:22:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4746beb1-d313-4cea-bf7b-75b507ebbdd2/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:22:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4746beb1-d313-4cea-bf7b-75b507ebbdd2/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:22:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea95226c-40fe-4408-a9f0-5538659261a6/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:22:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea95226c-40fe-4408-a9f0-5538659261a6/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:22:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea95226c-40fe-4408-a9f0-5538659261a6/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:22:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea95226c-40fe-4408-a9f0-5538659261a6/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:22:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:22:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:22:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:22:03 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:22:03 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:22:03 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=7351MB free_disk=25.40471649169922GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 10:22:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:22:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:22:03 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance ca002e73-ddf7-4452-82b6-0d831d984756 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:22:03 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance ea95226c-40fe-4408-a9f0-5538659261a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:22:03 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 8e055c58-a365-4f18-a6e3-377e32e2189d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:22:03 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 0e8a7668-1635-4cbc-8c09-ece19ff67d4f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:22:03 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:22:03 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 09a20950-bce9-4c83-82db-e058872ae358 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:22:03 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 6493ab9a-4d69-434d-bed7-e51f1c5f3497 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:22:03 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 4746beb1-d313-4cea-bf7b-75b507ebbdd2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:22:03 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance a6000393-6044-4b54-ac0b-1d631e2ed0ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:22:03 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 3df33475-981e-4608-9b08-6d414554a322 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 09 10:22:03 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 10:22:03 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 10:22:03 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Refreshing inventories for resource provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 10:22:03 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Updating ProviderTree inventory for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 10:22:03 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Updating inventory in ProviderTree for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 10:22:03 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Refreshing aggregate associations for resource provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d, aggregates: None {{(pid=72362) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 10:22:03 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Refreshing trait associations for resource provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE41,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=72362) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 10:22:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Acquiring lock "3df33475-981e-4608-9b08-6d414554a322" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:22:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Lock "3df33475-981e-4608-9b08-6d414554a322" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:22:03 user nova-compute[72362]: DEBUG nova.compute.manager [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] [instance: 3df33475-981e-4608-9b08-6d414554a322] Starting instance... {{(pid=72362) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 10:22:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:22:04 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:22:04 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:22:04 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 10:22:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.586s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:22:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.166s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:22:04 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:22:04 user nova-compute[72362]: INFO nova.compute.claims [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] [instance: 3df33475-981e-4608-9b08-6d414554a322] Claim successful on node user
Aug 09 10:22:04 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:22:04 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:22:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.361s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:22:04 user nova-compute[72362]: DEBUG nova.compute.manager [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] [instance: 3df33475-981e-4608-9b08-6d414554a322] Start building networks asynchronously for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 10:22:04 user nova-compute[72362]: DEBUG nova.compute.manager [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] [instance: 3df33475-981e-4608-9b08-6d414554a322] Allocating IP information in the background. {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 10:22:04 user nova-compute[72362]: DEBUG nova.network.neutron [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] [instance: 3df33475-981e-4608-9b08-6d414554a322] allocate_for_instance() {{(pid=72362) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 10:22:04 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] [instance: 3df33475-981e-4608-9b08-6d414554a322] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 10:22:04 user nova-compute[72362]: DEBUG nova.compute.manager [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] [instance: 3df33475-981e-4608-9b08-6d414554a322] Start building block device mappings for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 10:22:04 user nova-compute[72362]: DEBUG nova.policy [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fdfb320ba56d4f7d99bd311edb1d28e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0193988e7d5d4484bad7645b4dec9b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72362) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 10:22:04 user nova-compute[72362]: DEBUG nova.compute.manager [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] [instance: 3df33475-981e-4608-9b08-6d414554a322] Start spawning the instance on the hypervisor. {{(pid=72362) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 10:22:04 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] [instance: 3df33475-981e-4608-9b08-6d414554a322] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:22:04 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] [instance: 3df33475-981e-4608-9b08-6d414554a322] Creating image(s)
Aug 09 10:22:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Acquiring lock "/opt/stack/data/nova/instances/3df33475-981e-4608-9b08-6d414554a322/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:22:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Lock "/opt/stack/data/nova/instances/3df33475-981e-4608-9b08-6d414554a322/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:22:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Lock "/opt/stack/data/nova/instances/3df33475-981e-4608-9b08-6d414554a322/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:22:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:22:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.141s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:22:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Acquiring lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:22:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:22:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:22:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.139s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:22:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/3df33475-981e-4608-9b08-6d414554a322/disk 1073741824 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/3df33475-981e-4608-9b08-6d414554a322/disk 1073741824" returned: 0 in 0.052s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.133s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3df33475-981e-4608-9b08-6d414554a322/disk. size=1073741824 {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df33475-981e-4608-9b08-6d414554a322/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG nova.network.neutron [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] [instance: 3df33475-981e-4608-9b08-6d414554a322] Successfully created port: 723765ac-a8d0-47de-959f-2eeeda11d7d9 {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df33475-981e-4608-9b08-6d414554a322/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Cannot resize image /opt/stack/data/nova/instances/3df33475-981e-4608-9b08-6d414554a322/disk to a smaller size. {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG nova.objects.instance [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Lazy-loading 'migration_context' on Instance uuid 3df33475-981e-4608-9b08-6d414554a322 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] [instance: 3df33475-981e-4608-9b08-6d414554a322] Created local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] [instance: 3df33475-981e-4608-9b08-6d414554a322] Ensure instance console log exists: /opt/stack/data/nova/instances/3df33475-981e-4608-9b08-6d414554a322/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Starting finish_revert_migration {{(pid=72362) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Start _get_guest_xml network_info=[{"id": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "address": "fa:16:3e:16:b7:79", "network": {"id": "446f0622-648e-499f-bbb1-e4c0d89ab4df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-409995858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5438525a82b4ab08734e363ab1f80ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec7889ae-0c", "ovs_interfaceid": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': 'a08d1a11-49eb-4212-a351-e11ee9553b95'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '087c09fa-5b9a-4780-9283-db5ded0fdce3', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MhmCwvOG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '0e8a7668-1635-4cbc-8c09-ece19ff67d4f', 'attached_at': '2023-08-09T10:22:05.000000', 'detached_at': '', 'volume_id': '8ef319fe-2472-41ac-86a6-0e4f3522e7c7', 'serial': '8ef319fe-2472-41ac-86a6-0e4f3522e7c7'}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:22:05 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:22:05 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:22:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG nova.objects.instance [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0e8a7668-1635-4cbc-8c09-ece19ff67d4f {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MhmCwvOG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:22:05 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:22:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:22:05 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:22:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:22:05 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:22:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8a2f6b-5d37-4c57-93de-7b3b44051603]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:22:05 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f9f301-3f05-4578-9a05-da6ba96dd310]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7] added
Aug 09 10:22:05 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[834445ae-087d-40b7-b896-bebd2205283e]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaca48a1-fb18-45bb-b676-fd2afbc3fdbc]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MhmCwvOG {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MhmCwvOG" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42c7d6b-383d-4660-b9b0-f37533cd983a]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MhmCwvOG'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d41135-3b59-43e6-bf79-79433186e59c]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97fd1b7-f0ed-4a5f-aa0b-e60633d176e5]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)
Aug 09 10:22:05 user nova-compute[72362]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 (non-flash)
Aug 09 10:22:05 user nova-compute[72362]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 (non-flash)
Aug 09 10:22:05 user nova-compute[72362]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 (non-flash)
Aug 09 10:22:05 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)
Aug 09 10:22:05 user nova-compute[72362]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 (non-flash)
Aug 09 10:22:05 user nova-compute[72362]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 (non-flash)
Aug 09 10:22:05 user nova-compute[72362]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 (non-flash)
Aug 09 10:22:05 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[fefbe63e-3c65-430a-a79b-3f38cd245483]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7, portal: 172.16.0.220,3260]
Aug 09 10:22:05 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7, portal: 172.16.0.220,3260] successful.
Aug 09 10:22:05 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[162ffa61-0326-4421-a2f9-07db434e7b13]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6eb417a-b518-47cd-9cb7-5550ea1587f4]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)
Aug 09 10:22:05 user nova-compute[72362]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 (non-flash)
Aug 09 10:22:05 user nova-compute[72362]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 (non-flash)
Aug 09 10:22:05 user nova-compute[72362]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 (non-flash)
Aug 09 10:22:05 user nova-compute[72362]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:22:05 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)
Aug 09 10:22:05 user nova-compute[72362]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 (non-flash)
Aug 09 10:22:05 user nova-compute[72362]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 (non-flash)
Aug 09 10:22:05 user nova-compute[72362]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 (non-flash)
Aug 09 10:22:05 user nova-compute[72362]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:22:05 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[431ebde2-5a65-47f3-b935-360bb998fecf]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:22:05 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: None {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG nova.network.neutron [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] [instance: 3df33475-981e-4608-9b08-6d414554a322] Successfully updated port: 723765ac-a8d0-47de-959f-2eeeda11d7d9 {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Acquiring lock "refresh_cache-3df33475-981e-4608-9b08-6d414554a322" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Acquired lock "refresh_cache-3df33475-981e-4608-9b08-6d414554a322" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG nova.network.neutron [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] [instance: 3df33475-981e-4608-9b08-6d414554a322] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG nova.compute.manager [req-b577ed87-f6f0-4c4b-a7bc-9b9264f08e33 req-2252fb39-2363-4514-a2f4-26b41b0aff90 service nova] [instance: 3df33475-981e-4608-9b08-6d414554a322] Received event network-changed-723765ac-a8d0-47de-959f-2eeeda11d7d9 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG nova.compute.manager [req-b577ed87-f6f0-4c4b-a7bc-9b9264f08e33 req-2252fb39-2363-4514-a2f4-26b41b0aff90 service nova] [instance: 3df33475-981e-4608-9b08-6d414554a322] Refreshing instance network info cache due to event network-changed-723765ac-a8d0-47de-959f-2eeeda11d7d9. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b577ed87-f6f0-4c4b-a7bc-9b9264f08e33 req-2252fb39-2363-4514-a2f4-26b41b0aff90 service nova] Acquiring lock "refresh_cache-3df33475-981e-4608-9b08-6d414554a322" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG nova.network.neutron [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] [instance: 3df33475-981e-4608-9b08-6d414554a322] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG nova.network.neutron [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] [instance: 3df33475-981e-4608-9b08-6d414554a322] Updating instance_info_cache with network_info: [{"id": "723765ac-a8d0-47de-959f-2eeeda11d7d9", "address": "fa:16:3e:74:a8:b3", "network": {"id": "9e33cbad-7ecf-4003-9303-19bbfa16df56", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "60b108dbc1e84afa9ca07b0a7793a358", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap723765ac-a8", "ovs_interfaceid": "723765ac-a8d0-47de-959f-2eeeda11d7d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Releasing lock "refresh_cache-3df33475-981e-4608-9b08-6d414554a322" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG nova.compute.manager [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] [instance: 3df33475-981e-4608-9b08-6d414554a322] Instance network_info: |[{"id": "723765ac-a8d0-47de-959f-2eeeda11d7d9", "address": "fa:16:3e:74:a8:b3", "network": {"id": "9e33cbad-7ecf-4003-9303-19bbfa16df56", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "60b108dbc1e84afa9ca07b0a7793a358", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap723765ac-a8", "ovs_interfaceid": "723765ac-a8d0-47de-959f-2eeeda11d7d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b577ed87-f6f0-4c4b-a7bc-9b9264f08e33 req-2252fb39-2363-4514-a2f4-26b41b0aff90 service nova] Acquired lock "refresh_cache-3df33475-981e-4608-9b08-6d414554a322" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG nova.network.neutron [req-b577ed87-f6f0-4c4b-a7bc-9b9264f08e33 req-2252fb39-2363-4514-a2f4-26b41b0aff90 service nova] [instance: 3df33475-981e-4608-9b08-6d414554a322] Refreshing network info cache for port 723765ac-a8d0-47de-959f-2eeeda11d7d9 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] [instance: 3df33475-981e-4608-9b08-6d414554a322] Start _get_guest_xml network_info=[{"id": "723765ac-a8d0-47de-959f-2eeeda11d7d9", "address": "fa:16:3e:74:a8:b3", "network": {"id": "9e33cbad-7ecf-4003-9303-19bbfa16df56", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "60b108dbc1e84afa9ca07b0a7793a358", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap723765ac-a8", "ovs_interfaceid": "723765ac-a8d0-47de-959f-2eeeda11d7d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': 'a08d1a11-49eb-4212-a351-e11ee9553b95'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:22:06 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:22:06 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:22:06 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:22:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1799912781',display_name='tempest-VolumesNegativeTest-instance-1799912781',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1799912781',id=20,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0193988e7d5d4484bad7645b4dec9b04',ramdisk_id='',reservation_id='r-ov5fd4p9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-295872054',owner_user_name='tempest-VolumesNegativeTest-295872054-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:22:05Z,user_data=None,user_id='fdfb320ba56d4f7d99bd311edb1d28e5',uuid=3df33475-981e-4608-9b08-6d414554a322,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "723765ac-a8d0-47de-959f-2eeeda11d7d9", "address": "fa:16:3e:74:a8:b3", "network": {"id": "9e33cbad-7ecf-4003-9303-19bbfa16df56", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "60b108dbc1e84afa9ca07b0a7793a358", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap723765ac-a8", "ovs_interfaceid": "723765ac-a8d0-47de-959f-2eeeda11d7d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Converting VIF {"id": "723765ac-a8d0-47de-959f-2eeeda11d7d9", "address": "fa:16:3e:74:a8:b3", "network": {"id": "9e33cbad-7ecf-4003-9303-19bbfa16df56", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "60b108dbc1e84afa9ca07b0a7793a358", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap723765ac-a8", "ovs_interfaceid": "723765ac-a8d0-47de-959f-2eeeda11d7d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:a8:b3,bridge_name='br-int',has_traffic_filtering=True,id=723765ac-a8d0-47de-959f-2eeeda11d7d9,network=Network(9e33cbad-7ecf-4003-9303-19bbfa16df56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap723765ac-a8') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG nova.objects.instance [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Lazy-loading 'pci_devices' on Instance uuid 3df33475-981e-4608-9b08-6d414554a322 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] [instance: 3df33475-981e-4608-9b08-6d414554a322] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:22:06 user nova-compute[72362]:   <uuid>3df33475-981e-4608-9b08-6d414554a322</uuid>
Aug 09 10:22:06 user nova-compute[72362]:   <name>instance-00000014</name>
Aug 09 10:22:06 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:22:06 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:22:06 user nova-compute[72362]:   <metadata>
Aug 09 10:22:06 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:22:06 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:22:06 user nova-compute[72362]:       <nova:name>tempest-VolumesNegativeTest-instance-1799912781</nova:name>
Aug 09 10:22:06 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:22:06</nova:creationTime>
Aug 09 10:22:06 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:22:06 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:22:06 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:22:06 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:22:06 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:22:06 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:22:06 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:22:06 user nova-compute[72362]:       <nova:owner>
Aug 09 10:22:06 user nova-compute[72362]:         <nova:user uuid="fdfb320ba56d4f7d99bd311edb1d28e5">tempest-VolumesNegativeTest-295872054-project-member</nova:user>
Aug 09 10:22:06 user nova-compute[72362]:         <nova:project uuid="0193988e7d5d4484bad7645b4dec9b04">tempest-VolumesNegativeTest-295872054</nova:project>
Aug 09 10:22:06 user nova-compute[72362]:       </nova:owner>
Aug 09 10:22:06 user nova-compute[72362]:       <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:22:06 user nova-compute[72362]:       <nova:ports>
Aug 09 10:22:06 user nova-compute[72362]:         <nova:port uuid="723765ac-a8d0-47de-959f-2eeeda11d7d9">
Aug 09 10:22:06 user nova-compute[72362]:           <nova:ip type="fixed" address="192.168.233.169" ipVersion="4"/>
Aug 09 10:22:06 user nova-compute[72362]:         </nova:port>
Aug 09 10:22:06 user nova-compute[72362]:       </nova:ports>
Aug 09 10:22:06 user nova-compute[72362]:     </nova:instance>
Aug 09 10:22:06 user nova-compute[72362]:   </metadata>
Aug 09 10:22:06 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:22:06 user nova-compute[72362]:     <system>
Aug 09 10:22:06 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:22:06 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:22:06 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:22:06 user nova-compute[72362]:       <entry name="serial">3df33475-981e-4608-9b08-6d414554a322</entry>
Aug 09 10:22:06 user nova-compute[72362]:       <entry name="uuid">3df33475-981e-4608-9b08-6d414554a322</entry>
Aug 09 10:22:06 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:22:06 user nova-compute[72362]:     </system>
Aug 09 10:22:06 user nova-compute[72362]:   </sysinfo>
Aug 09 10:22:06 user nova-compute[72362]:   <os>
Aug 09 10:22:06 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:22:06 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:22:06 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:22:06 user nova-compute[72362]:   </os>
Aug 09 10:22:06 user nova-compute[72362]:   <features>
Aug 09 10:22:06 user nova-compute[72362]:     <acpi/>
Aug 09 10:22:06 user nova-compute[72362]:     <apic/>
Aug 09 10:22:06 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:22:06 user nova-compute[72362]:   </features>
Aug 09 10:22:06 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:22:06 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:22:06 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:22:06 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:22:06 user nova-compute[72362]:   </clock>
Aug 09 10:22:06 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:22:06 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:22:06 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:22:06 user nova-compute[72362]:   </cpu>
Aug 09 10:22:06 user nova-compute[72362]:   <devices>
Aug 09 10:22:06 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:22:06 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:22:06 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/3df33475-981e-4608-9b08-6d414554a322/disk"/>
Aug 09 10:22:06 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:22:06 user nova-compute[72362]:     </disk>
Aug 09 10:22:06 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:22:06 user nova-compute[72362]:       <mac address="fa:16:3e:74:a8:b3"/>
Aug 09 10:22:06 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:22:06 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:22:06 user nova-compute[72362]:       <target dev="tap723765ac-a8"/>
Aug 09 10:22:06 user nova-compute[72362]:     </interface>
Aug 09 10:22:06 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:22:06 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/3df33475-981e-4608-9b08-6d414554a322/console.log" append="off"/>
Aug 09 10:22:06 user nova-compute[72362]:     </serial>
Aug 09 10:22:06 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:22:06 user nova-compute[72362]:     <video>
Aug 09 10:22:06 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:22:06 user nova-compute[72362]:     </video>
Aug 09 10:22:06 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:22:06 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:22:06 user nova-compute[72362]:     </rng>
Aug 09 10:22:06 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:22:06 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:22:06 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:22:06 user nova-compute[72362]:     </memballoon>
Aug 09 10:22:06 user nova-compute[72362]:   </devices>
Aug 09 10:22:06 user nova-compute[72362]: </domain>
Aug 09 10:22:06 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:22:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1799912781',display_name='tempest-VolumesNegativeTest-instance-1799912781',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1799912781',id=20,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0193988e7d5d4484bad7645b4dec9b04',ramdisk_id='',reservation_id='r-ov5fd4p9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-295872054',owner_user_name='tempest-VolumesNegativeTest-295872054-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:22:05Z,user_data=None,user_id='fdfb320ba56d4f7d99bd311edb1d28e5',uuid=3df33475-981e-4608-9b08-6d414554a322,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "723765ac-a8d0-47de-959f-2eeeda11d7d9", "address": "fa:16:3e:74:a8:b3", "network": {"id": "9e33cbad-7ecf-4003-9303-19bbfa16df56", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "60b108dbc1e84afa9ca07b0a7793a358", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap723765ac-a8", "ovs_interfaceid": "723765ac-a8d0-47de-959f-2eeeda11d7d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Converting VIF {"id": "723765ac-a8d0-47de-959f-2eeeda11d7d9", "address": "fa:16:3e:74:a8:b3", "network": {"id": "9e33cbad-7ecf-4003-9303-19bbfa16df56", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "60b108dbc1e84afa9ca07b0a7793a358", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap723765ac-a8", "ovs_interfaceid": "723765ac-a8d0-47de-959f-2eeeda11d7d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:a8:b3,bridge_name='br-int',has_traffic_filtering=True,id=723765ac-a8d0-47de-959f-2eeeda11d7d9,network=Network(9e33cbad-7ecf-4003-9303-19bbfa16df56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap723765ac-a8') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG os_vif [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:a8:b3,bridge_name='br-int',has_traffic_filtering=True,id=723765ac-a8d0-47de-959f-2eeeda11d7d9,network=Network(9e33cbad-7ecf-4003-9303-19bbfa16df56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap723765ac-a8') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap723765ac-a8, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap723765ac-a8, col_values=(('external_ids', {'iface-id': '723765ac-a8d0-47de-959f-2eeeda11d7d9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:a8:b3', 'vm-uuid': '3df33475-981e-4608-9b08-6d414554a322'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:06 user nova-compute[72362]: INFO os_vif [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:a8:b3,bridge_name='br-int',has_traffic_filtering=True,id=723765ac-a8d0-47de-959f-2eeeda11d7d9,network=Network(9e33cbad-7ecf-4003-9303-19bbfa16df56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap723765ac-a8')
Aug 09 10:22:06 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] No VIF found with MAC fa:16:3e:74:a8:b3, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG nova.network.neutron [req-b577ed87-f6f0-4c4b-a7bc-9b9264f08e33 req-2252fb39-2363-4514-a2f4-26b41b0aff90 service nova] [instance: 3df33475-981e-4608-9b08-6d414554a322] Updated VIF entry in instance network info cache for port 723765ac-a8d0-47de-959f-2eeeda11d7d9. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG nova.network.neutron [req-b577ed87-f6f0-4c4b-a7bc-9b9264f08e33 req-2252fb39-2363-4514-a2f4-26b41b0aff90 service nova] [instance: 3df33475-981e-4608-9b08-6d414554a322] Updating instance_info_cache with network_info: [{"id": "723765ac-a8d0-47de-959f-2eeeda11d7d9", "address": "fa:16:3e:74:a8:b3", "network": {"id": "9e33cbad-7ecf-4003-9303-19bbfa16df56", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "60b108dbc1e84afa9ca07b0a7793a358", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap723765ac-a8", "ovs_interfaceid": "723765ac-a8d0-47de-959f-2eeeda11d7d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b577ed87-f6f0-4c4b-a7bc-9b9264f08e33 req-2252fb39-2363-4514-a2f4-26b41b0aff90 service nova] Releasing lock "refresh_cache-3df33475-981e-4608-9b08-6d414554a322" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MhmCwvOG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23533383563306638', 'path': '/dev/sdb'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533383563306638', 'path': '/dev/sdb'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:15:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-419570951',display_name='tempest-ServerActionsTestOtherB-server-419570951',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-419570951',id=2,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAlSzovB4mzuHqVxORdW0QCnCxzvtrYywTRh5RUAkSVJoqhjnBo5zwvIiDyhRaMXzyUvfprKRDpBxT96lz++BVUa0Y8Z7q5AuzttS0DGZzN7x8fIo5ox8C7rVw5EduEeQ==',key_name='tempest-keypair-2060096321',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:20:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b5438525a82b4ab08734e363ab1f80ec',ramdisk_id='',reservation_id='r-gepn5vk7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-767949360',owner_user_name='tempest-ServerActionsTestOtherB-767949360-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:21:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ffd407a36c74b8ea1bc88b98366876e',uuid=0e8a7668-1635-4cbc-8c09-ece19ff67d4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "address": "fa:16:3e:16:b7:79", "network": {"id": "446f0622-648e-499f-bbb1-e4c0d89ab4df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-409995858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5438525a82b4ab08734e363ab1f80ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec7889ae-0c", "ovs_interfaceid": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Converting VIF {"id": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "address": "fa:16:3e:16:b7:79", "network": {"id": "446f0622-648e-499f-bbb1-e4c0d89ab4df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-409995858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5438525a82b4ab08734e363ab1f80ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec7889ae-0c", "ovs_interfaceid": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:b7:79,bridge_name='br-int',has_traffic_filtering=True,id=ec7889ae-0cbc-41e3-a750-a5cb2b522ce9,network=Network(446f0622-648e-499f-bbb1-e4c0d89ab4df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec7889ae-0c') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:22:06 user nova-compute[72362]:   <uuid>0e8a7668-1635-4cbc-8c09-ece19ff67d4f</uuid>
Aug 09 10:22:06 user nova-compute[72362]:   <name>instance-00000002</name>
Aug 09 10:22:06 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:22:06 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:22:06 user nova-compute[72362]:   <metadata>
Aug 09 10:22:06 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:22:06 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:22:06 user nova-compute[72362]:       <nova:name>tempest-ServerActionsTestOtherB-server-419570951</nova:name>
Aug 09 10:22:06 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:22:05</nova:creationTime>
Aug 09 10:22:06 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:22:06 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:22:06 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:22:06 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:22:06 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:22:06 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:22:06 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:22:06 user nova-compute[72362]:       <nova:owner>
Aug 09 10:22:06 user nova-compute[72362]:         <nova:user uuid="9ffd407a36c74b8ea1bc88b98366876e">tempest-ServerActionsTestOtherB-767949360-project-member</nova:user>
Aug 09 10:22:06 user nova-compute[72362]:         <nova:project uuid="b5438525a82b4ab08734e363ab1f80ec">tempest-ServerActionsTestOtherB-767949360</nova:project>
Aug 09 10:22:06 user nova-compute[72362]:       </nova:owner>
Aug 09 10:22:06 user nova-compute[72362]:       <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:22:06 user nova-compute[72362]:       <nova:ports>
Aug 09 10:22:06 user nova-compute[72362]:         <nova:port uuid="ec7889ae-0cbc-41e3-a750-a5cb2b522ce9">
Aug 09 10:22:06 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 09 10:22:06 user nova-compute[72362]:         </nova:port>
Aug 09 10:22:06 user nova-compute[72362]:       </nova:ports>
Aug 09 10:22:06 user nova-compute[72362]:     </nova:instance>
Aug 09 10:22:06 user nova-compute[72362]:   </metadata>
Aug 09 10:22:06 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:22:06 user nova-compute[72362]:     <system>
Aug 09 10:22:06 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:22:06 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:22:06 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:22:06 user nova-compute[72362]:       <entry name="serial">0e8a7668-1635-4cbc-8c09-ece19ff67d4f</entry>
Aug 09 10:22:06 user nova-compute[72362]:       <entry name="uuid">0e8a7668-1635-4cbc-8c09-ece19ff67d4f</entry>
Aug 09 10:22:06 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:22:06 user nova-compute[72362]:     </system>
Aug 09 10:22:06 user nova-compute[72362]:   </sysinfo>
Aug 09 10:22:06 user nova-compute[72362]:   <os>
Aug 09 10:22:06 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:22:06 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:22:06 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:22:06 user nova-compute[72362]:   </os>
Aug 09 10:22:06 user nova-compute[72362]:   <features>
Aug 09 10:22:06 user nova-compute[72362]:     <acpi/>
Aug 09 10:22:06 user nova-compute[72362]:     <apic/>
Aug 09 10:22:06 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:22:06 user nova-compute[72362]:   </features>
Aug 09 10:22:06 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:22:06 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:22:06 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:22:06 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:22:06 user nova-compute[72362]:   </clock>
Aug 09 10:22:06 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:22:06 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:22:06 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:22:06 user nova-compute[72362]:   </cpu>
Aug 09 10:22:06 user nova-compute[72362]:   <devices>
Aug 09 10:22:06 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:22:06 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:22:06 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/disk"/>
Aug 09 10:22:06 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:22:06 user nova-compute[72362]:     </disk>
Aug 09 10:22:06 user nova-compute[72362]:     <disk type="block" device="disk">
Aug 09 10:22:06 user nova-compute[72362]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:22:06 user nova-compute[72362]:       <source dev="/dev/sdb"/>
Aug 09 10:22:06 user nova-compute[72362]:       <target dev="vdb" bus="virtio"/>
Aug 09 10:22:06 user nova-compute[72362]:       <serial>8ef319fe-2472-41ac-86a6-0e4f3522e7c7</serial>
Aug 09 10:22:06 user nova-compute[72362]:     </disk>
Aug 09 10:22:06 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:22:06 user nova-compute[72362]:       <mac address="fa:16:3e:16:b7:79"/>
Aug 09 10:22:06 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:22:06 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:22:06 user nova-compute[72362]:       <target dev="tapec7889ae-0c"/>
Aug 09 10:22:06 user nova-compute[72362]:     </interface>
Aug 09 10:22:06 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:22:06 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/console.log" append="off"/>
Aug 09 10:22:06 user nova-compute[72362]:     </serial>
Aug 09 10:22:06 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:22:06 user nova-compute[72362]:     <video>
Aug 09 10:22:06 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:22:06 user nova-compute[72362]:     </video>
Aug 09 10:22:06 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:22:06 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:22:06 user nova-compute[72362]:     </rng>
Aug 09 10:22:06 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:22:06 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:22:06 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:22:06 user nova-compute[72362]:     </memballoon>
Aug 09 10:22:06 user nova-compute[72362]:   </devices>
Aug 09 10:22:06 user nova-compute[72362]: </domain>
Aug 09 10:22:06 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:15:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-419570951',display_name='tempest-ServerActionsTestOtherB-server-419570951',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-419570951',id=2,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAlSzovB4mzuHqVxORdW0QCnCxzvtrYywTRh5RUAkSVJoqhjnBo5zwvIiDyhRaMXzyUvfprKRDpBxT96lz++BVUa0Y8Z7q5AuzttS0DGZzN7x8fIo5ox8C7rVw5EduEeQ==',key_name='tempest-keypair-2060096321',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:20:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b5438525a82b4ab08734e363ab1f80ec',ramdisk_id='',reservation_id='r-gepn5vk7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-767949360',owner_user_name='tempest-ServerActionsTestOtherB-767949360-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:21:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ffd407a36c74b8ea1bc88b98366876e',uuid=0e8a7668-1635-4cbc-8c09-ece19ff67d4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "address": "fa:16:3e:16:b7:79", "network": {"id": "446f0622-648e-499f-bbb1-e4c0d89ab4df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-409995858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5438525a82b4ab08734e363ab1f80ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec7889ae-0c", "ovs_interfaceid": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Converting VIF {"id": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "address": "fa:16:3e:16:b7:79", "network": {"id": "446f0622-648e-499f-bbb1-e4c0d89ab4df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-409995858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5438525a82b4ab08734e363ab1f80ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec7889ae-0c", "ovs_interfaceid": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:b7:79,bridge_name='br-int',has_traffic_filtering=True,id=ec7889ae-0cbc-41e3-a750-a5cb2b522ce9,network=Network(446f0622-648e-499f-bbb1-e4c0d89ab4df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec7889ae-0c') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG os_vif [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:b7:79,bridge_name='br-int',has_traffic_filtering=True,id=ec7889ae-0cbc-41e3-a750-a5cb2b522ce9,network=Network(446f0622-648e-499f-bbb1-e4c0d89ab4df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec7889ae-0c') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec7889ae-0c, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapec7889ae-0c, col_values=(('external_ids', {'iface-id': 'ec7889ae-0cbc-41e3-a750-a5cb2b522ce9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:b7:79', 'vm-uuid': '0e8a7668-1635-4cbc-8c09-ece19ff67d4f'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:22:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:06 user nova-compute[72362]: INFO os_vif [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:b7:79,bridge_name='br-int',has_traffic_filtering=True,id=ec7889ae-0cbc-41e3-a750-a5cb2b522ce9,network=Network(446f0622-648e-499f-bbb1-e4c0d89ab4df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec7889ae-0c')
Aug 09 10:22:07 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691576512.8605716, 0e8a7668-1635-4cbc-8c09-ece19ff67d4f => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:22:07 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] VM Stopped (Lifecycle Event)
Aug 09 10:22:07 user nova-compute[72362]: DEBUG nova.compute.manager [None req-a8cd968d-9f7b-4b09-91d7-a350ba52b2fc None None] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:22:08 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:09 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:09 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:09 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:09 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:09 user nova-compute[72362]: DEBUG nova.compute.manager [req-930f9b79-4378-4f42-9b54-64b5034efca1 req-dc5b6851-b35d-465e-9c8e-7753f0c5273f service nova] [instance: 3df33475-981e-4608-9b08-6d414554a322] Received event network-vif-plugged-723765ac-a8d0-47de-959f-2eeeda11d7d9 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:22:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-930f9b79-4378-4f42-9b54-64b5034efca1 req-dc5b6851-b35d-465e-9c8e-7753f0c5273f service nova] Acquiring lock "3df33475-981e-4608-9b08-6d414554a322-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:22:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-930f9b79-4378-4f42-9b54-64b5034efca1 req-dc5b6851-b35d-465e-9c8e-7753f0c5273f service nova] Lock "3df33475-981e-4608-9b08-6d414554a322-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:22:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-930f9b79-4378-4f42-9b54-64b5034efca1 req-dc5b6851-b35d-465e-9c8e-7753f0c5273f service nova] Lock "3df33475-981e-4608-9b08-6d414554a322-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:22:09 user nova-compute[72362]: DEBUG nova.compute.manager [req-930f9b79-4378-4f42-9b54-64b5034efca1 req-dc5b6851-b35d-465e-9c8e-7753f0c5273f service nova] [instance: 3df33475-981e-4608-9b08-6d414554a322] No waiting events found dispatching network-vif-plugged-723765ac-a8d0-47de-959f-2eeeda11d7d9 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:22:09 user nova-compute[72362]: WARNING nova.compute.manager [req-930f9b79-4378-4f42-9b54-64b5034efca1 req-dc5b6851-b35d-465e-9c8e-7753f0c5273f service nova] [instance: 3df33475-981e-4608-9b08-6d414554a322] Received unexpected event network-vif-plugged-723765ac-a8d0-47de-959f-2eeeda11d7d9 for instance with vm_state building and task_state spawning.
Aug 09 10:22:09 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:09 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:09 user nova-compute[72362]: DEBUG nova.compute.manager [req-8f53732e-e4a0-4763-b2ac-9248f8bc5462 req-1b214907-04c3-42c2-82f0-149379deeb8d service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Received event network-vif-plugged-ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:22:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8f53732e-e4a0-4763-b2ac-9248f8bc5462 req-1b214907-04c3-42c2-82f0-149379deeb8d service nova] Acquiring lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:22:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8f53732e-e4a0-4763-b2ac-9248f8bc5462 req-1b214907-04c3-42c2-82f0-149379deeb8d service nova] Lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:22:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8f53732e-e4a0-4763-b2ac-9248f8bc5462 req-1b214907-04c3-42c2-82f0-149379deeb8d service nova] Lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:22:09 user nova-compute[72362]: DEBUG nova.compute.manager [req-8f53732e-e4a0-4763-b2ac-9248f8bc5462 req-1b214907-04c3-42c2-82f0-149379deeb8d service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] No waiting events found dispatching network-vif-plugged-ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:22:09 user nova-compute[72362]: WARNING nova.compute.manager [req-8f53732e-e4a0-4763-b2ac-9248f8bc5462 req-1b214907-04c3-42c2-82f0-149379deeb8d service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Received unexpected event network-vif-plugged-ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 for instance with vm_state resized and task_state resize_reverting.
Aug 09 10:22:09 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:09 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:09 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:09 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:10 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:10 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:10 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:11 user nova-compute[72362]: DEBUG nova.compute.manager [req-07537dc2-8817-4463-b089-92c833098ea9 req-2ff78d1f-a9c1-4aec-8364-1c13087a3ad6 service nova] [instance: 3df33475-981e-4608-9b08-6d414554a322] Received event network-vif-plugged-723765ac-a8d0-47de-959f-2eeeda11d7d9 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:22:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-07537dc2-8817-4463-b089-92c833098ea9 req-2ff78d1f-a9c1-4aec-8364-1c13087a3ad6 service nova] Acquiring lock "3df33475-981e-4608-9b08-6d414554a322-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:22:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-07537dc2-8817-4463-b089-92c833098ea9 req-2ff78d1f-a9c1-4aec-8364-1c13087a3ad6 service nova] Lock "3df33475-981e-4608-9b08-6d414554a322-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:22:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-07537dc2-8817-4463-b089-92c833098ea9 req-2ff78d1f-a9c1-4aec-8364-1c13087a3ad6 service nova] Lock "3df33475-981e-4608-9b08-6d414554a322-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:22:11 user nova-compute[72362]: DEBUG nova.compute.manager [req-07537dc2-8817-4463-b089-92c833098ea9 req-2ff78d1f-a9c1-4aec-8364-1c13087a3ad6 service nova] [instance: 3df33475-981e-4608-9b08-6d414554a322] No waiting events found dispatching network-vif-plugged-723765ac-a8d0-47de-959f-2eeeda11d7d9 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:22:11 user nova-compute[72362]: WARNING nova.compute.manager [req-07537dc2-8817-4463-b089-92c833098ea9 req-2ff78d1f-a9c1-4aec-8364-1c13087a3ad6 service nova] [instance: 3df33475-981e-4608-9b08-6d414554a322] Received unexpected event network-vif-plugged-723765ac-a8d0-47de-959f-2eeeda11d7d9 for instance with vm_state building and task_state spawning.
Aug 09 10:22:11 user nova-compute[72362]: DEBUG nova.compute.manager [req-080d2c3b-b23f-4b2a-b452-4ae98de61238 req-2dc56b77-3d93-4c51-bfce-6c1469e4ed01 service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Received event network-vif-plugged-ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:22:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-080d2c3b-b23f-4b2a-b452-4ae98de61238 req-2dc56b77-3d93-4c51-bfce-6c1469e4ed01 service nova] Acquiring lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:22:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-080d2c3b-b23f-4b2a-b452-4ae98de61238 req-2dc56b77-3d93-4c51-bfce-6c1469e4ed01 service nova] Lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:22:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-080d2c3b-b23f-4b2a-b452-4ae98de61238 req-2dc56b77-3d93-4c51-bfce-6c1469e4ed01 service nova] Lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:22:11 user nova-compute[72362]: DEBUG nova.compute.manager [req-080d2c3b-b23f-4b2a-b452-4ae98de61238 req-2dc56b77-3d93-4c51-bfce-6c1469e4ed01 service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] No waiting events found dispatching network-vif-plugged-ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:22:11 user nova-compute[72362]: WARNING nova.compute.manager [req-080d2c3b-b23f-4b2a-b452-4ae98de61238 req-2dc56b77-3d93-4c51-bfce-6c1469e4ed01 service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Received unexpected event network-vif-plugged-ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 for instance with vm_state resized and task_state resize_reverting.
Aug 09 10:22:11 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576531.6470718, 3df33475-981e-4608-9b08-6d414554a322 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:22:11 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 3df33475-981e-4608-9b08-6d414554a322] VM Resumed (Lifecycle Event)
Aug 09 10:22:11 user nova-compute[72362]: DEBUG nova.compute.manager [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:22:11 user nova-compute[72362]: DEBUG nova.compute.manager [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] [instance: 3df33475-981e-4608-9b08-6d414554a322] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:22:11 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] [instance: 3df33475-981e-4608-9b08-6d414554a322] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:22:11 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Instance running successfully.
Aug 09 10:22:11 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] finish_revert_migration finished successfully. {{(pid=72362) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 09 10:22:11 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 3df33475-981e-4608-9b08-6d414554a322] Instance spawned successfully.
Aug 09 10:22:11 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] [instance: 3df33475-981e-4608-9b08-6d414554a322] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 10:22:11 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 3df33475-981e-4608-9b08-6d414554a322] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:22:11 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 3df33475-981e-4608-9b08-6d414554a322] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:22:11 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] [instance: 3df33475-981e-4608-9b08-6d414554a322] Found default for hw_cdrom_bus of ide {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:22:11 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] [instance: 3df33475-981e-4608-9b08-6d414554a322] Found default for hw_disk_bus of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:22:11 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] [instance: 3df33475-981e-4608-9b08-6d414554a322] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:22:11 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] [instance: 3df33475-981e-4608-9b08-6d414554a322] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:22:11 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] [instance: 3df33475-981e-4608-9b08-6d414554a322] Found default for hw_video_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:22:11 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] [instance: 3df33475-981e-4608-9b08-6d414554a322] Found default for hw_vif_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:22:11 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 3df33475-981e-4608-9b08-6d414554a322] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:22:11 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576531.647222, 0e8a7668-1635-4cbc-8c09-ece19ff67d4f => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:22:11 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] VM Resumed (Lifecycle Event)
Aug 09 10:22:11 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:22:11 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:22:11 user nova-compute[72362]: INFO nova.compute.manager [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] [instance: 3df33475-981e-4608-9b08-6d414554a322] Took 7.08 seconds to spawn the instance on the hypervisor.
Aug 09 10:22:11 user nova-compute[72362]: DEBUG nova.compute.manager [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] [instance: 3df33475-981e-4608-9b08-6d414554a322] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:22:11 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 09 10:22:11 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576531.6495128, 0e8a7668-1635-4cbc-8c09-ece19ff67d4f => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:22:11 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] VM Started (Lifecycle Event)
Aug 09 10:22:11 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:22:11 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:22:11 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 09 10:22:11 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576531.649989, 3df33475-981e-4608-9b08-6d414554a322 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:22:11 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 3df33475-981e-4608-9b08-6d414554a322] VM Started (Lifecycle Event)
Aug 09 10:22:11 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 3df33475-981e-4608-9b08-6d414554a322] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:22:11 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 3df33475-981e-4608-9b08-6d414554a322] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:22:11 user nova-compute[72362]: INFO nova.compute.manager [None req-5c243df0-74e5-4d07-85a8-2994e4de50cc tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Updating instance to original state: 'active'
Aug 09 10:22:11 user nova-compute[72362]: INFO nova.compute.manager [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] [instance: 3df33475-981e-4608-9b08-6d414554a322] Took 7.99 seconds to build instance.
Aug 09 10:22:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f68005af-0aa9-420c-9655-715e5f45b524 tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Lock "3df33475-981e-4608-9b08-6d414554a322" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.084s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:22:11 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:15 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:16 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:21 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquiring lock "30213e67-6b1d-4d97-a971-1544335d02fb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:22:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "30213e67-6b1d-4d97-a971-1544335d02fb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:22:23 user nova-compute[72362]: DEBUG nova.compute.manager [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Starting instance... {{(pid=72362) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 10:22:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:22:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:22:23 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:22:23 user nova-compute[72362]: INFO nova.compute.claims [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Claim successful on node user
Aug 09 10:22:24 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:22:24 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:22:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.471s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:22:24 user nova-compute[72362]: DEBUG nova.compute.manager [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Start building networks asynchronously for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 10:22:24 user nova-compute[72362]: DEBUG nova.compute.manager [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Allocating IP information in the background. {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 10:22:24 user nova-compute[72362]: DEBUG nova.network.neutron [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] allocate_for_instance() {{(pid=72362) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 10:22:24 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 10:22:24 user nova-compute[72362]: DEBUG nova.compute.manager [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Start building block device mappings for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 10:22:24 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:22:24 user nova-compute[72362]: INFO nova.virt.block_device [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Booting with blank volume at /dev/vda
Aug 09 10:22:24 user nova-compute[72362]: WARNING nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] While synchronizing instance power states, found 11 instances in the database and 10 instances on the hypervisor.
Aug 09 10:22:24 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Triggering sync for uuid 0e8a7668-1635-4cbc-8c09-ece19ff67d4f {{(pid=72362) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 10:22:24 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Triggering sync for uuid ca002e73-ddf7-4452-82b6-0d831d984756 {{(pid=72362) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 10:22:24 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Triggering sync for uuid ea95226c-40fe-4408-a9f0-5538659261a6 {{(pid=72362) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 10:22:24 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Triggering sync for uuid 8e055c58-a365-4f18-a6e3-377e32e2189d {{(pid=72362) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 10:22:24 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Triggering sync for uuid 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f {{(pid=72362) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 10:22:24 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Triggering sync for uuid 09a20950-bce9-4c83-82db-e058872ae358 {{(pid=72362) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 10:22:24 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Triggering sync for uuid 6493ab9a-4d69-434d-bed7-e51f1c5f3497 {{(pid=72362) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 10:22:24 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Triggering sync for uuid 4746beb1-d313-4cea-bf7b-75b507ebbdd2 {{(pid=72362) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 10:22:24 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Triggering sync for uuid a6000393-6044-4b54-ac0b-1d631e2ed0ae {{(pid=72362) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 10:22:24 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Triggering sync for uuid 3df33475-981e-4608-9b08-6d414554a322 {{(pid=72362) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 10:22:24 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Triggering sync for uuid 30213e67-6b1d-4d97-a971-1544335d02fb {{(pid=72362) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 10:22:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:22:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:22:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "ca002e73-ddf7-4452-82b6-0d831d984756" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:22:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "ca002e73-ddf7-4452-82b6-0d831d984756" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:22:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "ea95226c-40fe-4408-a9f0-5538659261a6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:22:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "ea95226c-40fe-4408-a9f0-5538659261a6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:22:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "8e055c58-a365-4f18-a6e3-377e32e2189d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:22:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "8e055c58-a365-4f18-a6e3-377e32e2189d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:22:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:22:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:22:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "09a20950-bce9-4c83-82db-e058872ae358" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:22:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "09a20950-bce9-4c83-82db-e058872ae358" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:22:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "6493ab9a-4d69-434d-bed7-e51f1c5f3497" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:22:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "6493ab9a-4d69-434d-bed7-e51f1c5f3497" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:22:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:22:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:22:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:22:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:22:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "3df33475-981e-4608-9b08-6d414554a322" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:22:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "3df33475-981e-4608-9b08-6d414554a322" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:22:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "30213e67-6b1d-4d97-a971-1544335d02fb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:22:24 user nova-compute[72362]: DEBUG nova.policy [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4a1904ffd10b4e8b959971b5e2383113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f206cedc59df46deb91e7ec2167c1f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72362) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 10:22:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:22:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "ca002e73-ddf7-4452-82b6-0d831d984756" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:22:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "8e055c58-a365-4f18-a6e3-377e32e2189d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.087s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:22:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:22:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "ea95226c-40fe-4408-a9f0-5538659261a6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:22:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.101s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:22:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "3df33475-981e-4608-9b08-6d414554a322" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.102s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:22:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "6493ab9a-4d69-434d-bed7-e51f1c5f3497" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.105s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:22:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "09a20950-bce9-4c83-82db-e058872ae358" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.108s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:22:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.112s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:22:25 user nova-compute[72362]: DEBUG nova.network.neutron [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Successfully created port: 86a5b4ed-c891-4322-9ed4-4ddb3795148c {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:22:25 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:26 user nova-compute[72362]: DEBUG nova.network.neutron [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Successfully updated port: 86a5b4ed-c891-4322-9ed4-4ddb3795148c {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:22:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquiring lock "refresh_cache-30213e67-6b1d-4d97-a971-1544335d02fb" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:22:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquired lock "refresh_cache-30213e67-6b1d-4d97-a971-1544335d02fb" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:22:26 user nova-compute[72362]: DEBUG nova.network.neutron [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:22:26 user nova-compute[72362]: DEBUG nova.compute.manager [req-c0b61c1b-e97a-4cd8-ac64-8c8a16f8ee53 req-8a836ba5-7db4-43d5-af04-0a06a4fb00bb service nova] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Received event network-changed-86a5b4ed-c891-4322-9ed4-4ddb3795148c {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:22:26 user nova-compute[72362]: DEBUG nova.compute.manager [req-c0b61c1b-e97a-4cd8-ac64-8c8a16f8ee53 req-8a836ba5-7db4-43d5-af04-0a06a4fb00bb service nova] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Refreshing instance network info cache due to event network-changed-86a5b4ed-c891-4322-9ed4-4ddb3795148c. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:22:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c0b61c1b-e97a-4cd8-ac64-8c8a16f8ee53 req-8a836ba5-7db4-43d5-af04-0a06a4fb00bb service nova] Acquiring lock "refresh_cache-30213e67-6b1d-4d97-a971-1544335d02fb" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:22:26 user nova-compute[72362]: DEBUG nova.network.neutron [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:22:26 user nova-compute[72362]: DEBUG nova.network.neutron [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Updating instance_info_cache with network_info: [{"id": "86a5b4ed-c891-4322-9ed4-4ddb3795148c", "address": "fa:16:3e:7b:56:f2", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a5b4ed-c8", "ovs_interfaceid": "86a5b4ed-c891-4322-9ed4-4ddb3795148c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:22:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Releasing lock "refresh_cache-30213e67-6b1d-4d97-a971-1544335d02fb" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:22:26 user nova-compute[72362]: DEBUG nova.compute.manager [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Instance network_info: |[{"id": "86a5b4ed-c891-4322-9ed4-4ddb3795148c", "address": "fa:16:3e:7b:56:f2", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a5b4ed-c8", "ovs_interfaceid": "86a5b4ed-c891-4322-9ed4-4ddb3795148c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 10:22:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c0b61c1b-e97a-4cd8-ac64-8c8a16f8ee53 req-8a836ba5-7db4-43d5-af04-0a06a4fb00bb service nova] Acquired lock "refresh_cache-30213e67-6b1d-4d97-a971-1544335d02fb" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:22:26 user nova-compute[72362]: DEBUG nova.network.neutron [req-c0b61c1b-e97a-4cd8-ac64-8c8a16f8ee53 req-8a836ba5-7db4-43d5-af04-0a06a4fb00bb service nova] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Refreshing network info cache for port 86a5b4ed-c891-4322-9ed4-4ddb3795148c {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:22:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:27 user nova-compute[72362]: DEBUG nova.network.neutron [req-c0b61c1b-e97a-4cd8-ac64-8c8a16f8ee53 req-8a836ba5-7db4-43d5-af04-0a06a4fb00bb service nova] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Updated VIF entry in instance network info cache for port 86a5b4ed-c891-4322-9ed4-4ddb3795148c. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:22:27 user nova-compute[72362]: DEBUG nova.network.neutron [req-c0b61c1b-e97a-4cd8-ac64-8c8a16f8ee53 req-8a836ba5-7db4-43d5-af04-0a06a4fb00bb service nova] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Updating instance_info_cache with network_info: [{"id": "86a5b4ed-c891-4322-9ed4-4ddb3795148c", "address": "fa:16:3e:7b:56:f2", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a5b4ed-c8", "ovs_interfaceid": "86a5b4ed-c891-4322-9ed4-4ddb3795148c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:22:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c0b61c1b-e97a-4cd8-ac64-8c8a16f8ee53 req-8a836ba5-7db4-43d5-af04-0a06a4fb00bb service nova] Releasing lock "refresh_cache-30213e67-6b1d-4d97-a971-1544335d02fb" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:22:29 user nova-compute[72362]: DEBUG os_brick.utils [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:22:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:22:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:22:30 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb4096e-9622-40ae-aed1-fff1ed5e106c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:22:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:22:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:22:30 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e364aa3a-89f6-41fd-b034-3a6bf3c4b9ef]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:22:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:22:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:22:30 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17082a8-ca8c-4858-954d-dfe21e202ddf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:22:30 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[617061b0-41f1-4104-8e05-2fa16bc0ef02]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:22:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:22:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:22:30 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:22:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:22:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:22:30 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:22:30 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1c6a4b-cedf-4d43-bc61-b64394fa1ca4]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:22:30 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:22:30 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:22:30 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:22:30 user nova-compute[72362]: DEBUG os_brick.utils [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:22:30 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Updating existing volume attachment record: 519da4a4-5f90-408b-932b-b112c10f58ba {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 10:22:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f91a7835-e8c5-4c06-bb78-7a9ef2ac6bb3 tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Acquiring lock "ea95226c-40fe-4408-a9f0-5538659261a6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:22:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f91a7835-e8c5-4c06-bb78-7a9ef2ac6bb3 tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Lock "ea95226c-40fe-4408-a9f0-5538659261a6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:22:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f91a7835-e8c5-4c06-bb78-7a9ef2ac6bb3 tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Acquiring lock "ea95226c-40fe-4408-a9f0-5538659261a6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:22:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f91a7835-e8c5-4c06-bb78-7a9ef2ac6bb3 tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Lock "ea95226c-40fe-4408-a9f0-5538659261a6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:22:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f91a7835-e8c5-4c06-bb78-7a9ef2ac6bb3 tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Lock "ea95226c-40fe-4408-a9f0-5538659261a6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:22:32 user nova-compute[72362]: INFO nova.compute.manager [None req-f91a7835-e8c5-4c06-bb78-7a9ef2ac6bb3 tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Terminating instance
Aug 09 10:22:32 user nova-compute[72362]: DEBUG nova.compute.manager [None req-f91a7835-e8c5-4c06-bb78-7a9ef2ac6bb3 tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Start destroying the instance on the hypervisor. {{(pid=72362) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 10:22:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:32 user nova-compute[72362]: DEBUG nova.compute.manager [req-ae1ff8c1-a0be-4369-afd5-3a966d41fce6 req-c898cd53-ef21-4346-93a5-23b79ca33bff service nova] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Received event network-vif-unplugged-fc1688e4-e2d3-4f8f-be55-4a6793ae4497 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:22:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ae1ff8c1-a0be-4369-afd5-3a966d41fce6 req-c898cd53-ef21-4346-93a5-23b79ca33bff service nova] Acquiring lock "ea95226c-40fe-4408-a9f0-5538659261a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:22:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ae1ff8c1-a0be-4369-afd5-3a966d41fce6 req-c898cd53-ef21-4346-93a5-23b79ca33bff service nova] Lock "ea95226c-40fe-4408-a9f0-5538659261a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:22:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ae1ff8c1-a0be-4369-afd5-3a966d41fce6 req-c898cd53-ef21-4346-93a5-23b79ca33bff service nova] Lock "ea95226c-40fe-4408-a9f0-5538659261a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:22:32 user nova-compute[72362]: DEBUG nova.compute.manager [req-ae1ff8c1-a0be-4369-afd5-3a966d41fce6 req-c898cd53-ef21-4346-93a5-23b79ca33bff service nova] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] No waiting events found dispatching network-vif-unplugged-fc1688e4-e2d3-4f8f-be55-4a6793ae4497 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:22:32 user nova-compute[72362]: DEBUG nova.compute.manager [req-ae1ff8c1-a0be-4369-afd5-3a966d41fce6 req-c898cd53-ef21-4346-93a5-23b79ca33bff service nova] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Received event network-vif-unplugged-fc1688e4-e2d3-4f8f-be55-4a6793ae4497 for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:22:33 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Instance destroyed successfully.
Aug 09 10:22:33 user nova-compute[72362]: DEBUG nova.objects.instance [None req-f91a7835-e8c5-4c06-bb78-7a9ef2ac6bb3 tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Lazy-loading 'resources' on Instance uuid ea95226c-40fe-4408-a9f0-5538659261a6 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:22:33 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-f91a7835-e8c5-4c06-bb78-7a9ef2ac6bb3 tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:16:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-542512523',display_name='tempest-VolumesAdminNegativeTest-server-542512523',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-542512523',id=4,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoX7ZinHGYEXNZ0pSDCITz49RW9Y6hct+6iOxBWojlTkGOxkA/hmrwaEOuG0fl0JmyM8Mm5LwAYVFoRS99ogyYlQTaOMuqXEYekfEQXOqBs2QJU+kq4INZqo503jFGQtg==',key_name='tempest-keypair-1279119124',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:16:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b2e7ca3484c64611b9573ba0b86592b5',ramdisk_id='',reservation_id='r-5u8x7soq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-240994046',owner_user_name='tempest-VolumesAdminNegativeTest-240994046-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:16:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6220335c74b4c78a0d1a86efc98ebcb',uuid=ea95226c-40fe-4408-a9f0-5538659261a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc1688e4-e2d3-4f8f-be55-4a6793ae4497", "address": "fa:16:3e:31:49:f0", "network": {"id": "c32d66f0-0db4-4c6b-a45d-8c1eb6f4b510", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-858657617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2e7ca3484c64611b9573ba0b86592b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc1688e4-e2", "ovs_interfaceid": "fc1688e4-e2d3-4f8f-be55-4a6793ae4497", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:22:33 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-f91a7835-e8c5-4c06-bb78-7a9ef2ac6bb3 tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Converting VIF {"id": "fc1688e4-e2d3-4f8f-be55-4a6793ae4497", "address": "fa:16:3e:31:49:f0", "network": {"id": "c32d66f0-0db4-4c6b-a45d-8c1eb6f4b510", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-858657617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2e7ca3484c64611b9573ba0b86592b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc1688e4-e2", "ovs_interfaceid": "fc1688e4-e2d3-4f8f-be55-4a6793ae4497", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:22:33 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-f91a7835-e8c5-4c06-bb78-7a9ef2ac6bb3 tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:49:f0,bridge_name='br-int',has_traffic_filtering=True,id=fc1688e4-e2d3-4f8f-be55-4a6793ae4497,network=Network(c32d66f0-0db4-4c6b-a45d-8c1eb6f4b510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc1688e4-e2') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:22:33 user nova-compute[72362]: DEBUG os_vif [None req-f91a7835-e8c5-4c06-bb78-7a9ef2ac6bb3 tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:49:f0,bridge_name='br-int',has_traffic_filtering=True,id=fc1688e4-e2d3-4f8f-be55-4a6793ae4497,network=Network(c32d66f0-0db4-4c6b-a45d-8c1eb6f4b510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc1688e4-e2') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:22:33 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:33 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc1688e4-e2, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:22:33 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:33 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:22:33 user nova-compute[72362]: INFO os_vif [None req-f91a7835-e8c5-4c06-bb78-7a9ef2ac6bb3 tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:49:f0,bridge_name='br-int',has_traffic_filtering=True,id=fc1688e4-e2d3-4f8f-be55-4a6793ae4497,network=Network(c32d66f0-0db4-4c6b-a45d-8c1eb6f4b510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc1688e4-e2')
Aug 09 10:22:33 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-f91a7835-e8c5-4c06-bb78-7a9ef2ac6bb3 tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Deleting instance files /opt/stack/data/nova/instances/ea95226c-40fe-4408-a9f0-5538659261a6_del
Aug 09 10:22:33 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-f91a7835-e8c5-4c06-bb78-7a9ef2ac6bb3 tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Deletion of /opt/stack/data/nova/instances/ea95226c-40fe-4408-a9f0-5538659261a6_del complete
Aug 09 10:22:33 user nova-compute[72362]: INFO nova.compute.manager [None req-f91a7835-e8c5-4c06-bb78-7a9ef2ac6bb3 tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 09 10:22:33 user nova-compute[72362]: DEBUG oslo.service.loopingcall [None req-f91a7835-e8c5-4c06-bb78-7a9ef2ac6bb3 tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72362) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 10:22:33 user nova-compute[72362]: DEBUG nova.compute.manager [-] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Deallocating network for instance {{(pid=72362) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 10:22:33 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] deallocate_for_instance() {{(pid=72362) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 10:22:34 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:22:34 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Took 0.81 seconds to deallocate network for instance.
Aug 09 10:22:34 user nova-compute[72362]: DEBUG nova.compute.manager [req-b6d19cd9-8c16-4cf7-a70f-cc3d596a4d58 req-22465c67-8e96-48f6-9249-1d12b473ff32 service nova] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Received event network-vif-deleted-fc1688e4-e2d3-4f8f-be55-4a6793ae4497 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:22:34 user nova-compute[72362]: INFO nova.compute.manager [req-b6d19cd9-8c16-4cf7-a70f-cc3d596a4d58 req-22465c67-8e96-48f6-9249-1d12b473ff32 service nova] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Neutron deleted interface fc1688e4-e2d3-4f8f-be55-4a6793ae4497; detaching it from the instance and deleting it from the info cache
Aug 09 10:22:34 user nova-compute[72362]: DEBUG nova.network.neutron [req-b6d19cd9-8c16-4cf7-a70f-cc3d596a4d58 req-22465c67-8e96-48f6-9249-1d12b473ff32 service nova] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:22:34 user nova-compute[72362]: DEBUG nova.compute.manager [req-b6d19cd9-8c16-4cf7-a70f-cc3d596a4d58 req-22465c67-8e96-48f6-9249-1d12b473ff32 service nova] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Detach interface failed, port_id=fc1688e4-e2d3-4f8f-be55-4a6793ae4497, reason: Instance ea95226c-40fe-4408-a9f0-5538659261a6 could not be found. {{(pid=72362) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 10:22:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f91a7835-e8c5-4c06-bb78-7a9ef2ac6bb3 tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:22:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f91a7835-e8c5-4c06-bb78-7a9ef2ac6bb3 tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:22:34 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-f91a7835-e8c5-4c06-bb78-7a9ef2ac6bb3 tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:22:34 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-f91a7835-e8c5-4c06-bb78-7a9ef2ac6bb3 tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:22:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f91a7835-e8c5-4c06-bb78-7a9ef2ac6bb3 tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.394s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:22:34 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-f91a7835-e8c5-4c06-bb78-7a9ef2ac6bb3 tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Deleted allocations for instance ea95226c-40fe-4408-a9f0-5538659261a6
Aug 09 10:22:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f91a7835-e8c5-4c06-bb78-7a9ef2ac6bb3 tempest-VolumesAdminNegativeTest-240994046 tempest-VolumesAdminNegativeTest-240994046-project-member] Lock "ea95226c-40fe-4408-a9f0-5538659261a6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.310s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:22:34 user nova-compute[72362]: DEBUG nova.compute.manager [req-82545643-8352-43e3-a106-cdd5a1d8f7b7 req-2824f040-c389-4c23-b048-d2564d0e9774 service nova] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Received event network-vif-plugged-fc1688e4-e2d3-4f8f-be55-4a6793ae4497 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:22:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-82545643-8352-43e3-a106-cdd5a1d8f7b7 req-2824f040-c389-4c23-b048-d2564d0e9774 service nova] Acquiring lock "ea95226c-40fe-4408-a9f0-5538659261a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:22:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-82545643-8352-43e3-a106-cdd5a1d8f7b7 req-2824f040-c389-4c23-b048-d2564d0e9774 service nova] Lock "ea95226c-40fe-4408-a9f0-5538659261a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:22:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-82545643-8352-43e3-a106-cdd5a1d8f7b7 req-2824f040-c389-4c23-b048-d2564d0e9774 service nova] Lock "ea95226c-40fe-4408-a9f0-5538659261a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:22:34 user nova-compute[72362]: DEBUG nova.compute.manager [req-82545643-8352-43e3-a106-cdd5a1d8f7b7 req-2824f040-c389-4c23-b048-d2564d0e9774 service nova] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] No waiting events found dispatching network-vif-plugged-fc1688e4-e2d3-4f8f-be55-4a6793ae4497 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:22:34 user nova-compute[72362]: WARNING nova.compute.manager [req-82545643-8352-43e3-a106-cdd5a1d8f7b7 req-2824f040-c389-4c23-b048-d2564d0e9774 service nova] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Received unexpected event network-vif-plugged-fc1688e4-e2d3-4f8f-be55-4a6793ae4497 for instance with vm_state deleted and task_state None.
Aug 09 10:22:35 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:36 user nova-compute[72362]: DEBUG nova.compute.manager [req-84e963d3-01e8-4142-b5ff-63d64ae65f4b req-d7a4e8a4-4c5d-4a2a-ac18-d87c00945ebd service nova] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Received event network-changed-9735e8ce-a2bd-49c8-adcf-846c05b7427e {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:22:36 user nova-compute[72362]: DEBUG nova.compute.manager [req-84e963d3-01e8-4142-b5ff-63d64ae65f4b req-d7a4e8a4-4c5d-4a2a-ac18-d87c00945ebd service nova] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Refreshing instance network info cache due to event network-changed-9735e8ce-a2bd-49c8-adcf-846c05b7427e. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:22:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-84e963d3-01e8-4142-b5ff-63d64ae65f4b req-d7a4e8a4-4c5d-4a2a-ac18-d87c00945ebd service nova] Acquiring lock "refresh_cache-3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:22:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-84e963d3-01e8-4142-b5ff-63d64ae65f4b req-d7a4e8a4-4c5d-4a2a-ac18-d87c00945ebd service nova] Acquired lock "refresh_cache-3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:22:36 user nova-compute[72362]: DEBUG nova.network.neutron [req-84e963d3-01e8-4142-b5ff-63d64ae65f4b req-d7a4e8a4-4c5d-4a2a-ac18-d87c00945ebd service nova] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Refreshing network info cache for port 9735e8ce-a2bd-49c8-adcf-846c05b7427e {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:22:36 user nova-compute[72362]: DEBUG nova.network.neutron [req-84e963d3-01e8-4142-b5ff-63d64ae65f4b req-d7a4e8a4-4c5d-4a2a-ac18-d87c00945ebd service nova] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Updated VIF entry in instance network info cache for port 9735e8ce-a2bd-49c8-adcf-846c05b7427e. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:22:36 user nova-compute[72362]: DEBUG nova.network.neutron [req-84e963d3-01e8-4142-b5ff-63d64ae65f4b req-d7a4e8a4-4c5d-4a2a-ac18-d87c00945ebd service nova] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Updating instance_info_cache with network_info: [{"id": "9735e8ce-a2bd-49c8-adcf-846c05b7427e", "address": "fa:16:3e:91:34:e3", "network": {"id": "e6c54663-74e3-43e2-8f0d-61b300c1f68d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1222286883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ac22022944542c0b52dd912d3dbcce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9735e8ce-a2", "ovs_interfaceid": "9735e8ce-a2bd-49c8-adcf-846c05b7427e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:22:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-84e963d3-01e8-4142-b5ff-63d64ae65f4b req-d7a4e8a4-4c5d-4a2a-ac18-d87c00945ebd service nova] Releasing lock "refresh_cache-3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:22:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG nova.compute.manager [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Start spawning the instance on the hypervisor. {{(pid=72362) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:22:42 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Creating image(s)
Aug 09 10:22:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Did not create local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Ensure instance console log exists: /opt/stack/data/nova/instances/30213e67-6b1d-4d97-a971-1544335d02fb/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Start _get_guest_xml network_info=[{"id": "86a5b4ed-c891-4322-9ed4-4ddb3795148c", "address": "fa:16:3e:7b:56:f2", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a5b4ed-c8", "ovs_interfaceid": "86a5b4ed-c891-4322-9ed4-4ddb3795148c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '519da4a4-5f90-408b-932b-b112c10f58ba', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vHFgXAfm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '30213e67-6b1d-4d97-a971-1544335d02fb', 'attached_at': '', 'detached_at': '', 'volume_id': '68af9a24-14e2-4f6b-902b-08139cf943b9', 'serial': '68af9a24-14e2-4f6b-902b-08139cf943b9'}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:22:42 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:22:42 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:22:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vHFgXAfm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:22:42 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:22:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:22:42 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:22:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:22:42 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:22:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[8182264f-c994-4868-94be-7f77146a8395]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:22:42 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1513ec-1cbc-43ae-b84e-ef6dc90d044c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9] added
Aug 09 10:22:42 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffeb064b-68ba-4ca8-8321-9e2d0894a00a]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ec38a1-68ff-4305-8eb9-fb0c4f2a1e8c]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vHFgXAfm {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vHFgXAfm" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0272b4-1883-4bdd-96b8-2dfe5110188e]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vHFgXAfm'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83921ef-e323-4394-9d0c-3c14efab6fe7]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d705fcad-5e92-4a00-8287-9269e800b9d5]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c19808d-4ec8-4091-a544-6877cb777c9f (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)
Aug 09 10:22:42 user nova-compute[72362]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 (non-flash)
Aug 09 10:22:42 user nova-compute[72362]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 (non-flash)
Aug 09 10:22:42 user nova-compute[72362]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 (non-flash)
Aug 09 10:22:42 user nova-compute[72362]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:22:42 user nova-compute[72362]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c19808d-4ec8-4091-a544-6877cb777c9f (non-flash)
Aug 09 10:22:42 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)
Aug 09 10:22:42 user nova-compute[72362]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 (non-flash)
Aug 09 10:22:42 user nova-compute[72362]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 (non-flash)
Aug 09 10:22:42 user nova-compute[72362]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 (non-flash)
Aug 09 10:22:42 user nova-compute[72362]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:22:42 user nova-compute[72362]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c19808d-4ec8-4091-a544-6877cb777c9f (non-flash)
Aug 09 10:22:42 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[080a037e-9c24-4cf3-be59-796a4a21db7c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9, portal: 172.16.0.220,3260]
Aug 09 10:22:42 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9, portal: 172.16.0.220,3260] successful.
Aug 09 10:22:42 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:22:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:22:43 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:22:43 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3bf64a4-7f8b-43cf-bf75-b7f66dade28c]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:22:43 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:22:43 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:22:43 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:22:43 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f9d850-249a-4416-94e0-d7d2c259b4ef]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c19808d-4ec8-4091-a544-6877cb777c9f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:22:43 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)
Aug 09 10:22:43 user nova-compute[72362]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 (non-flash)
Aug 09 10:22:43 user nova-compute[72362]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 (non-flash)
Aug 09 10:22:43 user nova-compute[72362]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 (non-flash)
Aug 09 10:22:43 user nova-compute[72362]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:22:43 user nova-compute[72362]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c19808d-4ec8-4091-a544-6877cb777c9f (non-flash)
Aug 09 10:22:43 user nova-compute[72362]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:22:43 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:22:43 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)
Aug 09 10:22:43 user nova-compute[72362]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 (non-flash)
Aug 09 10:22:43 user nova-compute[72362]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 (non-flash)
Aug 09 10:22:43 user nova-compute[72362]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 (non-flash)
Aug 09 10:22:43 user nova-compute[72362]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:22:43 user nova-compute[72362]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c19808d-4ec8-4091-a544-6877cb777c9f (non-flash)
Aug 09 10:22:43 user nova-compute[72362]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:22:43 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:22:43 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:22:43 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:22:43 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] HCTL ('39', '-', '-', 0) found on session 20 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:22:43 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:22:43 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:22:43 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.025s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:22:43 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[305ae1f5-6aef-408a-be7d-8b5d72b5d62c]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:22:43 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Searching for a device in session 20 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:22:43 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vHFgXAfm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:22:43 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:44 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:22:44 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] <== connect_volume: return (1385ms) {'type': 'block', 'scsi_wwn': '26330393865653433', 'path': '/dev/sdh'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:22:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330393865653433', 'path': '/dev/sdh'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:22:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:22:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-358044317',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-358044317',id=21,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f206cedc59df46deb91e7ec2167c1f2b',ramdisk_id='',reservation_id='r-0rukucvy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1706340435',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:22:24Z,user_data=None,user_id='4a1904ffd10b4e8b959971b5e2383113',uuid=30213e67-6b1d-4d97-a971-1544335d02fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86a5b4ed-c891-4322-9ed4-4ddb3795148c", "address": "fa:16:3e:7b:56:f2", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a5b4ed-c8", "ovs_interfaceid": "86a5b4ed-c891-4322-9ed4-4ddb3795148c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:22:44 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Converting VIF {"id": "86a5b4ed-c891-4322-9ed4-4ddb3795148c", "address": "fa:16:3e:7b:56:f2", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a5b4ed-c8", "ovs_interfaceid": "86a5b4ed-c891-4322-9ed4-4ddb3795148c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:22:44 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:56:f2,bridge_name='br-int',has_traffic_filtering=True,id=86a5b4ed-c891-4322-9ed4-4ddb3795148c,network=Network(bb852331-57aa-4911-b8ff-30f5411f65b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86a5b4ed-c8') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:22:44 user nova-compute[72362]: DEBUG nova.objects.instance [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lazy-loading 'pci_devices' on Instance uuid 30213e67-6b1d-4d97-a971-1544335d02fb {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:22:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:22:44 user nova-compute[72362]:   <uuid>30213e67-6b1d-4d97-a971-1544335d02fb</uuid>
Aug 09 10:22:44 user nova-compute[72362]:   <name>instance-00000015</name>
Aug 09 10:22:44 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:22:44 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:22:44 user nova-compute[72362]:   <metadata>
Aug 09 10:22:44 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:22:44 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:22:44 user nova-compute[72362]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-358044317</nova:name>
Aug 09 10:22:44 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:22:42</nova:creationTime>
Aug 09 10:22:44 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:22:44 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:22:44 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:22:44 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:22:44 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:22:44 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:22:44 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:22:44 user nova-compute[72362]:       <nova:owner>
Aug 09 10:22:44 user nova-compute[72362]:         <nova:user uuid="4a1904ffd10b4e8b959971b5e2383113">tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member</nova:user>
Aug 09 10:22:44 user nova-compute[72362]:         <nova:project uuid="f206cedc59df46deb91e7ec2167c1f2b">tempest-ServerBootFromVolumeStableRescueTest-1706340435</nova:project>
Aug 09 10:22:44 user nova-compute[72362]:       </nova:owner>
Aug 09 10:22:44 user nova-compute[72362]:       <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:22:44 user nova-compute[72362]:       <nova:ports>
Aug 09 10:22:44 user nova-compute[72362]:         <nova:port uuid="86a5b4ed-c891-4322-9ed4-4ddb3795148c">
Aug 09 10:22:44 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 10:22:44 user nova-compute[72362]:         </nova:port>
Aug 09 10:22:44 user nova-compute[72362]:       </nova:ports>
Aug 09 10:22:44 user nova-compute[72362]:     </nova:instance>
Aug 09 10:22:44 user nova-compute[72362]:   </metadata>
Aug 09 10:22:44 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:22:44 user nova-compute[72362]:     <system>
Aug 09 10:22:44 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:22:44 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:22:44 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:22:44 user nova-compute[72362]:       <entry name="serial">30213e67-6b1d-4d97-a971-1544335d02fb</entry>
Aug 09 10:22:44 user nova-compute[72362]:       <entry name="uuid">30213e67-6b1d-4d97-a971-1544335d02fb</entry>
Aug 09 10:22:44 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:22:44 user nova-compute[72362]:     </system>
Aug 09 10:22:44 user nova-compute[72362]:   </sysinfo>
Aug 09 10:22:44 user nova-compute[72362]:   <os>
Aug 09 10:22:44 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:22:44 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:22:44 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:22:44 user nova-compute[72362]:   </os>
Aug 09 10:22:44 user nova-compute[72362]:   <features>
Aug 09 10:22:44 user nova-compute[72362]:     <acpi/>
Aug 09 10:22:44 user nova-compute[72362]:     <apic/>
Aug 09 10:22:44 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:22:44 user nova-compute[72362]:   </features>
Aug 09 10:22:44 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:22:44 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:22:44 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:22:44 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:22:44 user nova-compute[72362]:   </clock>
Aug 09 10:22:44 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:22:44 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:22:44 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:22:44 user nova-compute[72362]:   </cpu>
Aug 09 10:22:44 user nova-compute[72362]:   <devices>
Aug 09 10:22:44 user nova-compute[72362]:     <disk type="block" device="disk">
Aug 09 10:22:44 user nova-compute[72362]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:22:44 user nova-compute[72362]:       <source dev="/dev/sdh"/>
Aug 09 10:22:44 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:22:44 user nova-compute[72362]:       <serial>68af9a24-14e2-4f6b-902b-08139cf943b9</serial>
Aug 09 10:22:44 user nova-compute[72362]:     </disk>
Aug 09 10:22:44 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:22:44 user nova-compute[72362]:       <mac address="fa:16:3e:7b:56:f2"/>
Aug 09 10:22:44 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:22:44 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:22:44 user nova-compute[72362]:       <target dev="tap86a5b4ed-c8"/>
Aug 09 10:22:44 user nova-compute[72362]:     </interface>
Aug 09 10:22:44 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:22:44 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/30213e67-6b1d-4d97-a971-1544335d02fb/console.log" append="off"/>
Aug 09 10:22:44 user nova-compute[72362]:     </serial>
Aug 09 10:22:44 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:22:44 user nova-compute[72362]:     <video>
Aug 09 10:22:44 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:22:44 user nova-compute[72362]:     </video>
Aug 09 10:22:44 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:22:44 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:22:44 user nova-compute[72362]:     </rng>
Aug 09 10:22:44 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:22:44 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:22:44 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:22:44 user nova-compute[72362]:     </memballoon>
Aug 09 10:22:44 user nova-compute[72362]:   </devices>
Aug 09 10:22:44 user nova-compute[72362]: </domain>
Aug 09 10:22:44 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:22:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:22:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-358044317',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-358044317',id=21,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f206cedc59df46deb91e7ec2167c1f2b',ramdisk_id='',reservation_id='r-0rukucvy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1706340435',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:22:24Z,user_data=None,user_id='4a1904ffd10b4e8b959971b5e2383113',uuid=30213e67-6b1d-4d97-a971-1544335d02fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86a5b4ed-c891-4322-9ed4-4ddb3795148c", "address": "fa:16:3e:7b:56:f2", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a5b4ed-c8", "ovs_interfaceid": "86a5b4ed-c891-4322-9ed4-4ddb3795148c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:22:44 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Converting VIF {"id": "86a5b4ed-c891-4322-9ed4-4ddb3795148c", "address": "fa:16:3e:7b:56:f2", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a5b4ed-c8", "ovs_interfaceid": "86a5b4ed-c891-4322-9ed4-4ddb3795148c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:22:44 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:56:f2,bridge_name='br-int',has_traffic_filtering=True,id=86a5b4ed-c891-4322-9ed4-4ddb3795148c,network=Network(bb852331-57aa-4911-b8ff-30f5411f65b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86a5b4ed-c8') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:22:44 user nova-compute[72362]: DEBUG os_vif [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:56:f2,bridge_name='br-int',has_traffic_filtering=True,id=86a5b4ed-c891-4322-9ed4-4ddb3795148c,network=Network(bb852331-57aa-4911-b8ff-30f5411f65b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86a5b4ed-c8') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:22:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:22:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:22:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap86a5b4ed-c8, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:22:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap86a5b4ed-c8, col_values=(('external_ids', {'iface-id': '86a5b4ed-c891-4322-9ed4-4ddb3795148c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:56:f2', 'vm-uuid': '30213e67-6b1d-4d97-a971-1544335d02fb'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:22:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:22:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:44 user nova-compute[72362]: INFO os_vif [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:56:f2,bridge_name='br-int',has_traffic_filtering=True,id=86a5b4ed-c891-4322-9ed4-4ddb3795148c,network=Network(bb852331-57aa-4911-b8ff-30f5411f65b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86a5b4ed-c8')
Aug 09 10:22:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:22:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] No VIF found with MAC fa:16:3e:7b:56:f2, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:22:45 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:45 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:45 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:45 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:45 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:45 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:45 user nova-compute[72362]: DEBUG nova.compute.manager [req-c0a35fae-9c95-46fe-a67f-9c9e83ca6bfd req-f8c7a6d1-7030-4495-bb40-57923061f2e4 service nova] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Received event network-vif-plugged-86a5b4ed-c891-4322-9ed4-4ddb3795148c {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:22:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c0a35fae-9c95-46fe-a67f-9c9e83ca6bfd req-f8c7a6d1-7030-4495-bb40-57923061f2e4 service nova] Acquiring lock "30213e67-6b1d-4d97-a971-1544335d02fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:22:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c0a35fae-9c95-46fe-a67f-9c9e83ca6bfd req-f8c7a6d1-7030-4495-bb40-57923061f2e4 service nova] Lock "30213e67-6b1d-4d97-a971-1544335d02fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:22:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c0a35fae-9c95-46fe-a67f-9c9e83ca6bfd req-f8c7a6d1-7030-4495-bb40-57923061f2e4 service nova] Lock "30213e67-6b1d-4d97-a971-1544335d02fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:22:45 user nova-compute[72362]: DEBUG nova.compute.manager [req-c0a35fae-9c95-46fe-a67f-9c9e83ca6bfd req-f8c7a6d1-7030-4495-bb40-57923061f2e4 service nova] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] No waiting events found dispatching network-vif-plugged-86a5b4ed-c891-4322-9ed4-4ddb3795148c {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:22:45 user nova-compute[72362]: WARNING nova.compute.manager [req-c0a35fae-9c95-46fe-a67f-9c9e83ca6bfd req-f8c7a6d1-7030-4495-bb40-57923061f2e4 service nova] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Received unexpected event network-vif-plugged-86a5b4ed-c891-4322-9ed4-4ddb3795148c for instance with vm_state building and task_state spawning.
Aug 09 10:22:48 user nova-compute[72362]: DEBUG nova.compute.manager [req-421cdd5a-047e-4d8e-a64c-973fec03f154 req-39bd0533-b244-49fd-a318-ad03ebfbee61 service nova] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Received event network-vif-plugged-86a5b4ed-c891-4322-9ed4-4ddb3795148c {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:22:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-421cdd5a-047e-4d8e-a64c-973fec03f154 req-39bd0533-b244-49fd-a318-ad03ebfbee61 service nova] Acquiring lock "30213e67-6b1d-4d97-a971-1544335d02fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:22:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-421cdd5a-047e-4d8e-a64c-973fec03f154 req-39bd0533-b244-49fd-a318-ad03ebfbee61 service nova] Lock "30213e67-6b1d-4d97-a971-1544335d02fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:22:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-421cdd5a-047e-4d8e-a64c-973fec03f154 req-39bd0533-b244-49fd-a318-ad03ebfbee61 service nova] Lock "30213e67-6b1d-4d97-a971-1544335d02fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.006s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:22:48 user nova-compute[72362]: DEBUG nova.compute.manager [req-421cdd5a-047e-4d8e-a64c-973fec03f154 req-39bd0533-b244-49fd-a318-ad03ebfbee61 service nova] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] No waiting events found dispatching network-vif-plugged-86a5b4ed-c891-4322-9ed4-4ddb3795148c {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:22:48 user nova-compute[72362]: WARNING nova.compute.manager [req-421cdd5a-047e-4d8e-a64c-973fec03f154 req-39bd0533-b244-49fd-a318-ad03ebfbee61 service nova] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Received unexpected event network-vif-plugged-86a5b4ed-c891-4322-9ed4-4ddb3795148c for instance with vm_state building and task_state spawning.
Aug 09 10:22:48 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576568.1032434, 30213e67-6b1d-4d97-a971-1544335d02fb => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:22:48 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] VM Resumed (Lifecycle Event)
Aug 09 10:22:48 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691576553.1031, ea95226c-40fe-4408-a9f0-5538659261a6 => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:22:48 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] VM Stopped (Lifecycle Event)
Aug 09 10:22:48 user nova-compute[72362]: DEBUG nova.compute.manager [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:22:48 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:22:48 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:22:48 user nova-compute[72362]: DEBUG nova.compute.manager [None req-9842adf8-fdaf-4ed7-a4d6-ea56c4f37641 None None] [instance: ea95226c-40fe-4408-a9f0-5538659261a6] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:22:48 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Instance spawned successfully.
Aug 09 10:22:48 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 10:22:48 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:22:48 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Found default for hw_cdrom_bus of ide {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:22:48 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Found default for hw_disk_bus of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:22:48 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:22:48 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:22:48 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Found default for hw_video_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:22:48 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Found default for hw_vif_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:22:48 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:22:48 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576568.1034832, 30213e67-6b1d-4d97-a971-1544335d02fb => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:22:48 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] VM Started (Lifecycle Event)
Aug 09 10:22:48 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:22:48 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:22:48 user nova-compute[72362]: INFO nova.compute.manager [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Took 5.63 seconds to spawn the instance on the hypervisor.
Aug 09 10:22:48 user nova-compute[72362]: DEBUG nova.compute.manager [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:22:48 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:22:48 user nova-compute[72362]: INFO nova.compute.manager [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Took 24.73 seconds to build instance.
Aug 09 10:22:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-68f46b06-315c-4c0d-9206-e8fdaafb5246 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "30213e67-6b1d-4d97-a971-1544335d02fb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.825s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:22:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "30213e67-6b1d-4d97-a971-1544335d02fb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 24.064s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:22:48 user nova-compute[72362]: INFO nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Aug 09 10:22:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "30213e67-6b1d-4d97-a971-1544335d02fb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:22:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:50 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:22:50 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:53 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:22:53 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 10:22:54 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:54 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:22:54 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:22:55 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:22:56 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:22:57 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:22:57 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 10:22:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "refresh_cache-ca002e73-ddf7-4452-82b6-0d831d984756" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:22:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquired lock "refresh_cache-ca002e73-ddf7-4452-82b6-0d831d984756" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:22:58 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Forcefully refreshing network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 10:22:58 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Updating instance_info_cache with network_info: [{"id": "7ce03c91-ff2d-4735-bc98-088dc96293d0", "address": "fa:16:3e:57:3a:02", "network": {"id": "f6bb574e-dc90-445b-b678-6e7d825a8437", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-198645654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d000751b939e4805abb861b91d698b6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce03c91-ff", "ovs_interfaceid": "7ce03c91-ff2d-4735-bc98-088dc96293d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:22:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Releasing lock "refresh_cache-ca002e73-ddf7-4452-82b6-0d831d984756" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:22:58 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Updated the network info_cache for instance {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 10:22:59 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:22:59 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:22:59 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 10:22:59 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 10:22:59 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:22:59 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 10:22:59 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:23:00 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:02 user nova-compute[72362]: DEBUG nova.compute.manager [req-63f4ae64-3e44-4ce5-8b35-8d9443d2b0c1 req-cf6cb4de-a560-42c5-9b50-df19e2f35db0 service nova] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Received event network-changed-a9017bf2-874f-419a-aae5-43f2ce4a63dd {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:23:02 user nova-compute[72362]: DEBUG nova.compute.manager [req-63f4ae64-3e44-4ce5-8b35-8d9443d2b0c1 req-cf6cb4de-a560-42c5-9b50-df19e2f35db0 service nova] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Refreshing instance network info cache due to event network-changed-a9017bf2-874f-419a-aae5-43f2ce4a63dd. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:23:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-63f4ae64-3e44-4ce5-8b35-8d9443d2b0c1 req-cf6cb4de-a560-42c5-9b50-df19e2f35db0 service nova] Acquiring lock "refresh_cache-6493ab9a-4d69-434d-bed7-e51f1c5f3497" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:23:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-63f4ae64-3e44-4ce5-8b35-8d9443d2b0c1 req-cf6cb4de-a560-42c5-9b50-df19e2f35db0 service nova] Acquired lock "refresh_cache-6493ab9a-4d69-434d-bed7-e51f1c5f3497" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:23:02 user nova-compute[72362]: DEBUG nova.network.neutron [req-63f4ae64-3e44-4ce5-8b35-8d9443d2b0c1 req-cf6cb4de-a560-42c5-9b50-df19e2f35db0 service nova] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Refreshing network info cache for port a9017bf2-874f-419a-aae5-43f2ce4a63dd {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:23:02 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:23:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:23:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:23:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:23:03 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 10:23:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:03 user nova-compute[72362]: DEBUG nova.network.neutron [req-63f4ae64-3e44-4ce5-8b35-8d9443d2b0c1 req-cf6cb4de-a560-42c5-9b50-df19e2f35db0 service nova] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Updated VIF entry in instance network info cache for port a9017bf2-874f-419a-aae5-43f2ce4a63dd. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:23:03 user nova-compute[72362]: DEBUG nova.network.neutron [req-63f4ae64-3e44-4ce5-8b35-8d9443d2b0c1 req-cf6cb4de-a560-42c5-9b50-df19e2f35db0 service nova] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Updating instance_info_cache with network_info: [{"id": "a9017bf2-874f-419a-aae5-43f2ce4a63dd", "address": "fa:16:3e:ac:ef:70", "network": {"id": "0f5e6621-493c-440d-aaec-419fc6111969", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1795951162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec98263d80c34ed19b02d7c8cdb8a627", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9017bf2-87", "ovs_interfaceid": "a9017bf2-874f-419a-aae5-43f2ce4a63dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:23:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-63f4ae64-3e44-4ce5-8b35-8d9443d2b0c1 req-cf6cb4de-a560-42c5-9b50-df19e2f35db0 service nova] Releasing lock "refresh_cache-6493ab9a-4d69-434d-bed7-e51f1c5f3497" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:23:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:03 user nova-compute[72362]: INFO nova.compute.manager [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Rebuilding instance
Aug 09 10:23:03 user nova-compute[72362]: DEBUG nova.objects.instance [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6493ab9a-4d69-434d-bed7-e51f1c5f3497 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:23:03 user nova-compute[72362]: DEBUG nova.compute.manager [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:23:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:03 user nova-compute[72362]: DEBUG nova.objects.instance [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Lazy-loading 'pci_requests' on Instance uuid 6493ab9a-4d69-434d-bed7-e51f1c5f3497 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:23:03 user nova-compute[72362]: DEBUG nova.objects.instance [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Lazy-loading 'pci_devices' on Instance uuid 6493ab9a-4d69-434d-bed7-e51f1c5f3497 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:23:03 user nova-compute[72362]: DEBUG nova.objects.instance [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Lazy-loading 'resources' on Instance uuid 6493ab9a-4d69-434d-bed7-e51f1c5f3497 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:23:03 user nova-compute[72362]: DEBUG nova.objects.instance [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Lazy-loading 'migration_context' on Instance uuid 6493ab9a-4d69-434d-bed7-e51f1c5f3497 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:23:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:04 user nova-compute[72362]: DEBUG nova.objects.instance [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72362) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 09 10:23:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:04 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:23:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:04 user nova-compute[72362]: DEBUG nova.compute.manager [req-f42d5050-119d-4570-9e7c-346db0e358d4 req-b0cb1181-bbfa-41b7-908e-50a296919d9e service nova] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Received event network-vif-unplugged-a9017bf2-874f-419a-aae5-43f2ce4a63dd {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:23:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f42d5050-119d-4570-9e7c-346db0e358d4 req-b0cb1181-bbfa-41b7-908e-50a296919d9e service nova] Acquiring lock "6493ab9a-4d69-434d-bed7-e51f1c5f3497-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:23:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f42d5050-119d-4570-9e7c-346db0e358d4 req-b0cb1181-bbfa-41b7-908e-50a296919d9e service nova] Lock "6493ab9a-4d69-434d-bed7-e51f1c5f3497-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:23:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f42d5050-119d-4570-9e7c-346db0e358d4 req-b0cb1181-bbfa-41b7-908e-50a296919d9e service nova] Lock "6493ab9a-4d69-434d-bed7-e51f1c5f3497-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:23:04 user nova-compute[72362]: DEBUG nova.compute.manager [req-f42d5050-119d-4570-9e7c-346db0e358d4 req-b0cb1181-bbfa-41b7-908e-50a296919d9e service nova] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] No waiting events found dispatching network-vif-unplugged-a9017bf2-874f-419a-aae5-43f2ce4a63dd {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:23:04 user nova-compute[72362]: WARNING nova.compute.manager [req-f42d5050-119d-4570-9e7c-346db0e358d4 req-b0cb1181-bbfa-41b7-908e-50a296919d9e service nova] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Received unexpected event network-vif-unplugged-a9017bf2-874f-419a-aae5-43f2ce4a63dd for instance with vm_state active and task_state rebuilding.
Aug 09 10:23:04 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:23:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca002e73-ddf7-4452-82b6-0d831d984756/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca002e73-ddf7-4452-82b6-0d831d984756/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca002e73-ddf7-4452-82b6-0d831d984756/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca002e73-ddf7-4452-82b6-0d831d984756/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4746beb1-d313-4cea-bf7b-75b507ebbdd2/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:04 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Instance destroyed successfully.
Aug 09 10:23:04 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Instance destroyed successfully.
Aug 09 10:23:04 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:21:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-405979082',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-794271322',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFPlCV+krNMhby8imZncFRp5DGbA/vMmO2zNpzm0Pvmj5dU73J2HkJnfxWbQ3K2RYIgrwe8xBwFNEDCwdB9IYNqQGuPlU9V+VeI/1xppVZd/VycFGQoWDxVC9NrPc4QD9w==',key_name='tempest-keypair-286170421',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:21:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ec98263d80c34ed19b02d7c8cdb8a627',ramdisk_id='',reservation_id='r-8d9h038f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-773277146',owner_user_name='tempest-ServerActionsV293TestJSON-773277146-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:23:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='731b08d22e494215be0dd798362a6f91',uuid=6493ab9a-4d69-434d-bed7-e51f1c5f3497,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a9017bf2-874f-419a-aae5-43f2ce4a63dd", "address": "fa:16:3e:ac:ef:70", "network": {"id": "0f5e6621-493c-440d-aaec-419fc6111969", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1795951162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec98263d80c34ed19b02d7c8cdb8a627", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9017bf2-87", "ovs_interfaceid": "a9017bf2-874f-419a-aae5-43f2ce4a63dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:23:04 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Converting VIF {"id": "a9017bf2-874f-419a-aae5-43f2ce4a63dd", "address": "fa:16:3e:ac:ef:70", "network": {"id": "0f5e6621-493c-440d-aaec-419fc6111969", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1795951162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec98263d80c34ed19b02d7c8cdb8a627", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9017bf2-87", "ovs_interfaceid": "a9017bf2-874f-419a-aae5-43f2ce4a63dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:23:04 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:ef:70,bridge_name='br-int',has_traffic_filtering=True,id=a9017bf2-874f-419a-aae5-43f2ce4a63dd,network=Network(0f5e6621-493c-440d-aaec-419fc6111969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9017bf2-87') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:23:04 user nova-compute[72362]: DEBUG os_vif [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:ef:70,bridge_name='br-int',has_traffic_filtering=True,id=a9017bf2-874f-419a-aae5-43f2ce4a63dd,network=Network(0f5e6621-493c-440d-aaec-419fc6111969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9017bf2-87') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:23:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa9017bf2-87, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:23:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:23:04 user nova-compute[72362]: INFO os_vif [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:ef:70,bridge_name='br-int',has_traffic_filtering=True,id=a9017bf2-874f-419a-aae5-43f2ce4a63dd,network=Network(0f5e6621-493c-440d-aaec-419fc6111969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9017bf2-87')
Aug 09 10:23:04 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:23:04 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KJEmzxkc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:23:04 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 10:23:04 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:23:04 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:23:04 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:23:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:04 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb73f62-43d2-4351-ab2e-02a9d4a50fe1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4746beb1-d313-4cea-bf7b-75b507ebbdd2/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4746beb1-d313-4cea-bf7b-75b507ebbdd2/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:04 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddaa6e7c-993b-473f-b01b-0e8315ba8a2a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:04 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)
Aug 09 10:23:04 user nova-compute[72362]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 (non-flash)
Aug 09 10:23:04 user nova-compute[72362]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 (non-flash)
Aug 09 10:23:04 user nova-compute[72362]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 (non-flash)
Aug 09 10:23:04 user nova-compute[72362]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:23:04 user nova-compute[72362]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:23:04 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:23:04 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)
Aug 09 10:23:04 user nova-compute[72362]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 (non-flash)
Aug 09 10:23:04 user nova-compute[72362]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 (non-flash)
Aug 09 10:23:04 user nova-compute[72362]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 (non-flash)
Aug 09 10:23:04 user nova-compute[72362]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:23:04 user nova-compute[72362]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:23:04 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:23:04 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e441b640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6'): ({'sdc'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:23:04 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Removing single pathed devices sdc {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:23:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:04 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[23cb8629-7afb-4bdc-8bda-dd60469fa61a]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:04 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[8efbd889-87d5-4752-a1f3-d041192ec96d]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:04 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Flushing IO for device /dev/sdc {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:23:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9533b6-10cb-47ca-a310-dced36e96e2d]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4746beb1-d313-4cea-bf7b-75b507ebbdd2/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d47946-5b48-40a7-b6e1-676fcdbe92c6]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] SCSI volumes sdc have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26338623666333432', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_cd941ff4', '/dev/disk/by-id/scsi-1SCST_BIOcd941ff4-c8b6f342f505e44f') {{(pid=84003) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[9198d731-1326-415c-a258-1ae995ae14b4]: (4, None) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4f5c08-c0d2-40ed-9e02-d77cb9f0e1c8]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d738b88f-92c0-4057-814e-2e98794e519a]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6, portal: 172.16.0.220,3260]
Aug 09 10:23:05 user nova-compute[72362]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6, portal: 172.16.0.220,3260] successful.
Aug 09 10:23:05 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c45d29-520e-44e3-ace3-836d6a14136a]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.417s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] <== disconnect_volume: return (419ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:23:05 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Deleting instance files /opt/stack/data/nova/instances/6493ab9a-4d69-434d-bed7-e51f1c5f3497_del
Aug 09 10:23:05 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Deletion of /opt/stack/data/nova/instances/6493ab9a-4d69-434d-bed7-e51f1c5f3497_del complete
Aug 09 10:23:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df33475-981e-4608-9b08-6d414554a322/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df33475-981e-4608-9b08-6d414554a322/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df33475-981e-4608-9b08-6d414554a322/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:05 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 6493ab9a-4d69-434d-bed7-e51f1c5f3497 could not be found.
Aug 09 10:23:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KJEmzxkc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:23:05 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 10:23:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[279e6d47-b3fd-4bdb-b67c-823aa114c1c5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96d32fb-5b23-4b9c-9e4a-c8bb9efe5487]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 (non-flash)
Aug 09 10:23:05 user nova-compute[72362]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 (non-flash)
Aug 09 10:23:05 user nova-compute[72362]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 (non-flash)
Aug 09 10:23:05 user nova-compute[72362]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:23:05 user nova-compute[72362]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:23:05 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 (non-flash)
Aug 09 10:23:05 user nova-compute[72362]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 (non-flash)
Aug 09 10:23:05 user nova-compute[72362]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 (non-flash)
Aug 09 10:23:05 user nova-compute[72362]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:23:05 user nova-compute[72362]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:23:05 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e4219900>, {}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Disconnecting from: [] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.054s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] <== disconnect_volume: return (56ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:23:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df33475-981e-4608-9b08-6d414554a322/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:06 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:23:06 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:23:06 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=7294MB free_disk=25.409687042236328GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 10:23:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:23:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:23:06 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance ca002e73-ddf7-4452-82b6-0d831d984756 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:23:06 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 8e055c58-a365-4f18-a6e3-377e32e2189d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:23:06 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 0e8a7668-1635-4cbc-8c09-ece19ff67d4f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:23:06 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:23:06 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 09a20950-bce9-4c83-82db-e058872ae358 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:23:06 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 6493ab9a-4d69-434d-bed7-e51f1c5f3497 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:23:06 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 4746beb1-d313-4cea-bf7b-75b507ebbdd2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:23:06 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance a6000393-6044-4b54-ac0b-1d631e2ed0ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:23:06 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 3df33475-981e-4608-9b08-6d414554a322 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:23:06 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 30213e67-6b1d-4d97-a971-1544335d02fb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:23:06 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 10:23:06 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 10:23:06 user nova-compute[72362]: DEBUG nova.compute.manager [req-edcf2469-da02-4425-8fb9-12c5ab6cf7ff req-79313c9c-cc7b-4fcf-b746-fcfc3861d5f1 service nova] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Received event network-vif-plugged-a9017bf2-874f-419a-aae5-43f2ce4a63dd {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:23:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-edcf2469-da02-4425-8fb9-12c5ab6cf7ff req-79313c9c-cc7b-4fcf-b746-fcfc3861d5f1 service nova] Acquiring lock "6493ab9a-4d69-434d-bed7-e51f1c5f3497-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:23:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-edcf2469-da02-4425-8fb9-12c5ab6cf7ff req-79313c9c-cc7b-4fcf-b746-fcfc3861d5f1 service nova] Lock "6493ab9a-4d69-434d-bed7-e51f1c5f3497-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:23:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-edcf2469-da02-4425-8fb9-12c5ab6cf7ff req-79313c9c-cc7b-4fcf-b746-fcfc3861d5f1 service nova] Lock "6493ab9a-4d69-434d-bed7-e51f1c5f3497-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:23:06 user nova-compute[72362]: DEBUG nova.compute.manager [req-edcf2469-da02-4425-8fb9-12c5ab6cf7ff req-79313c9c-cc7b-4fcf-b746-fcfc3861d5f1 service nova] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] No waiting events found dispatching network-vif-plugged-a9017bf2-874f-419a-aae5-43f2ce4a63dd {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:23:06 user nova-compute[72362]: WARNING nova.compute.manager [req-edcf2469-da02-4425-8fb9-12c5ab6cf7ff req-79313c9c-cc7b-4fcf-b746-fcfc3861d5f1 service nova] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Received unexpected event network-vif-plugged-a9017bf2-874f-419a-aae5-43f2ce4a63dd for instance with vm_state active and task_state rebuilding.
Aug 09 10:23:06 user nova-compute[72362]: DEBUG nova.compute.manager [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Preparing to wait for external event volume-reimaged-b2bcc794-ae54-4b73-8b5e-751599d537f6 {{(pid=72362) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 09 10:23:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Acquiring lock "6493ab9a-4d69-434d-bed7-e51f1c5f3497-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:23:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Lock "6493ab9a-4d69-434d-bed7-e51f1c5f3497-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:23:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Lock "6493ab9a-4d69-434d-bed7-e51f1c5f3497-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:23:06 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:23:06 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:23:06 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 10:23:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.462s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:23:09 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:10 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:14 user nova-compute[72362]: DEBUG nova.compute.manager [req-8b45b99f-779a-4bee-8078-76f7ecaa1cc0 req-4571ee2b-b463-4686-8821-cdd7decfb4c4 service nova] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Received event network-changed-a10771ea-ee0f-4376-88cc-97dd0eb98d8d {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:23:14 user nova-compute[72362]: DEBUG nova.compute.manager [req-8b45b99f-779a-4bee-8078-76f7ecaa1cc0 req-4571ee2b-b463-4686-8821-cdd7decfb4c4 service nova] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Refreshing instance network info cache due to event network-changed-a10771ea-ee0f-4376-88cc-97dd0eb98d8d. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:23:14 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8b45b99f-779a-4bee-8078-76f7ecaa1cc0 req-4571ee2b-b463-4686-8821-cdd7decfb4c4 service nova] Acquiring lock "refresh_cache-4746beb1-d313-4cea-bf7b-75b507ebbdd2" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:23:14 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8b45b99f-779a-4bee-8078-76f7ecaa1cc0 req-4571ee2b-b463-4686-8821-cdd7decfb4c4 service nova] Acquired lock "refresh_cache-4746beb1-d313-4cea-bf7b-75b507ebbdd2" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:23:14 user nova-compute[72362]: DEBUG nova.network.neutron [req-8b45b99f-779a-4bee-8078-76f7ecaa1cc0 req-4571ee2b-b463-4686-8821-cdd7decfb4c4 service nova] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Refreshing network info cache for port a10771ea-ee0f-4376-88cc-97dd0eb98d8d {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:23:14 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:15 user nova-compute[72362]: DEBUG nova.network.neutron [req-8b45b99f-779a-4bee-8078-76f7ecaa1cc0 req-4571ee2b-b463-4686-8821-cdd7decfb4c4 service nova] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Updated VIF entry in instance network info cache for port a10771ea-ee0f-4376-88cc-97dd0eb98d8d. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:23:15 user nova-compute[72362]: DEBUG nova.network.neutron [req-8b45b99f-779a-4bee-8078-76f7ecaa1cc0 req-4571ee2b-b463-4686-8821-cdd7decfb4c4 service nova] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Updating instance_info_cache with network_info: [{"id": "a10771ea-ee0f-4376-88cc-97dd0eb98d8d", "address": "fa:16:3e:03:05:4e", "network": {"id": "557d516c-f355-4cc8-ae2e-5dbec7ce9762", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1511437856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99716e91e68b4abfba3a4c9335e42955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa10771ea-ee", "ovs_interfaceid": "a10771ea-ee0f-4376-88cc-97dd0eb98d8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:23:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8b45b99f-779a-4bee-8078-76f7ecaa1cc0 req-4571ee2b-b463-4686-8821-cdd7decfb4c4 service nova] Releasing lock "refresh_cache-4746beb1-d313-4cea-bf7b-75b507ebbdd2" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:23:15 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:19 user nova-compute[72362]: DEBUG nova.compute.manager [req-00692d11-d269-42cc-ba8a-6482d9fb4803 req-cf7c10d3-cb82-4410-84b9-ed8558b6faa3 service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Received event network-changed-8c0230bc-c7a7-4497-af9a-2fafb259605c {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:23:19 user nova-compute[72362]: DEBUG nova.compute.manager [req-00692d11-d269-42cc-ba8a-6482d9fb4803 req-cf7c10d3-cb82-4410-84b9-ed8558b6faa3 service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Refreshing instance network info cache due to event network-changed-8c0230bc-c7a7-4497-af9a-2fafb259605c. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:23:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-00692d11-d269-42cc-ba8a-6482d9fb4803 req-cf7c10d3-cb82-4410-84b9-ed8558b6faa3 service nova] Acquiring lock "refresh_cache-a6000393-6044-4b54-ac0b-1d631e2ed0ae" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:23:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-00692d11-d269-42cc-ba8a-6482d9fb4803 req-cf7c10d3-cb82-4410-84b9-ed8558b6faa3 service nova] Acquired lock "refresh_cache-a6000393-6044-4b54-ac0b-1d631e2ed0ae" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:23:19 user nova-compute[72362]: DEBUG nova.network.neutron [req-00692d11-d269-42cc-ba8a-6482d9fb4803 req-cf7c10d3-cb82-4410-84b9-ed8558b6faa3 service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Refreshing network info cache for port 8c0230bc-c7a7-4497-af9a-2fafb259605c {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:23:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a69929b6-1da2-40f8-a5af-e425e1db59db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Acquiring lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:23:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a69929b6-1da2-40f8-a5af-e425e1db59db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:23:19 user nova-compute[72362]: DEBUG nova.objects.instance [None req-a69929b6-1da2-40f8-a5af-e425e1db59db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lazy-loading 'flavor' on Instance uuid 4746beb1-d313-4cea-bf7b-75b507ebbdd2 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:23:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a69929b6-1da2-40f8-a5af-e425e1db59db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:23:19 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691576584.7707179, 6493ab9a-4d69-434d-bed7-e51f1c5f3497 => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:23:19 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] VM Stopped (Lifecycle Event)
Aug 09 10:23:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a69929b6-1da2-40f8-a5af-e425e1db59db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Acquiring lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:23:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a69929b6-1da2-40f8-a5af-e425e1db59db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:23:19 user nova-compute[72362]: INFO nova.compute.manager [None req-a69929b6-1da2-40f8-a5af-e425e1db59db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Attaching volume f975f699-138e-44a5-b600-8d0b666c0361 to /dev/vdb
Aug 09 10:23:19 user nova-compute[72362]: DEBUG nova.compute.manager [None req-f67642d6-5484-4fe9-b8f5-7f40e09f8b1b None None] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:23:19 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:19 user nova-compute[72362]: DEBUG os_brick.utils [None req-a69929b6-1da2-40f8-a5af-e425e1db59db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:23:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:19 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4fa9464-dad8-4cd1-9720-f03b56762685]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:19 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b0ff40-b99e-4226-bf2c-bbb1afd66354]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:19 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[547921ae-28da-4a04-b96c-bb62366bd0fb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:19 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a12d20-2d0d-437d-8f8d-a3f6b4720273]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-a69929b6-1da2-40f8-a5af-e425e1db59db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-a69929b6-1da2-40f8-a5af-e425e1db59db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:23:19 user nova-compute[72362]: DEBUG nova.network.neutron [req-00692d11-d269-42cc-ba8a-6482d9fb4803 req-cf7c10d3-cb82-4410-84b9-ed8558b6faa3 service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Updated VIF entry in instance network info cache for port 8c0230bc-c7a7-4497-af9a-2fafb259605c. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:23:19 user nova-compute[72362]: DEBUG nova.network.neutron [req-00692d11-d269-42cc-ba8a-6482d9fb4803 req-cf7c10d3-cb82-4410-84b9-ed8558b6faa3 service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Updating instance_info_cache with network_info: [{"id": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "address": "fa:16:3e:6e:b0:73", "network": {"id": "7358b925-3211-4419-84eb-df6967f5ea8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1360753488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dac04663e2f45378cc0e466740342d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c0230bc-c7", "ovs_interfaceid": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:23:19 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a69929b6-1da2-40f8-a5af-e425e1db59db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:23:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-00692d11-d269-42cc-ba8a-6482d9fb4803 req-cf7c10d3-cb82-4410-84b9-ed8558b6faa3 service nova] Releasing lock "refresh_cache-a6000393-6044-4b54-ac0b-1d631e2ed0ae" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:23:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:23:19 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:23:19 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[247f1a92-3ee4-4ca8-bd05-23fc3ca7f4f3]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:19 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-a69929b6-1da2-40f8-a5af-e425e1db59db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:23:19 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-a69929b6-1da2-40f8-a5af-e425e1db59db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:23:19 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-a69929b6-1da2-40f8-a5af-e425e1db59db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:23:19 user nova-compute[72362]: DEBUG os_brick.utils [None req-a69929b6-1da2-40f8-a5af-e425e1db59db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:23:19 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-a69929b6-1da2-40f8-a5af-e425e1db59db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Updating existing volume attachment record: 22af5efd-f380-461b-af41-3bf6c7312ee9 {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 10:23:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-789e7315-8eef-49ca-821f-8bbdc106885c tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Acquiring lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:23:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-789e7315-8eef-49ca-821f-8bbdc106885c tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:23:24 user nova-compute[72362]: DEBUG nova.objects.instance [None req-789e7315-8eef-49ca-821f-8bbdc106885c tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lazy-loading 'flavor' on Instance uuid a6000393-6044-4b54-ac0b-1d631e2ed0ae {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:23:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-789e7315-8eef-49ca-821f-8bbdc106885c tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:23:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-789e7315-8eef-49ca-821f-8bbdc106885c tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Acquiring lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:23:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-789e7315-8eef-49ca-821f-8bbdc106885c tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:23:24 user nova-compute[72362]: INFO nova.compute.manager [None req-789e7315-8eef-49ca-821f-8bbdc106885c tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Attaching volume cb2be0ee-763d-488d-b7e6-65e39d26b53b to /dev/vdb
Aug 09 10:23:24 user nova-compute[72362]: DEBUG os_brick.utils [None req-789e7315-8eef-49ca-821f-8bbdc106885c tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:23:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:24 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0275f82a-bc34-4d00-a519-e116044d068f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:24 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3436c197-c167-4e51-8de7-d731cd15818b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:24 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[657c446b-afb7-4b15-947d-31f7d784be52]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:24 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[7915257d-2a02-41ea-bd59-1173359fd9ce]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-789e7315-8eef-49ca-821f-8bbdc106885c tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-789e7315-8eef-49ca-821f-8bbdc106885c tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:23:24 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-789e7315-8eef-49ca-821f-8bbdc106885c tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:23:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:23:24 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:23:24 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[491c9b1a-9298-4f99-aa2d-84215a216580]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:24 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-789e7315-8eef-49ca-821f-8bbdc106885c tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:23:24 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-789e7315-8eef-49ca-821f-8bbdc106885c tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:23:24 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-789e7315-8eef-49ca-821f-8bbdc106885c tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:23:24 user nova-compute[72362]: DEBUG os_brick.utils [None req-789e7315-8eef-49ca-821f-8bbdc106885c tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:23:24 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-789e7315-8eef-49ca-821f-8bbdc106885c tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Updating existing volume attachment record: b5e8aee0-8c6e-4f46-9a23-fc047333f9c5 {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 10:23:25 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:29 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a69929b6-1da2-40f8-a5af-e425e1db59db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69929b6-1da2-40f8-a5af-e425e1db59db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ozNyCfra', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:23:30 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-a69929b6-1da2-40f8-a5af-e425e1db59db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:23:30 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-a69929b6-1da2-40f8-a5af-e425e1db59db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-a69929b6-1da2-40f8-a5af-e425e1db59db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:23:30 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-a69929b6-1da2-40f8-a5af-e425e1db59db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:23:30 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-a69929b6-1da2-40f8-a5af-e425e1db59db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-a69929b6-1da2-40f8-a5af-e425e1db59db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:23:30 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-a69929b6-1da2-40f8-a5af-e425e1db59db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:23:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361 -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[932942a1-c16e-410b-858f-52841740d9a9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69929b6-1da2-40f8-a5af-e425e1db59db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:23:30 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361 -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3371f5f6-d5bf-44d2-b544-7295e9ccbac0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69929b6-1da2-40f8-a5af-e425e1db59db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361] added
Aug 09 10:23:30 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c85cf28-9c58-4585-97ac-f660913c0f10]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69929b6-1da2-40f8-a5af-e425e1db59db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG nova.compute.manager [req-66849e3a-1a96-424f-9c88-6e3c408e69e5 req-6121f6f3-54b8-476e-b68a-1fa89f38274b service nova] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Received event volume-reimaged-b2bcc794-ae54-4b73-8b5e-751599d537f6 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-66849e3a-1a96-424f-9c88-6e3c408e69e5 req-6121f6f3-54b8-476e-b68a-1fa89f38274b service nova] Acquiring lock "6493ab9a-4d69-434d-bed7-e51f1c5f3497-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-66849e3a-1a96-424f-9c88-6e3c408e69e5 req-6121f6f3-54b8-476e-b68a-1fa89f38274b service nova] Lock "6493ab9a-4d69-434d-bed7-e51f1c5f3497-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-66849e3a-1a96-424f-9c88-6e3c408e69e5 req-6121f6f3-54b8-476e-b68a-1fa89f38274b service nova] Lock "6493ab9a-4d69-434d-bed7-e51f1c5f3497-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG nova.compute.manager [req-66849e3a-1a96-424f-9c88-6e3c408e69e5 req-6121f6f3-54b8-476e-b68a-1fa89f38274b service nova] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Processing event volume-reimaged-b2bcc794-ae54-4b73-8b5e-751599d537f6 {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d80539-4692-4016-be86-f5b45b5c56a4]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG nova.compute.manager [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Instance event wait completed in 24 seconds for volume-reimaged {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69929b6-1da2-40f8-a5af-e425e1db59db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ozNyCfra {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ozNyCfra" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5291194b-42cc-405f-a952-abcf1345f151]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69929b6-1da2-40f8-a5af-e425e1db59db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ozNyCfra'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8ac200-c9e9-4d4d-a4b7-432928706c0c]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69929b6-1da2-40f8-a5af-e425e1db59db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:30 user nova-compute[72362]: INFO nova.virt.block_device [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Booting with volume b2bcc794-ae54-4b73-8b5e-751599d537f6 at /dev/vda
Aug 09 10:23:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cca77a4-c491-4476-aa41-4b241d424dde]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69929b6-1da2-40f8-a5af-e425e1db59db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 (non-flash)
Aug 09 10:23:30 user nova-compute[72362]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 (non-flash)
Aug 09 10:23:30 user nova-compute[72362]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 (non-flash)
Aug 09 10:23:30 user nova-compute[72362]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:23:30 user nova-compute[72362]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:23:30 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69929b6-1da2-40f8-a5af-e425e1db59db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 (non-flash)
Aug 09 10:23:30 user nova-compute[72362]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 (non-flash)
Aug 09 10:23:30 user nova-compute[72362]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 (non-flash)
Aug 09 10:23:30 user nova-compute[72362]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:23:30 user nova-compute[72362]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:23:30 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361 -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG os_brick.utils [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3657475-d73f-4cb5-87e5-5cce80b083c6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[785375c6-2785-4837-943c-4c4f1611014d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69929b6-1da2-40f8-a5af-e425e1db59db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361, portal: 172.16.0.220,3260]
Aug 09 10:23:30 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361, portal: 172.16.0.220,3260] successful.
Aug 09 10:23:30 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69af14b-c4f8-426c-99ca-f1931b11cc3a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d387a8-a35d-4527-8e39-6303fe6e9514]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69929b6-1da2-40f8-a5af-e425e1db59db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c931d2ee-9153-4fb1-8b03-b717a00262be]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c57cf2-d049-490d-9971-25f5b01aa6e5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43a2b03-3c57-4a77-a460-8c3f05146917]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69929b6-1da2-40f8-a5af-e425e1db59db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 (non-flash)
Aug 09 10:23:30 user nova-compute[72362]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 (non-flash)
Aug 09 10:23:30 user nova-compute[72362]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 (non-flash)
Aug 09 10:23:30 user nova-compute[72362]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:23:30 user nova-compute[72362]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:23:30 user nova-compute[72362]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361 (non-flash)
Aug 09 10:23:30 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69929b6-1da2-40f8-a5af-e425e1db59db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 (non-flash)
Aug 09 10:23:30 user nova-compute[72362]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 (non-flash)
Aug 09 10:23:30 user nova-compute[72362]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 (non-flash)
Aug 09 10:23:30 user nova-compute[72362]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:23:30 user nova-compute[72362]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:23:30 user nova-compute[72362]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361 (non-flash)
Aug 09 10:23:30 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-a69929b6-1da2-40f8-a5af-e425e1db59db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69929b6-1da2-40f8-a5af-e425e1db59db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-a69929b6-1da2-40f8-a5af-e425e1db59db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-a69929b6-1da2-40f8-a5af-e425e1db59db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:23:31 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:23:31 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[63576f9d-d7e4-4652-a8e5-008b94693531]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:31 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:23:31 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:23:31 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:23:31 user nova-compute[72362]: DEBUG os_brick.utils [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:23:31 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Updating existing volume attachment record: 693799da-3840-4752-b7f3-80140638fba1 {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 10:23:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:31 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[85cb07d9-cb5b-4932-8a55-fdc8dda3af30]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:31 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-a69929b6-1da2-40f8-a5af-e425e1db59db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:23:31 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69929b6-1da2-40f8-a5af-e425e1db59db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ozNyCfra', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:23:32 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-a69929b6-1da2-40f8-a5af-e425e1db59db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.410s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:23:32 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69929b6-1da2-40f8-a5af-e425e1db59db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] <== connect_volume: return (1412ms) {'type': 'block', 'scsi_wwn': '26231333835353563', 'path': '/dev/sdc'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:23:32 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a69929b6-1da2-40f8-a5af-e425e1db59db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231333835353563', 'path': '/dev/sdc'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:23:32 user nova-compute[72362]: DEBUG nova.objects.instance [None req-a69929b6-1da2-40f8-a5af-e425e1db59db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lazy-loading 'flavor' on Instance uuid 4746beb1-d313-4cea-bf7b-75b507ebbdd2 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:23:32 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-a69929b6-1da2-40f8-a5af-e425e1db59db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 10:23:32 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:23:32 user nova-compute[72362]:   <source dev="/dev/sdc"/>
Aug 09 10:23:32 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:23:32 user nova-compute[72362]:   <serial>f975f699-138e-44a5-b600-8d0b666c0361</serial>
Aug 09 10:23:32 user nova-compute[72362]: </disk>
Aug 09 10:23:32 user nova-compute[72362]:  {{(pid=72362) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 10:23:32 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-a69929b6-1da2-40f8-a5af-e425e1db59db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:23:32 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-a69929b6-1da2-40f8-a5af-e425e1db59db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:23:32 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-a69929b6-1da2-40f8-a5af-e425e1db59db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] No VIF found with MAC fa:16:3e:03:05:4e, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:23:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a69929b6-1da2-40f8-a5af-e425e1db59db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.908s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:23:33 user nova-compute[72362]: DEBUG nova.compute.manager [req-5f2228ed-1f96-4c08-a16e-c65def52ddde req-a2a152f6-0ac6-4272-9d97-43ab25d3d0bb service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received event network-changed-5fd897a8-78c2-49be-b1d6-867bab82082d {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:23:33 user nova-compute[72362]: DEBUG nova.compute.manager [req-5f2228ed-1f96-4c08-a16e-c65def52ddde req-a2a152f6-0ac6-4272-9d97-43ab25d3d0bb service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Refreshing instance network info cache due to event network-changed-5fd897a8-78c2-49be-b1d6-867bab82082d. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:23:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-5f2228ed-1f96-4c08-a16e-c65def52ddde req-a2a152f6-0ac6-4272-9d97-43ab25d3d0bb service nova] Acquiring lock "refresh_cache-09a20950-bce9-4c83-82db-e058872ae358" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:23:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-5f2228ed-1f96-4c08-a16e-c65def52ddde req-a2a152f6-0ac6-4272-9d97-43ab25d3d0bb service nova] Acquired lock "refresh_cache-09a20950-bce9-4c83-82db-e058872ae358" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:23:33 user nova-compute[72362]: DEBUG nova.network.neutron [req-5f2228ed-1f96-4c08-a16e-c65def52ddde req-a2a152f6-0ac6-4272-9d97-43ab25d3d0bb service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Refreshing network info cache for port 5fd897a8-78c2-49be-b1d6-867bab82082d {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:23:34 user nova-compute[72362]: DEBUG nova.network.neutron [req-5f2228ed-1f96-4c08-a16e-c65def52ddde req-a2a152f6-0ac6-4272-9d97-43ab25d3d0bb service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Updated VIF entry in instance network info cache for port 5fd897a8-78c2-49be-b1d6-867bab82082d. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:23:34 user nova-compute[72362]: DEBUG nova.network.neutron [req-5f2228ed-1f96-4c08-a16e-c65def52ddde req-a2a152f6-0ac6-4272-9d97-43ab25d3d0bb service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Updating instance_info_cache with network_info: [{"id": "5fd897a8-78c2-49be-b1d6-867bab82082d", "address": "fa:16:3e:ae:3a:4a", "network": {"id": "e2b9dab7-85be-4e72-a3a9-14cd26990b44", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1356785765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd897a8-78", "ovs_interfaceid": "5fd897a8-78c2-49be-b1d6-867bab82082d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f1457dd7-06e1-43ac-a55d-3f4f9fe150f8", "address": "fa:16:3e:f2:a7:dd", "network": {"id": "b1aa635b-9b29-45b6-8cd4-06ccd9e0f545", "bridge": "br-int", "label": "tempest-device-tagging-net1-2012050279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1457dd7-06", "ovs_interfaceid": "f1457dd7-06e1-43ac-a55d-3f4f9fe150f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "21baa9dd-a7b0-445e-be2e-ab8b953bae49", "address": "fa:16:3e:55:ce:ef", "network": {"id": "b1aa635b-9b29-45b6-8cd4-06ccd9e0f545", "bridge": "br-int", "label": "tempest-device-tagging-net1-2012050279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21baa9dd-a7", "ovs_interfaceid": "21baa9dd-a7b0-445e-be2e-ab8b953bae49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "32d1ff81-fed5-47fe-88ce-04bd2777f1e5", "address": "fa:16:3e:b5:df:02", "network": {"id": "b1aa635b-9b29-45b6-8cd4-06ccd9e0f545", "bridge": "br-int", "label": "tempest-device-tagging-net1-2012050279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d1ff81-fe", "ovs_interfaceid": "32d1ff81-fed5-47fe-88ce-04bd2777f1e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41551d54-2c78-4fbe-9b7a-43452c5e94da", "address": "fa:16:3e:d8:11:91", "network": {"id": "b1aa635b-9b29-45b6-8cd4-06ccd9e0f545", "bridge": "br-int", "label": "tempest-device-tagging-net1-2012050279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41551d54-2c", "ovs_interfaceid": "41551d54-2c78-4fbe-9b7a-43452c5e94da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "de067d87-6780-4c38-bf69-7d976cbde30a", "address": "fa:16:3e:e1:62:57", "network": {"id": "6e7161bb-3d35-4adb-89d3-aa23f97adbfa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1214229212", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde067d87-67", "ovs_interfaceid": "de067d87-6780-4c38-bf69-7d976cbde30a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cb0c5adb-40d5-4fb6-b458-35a85c670333", "address": "fa:16:3e:8a:63:cf", "network": {"id": "6e7161bb-3d35-4adb-89d3-aa23f97adbfa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1214229212", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb0c5adb-40", "ovs_interfaceid": "cb0c5adb-40d5-4fb6-b458-35a85c670333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:23:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-5f2228ed-1f96-4c08-a16e-c65def52ddde req-a2a152f6-0ac6-4272-9d97-43ab25d3d0bb service nova] Releasing lock "refresh_cache-09a20950-bce9-4c83-82db-e058872ae358" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:23:34 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Acquiring lock "09a20950-bce9-4c83-82db-e058872ae358" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:23:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Lock "09a20950-bce9-4c83-82db-e058872ae358" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:23:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Acquiring lock "09a20950-bce9-4c83-82db-e058872ae358-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:23:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:23:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:23:35 user nova-compute[72362]: INFO nova.compute.manager [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Terminating instance
Aug 09 10:23:35 user nova-compute[72362]: DEBUG nova.compute.manager [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Start destroying the instance on the hypervisor. {{(pid=72362) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 10:23:35 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:35 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:35 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:35 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:35 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:36 user nova-compute[72362]: DEBUG nova.compute.manager [req-8ca31b1f-0fe3-4f2a-9324-f6b482667910 req-122bc915-6038-4bd4-8576-3664ac07d8c4 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received event network-vif-unplugged-5fd897a8-78c2-49be-b1d6-867bab82082d {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:23:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8ca31b1f-0fe3-4f2a-9324-f6b482667910 req-122bc915-6038-4bd4-8576-3664ac07d8c4 service nova] Acquiring lock "09a20950-bce9-4c83-82db-e058872ae358-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:23:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8ca31b1f-0fe3-4f2a-9324-f6b482667910 req-122bc915-6038-4bd4-8576-3664ac07d8c4 service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:23:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8ca31b1f-0fe3-4f2a-9324-f6b482667910 req-122bc915-6038-4bd4-8576-3664ac07d8c4 service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:23:36 user nova-compute[72362]: DEBUG nova.compute.manager [req-8ca31b1f-0fe3-4f2a-9324-f6b482667910 req-122bc915-6038-4bd4-8576-3664ac07d8c4 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] No waiting events found dispatching network-vif-unplugged-5fd897a8-78c2-49be-b1d6-867bab82082d {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:23:36 user nova-compute[72362]: DEBUG nova.compute.manager [req-8ca31b1f-0fe3-4f2a-9324-f6b482667910 req-122bc915-6038-4bd4-8576-3664ac07d8c4 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received event network-vif-unplugged-5fd897a8-78c2-49be-b1d6-867bab82082d for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:23:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:36 user nova-compute[72362]: DEBUG nova.compute.manager [req-10e6c87f-3035-474a-8d68-80fac45920d4 req-9699af9a-985a-4a5f-b1d9-f3e30979fc22 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received event network-vif-unplugged-f1457dd7-06e1-43ac-a55d-3f4f9fe150f8 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:23:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-10e6c87f-3035-474a-8d68-80fac45920d4 req-9699af9a-985a-4a5f-b1d9-f3e30979fc22 service nova] Acquiring lock "09a20950-bce9-4c83-82db-e058872ae358-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:23:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-10e6c87f-3035-474a-8d68-80fac45920d4 req-9699af9a-985a-4a5f-b1d9-f3e30979fc22 service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:23:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-10e6c87f-3035-474a-8d68-80fac45920d4 req-9699af9a-985a-4a5f-b1d9-f3e30979fc22 service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:23:36 user nova-compute[72362]: DEBUG nova.compute.manager [req-10e6c87f-3035-474a-8d68-80fac45920d4 req-9699af9a-985a-4a5f-b1d9-f3e30979fc22 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] No waiting events found dispatching network-vif-unplugged-f1457dd7-06e1-43ac-a55d-3f4f9fe150f8 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:23:36 user nova-compute[72362]: DEBUG nova.compute.manager [req-10e6c87f-3035-474a-8d68-80fac45920d4 req-9699af9a-985a-4a5f-b1d9-f3e30979fc22 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received event network-vif-unplugged-f1457dd7-06e1-43ac-a55d-3f4f9fe150f8 for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:23:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:36 user nova-compute[72362]: DEBUG nova.compute.manager [req-b35adc44-b0f0-414a-976b-ee6789fc9428 req-d773ee47-7f64-4555-9ac2-3581cf0b70a0 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received event network-vif-unplugged-32d1ff81-fed5-47fe-88ce-04bd2777f1e5 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:23:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b35adc44-b0f0-414a-976b-ee6789fc9428 req-d773ee47-7f64-4555-9ac2-3581cf0b70a0 service nova] Acquiring lock "09a20950-bce9-4c83-82db-e058872ae358-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:23:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b35adc44-b0f0-414a-976b-ee6789fc9428 req-d773ee47-7f64-4555-9ac2-3581cf0b70a0 service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:23:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b35adc44-b0f0-414a-976b-ee6789fc9428 req-d773ee47-7f64-4555-9ac2-3581cf0b70a0 service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:23:36 user nova-compute[72362]: DEBUG nova.compute.manager [req-b35adc44-b0f0-414a-976b-ee6789fc9428 req-d773ee47-7f64-4555-9ac2-3581cf0b70a0 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] No waiting events found dispatching network-vif-unplugged-32d1ff81-fed5-47fe-88ce-04bd2777f1e5 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:23:36 user nova-compute[72362]: DEBUG nova.compute.manager [req-b35adc44-b0f0-414a-976b-ee6789fc9428 req-d773ee47-7f64-4555-9ac2-3581cf0b70a0 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received event network-vif-unplugged-32d1ff81-fed5-47fe-88ce-04bd2777f1e5 for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:23:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:37 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Instance destroyed successfully.
Aug 09 10:23:37 user nova-compute[72362]: DEBUG nova.objects.instance [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Lazy-loading 'resources' on Instance uuid 09a20950-bce9-4c83-82db-e058872ae358 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-445751592',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-445751592',id=16,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjmyWbMuiYwF3FarfTsEVQBll5AtEBHU5mcq0TNfpZjnm47NEOTKkLyChcDjkjpAKpX4t5dZ90uBnn976//CfCicnjiqQH8Rf/FqLWCYp0xuTRU8vwDe8CWZFymiWd5Cw==',key_name='tempest-keypair-2092297342',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:21:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d18e5da818db4bbab4359c2b6f13f93f',ramdisk_id='',reservation_id='r-d84dx2ud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1095709842',owner_user_name='tempest-TaggedBootDevicesTest-1095709842-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:21:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b306455ac86f4464b585007877c7fc97',uuid=09a20950-bce9-4c83-82db-e058872ae358,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5fd897a8-78c2-49be-b1d6-867bab82082d", "address": "fa:16:3e:ae:3a:4a", "network": {"id": "e2b9dab7-85be-4e72-a3a9-14cd26990b44", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1356785765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd897a8-78", "ovs_interfaceid": "5fd897a8-78c2-49be-b1d6-867bab82082d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Converting VIF {"id": "5fd897a8-78c2-49be-b1d6-867bab82082d", "address": "fa:16:3e:ae:3a:4a", "network": {"id": "e2b9dab7-85be-4e72-a3a9-14cd26990b44", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1356785765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd897a8-78", "ovs_interfaceid": "5fd897a8-78c2-49be-b1d6-867bab82082d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:3a:4a,bridge_name='br-int',has_traffic_filtering=True,id=5fd897a8-78c2-49be-b1d6-867bab82082d,network=Network(e2b9dab7-85be-4e72-a3a9-14cd26990b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fd897a8-78') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG os_vif [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:3a:4a,bridge_name='br-int',has_traffic_filtering=True,id=5fd897a8-78c2-49be-b1d6-867bab82082d,network=Network(e2b9dab7-85be-4e72-a3a9-14cd26990b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fd897a8-78') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5fd897a8-78, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:37 user nova-compute[72362]: INFO os_vif [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:3a:4a,bridge_name='br-int',has_traffic_filtering=True,id=5fd897a8-78c2-49be-b1d6-867bab82082d,network=Network(e2b9dab7-85be-4e72-a3a9-14cd26990b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fd897a8-78')
Aug 09 10:23:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-445751592',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-445751592',id=16,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjmyWbMuiYwF3FarfTsEVQBll5AtEBHU5mcq0TNfpZjnm47NEOTKkLyChcDjkjpAKpX4t5dZ90uBnn976//CfCicnjiqQH8Rf/FqLWCYp0xuTRU8vwDe8CWZFymiWd5Cw==',key_name='tempest-keypair-2092297342',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:21:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d18e5da818db4bbab4359c2b6f13f93f',ramdisk_id='',reservation_id='r-d84dx2ud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1095709842',owner_user_name='tempest-TaggedBootDevicesTest-1095709842-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:21:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b306455ac86f4464b585007877c7fc97',uuid=09a20950-bce9-4c83-82db-e058872ae358,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f1457dd7-06e1-43ac-a55d-3f4f9fe150f8", "address": "fa:16:3e:f2:a7:dd", "network": {"id": "b1aa635b-9b29-45b6-8cd4-06ccd9e0f545", "bridge": "br-int", "label": "tempest-device-tagging-net1-2012050279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1457dd7-06", "ovs_interfaceid": "f1457dd7-06e1-43ac-a55d-3f4f9fe150f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Converting VIF {"id": "f1457dd7-06e1-43ac-a55d-3f4f9fe150f8", "address": "fa:16:3e:f2:a7:dd", "network": {"id": "b1aa635b-9b29-45b6-8cd4-06ccd9e0f545", "bridge": "br-int", "label": "tempest-device-tagging-net1-2012050279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1457dd7-06", "ovs_interfaceid": "f1457dd7-06e1-43ac-a55d-3f4f9fe150f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:a7:dd,bridge_name='br-int',has_traffic_filtering=True,id=f1457dd7-06e1-43ac-a55d-3f4f9fe150f8,network=Network(b1aa635b-9b29-45b6-8cd4-06ccd9e0f545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf1457dd7-06') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG os_vif [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:a7:dd,bridge_name='br-int',has_traffic_filtering=True,id=f1457dd7-06e1-43ac-a55d-3f4f9fe150f8,network=Network(b1aa635b-9b29-45b6-8cd4-06ccd9e0f545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf1457dd7-06') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf1457dd7-06, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:37 user nova-compute[72362]: INFO os_vif [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:a7:dd,bridge_name='br-int',has_traffic_filtering=True,id=f1457dd7-06e1-43ac-a55d-3f4f9fe150f8,network=Network(b1aa635b-9b29-45b6-8cd4-06ccd9e0f545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf1457dd7-06')
Aug 09 10:23:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-445751592',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-445751592',id=16,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjmyWbMuiYwF3FarfTsEVQBll5AtEBHU5mcq0TNfpZjnm47NEOTKkLyChcDjkjpAKpX4t5dZ90uBnn976//CfCicnjiqQH8Rf/FqLWCYp0xuTRU8vwDe8CWZFymiWd5Cw==',key_name='tempest-keypair-2092297342',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:21:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d18e5da818db4bbab4359c2b6f13f93f',ramdisk_id='',reservation_id='r-d84dx2ud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1095709842',owner_user_name='tempest-TaggedBootDevicesTest-1095709842-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:21:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b306455ac86f4464b585007877c7fc97',uuid=09a20950-bce9-4c83-82db-e058872ae358,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21baa9dd-a7b0-445e-be2e-ab8b953bae49", "address": "fa:16:3e:55:ce:ef", "network": {"id": "b1aa635b-9b29-45b6-8cd4-06ccd9e0f545", "bridge": "br-int", "label": "tempest-device-tagging-net1-2012050279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21baa9dd-a7", "ovs_interfaceid": "21baa9dd-a7b0-445e-be2e-ab8b953bae49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Converting VIF {"id": "21baa9dd-a7b0-445e-be2e-ab8b953bae49", "address": "fa:16:3e:55:ce:ef", "network": {"id": "b1aa635b-9b29-45b6-8cd4-06ccd9e0f545", "bridge": "br-int", "label": "tempest-device-tagging-net1-2012050279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21baa9dd-a7", "ovs_interfaceid": "21baa9dd-a7b0-445e-be2e-ab8b953bae49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:ce:ef,bridge_name='br-int',has_traffic_filtering=True,id=21baa9dd-a7b0-445e-be2e-ab8b953bae49,network=Network(b1aa635b-9b29-45b6-8cd4-06ccd9e0f545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap21baa9dd-a7') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG os_vif [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:ce:ef,bridge_name='br-int',has_traffic_filtering=True,id=21baa9dd-a7b0-445e-be2e-ab8b953bae49,network=Network(b1aa635b-9b29-45b6-8cd4-06ccd9e0f545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap21baa9dd-a7') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21baa9dd-a7, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:37 user nova-compute[72362]: INFO os_vif [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:ce:ef,bridge_name='br-int',has_traffic_filtering=True,id=21baa9dd-a7b0-445e-be2e-ab8b953bae49,network=Network(b1aa635b-9b29-45b6-8cd4-06ccd9e0f545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap21baa9dd-a7')
Aug 09 10:23:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-445751592',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-445751592',id=16,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjmyWbMuiYwF3FarfTsEVQBll5AtEBHU5mcq0TNfpZjnm47NEOTKkLyChcDjkjpAKpX4t5dZ90uBnn976//CfCicnjiqQH8Rf/FqLWCYp0xuTRU8vwDe8CWZFymiWd5Cw==',key_name='tempest-keypair-2092297342',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:21:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d18e5da818db4bbab4359c2b6f13f93f',ramdisk_id='',reservation_id='r-d84dx2ud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1095709842',owner_user_name='tempest-TaggedBootDevicesTest-1095709842-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:21:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b306455ac86f4464b585007877c7fc97',uuid=09a20950-bce9-4c83-82db-e058872ae358,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32d1ff81-fed5-47fe-88ce-04bd2777f1e5", "address": "fa:16:3e:b5:df:02", "network": {"id": "b1aa635b-9b29-45b6-8cd4-06ccd9e0f545", "bridge": "br-int", "label": "tempest-device-tagging-net1-2012050279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d1ff81-fe", "ovs_interfaceid": "32d1ff81-fed5-47fe-88ce-04bd2777f1e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Converting VIF {"id": "32d1ff81-fed5-47fe-88ce-04bd2777f1e5", "address": "fa:16:3e:b5:df:02", "network": {"id": "b1aa635b-9b29-45b6-8cd4-06ccd9e0f545", "bridge": "br-int", "label": "tempest-device-tagging-net1-2012050279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d1ff81-fe", "ovs_interfaceid": "32d1ff81-fed5-47fe-88ce-04bd2777f1e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:df:02,bridge_name='br-int',has_traffic_filtering=True,id=32d1ff81-fed5-47fe-88ce-04bd2777f1e5,network=Network(b1aa635b-9b29-45b6-8cd4-06ccd9e0f545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32d1ff81-fe') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG os_vif [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:df:02,bridge_name='br-int',has_traffic_filtering=True,id=32d1ff81-fed5-47fe-88ce-04bd2777f1e5,network=Network(b1aa635b-9b29-45b6-8cd4-06ccd9e0f545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32d1ff81-fe') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap32d1ff81-fe, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:37 user nova-compute[72362]: INFO os_vif [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:df:02,bridge_name='br-int',has_traffic_filtering=True,id=32d1ff81-fed5-47fe-88ce-04bd2777f1e5,network=Network(b1aa635b-9b29-45b6-8cd4-06ccd9e0f545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32d1ff81-fe')
Aug 09 10:23:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-445751592',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-445751592',id=16,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjmyWbMuiYwF3FarfTsEVQBll5AtEBHU5mcq0TNfpZjnm47NEOTKkLyChcDjkjpAKpX4t5dZ90uBnn976//CfCicnjiqQH8Rf/FqLWCYp0xuTRU8vwDe8CWZFymiWd5Cw==',key_name='tempest-keypair-2092297342',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:21:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d18e5da818db4bbab4359c2b6f13f93f',ramdisk_id='',reservation_id='r-d84dx2ud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1095709842',owner_user_name='tempest-TaggedBootDevicesTest-1095709842-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:21:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b306455ac86f4464b585007877c7fc97',uuid=09a20950-bce9-4c83-82db-e058872ae358,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41551d54-2c78-4fbe-9b7a-43452c5e94da", "address": "fa:16:3e:d8:11:91", "network": {"id": "b1aa635b-9b29-45b6-8cd4-06ccd9e0f545", "bridge": "br-int", "label": "tempest-device-tagging-net1-2012050279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41551d54-2c", "ovs_interfaceid": "41551d54-2c78-4fbe-9b7a-43452c5e94da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Converting VIF {"id": "41551d54-2c78-4fbe-9b7a-43452c5e94da", "address": "fa:16:3e:d8:11:91", "network": {"id": "b1aa635b-9b29-45b6-8cd4-06ccd9e0f545", "bridge": "br-int", "label": "tempest-device-tagging-net1-2012050279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41551d54-2c", "ovs_interfaceid": "41551d54-2c78-4fbe-9b7a-43452c5e94da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:11:91,bridge_name='br-int',has_traffic_filtering=True,id=41551d54-2c78-4fbe-9b7a-43452c5e94da,network=Network(b1aa635b-9b29-45b6-8cd4-06ccd9e0f545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41551d54-2c') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG os_vif [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:11:91,bridge_name='br-int',has_traffic_filtering=True,id=41551d54-2c78-4fbe-9b7a-43452c5e94da,network=Network(b1aa635b-9b29-45b6-8cd4-06ccd9e0f545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41551d54-2c') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap41551d54-2c, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:37 user nova-compute[72362]: INFO os_vif [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:11:91,bridge_name='br-int',has_traffic_filtering=True,id=41551d54-2c78-4fbe-9b7a-43452c5e94da,network=Network(b1aa635b-9b29-45b6-8cd4-06ccd9e0f545),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41551d54-2c')
Aug 09 10:23:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-445751592',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-445751592',id=16,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjmyWbMuiYwF3FarfTsEVQBll5AtEBHU5mcq0TNfpZjnm47NEOTKkLyChcDjkjpAKpX4t5dZ90uBnn976//CfCicnjiqQH8Rf/FqLWCYp0xuTRU8vwDe8CWZFymiWd5Cw==',key_name='tempest-keypair-2092297342',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:21:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d18e5da818db4bbab4359c2b6f13f93f',ramdisk_id='',reservation_id='r-d84dx2ud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1095709842',owner_user_name='tempest-TaggedBootDevicesTest-1095709842-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:21:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b306455ac86f4464b585007877c7fc97',uuid=09a20950-bce9-4c83-82db-e058872ae358,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de067d87-6780-4c38-bf69-7d976cbde30a", "address": "fa:16:3e:e1:62:57", "network": {"id": "6e7161bb-3d35-4adb-89d3-aa23f97adbfa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1214229212", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde067d87-67", "ovs_interfaceid": "de067d87-6780-4c38-bf69-7d976cbde30a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Converting VIF {"id": "de067d87-6780-4c38-bf69-7d976cbde30a", "address": "fa:16:3e:e1:62:57", "network": {"id": "6e7161bb-3d35-4adb-89d3-aa23f97adbfa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1214229212", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde067d87-67", "ovs_interfaceid": "de067d87-6780-4c38-bf69-7d976cbde30a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:62:57,bridge_name='br-int',has_traffic_filtering=True,id=de067d87-6780-4c38-bf69-7d976cbde30a,network=Network(6e7161bb-3d35-4adb-89d3-aa23f97adbfa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde067d87-67') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG os_vif [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:62:57,bridge_name='br-int',has_traffic_filtering=True,id=de067d87-6780-4c38-bf69-7d976cbde30a,network=Network(6e7161bb-3d35-4adb-89d3-aa23f97adbfa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde067d87-67') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde067d87-67, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:37 user nova-compute[72362]: INFO os_vif [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:62:57,bridge_name='br-int',has_traffic_filtering=True,id=de067d87-6780-4c38-bf69-7d976cbde30a,network=Network(6e7161bb-3d35-4adb-89d3-aa23f97adbfa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde067d87-67')
Aug 09 10:23:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-445751592',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-445751592',id=16,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjmyWbMuiYwF3FarfTsEVQBll5AtEBHU5mcq0TNfpZjnm47NEOTKkLyChcDjkjpAKpX4t5dZ90uBnn976//CfCicnjiqQH8Rf/FqLWCYp0xuTRU8vwDe8CWZFymiWd5Cw==',key_name='tempest-keypair-2092297342',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:21:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d18e5da818db4bbab4359c2b6f13f93f',ramdisk_id='',reservation_id='r-d84dx2ud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1095709842',owner_user_name='tempest-TaggedBootDevicesTest-1095709842-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:21:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b306455ac86f4464b585007877c7fc97',uuid=09a20950-bce9-4c83-82db-e058872ae358,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb0c5adb-40d5-4fb6-b458-35a85c670333", "address": "fa:16:3e:8a:63:cf", "network": {"id": "6e7161bb-3d35-4adb-89d3-aa23f97adbfa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1214229212", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb0c5adb-40", "ovs_interfaceid": "cb0c5adb-40d5-4fb6-b458-35a85c670333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Converting VIF {"id": "cb0c5adb-40d5-4fb6-b458-35a85c670333", "address": "fa:16:3e:8a:63:cf", "network": {"id": "6e7161bb-3d35-4adb-89d3-aa23f97adbfa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1214229212", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb0c5adb-40", "ovs_interfaceid": "cb0c5adb-40d5-4fb6-b458-35a85c670333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:63:cf,bridge_name='br-int',has_traffic_filtering=True,id=cb0c5adb-40d5-4fb6-b458-35a85c670333,network=Network(6e7161bb-3d35-4adb-89d3-aa23f97adbfa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb0c5adb-40') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG os_vif [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:63:cf,bridge_name='br-int',has_traffic_filtering=True,id=cb0c5adb-40d5-4fb6-b458-35a85c670333,network=Network(6e7161bb-3d35-4adb-89d3-aa23f97adbfa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb0c5adb-40') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb0c5adb-40, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:37 user nova-compute[72362]: INFO os_vif [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:63:cf,bridge_name='br-int',has_traffic_filtering=True,id=cb0c5adb-40d5-4fb6-b458-35a85c670333,network=Network(6e7161bb-3d35-4adb-89d3-aa23f97adbfa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb0c5adb-40')
Aug 09 10:23:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KMUpNhnz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:23:37 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:23:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f461d61c-d6b3-4f10-bb1b-b39372ed4e08]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5dba28f-fe90-432c-adb2-b8df9c01d416]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 (non-flash)
Aug 09 10:23:37 user nova-compute[72362]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 (non-flash)
Aug 09 10:23:37 user nova-compute[72362]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 (non-flash)
Aug 09 10:23:37 user nova-compute[72362]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:23:37 user nova-compute[72362]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:23:37 user nova-compute[72362]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361 (non-flash)
Aug 09 10:23:37 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 (non-flash)
Aug 09 10:23:37 user nova-compute[72362]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 (non-flash)
Aug 09 10:23:37 user nova-compute[72362]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 (non-flash)
Aug 09 10:23:37 user nova-compute[72362]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:23:37 user nova-compute[72362]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:23:37 user nova-compute[72362]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361 (non-flash)
Aug 09 10:23:37 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34dc7bd510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28'): ({'sdd'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Removing single pathed devices sdd {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:37 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b47783a-fe78-4f2d-a0cd-76369e21aef9]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0abb39a0-5798-4c6f-a21a-258b2b3fad6c]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Flushing IO for device /dev/sdd {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[915fa802-3c36-43ea-a003-009547258b4f]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG nova.compute.manager [req-15b6644e-a6dc-40f6-8397-d4ca57aae6e3 req-3984cadc-9759-477b-abed-a728b2a26e99 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received event network-vif-plugged-5fd897a8-78c2-49be-b1d6-867bab82082d {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-15b6644e-a6dc-40f6-8397-d4ca57aae6e3 req-3984cadc-9759-477b-abed-a728b2a26e99 service nova] Acquiring lock "09a20950-bce9-4c83-82db-e058872ae358-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-15b6644e-a6dc-40f6-8397-d4ca57aae6e3 req-3984cadc-9759-477b-abed-a728b2a26e99 service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-15b6644e-a6dc-40f6-8397-d4ca57aae6e3 req-3984cadc-9759-477b-abed-a728b2a26e99 service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG nova.compute.manager [req-15b6644e-a6dc-40f6-8397-d4ca57aae6e3 req-3984cadc-9759-477b-abed-a728b2a26e99 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] No waiting events found dispatching network-vif-plugged-5fd897a8-78c2-49be-b1d6-867bab82082d {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:23:38 user nova-compute[72362]: WARNING nova.compute.manager [req-15b6644e-a6dc-40f6-8397-d4ca57aae6e3 req-3984cadc-9759-477b-abed-a728b2a26e99 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received unexpected event network-vif-plugged-5fd897a8-78c2-49be-b1d6-867bab82082d for instance with vm_state active and task_state deleting.
Aug 09 10:23:38 user nova-compute[72362]: DEBUG nova.compute.manager [req-15b6644e-a6dc-40f6-8397-d4ca57aae6e3 req-3984cadc-9759-477b-abed-a728b2a26e99 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received event network-vif-unplugged-41551d54-2c78-4fbe-9b7a-43452c5e94da {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-15b6644e-a6dc-40f6-8397-d4ca57aae6e3 req-3984cadc-9759-477b-abed-a728b2a26e99 service nova] Acquiring lock "09a20950-bce9-4c83-82db-e058872ae358-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-15b6644e-a6dc-40f6-8397-d4ca57aae6e3 req-3984cadc-9759-477b-abed-a728b2a26e99 service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-15b6644e-a6dc-40f6-8397-d4ca57aae6e3 req-3984cadc-9759-477b-abed-a728b2a26e99 service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG nova.compute.manager [req-15b6644e-a6dc-40f6-8397-d4ca57aae6e3 req-3984cadc-9759-477b-abed-a728b2a26e99 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] No waiting events found dispatching network-vif-unplugged-41551d54-2c78-4fbe-9b7a-43452c5e94da {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG nova.compute.manager [req-15b6644e-a6dc-40f6-8397-d4ca57aae6e3 req-3984cadc-9759-477b-abed-a728b2a26e99 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received event network-vif-unplugged-41551d54-2c78-4fbe-9b7a-43452c5e94da for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG nova.compute.manager [req-15b6644e-a6dc-40f6-8397-d4ca57aae6e3 req-3984cadc-9759-477b-abed-a728b2a26e99 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received event network-vif-plugged-41551d54-2c78-4fbe-9b7a-43452c5e94da {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-15b6644e-a6dc-40f6-8397-d4ca57aae6e3 req-3984cadc-9759-477b-abed-a728b2a26e99 service nova] Acquiring lock "09a20950-bce9-4c83-82db-e058872ae358-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-15b6644e-a6dc-40f6-8397-d4ca57aae6e3 req-3984cadc-9759-477b-abed-a728b2a26e99 service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-15b6644e-a6dc-40f6-8397-d4ca57aae6e3 req-3984cadc-9759-477b-abed-a728b2a26e99 service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG nova.compute.manager [req-15b6644e-a6dc-40f6-8397-d4ca57aae6e3 req-3984cadc-9759-477b-abed-a728b2a26e99 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] No waiting events found dispatching network-vif-plugged-41551d54-2c78-4fbe-9b7a-43452c5e94da {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:23:38 user nova-compute[72362]: WARNING nova.compute.manager [req-15b6644e-a6dc-40f6-8397-d4ca57aae6e3 req-3984cadc-9759-477b-abed-a728b2a26e99 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received unexpected event network-vif-plugged-41551d54-2c78-4fbe-9b7a-43452c5e94da for instance with vm_state active and task_state deleting.
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e5abba-b35b-4b4f-9cdf-8a0c48cad6b9]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] SCSI volumes sdd have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc99afb9-16e8-4bf0-8f6c-2b82bd4abdca]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-789e7315-8eef-49ca-821f-8bbdc106885c tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-789e7315-8eef-49ca-821f-8bbdc106885c tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXfyDmWR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:23:38 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-789e7315-8eef-49ca-821f-8bbdc106885c tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:23:38 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-789e7315-8eef-49ca-821f-8bbdc106885c tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[357e41c6-82b9-440e-9da8-a894719c103b]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28, portal: 172.16.0.220,3260]
Aug 09 10:23:38 user nova-compute[72362]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28, portal: 172.16.0.220,3260] successful.
Aug 09 10:23:38 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deb67b62-54b5-4129-bf15-580c82d0ab28 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc19924a-ab71-47eb-bc9f-baa146548f6e]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] <== disconnect_volume: return (361ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-789e7315-8eef-49ca-821f-8bbdc106885c tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.050s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:23:38 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-789e7315-8eef-49ca-821f-8bbdc106885c tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:23:38 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-789e7315-8eef-49ca-821f-8bbdc106885c tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-789e7315-8eef-49ca-821f-8bbdc106885c tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:23:38 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-789e7315-8eef-49ca-821f-8bbdc106885c tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tISMzEJk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:23:38 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:23:38 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c52cd7-705f-4a8f-b591-933095454bf0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-789e7315-8eef-49ca-821f-8bbdc106885c tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:23:38 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG nova.compute.manager [req-ceeb0fd2-109a-436d-8294-eaf9ab1d4396 req-52be6391-a391-4063-8361-4a239f2f315b service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received event network-vif-plugged-f1457dd7-06e1-43ac-a55d-3f4f9fe150f8 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ceeb0fd2-109a-436d-8294-eaf9ab1d4396 req-52be6391-a391-4063-8361-4a239f2f315b service nova] Acquiring lock "09a20950-bce9-4c83-82db-e058872ae358-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ceeb0fd2-109a-436d-8294-eaf9ab1d4396 req-52be6391-a391-4063-8361-4a239f2f315b service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ceeb0fd2-109a-436d-8294-eaf9ab1d4396 req-52be6391-a391-4063-8361-4a239f2f315b service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG nova.compute.manager [req-ceeb0fd2-109a-436d-8294-eaf9ab1d4396 req-52be6391-a391-4063-8361-4a239f2f315b service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] No waiting events found dispatching network-vif-plugged-f1457dd7-06e1-43ac-a55d-3f4f9fe150f8 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:23:38 user nova-compute[72362]: WARNING nova.compute.manager [req-ceeb0fd2-109a-436d-8294-eaf9ab1d4396 req-52be6391-a391-4063-8361-4a239f2f315b service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received unexpected event network-vif-plugged-f1457dd7-06e1-43ac-a55d-3f4f9fe150f8 for instance with vm_state active and task_state deleting.
Aug 09 10:23:38 user nova-compute[72362]: DEBUG nova.compute.manager [req-ceeb0fd2-109a-436d-8294-eaf9ab1d4396 req-52be6391-a391-4063-8361-4a239f2f315b service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received event network-vif-unplugged-21baa9dd-a7b0-445e-be2e-ab8b953bae49 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ceeb0fd2-109a-436d-8294-eaf9ab1d4396 req-52be6391-a391-4063-8361-4a239f2f315b service nova] Acquiring lock "09a20950-bce9-4c83-82db-e058872ae358-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ceeb0fd2-109a-436d-8294-eaf9ab1d4396 req-52be6391-a391-4063-8361-4a239f2f315b service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ceeb0fd2-109a-436d-8294-eaf9ab1d4396 req-52be6391-a391-4063-8361-4a239f2f315b service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG nova.compute.manager [req-ceeb0fd2-109a-436d-8294-eaf9ab1d4396 req-52be6391-a391-4063-8361-4a239f2f315b service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] No waiting events found dispatching network-vif-unplugged-21baa9dd-a7b0-445e-be2e-ab8b953bae49 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG nova.compute.manager [req-ceeb0fd2-109a-436d-8294-eaf9ab1d4396 req-52be6391-a391-4063-8361-4a239f2f315b service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received event network-vif-unplugged-21baa9dd-a7b0-445e-be2e-ab8b953bae49 for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG nova.compute.manager [req-ceeb0fd2-109a-436d-8294-eaf9ab1d4396 req-52be6391-a391-4063-8361-4a239f2f315b service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received event network-vif-plugged-21baa9dd-a7b0-445e-be2e-ab8b953bae49 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ceeb0fd2-109a-436d-8294-eaf9ab1d4396 req-52be6391-a391-4063-8361-4a239f2f315b service nova] Acquiring lock "09a20950-bce9-4c83-82db-e058872ae358-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ceeb0fd2-109a-436d-8294-eaf9ab1d4396 req-52be6391-a391-4063-8361-4a239f2f315b service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ceeb0fd2-109a-436d-8294-eaf9ab1d4396 req-52be6391-a391-4063-8361-4a239f2f315b service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG nova.compute.manager [req-ceeb0fd2-109a-436d-8294-eaf9ab1d4396 req-52be6391-a391-4063-8361-4a239f2f315b service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] No waiting events found dispatching network-vif-plugged-21baa9dd-a7b0-445e-be2e-ab8b953bae49 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:23:38 user nova-compute[72362]: WARNING nova.compute.manager [req-ceeb0fd2-109a-436d-8294-eaf9ab1d4396 req-52be6391-a391-4063-8361-4a239f2f315b service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received unexpected event network-vif-plugged-21baa9dd-a7b0-445e-be2e-ab8b953bae49 for instance with vm_state active and task_state deleting.
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1151d95-880d-40b9-9a01-a4cbfaff5914]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-789e7315-8eef-49ca-821f-8bbdc106885c tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b] added
Aug 09 10:23:38 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1b9644-1494-49bc-8ff1-c8f00c731eef]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-789e7315-8eef-49ca-821f-8bbdc106885c tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[07fc538b-6110-490e-9870-70eb9058e2f5]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-789e7315-8eef-49ca-821f-8bbdc106885c tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EXfyDmWR {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EXfyDmWR" returned: 0 in 0.024s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[10269cc8-e680-4168-b8c5-227eee13b3a1]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-789e7315-8eef-49ca-821f-8bbdc106885c tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EXfyDmWR'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[2031fcac-6966-4743-8958-a213174da051]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-789e7315-8eef-49ca-821f-8bbdc106885c tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0017078c-28cb-4774-8539-5caf7b18ec9c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-789e7315-8eef-49ca-821f-8bbdc106885c tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 (non-flash)
Aug 09 10:23:38 user nova-compute[72362]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 (non-flash)
Aug 09 10:23:38 user nova-compute[72362]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:23:38 user nova-compute[72362]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:23:38 user nova-compute[72362]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361 (non-flash)
Aug 09 10:23:38 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-789e7315-8eef-49ca-821f-8bbdc106885c tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 (non-flash)
Aug 09 10:23:38 user nova-compute[72362]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 (non-flash)
Aug 09 10:23:38 user nova-compute[72362]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:23:38 user nova-compute[72362]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:23:38 user nova-compute[72362]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361 (non-flash)
Aug 09 10:23:38 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG nova.compute.manager [req-1555285a-f1ad-43b3-8346-0664ff328b4c req-c9b48a1f-f3d3-4503-a31d-5d0cb09dee3b service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received event network-vif-plugged-32d1ff81-fed5-47fe-88ce-04bd2777f1e5 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-1555285a-f1ad-43b3-8346-0664ff328b4c req-c9b48a1f-f3d3-4503-a31d-5d0cb09dee3b service nova] Acquiring lock "09a20950-bce9-4c83-82db-e058872ae358-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-1555285a-f1ad-43b3-8346-0664ff328b4c req-c9b48a1f-f3d3-4503-a31d-5d0cb09dee3b service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-1555285a-f1ad-43b3-8346-0664ff328b4c req-c9b48a1f-f3d3-4503-a31d-5d0cb09dee3b service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG nova.compute.manager [req-1555285a-f1ad-43b3-8346-0664ff328b4c req-c9b48a1f-f3d3-4503-a31d-5d0cb09dee3b service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] No waiting events found dispatching network-vif-plugged-32d1ff81-fed5-47fe-88ce-04bd2777f1e5 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:23:38 user nova-compute[72362]: WARNING nova.compute.manager [req-1555285a-f1ad-43b3-8346-0664ff328b4c req-c9b48a1f-f3d3-4503-a31d-5d0cb09dee3b service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received unexpected event network-vif-plugged-32d1ff81-fed5-47fe-88ce-04bd2777f1e5 for instance with vm_state active and task_state deleting.
Aug 09 10:23:38 user nova-compute[72362]: DEBUG nova.compute.manager [req-1555285a-f1ad-43b3-8346-0664ff328b4c req-c9b48a1f-f3d3-4503-a31d-5d0cb09dee3b service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received event network-vif-unplugged-de067d87-6780-4c38-bf69-7d976cbde30a {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-1555285a-f1ad-43b3-8346-0664ff328b4c req-c9b48a1f-f3d3-4503-a31d-5d0cb09dee3b service nova] Acquiring lock "09a20950-bce9-4c83-82db-e058872ae358-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-1555285a-f1ad-43b3-8346-0664ff328b4c req-c9b48a1f-f3d3-4503-a31d-5d0cb09dee3b service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-1555285a-f1ad-43b3-8346-0664ff328b4c req-c9b48a1f-f3d3-4503-a31d-5d0cb09dee3b service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG nova.compute.manager [req-1555285a-f1ad-43b3-8346-0664ff328b4c req-c9b48a1f-f3d3-4503-a31d-5d0cb09dee3b service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] No waiting events found dispatching network-vif-unplugged-de067d87-6780-4c38-bf69-7d976cbde30a {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG nova.compute.manager [req-1555285a-f1ad-43b3-8346-0664ff328b4c req-c9b48a1f-f3d3-4503-a31d-5d0cb09dee3b service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received event network-vif-unplugged-de067d87-6780-4c38-bf69-7d976cbde30a for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG nova.compute.manager [req-1555285a-f1ad-43b3-8346-0664ff328b4c req-c9b48a1f-f3d3-4503-a31d-5d0cb09dee3b service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received event network-vif-plugged-de067d87-6780-4c38-bf69-7d976cbde30a {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-1555285a-f1ad-43b3-8346-0664ff328b4c req-c9b48a1f-f3d3-4503-a31d-5d0cb09dee3b service nova] Acquiring lock "09a20950-bce9-4c83-82db-e058872ae358-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-1555285a-f1ad-43b3-8346-0664ff328b4c req-c9b48a1f-f3d3-4503-a31d-5d0cb09dee3b service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-1555285a-f1ad-43b3-8346-0664ff328b4c req-c9b48a1f-f3d3-4503-a31d-5d0cb09dee3b service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG nova.compute.manager [req-1555285a-f1ad-43b3-8346-0664ff328b4c req-c9b48a1f-f3d3-4503-a31d-5d0cb09dee3b service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] No waiting events found dispatching network-vif-plugged-de067d87-6780-4c38-bf69-7d976cbde30a {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:23:38 user nova-compute[72362]: WARNING nova.compute.manager [req-1555285a-f1ad-43b3-8346-0664ff328b4c req-c9b48a1f-f3d3-4503-a31d-5d0cb09dee3b service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received unexpected event network-vif-plugged-de067d87-6780-4c38-bf69-7d976cbde30a for instance with vm_state active and task_state deleting.
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5820b981-68c6-420d-8f56-1180cdccb774]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-789e7315-8eef-49ca-821f-8bbdc106885c tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b, portal: 172.16.0.220,3260]
Aug 09 10:23:38 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b, portal: 172.16.0.220,3260] successful.
Aug 09 10:23:38 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[217d6824-a886-47c2-a878-eee7bd8e1739]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-789e7315-8eef-49ca-821f-8bbdc106885c tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84dd7ca-8ea4-4bc5-9411-b9cac7e01c9f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-789e7315-8eef-49ca-821f-8bbdc106885c tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 (non-flash)
Aug 09 10:23:38 user nova-compute[72362]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 (non-flash)
Aug 09 10:23:38 user nova-compute[72362]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:23:38 user nova-compute[72362]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:23:38 user nova-compute[72362]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361 (non-flash)
Aug 09 10:23:38 user nova-compute[72362]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:23:38 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-789e7315-8eef-49ca-821f-8bbdc106885c tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 (non-flash)
Aug 09 10:23:38 user nova-compute[72362]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 (non-flash)
Aug 09 10:23:38 user nova-compute[72362]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:23:38 user nova-compute[72362]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:23:38 user nova-compute[72362]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361 (non-flash)
Aug 09 10:23:38 user nova-compute[72362]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:23:38 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-789e7315-8eef-49ca-821f-8bbdc106885c tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-789e7315-8eef-49ca-821f-8bbdc106885c tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-789e7315-8eef-49ca-821f-8bbdc106885c tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-789e7315-8eef-49ca-821f-8bbdc106885c tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9c3f88-a696-422a-af44-945908107898]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:38 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-789e7315-8eef-49ca-821f-8bbdc106885c tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: None {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-789e7315-8eef-49ca-821f-8bbdc106885c tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-789e7315-8eef-49ca-821f-8bbdc106885c tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXfyDmWR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-789e7315-8eef-49ca-821f-8bbdc106885c tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-789e7315-8eef-49ca-821f-8bbdc106885c tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] <== connect_volume: return (1434ms) {'type': 'block', 'scsi_wwn': '26437336564613734', 'path': '/dev/sdd'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-789e7315-8eef-49ca-821f-8bbdc106885c tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437336564613734', 'path': '/dev/sdd'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.379s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG nova.objects.instance [None req-789e7315-8eef-49ca-821f-8bbdc106885c tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lazy-loading 'flavor' on Instance uuid a6000393-6044-4b54-ac0b-1d631e2ed0ae {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[2012721a-ce43-4e88-bab4-7f1263b63719]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-789e7315-8eef-49ca-821f-8bbdc106885c tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 10:23:39 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:23:39 user nova-compute[72362]:   <source dev="/dev/sdd"/>
Aug 09 10:23:39 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:23:39 user nova-compute[72362]:   <serial>cb2be0ee-763d-488d-b7e6-65e39d26b53b</serial>
Aug 09 10:23:39 user nova-compute[72362]: </disk>
Aug 09 10:23:39 user nova-compute[72362]:  {{(pid=72362) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[da04357c-1430-448d-a4b0-25966d8635b9]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 (non-flash)
Aug 09 10:23:39 user nova-compute[72362]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 (non-flash)
Aug 09 10:23:39 user nova-compute[72362]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:23:39 user nova-compute[72362]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:23:39 user nova-compute[72362]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361 (non-flash)
Aug 09 10:23:39 user nova-compute[72362]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:23:39 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 (non-flash)
Aug 09 10:23:39 user nova-compute[72362]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 (non-flash)
Aug 09 10:23:39 user nova-compute[72362]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:23:39 user nova-compute[72362]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:23:39 user nova-compute[72362]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361 (non-flash)
Aug 09 10:23:39 user nova-compute[72362]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:23:39 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e45dcdc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31'): ({'sde'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Removing single pathed devices sde {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0529dc42-7b46-4291-9083-53c2f5a05c97]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdb3701-2238-4288-9ca5-c223b98be8ea]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Flushing IO for device /dev/sde {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f90eeb-55b2-472f-9c8d-28a42a404ea8]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe0050a-8494-405e-907a-baeb3721442a]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] SCSI volumes sde have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d971f0-ea36-4f09-8b04-0e360c8a77b4]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbc51f7-51f7-4c95-a5f0-8214f65e04d9]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31, portal: 172.16.0.220,3260]
Aug 09 10:23:39 user nova-compute[72362]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31, portal: 172.16.0.220,3260] successful.
Aug 09 10:23:39 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f562c44-6d2f-49a0-ac17-a67fed224b31 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27e13e7-8236-436e-b059-d0cb87b1a872]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] <== disconnect_volume: return (1707ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OTsbPwVa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:23:39 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:23:39 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:39 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e5406b-5882-450a-aeda-a9e6095b2c28]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6186cac6-c97b-4a8a-94a8-4d84ec1f305a]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 (non-flash)
Aug 09 10:23:40 user nova-compute[72362]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:23:40 user nova-compute[72362]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:23:40 user nova-compute[72362]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361 (non-flash)
Aug 09 10:23:40 user nova-compute[72362]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:23:40 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 (non-flash)
Aug 09 10:23:40 user nova-compute[72362]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:23:40 user nova-compute[72362]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:23:40 user nova-compute[72362]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361 (non-flash)
Aug 09 10:23:40 user nova-compute[72362]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:23:40 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e45dd360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5'): ({'sdf'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Removing single pathed devices sdf {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[590fb2d6-fb7d-4fa0-8da5-fbfcc32fa2ce]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6969cd40-5bef-463b-85b2-a306053c219d]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Flushing IO for device /dev/sdf {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[8410c738-91c2-493f-bd02-27c407c73eaf]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-789e7315-8eef-49ca-821f-8bbdc106885c tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-789e7315-8eef-49ca-821f-8bbdc106885c tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-789e7315-8eef-49ca-821f-8bbdc106885c tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] No VIF found with MAC fa:16:3e:6e:b0:73, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG nova.compute.manager [req-22e3a64c-20ec-446a-8ce2-e5f09f659e6e req-a573ffe7-8ddf-44ef-aebb-d2afe2f63234 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received event network-vif-unplugged-cb0c5adb-40d5-4fb6-b458-35a85c670333 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-22e3a64c-20ec-446a-8ce2-e5f09f659e6e req-a573ffe7-8ddf-44ef-aebb-d2afe2f63234 service nova] Acquiring lock "09a20950-bce9-4c83-82db-e058872ae358-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-22e3a64c-20ec-446a-8ce2-e5f09f659e6e req-a573ffe7-8ddf-44ef-aebb-d2afe2f63234 service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-22e3a64c-20ec-446a-8ce2-e5f09f659e6e req-a573ffe7-8ddf-44ef-aebb-d2afe2f63234 service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG nova.compute.manager [req-22e3a64c-20ec-446a-8ce2-e5f09f659e6e req-a573ffe7-8ddf-44ef-aebb-d2afe2f63234 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] No waiting events found dispatching network-vif-unplugged-cb0c5adb-40d5-4fb6-b458-35a85c670333 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG nova.compute.manager [req-22e3a64c-20ec-446a-8ce2-e5f09f659e6e req-a573ffe7-8ddf-44ef-aebb-d2afe2f63234 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received event network-vif-unplugged-cb0c5adb-40d5-4fb6-b458-35a85c670333 for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG nova.compute.manager [req-22e3a64c-20ec-446a-8ce2-e5f09f659e6e req-a573ffe7-8ddf-44ef-aebb-d2afe2f63234 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received event network-vif-plugged-cb0c5adb-40d5-4fb6-b458-35a85c670333 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-22e3a64c-20ec-446a-8ce2-e5f09f659e6e req-a573ffe7-8ddf-44ef-aebb-d2afe2f63234 service nova] Acquiring lock "09a20950-bce9-4c83-82db-e058872ae358-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-22e3a64c-20ec-446a-8ce2-e5f09f659e6e req-a573ffe7-8ddf-44ef-aebb-d2afe2f63234 service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-22e3a64c-20ec-446a-8ce2-e5f09f659e6e req-a573ffe7-8ddf-44ef-aebb-d2afe2f63234 service nova] Lock "09a20950-bce9-4c83-82db-e058872ae358-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG nova.compute.manager [req-22e3a64c-20ec-446a-8ce2-e5f09f659e6e req-a573ffe7-8ddf-44ef-aebb-d2afe2f63234 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] No waiting events found dispatching network-vif-plugged-cb0c5adb-40d5-4fb6-b458-35a85c670333 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:23:40 user nova-compute[72362]: WARNING nova.compute.manager [req-22e3a64c-20ec-446a-8ce2-e5f09f659e6e req-a573ffe7-8ddf-44ef-aebb-d2afe2f63234 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received unexpected event network-vif-plugged-cb0c5adb-40d5-4fb6-b458-35a85c670333 for instance with vm_state active and task_state deleting.
Aug 09 10:23:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[423ed7c7-082d-4601-9842-2a49e5456e0d]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] SCSI volumes sdf have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf56b55b-1ffe-4fc7-ac33-6a159a8cd90d]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfef270c-fb80-44fe-a3b9-d64ad0998fc2]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5, portal: 172.16.0.220,3260]
Aug 09 10:23:40 user nova-compute[72362]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5, portal: 172.16.0.220,3260] successful.
Aug 09 10:23:40 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfac3d0-b7f2-45e7-951c-60781c8515e5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0909d3-16b0-4d6f-b063-9c9c4a7662aa]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] <== disconnect_volume: return (355ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:23:40 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Deleting instance files /opt/stack/data/nova/instances/09a20950-bce9-4c83-82db-e058872ae358_del
Aug 09 10:23:40 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Deletion of /opt/stack/data/nova/instances/09a20950-bce9-4c83-82db-e058872ae358_del complete
Aug 09 10:23:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-789e7315-8eef-49ca-821f-8bbdc106885c tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.637s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:23:40 user nova-compute[72362]: INFO nova.compute.manager [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Took 4.73 seconds to destroy the instance on the hypervisor.
Aug 09 10:23:40 user nova-compute[72362]: DEBUG oslo.service.loopingcall [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72362) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG nova.compute.manager [-] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Deallocating network for instance {{(pid=72362) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 10:23:40 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 09a20950-bce9-4c83-82db-e058872ae358] deallocate_for_instance() {{(pid=72362) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 10:23:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4cc40f6c-7dc1-4d21-a193-bbc4517989f6 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Acquiring lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:23:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4cc40f6c-7dc1-4d21-a193-bbc4517989f6 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:23:41 user nova-compute[72362]: DEBUG nova.compute.manager [None req-4cc40f6c-7dc1-4d21-a193-bbc4517989f6 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:23:41 user nova-compute[72362]: DEBUG nova.compute.manager [None req-4cc40f6c-7dc1-4d21-a193-bbc4517989f6 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72362) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 09 10:23:41 user nova-compute[72362]: DEBUG nova.objects.instance [None req-4cc40f6c-7dc1-4d21-a193-bbc4517989f6 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lazy-loading 'flavor' on Instance uuid a6000393-6044-4b54-ac0b-1d631e2ed0ae {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:23:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG nova.compute.manager [req-39efc59f-bfcd-4265-915a-eec1696582bc req-95a3e43b-586e-41cc-97d7-7d651b6dde72 service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Received event network-vif-unplugged-8c0230bc-c7a7-4497-af9a-2fafb259605c {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-39efc59f-bfcd-4265-915a-eec1696582bc req-95a3e43b-586e-41cc-97d7-7d651b6dde72 service nova] Acquiring lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-39efc59f-bfcd-4265-915a-eec1696582bc req-95a3e43b-586e-41cc-97d7-7d651b6dde72 service nova] Lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-39efc59f-bfcd-4265-915a-eec1696582bc req-95a3e43b-586e-41cc-97d7-7d651b6dde72 service nova] Lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG nova.compute.manager [req-39efc59f-bfcd-4265-915a-eec1696582bc req-95a3e43b-586e-41cc-97d7-7d651b6dde72 service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] No waiting events found dispatching network-vif-unplugged-8c0230bc-c7a7-4497-af9a-2fafb259605c {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:23:42 user nova-compute[72362]: WARNING nova.compute.manager [req-39efc59f-bfcd-4265-915a-eec1696582bc req-95a3e43b-586e-41cc-97d7-7d651b6dde72 service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Received unexpected event network-vif-unplugged-8c0230bc-c7a7-4497-af9a-2fafb259605c for instance with vm_state active and task_state powering-off.
Aug 09 10:23:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:42 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Instance destroyed successfully.
Aug 09 10:23:42 user nova-compute[72362]: DEBUG nova.compute.manager [None req-4cc40f6c-7dc1-4d21-a193-bbc4517989f6 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:23:42 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Creating image(s)
Aug 09 10:23:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Did not create local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Ensure instance console log exists: /opt/stack/data/nova/instances/6493ab9a-4d69-434d-bed7-e51f1c5f3497/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Start _get_guest_xml network_info=[{"id": "a9017bf2-874f-419a-aae5-43f2ce4a63dd", "address": "fa:16:3e:ac:ef:70", "network": {"id": "0f5e6621-493c-440d-aaec-419fc6111969", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1795951162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec98263d80c34ed19b02d7c8cdb8a627", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9017bf2-87", "ovs_interfaceid": "a9017bf2-874f-419a-aae5-43f2ce4a63dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '693799da-3840-4752-b7f3-80140638fba1', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KJEmzxkc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6493ab9a-4d69-434d-bed7-e51f1c5f3497', 'attached_at': '', 'detached_at': '', 'volume_id': 'b2bcc794-ae54-4b73-8b5e-751599d537f6', 'serial': 'b2bcc794-ae54-4b73-8b5e-751599d537f6'}, 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:23:42 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 09 10:23:42 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 09 10:23:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG nova.objects.instance [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6493ab9a-4d69-434d-bed7-e51f1c5f3497 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KJEmzxkc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:23:42 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 10:23:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:23:42 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 10:23:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:23:42 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:23:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4cc40f6c-7dc1-4d21-a193-bbc4517989f6 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.136s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a451e4e6-cb04-4a6d-82c2-fb448c79b8e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:23:42 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[69882085-04c0-4f21-9004-1c009246d850]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6] added
Aug 09 10:23:42 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[045f5736-6e0d-4ae7-8033-921018551e6d]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[8749b768-62d9-4d44-941c-f329033b6ee0]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KJEmzxkc {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KJEmzxkc" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b966d6-64cf-470c-86ff-ffdb22e760ce]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KJEmzxkc'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[273b2c03-b054-4b87-98f6-68a077ad413c]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[281923df-b756-458a-aeb9-627c1510c554]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:23:42 user nova-compute[72362]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:23:42 user nova-compute[72362]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361 (non-flash)
Aug 09 10:23:42 user nova-compute[72362]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:23:42 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:23:42 user nova-compute[72362]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:23:42 user nova-compute[72362]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361 (non-flash)
Aug 09 10:23:42 user nova-compute[72362]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:23:42 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c14c800-5f6d-4593-b069-9e9707a93037]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6, portal: 172.16.0.220,3260]
Aug 09 10:23:42 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6, portal: 172.16.0.220,3260] successful.
Aug 09 10:23:42 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[98428354-605a-4fe8-af31-ed23ae0c48c3]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7935d57-1ba8-4fd3-a663-f29e866af021]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:23:42 user nova-compute[72362]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:23:42 user nova-compute[72362]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361 (non-flash)
Aug 09 10:23:42 user nova-compute[72362]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:23:42 user nova-compute[72362]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)
Aug 09 10:23:42 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:23:42 user nova-compute[72362]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:23:42 user nova-compute[72362]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361 (non-flash)
Aug 09 10:23:42 user nova-compute[72362]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:23:42 user nova-compute[72362]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)
Aug 09 10:23:42 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.407s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] HCTL ('36', '-', '-', 0) found on session 24 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:23:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:43 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.041s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:43 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[04100a88-10f4-4592-8229-62be01bd83b5]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:43 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Searching for a device in session 24 and hctl ['36', '*', '*', 0] yield: None {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:23:43 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:43 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:43 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:43 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:43 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:43 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:44 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Searching for a device in session 24 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:23:44 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KJEmzxkc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:23:44 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.536s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:23:44 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] <== connect_volume: return (1538ms) {'type': 'block', 'scsi_wwn': '26338623666333432', 'path': '/dev/sde'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:23:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338623666333432', 'path': '/dev/sde'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:23:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T10:21:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-405979082',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-794271322',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFPlCV+krNMhby8imZncFRp5DGbA/vMmO2zNpzm0Pvmj5dU73J2HkJnfxWbQ3K2RYIgrwe8xBwFNEDCwdB9IYNqQGuPlU9V+VeI/1xppVZd/VycFGQoWDxVC9NrPc4QD9w==',key_name='tempest-keypair-286170421',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:21:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ec98263d80c34ed19b02d7c8cdb8a627',ramdisk_id='',reservation_id='r-8d9h038f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-773277146',owner_user_name='tempest-ServerActionsV293TestJSON-773277146-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:23:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='731b08d22e494215be0dd798362a6f91',uuid=6493ab9a-4d69-434d-bed7-e51f1c5f3497,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a9017bf2-874f-419a-aae5-43f2ce4a63dd", "address": "fa:16:3e:ac:ef:70", "network": {"id": "0f5e6621-493c-440d-aaec-419fc6111969", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1795951162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec98263d80c34ed19b02d7c8cdb8a627", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9017bf2-87", "ovs_interfaceid": "a9017bf2-874f-419a-aae5-43f2ce4a63dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:23:44 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Converting VIF {"id": "a9017bf2-874f-419a-aae5-43f2ce4a63dd", "address": "fa:16:3e:ac:ef:70", "network": {"id": "0f5e6621-493c-440d-aaec-419fc6111969", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1795951162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec98263d80c34ed19b02d7c8cdb8a627", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9017bf2-87", "ovs_interfaceid": "a9017bf2-874f-419a-aae5-43f2ce4a63dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:23:44 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:ef:70,bridge_name='br-int',has_traffic_filtering=True,id=a9017bf2-874f-419a-aae5-43f2ce4a63dd,network=Network(0f5e6621-493c-440d-aaec-419fc6111969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9017bf2-87') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:23:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:23:44 user nova-compute[72362]:   <uuid>6493ab9a-4d69-434d-bed7-e51f1c5f3497</uuid>
Aug 09 10:23:44 user nova-compute[72362]:   <name>instance-00000011</name>
Aug 09 10:23:44 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:23:44 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:23:44 user nova-compute[72362]:   <metadata>
Aug 09 10:23:44 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:23:44 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:23:44 user nova-compute[72362]:       <nova:name>tempest-ServerActionsV293TestJSON-server-405979082</nova:name>
Aug 09 10:23:44 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:23:42</nova:creationTime>
Aug 09 10:23:44 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:23:44 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:23:44 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:23:44 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:23:44 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:23:44 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:23:44 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:23:44 user nova-compute[72362]:       <nova:owner>
Aug 09 10:23:44 user nova-compute[72362]:         <nova:user uuid="731b08d22e494215be0dd798362a6f91">tempest-ServerActionsV293TestJSON-773277146-project-member</nova:user>
Aug 09 10:23:44 user nova-compute[72362]:         <nova:project uuid="ec98263d80c34ed19b02d7c8cdb8a627">tempest-ServerActionsV293TestJSON-773277146</nova:project>
Aug 09 10:23:44 user nova-compute[72362]:       </nova:owner>
Aug 09 10:23:44 user nova-compute[72362]:       <nova:ports>
Aug 09 10:23:44 user nova-compute[72362]:         <nova:port uuid="a9017bf2-874f-419a-aae5-43f2ce4a63dd">
Aug 09 10:23:44 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 10:23:44 user nova-compute[72362]:         </nova:port>
Aug 09 10:23:44 user nova-compute[72362]:       </nova:ports>
Aug 09 10:23:44 user nova-compute[72362]:     </nova:instance>
Aug 09 10:23:44 user nova-compute[72362]:   </metadata>
Aug 09 10:23:44 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:23:44 user nova-compute[72362]:     <system>
Aug 09 10:23:44 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:23:44 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:23:44 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:23:44 user nova-compute[72362]:       <entry name="serial">6493ab9a-4d69-434d-bed7-e51f1c5f3497</entry>
Aug 09 10:23:44 user nova-compute[72362]:       <entry name="uuid">6493ab9a-4d69-434d-bed7-e51f1c5f3497</entry>
Aug 09 10:23:44 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:23:44 user nova-compute[72362]:     </system>
Aug 09 10:23:44 user nova-compute[72362]:   </sysinfo>
Aug 09 10:23:44 user nova-compute[72362]:   <os>
Aug 09 10:23:44 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:23:44 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:23:44 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:23:44 user nova-compute[72362]:   </os>
Aug 09 10:23:44 user nova-compute[72362]:   <features>
Aug 09 10:23:44 user nova-compute[72362]:     <acpi/>
Aug 09 10:23:44 user nova-compute[72362]:     <apic/>
Aug 09 10:23:44 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:23:44 user nova-compute[72362]:   </features>
Aug 09 10:23:44 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:23:44 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:23:44 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:23:44 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:23:44 user nova-compute[72362]:   </clock>
Aug 09 10:23:44 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:23:44 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:23:44 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:23:44 user nova-compute[72362]:   </cpu>
Aug 09 10:23:44 user nova-compute[72362]:   <devices>
Aug 09 10:23:44 user nova-compute[72362]:     <disk type="block" device="disk">
Aug 09 10:23:44 user nova-compute[72362]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:23:44 user nova-compute[72362]:       <source dev="/dev/sde"/>
Aug 09 10:23:44 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:23:44 user nova-compute[72362]:       <serial>b2bcc794-ae54-4b73-8b5e-751599d537f6</serial>
Aug 09 10:23:44 user nova-compute[72362]:     </disk>
Aug 09 10:23:44 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:23:44 user nova-compute[72362]:       <mac address="fa:16:3e:ac:ef:70"/>
Aug 09 10:23:44 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:23:44 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:23:44 user nova-compute[72362]:       <target dev="tapa9017bf2-87"/>
Aug 09 10:23:44 user nova-compute[72362]:     </interface>
Aug 09 10:23:44 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:23:44 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/6493ab9a-4d69-434d-bed7-e51f1c5f3497/console.log" append="off"/>
Aug 09 10:23:44 user nova-compute[72362]:     </serial>
Aug 09 10:23:44 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:23:44 user nova-compute[72362]:     <video>
Aug 09 10:23:44 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:23:44 user nova-compute[72362]:     </video>
Aug 09 10:23:44 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:23:44 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:23:44 user nova-compute[72362]:     </rng>
Aug 09 10:23:44 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:23:44 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:23:44 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:23:44 user nova-compute[72362]:     </memballoon>
Aug 09 10:23:44 user nova-compute[72362]:   </devices>
Aug 09 10:23:44 user nova-compute[72362]: </domain>
Aug 09 10:23:44 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:23:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T10:21:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-405979082',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-794271322',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFPlCV+krNMhby8imZncFRp5DGbA/vMmO2zNpzm0Pvmj5dU73J2HkJnfxWbQ3K2RYIgrwe8xBwFNEDCwdB9IYNqQGuPlU9V+VeI/1xppVZd/VycFGQoWDxVC9NrPc4QD9w==',key_name='tempest-keypair-286170421',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:21:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ec98263d80c34ed19b02d7c8cdb8a627',ramdisk_id='',reservation_id='r-8d9h038f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-773277146',owner_user_name='tempest-ServerActionsV293TestJSON-773277146-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:23:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='731b08d22e494215be0dd798362a6f91',uuid=6493ab9a-4d69-434d-bed7-e51f1c5f3497,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a9017bf2-874f-419a-aae5-43f2ce4a63dd", "address": "fa:16:3e:ac:ef:70", "network": {"id": "0f5e6621-493c-440d-aaec-419fc6111969", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1795951162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec98263d80c34ed19b02d7c8cdb8a627", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9017bf2-87", "ovs_interfaceid": "a9017bf2-874f-419a-aae5-43f2ce4a63dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:23:44 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Converting VIF {"id": "a9017bf2-874f-419a-aae5-43f2ce4a63dd", "address": "fa:16:3e:ac:ef:70", "network": {"id": "0f5e6621-493c-440d-aaec-419fc6111969", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1795951162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec98263d80c34ed19b02d7c8cdb8a627", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9017bf2-87", "ovs_interfaceid": "a9017bf2-874f-419a-aae5-43f2ce4a63dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:23:44 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:ef:70,bridge_name='br-int',has_traffic_filtering=True,id=a9017bf2-874f-419a-aae5-43f2ce4a63dd,network=Network(0f5e6621-493c-440d-aaec-419fc6111969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9017bf2-87') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:23:44 user nova-compute[72362]: DEBUG os_vif [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:ef:70,bridge_name='br-int',has_traffic_filtering=True,id=a9017bf2-874f-419a-aae5-43f2ce4a63dd,network=Network(0f5e6621-493c-440d-aaec-419fc6111969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9017bf2-87') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:23:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:23:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:23:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa9017bf2-87, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:23:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa9017bf2-87, col_values=(('external_ids', {'iface-id': 'a9017bf2-874f-419a-aae5-43f2ce4a63dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:ef:70', 'vm-uuid': '6493ab9a-4d69-434d-bed7-e51f1c5f3497'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:23:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:23:44 user nova-compute[72362]: DEBUG nova.compute.manager [req-53e4babd-d26b-47ba-b58d-1cfc9ae1cd3a req-83ddc82d-6b6d-4867-9137-834ea38bdc8f service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Received event network-vif-plugged-8c0230bc-c7a7-4497-af9a-2fafb259605c {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:23:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-53e4babd-d26b-47ba-b58d-1cfc9ae1cd3a req-83ddc82d-6b6d-4867-9137-834ea38bdc8f service nova] Acquiring lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:23:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-53e4babd-d26b-47ba-b58d-1cfc9ae1cd3a req-83ddc82d-6b6d-4867-9137-834ea38bdc8f service nova] Lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:23:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-53e4babd-d26b-47ba-b58d-1cfc9ae1cd3a req-83ddc82d-6b6d-4867-9137-834ea38bdc8f service nova] Lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:23:44 user nova-compute[72362]: DEBUG nova.compute.manager [req-53e4babd-d26b-47ba-b58d-1cfc9ae1cd3a req-83ddc82d-6b6d-4867-9137-834ea38bdc8f service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] No waiting events found dispatching network-vif-plugged-8c0230bc-c7a7-4497-af9a-2fafb259605c {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:23:44 user nova-compute[72362]: WARNING nova.compute.manager [req-53e4babd-d26b-47ba-b58d-1cfc9ae1cd3a req-83ddc82d-6b6d-4867-9137-834ea38bdc8f service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Received unexpected event network-vif-plugged-8c0230bc-c7a7-4497-af9a-2fafb259605c for instance with vm_state stopped and task_state None.
Aug 09 10:23:44 user nova-compute[72362]: DEBUG nova.compute.manager [req-53e4babd-d26b-47ba-b58d-1cfc9ae1cd3a req-83ddc82d-6b6d-4867-9137-834ea38bdc8f service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Received event network-vif-plugged-8c0230bc-c7a7-4497-af9a-2fafb259605c {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:23:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-53e4babd-d26b-47ba-b58d-1cfc9ae1cd3a req-83ddc82d-6b6d-4867-9137-834ea38bdc8f service nova] Acquiring lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:23:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-53e4babd-d26b-47ba-b58d-1cfc9ae1cd3a req-83ddc82d-6b6d-4867-9137-834ea38bdc8f service nova] Lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:23:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-53e4babd-d26b-47ba-b58d-1cfc9ae1cd3a req-83ddc82d-6b6d-4867-9137-834ea38bdc8f service nova] Lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:23:44 user nova-compute[72362]: DEBUG nova.compute.manager [req-53e4babd-d26b-47ba-b58d-1cfc9ae1cd3a req-83ddc82d-6b6d-4867-9137-834ea38bdc8f service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] No waiting events found dispatching network-vif-plugged-8c0230bc-c7a7-4497-af9a-2fafb259605c {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:23:44 user nova-compute[72362]: WARNING nova.compute.manager [req-53e4babd-d26b-47ba-b58d-1cfc9ae1cd3a req-83ddc82d-6b6d-4867-9137-834ea38bdc8f service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Received unexpected event network-vif-plugged-8c0230bc-c7a7-4497-af9a-2fafb259605c for instance with vm_state stopped and task_state None.
Aug 09 10:23:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:44 user nova-compute[72362]: INFO os_vif [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:ef:70,bridge_name='br-int',has_traffic_filtering=True,id=a9017bf2-874f-419a-aae5-43f2ce4a63dd,network=Network(0f5e6621-493c-440d-aaec-419fc6111969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9017bf2-87')
Aug 09 10:23:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:23:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] No VIF found with MAC fa:16:3e:ac:ef:70, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:23:45 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:45 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:45 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:45 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:45 user nova-compute[72362]: DEBUG nova.compute.manager [req-461687bc-554f-4c8c-809e-06f6a963e553 req-3e49e193-abe3-4c47-858d-4e8e641762aa service nova] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Received event network-vif-plugged-a9017bf2-874f-419a-aae5-43f2ce4a63dd {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:23:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-461687bc-554f-4c8c-809e-06f6a963e553 req-3e49e193-abe3-4c47-858d-4e8e641762aa service nova] Acquiring lock "6493ab9a-4d69-434d-bed7-e51f1c5f3497-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:23:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-461687bc-554f-4c8c-809e-06f6a963e553 req-3e49e193-abe3-4c47-858d-4e8e641762aa service nova] Lock "6493ab9a-4d69-434d-bed7-e51f1c5f3497-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:23:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-461687bc-554f-4c8c-809e-06f6a963e553 req-3e49e193-abe3-4c47-858d-4e8e641762aa service nova] Lock "6493ab9a-4d69-434d-bed7-e51f1c5f3497-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:23:45 user nova-compute[72362]: DEBUG nova.compute.manager [req-461687bc-554f-4c8c-809e-06f6a963e553 req-3e49e193-abe3-4c47-858d-4e8e641762aa service nova] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] No waiting events found dispatching network-vif-plugged-a9017bf2-874f-419a-aae5-43f2ce4a63dd {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:23:45 user nova-compute[72362]: WARNING nova.compute.manager [req-461687bc-554f-4c8c-809e-06f6a963e553 req-3e49e193-abe3-4c47-858d-4e8e641762aa service nova] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Received unexpected event network-vif-plugged-a9017bf2-874f-419a-aae5-43f2ce4a63dd for instance with vm_state active and task_state rebuild_spawning.
Aug 09 10:23:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:46 user nova-compute[72362]: DEBUG nova.compute.manager [req-9f86f9b0-9cc2-4a85-aed2-0d305bebb7c2 req-168e3f87-abb8-4227-ae35-f490fdccee29 service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Received event network-vif-plugged-8c0230bc-c7a7-4497-af9a-2fafb259605c {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:23:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-9f86f9b0-9cc2-4a85-aed2-0d305bebb7c2 req-168e3f87-abb8-4227-ae35-f490fdccee29 service nova] Acquiring lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:23:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-9f86f9b0-9cc2-4a85-aed2-0d305bebb7c2 req-168e3f87-abb8-4227-ae35-f490fdccee29 service nova] Lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:23:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-9f86f9b0-9cc2-4a85-aed2-0d305bebb7c2 req-168e3f87-abb8-4227-ae35-f490fdccee29 service nova] Lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:23:46 user nova-compute[72362]: DEBUG nova.compute.manager [req-9f86f9b0-9cc2-4a85-aed2-0d305bebb7c2 req-168e3f87-abb8-4227-ae35-f490fdccee29 service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] No waiting events found dispatching network-vif-plugged-8c0230bc-c7a7-4497-af9a-2fafb259605c {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:23:46 user nova-compute[72362]: WARNING nova.compute.manager [req-9f86f9b0-9cc2-4a85-aed2-0d305bebb7c2 req-168e3f87-abb8-4227-ae35-f490fdccee29 service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Received unexpected event network-vif-plugged-8c0230bc-c7a7-4497-af9a-2fafb259605c for instance with vm_state stopped and task_state None.
Aug 09 10:23:46 user nova-compute[72362]: DEBUG nova.compute.manager [req-9f86f9b0-9cc2-4a85-aed2-0d305bebb7c2 req-168e3f87-abb8-4227-ae35-f490fdccee29 service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Received event network-vif-unplugged-8c0230bc-c7a7-4497-af9a-2fafb259605c {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:23:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-9f86f9b0-9cc2-4a85-aed2-0d305bebb7c2 req-168e3f87-abb8-4227-ae35-f490fdccee29 service nova] Acquiring lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:23:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-9f86f9b0-9cc2-4a85-aed2-0d305bebb7c2 req-168e3f87-abb8-4227-ae35-f490fdccee29 service nova] Lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:23:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-9f86f9b0-9cc2-4a85-aed2-0d305bebb7c2 req-168e3f87-abb8-4227-ae35-f490fdccee29 service nova] Lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:23:46 user nova-compute[72362]: DEBUG nova.compute.manager [req-9f86f9b0-9cc2-4a85-aed2-0d305bebb7c2 req-168e3f87-abb8-4227-ae35-f490fdccee29 service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] No waiting events found dispatching network-vif-unplugged-8c0230bc-c7a7-4497-af9a-2fafb259605c {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:23:46 user nova-compute[72362]: WARNING nova.compute.manager [req-9f86f9b0-9cc2-4a85-aed2-0d305bebb7c2 req-168e3f87-abb8-4227-ae35-f490fdccee29 service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Received unexpected event network-vif-unplugged-8c0230bc-c7a7-4497-af9a-2fafb259605c for instance with vm_state stopped and task_state None.
Aug 09 10:23:46 user nova-compute[72362]: DEBUG nova.compute.manager [req-9f86f9b0-9cc2-4a85-aed2-0d305bebb7c2 req-168e3f87-abb8-4227-ae35-f490fdccee29 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received event network-vif-deleted-41551d54-2c78-4fbe-9b7a-43452c5e94da {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:23:46 user nova-compute[72362]: INFO nova.compute.manager [req-9f86f9b0-9cc2-4a85-aed2-0d305bebb7c2 req-168e3f87-abb8-4227-ae35-f490fdccee29 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Neutron deleted interface 41551d54-2c78-4fbe-9b7a-43452c5e94da; detaching it from the instance and deleting it from the info cache
Aug 09 10:23:46 user nova-compute[72362]: DEBUG nova.network.neutron [req-9f86f9b0-9cc2-4a85-aed2-0d305bebb7c2 req-168e3f87-abb8-4227-ae35-f490fdccee29 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Updating instance_info_cache with network_info: [{"id": "5fd897a8-78c2-49be-b1d6-867bab82082d", "address": "fa:16:3e:ae:3a:4a", "network": {"id": "e2b9dab7-85be-4e72-a3a9-14cd26990b44", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1356785765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd897a8-78", "ovs_interfaceid": "5fd897a8-78c2-49be-b1d6-867bab82082d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f1457dd7-06e1-43ac-a55d-3f4f9fe150f8", "address": "fa:16:3e:f2:a7:dd", "network": {"id": "b1aa635b-9b29-45b6-8cd4-06ccd9e0f545", "bridge": "br-int", "label": "tempest-device-tagging-net1-2012050279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1457dd7-06", "ovs_interfaceid": "f1457dd7-06e1-43ac-a55d-3f4f9fe150f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "21baa9dd-a7b0-445e-be2e-ab8b953bae49", "address": "fa:16:3e:55:ce:ef", "network": {"id": "b1aa635b-9b29-45b6-8cd4-06ccd9e0f545", "bridge": "br-int", "label": "tempest-device-tagging-net1-2012050279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21baa9dd-a7", "ovs_interfaceid": "21baa9dd-a7b0-445e-be2e-ab8b953bae49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "32d1ff81-fed5-47fe-88ce-04bd2777f1e5", "address": "fa:16:3e:b5:df:02", "network": {"id": "b1aa635b-9b29-45b6-8cd4-06ccd9e0f545", "bridge": "br-int", "label": "tempest-device-tagging-net1-2012050279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d1ff81-fe", "ovs_interfaceid": "32d1ff81-fed5-47fe-88ce-04bd2777f1e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "de067d87-6780-4c38-bf69-7d976cbde30a", "address": "fa:16:3e:e1:62:57", "network": {"id": "6e7161bb-3d35-4adb-89d3-aa23f97adbfa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1214229212", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde067d87-67", "ovs_interfaceid": "de067d87-6780-4c38-bf69-7d976cbde30a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cb0c5adb-40d5-4fb6-b458-35a85c670333", "address": "fa:16:3e:8a:63:cf", "network": {"id": "6e7161bb-3d35-4adb-89d3-aa23f97adbfa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1214229212", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d18e5da818db4bbab4359c2b6f13f93f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb0c5adb-40", "ovs_interfaceid": "cb0c5adb-40d5-4fb6-b458-35a85c670333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:23:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:46 user nova-compute[72362]: DEBUG nova.compute.manager [req-9f86f9b0-9cc2-4a85-aed2-0d305bebb7c2 req-168e3f87-abb8-4227-ae35-f490fdccee29 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Detach interface failed, port_id=41551d54-2c78-4fbe-9b7a-43452c5e94da, reason: Instance 09a20950-bce9-4c83-82db-e058872ae358 could not be found. {{(pid=72362) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 10:23:46 user nova-compute[72362]: DEBUG nova.compute.manager [req-9f86f9b0-9cc2-4a85-aed2-0d305bebb7c2 req-168e3f87-abb8-4227-ae35-f490fdccee29 service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Received event network-vif-plugged-8c0230bc-c7a7-4497-af9a-2fafb259605c {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:23:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-9f86f9b0-9cc2-4a85-aed2-0d305bebb7c2 req-168e3f87-abb8-4227-ae35-f490fdccee29 service nova] Acquiring lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:23:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-9f86f9b0-9cc2-4a85-aed2-0d305bebb7c2 req-168e3f87-abb8-4227-ae35-f490fdccee29 service nova] Lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:23:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-9f86f9b0-9cc2-4a85-aed2-0d305bebb7c2 req-168e3f87-abb8-4227-ae35-f490fdccee29 service nova] Lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:23:46 user nova-compute[72362]: DEBUG nova.compute.manager [req-9f86f9b0-9cc2-4a85-aed2-0d305bebb7c2 req-168e3f87-abb8-4227-ae35-f490fdccee29 service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] No waiting events found dispatching network-vif-plugged-8c0230bc-c7a7-4497-af9a-2fafb259605c {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:23:46 user nova-compute[72362]: WARNING nova.compute.manager [req-9f86f9b0-9cc2-4a85-aed2-0d305bebb7c2 req-168e3f87-abb8-4227-ae35-f490fdccee29 service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Received unexpected event network-vif-plugged-8c0230bc-c7a7-4497-af9a-2fafb259605c for instance with vm_state stopped and task_state None.
Aug 09 10:23:47 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576627.8920593, 6493ab9a-4d69-434d-bed7-e51f1c5f3497 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:23:47 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] VM Resumed (Lifecycle Event)
Aug 09 10:23:47 user nova-compute[72362]: DEBUG nova.compute.manager [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:23:47 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:23:47 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Instance spawned successfully.
Aug 09 10:23:47 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 10:23:47 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:23:47 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:23:47 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Found default for hw_cdrom_bus of ide {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:23:47 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Found default for hw_disk_bus of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:23:47 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:23:47 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:23:47 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Found default for hw_video_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:23:47 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Found default for hw_vif_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:23:47 user nova-compute[72362]: DEBUG nova.compute.manager [req-3bcfb74d-17cf-41bb-b419-0c5c5d1893ea req-a63cdfd1-03fb-48f9-be99-6a60e5260913 service nova] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Received event network-vif-plugged-a9017bf2-874f-419a-aae5-43f2ce4a63dd {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:23:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3bcfb74d-17cf-41bb-b419-0c5c5d1893ea req-a63cdfd1-03fb-48f9-be99-6a60e5260913 service nova] Acquiring lock "6493ab9a-4d69-434d-bed7-e51f1c5f3497-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:23:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3bcfb74d-17cf-41bb-b419-0c5c5d1893ea req-a63cdfd1-03fb-48f9-be99-6a60e5260913 service nova] Lock "6493ab9a-4d69-434d-bed7-e51f1c5f3497-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:23:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3bcfb74d-17cf-41bb-b419-0c5c5d1893ea req-a63cdfd1-03fb-48f9-be99-6a60e5260913 service nova] Lock "6493ab9a-4d69-434d-bed7-e51f1c5f3497-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:23:47 user nova-compute[72362]: DEBUG nova.compute.manager [req-3bcfb74d-17cf-41bb-b419-0c5c5d1893ea req-a63cdfd1-03fb-48f9-be99-6a60e5260913 service nova] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] No waiting events found dispatching network-vif-plugged-a9017bf2-874f-419a-aae5-43f2ce4a63dd {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:23:47 user nova-compute[72362]: WARNING nova.compute.manager [req-3bcfb74d-17cf-41bb-b419-0c5c5d1893ea req-a63cdfd1-03fb-48f9-be99-6a60e5260913 service nova] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Received unexpected event network-vif-plugged-a9017bf2-874f-419a-aae5-43f2ce4a63dd for instance with vm_state active and task_state rebuild_spawning.
Aug 09 10:23:47 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 09 10:23:47 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576627.8960185, 6493ab9a-4d69-434d-bed7-e51f1c5f3497 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:23:47 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] VM Started (Lifecycle Event)
Aug 09 10:23:48 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:23:48 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:23:48 user nova-compute[72362]: DEBUG nova.compute.manager [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:23:48 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 09 10:23:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:23:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:23:48 user nova-compute[72362]: DEBUG nova.objects.instance [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72362) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 09 10:23:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-66849e3a-1a96-424f-9c88-6e3c408e69e5 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.075s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:23:48 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:23:48 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Took 7.83 seconds to deallocate network for instance.
Aug 09 10:23:48 user nova-compute[72362]: DEBUG nova.compute.manager [req-76acb173-ce01-41d3-8c9d-5ee9ba603c83 req-b7e8fcd3-c8f2-46ec-92be-a94fb5a91163 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received event network-vif-deleted-de067d87-6780-4c38-bf69-7d976cbde30a {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:23:48 user nova-compute[72362]: DEBUG nova.compute.manager [req-76acb173-ce01-41d3-8c9d-5ee9ba603c83 req-b7e8fcd3-c8f2-46ec-92be-a94fb5a91163 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received event network-vif-deleted-32d1ff81-fed5-47fe-88ce-04bd2777f1e5 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:23:48 user nova-compute[72362]: DEBUG nova.compute.manager [req-76acb173-ce01-41d3-8c9d-5ee9ba603c83 req-b7e8fcd3-c8f2-46ec-92be-a94fb5a91163 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received event network-vif-deleted-cb0c5adb-40d5-4fb6-b458-35a85c670333 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:23:48 user nova-compute[72362]: DEBUG nova.compute.manager [req-76acb173-ce01-41d3-8c9d-5ee9ba603c83 req-b7e8fcd3-c8f2-46ec-92be-a94fb5a91163 service nova] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Received event network-vif-deleted-5fd897a8-78c2-49be-b1d6-867bab82082d {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:23:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:52 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691576617.5162807, 09a20950-bce9-4c83-82db-e058872ae358 => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:23:52 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 09a20950-bce9-4c83-82db-e058872ae358] VM Stopped (Lifecycle Event)
Aug 09 10:23:52 user nova-compute[72362]: DEBUG nova.compute.manager [None req-ad7872f2-532e-4181-81c3-7f7edd458a04 None None] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:23:53 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-27b24f92-8e97-4afd-8758-788d8aee84dd tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Acquiring lock "3df33475-981e-4608-9b08-6d414554a322" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:23:53 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-27b24f92-8e97-4afd-8758-788d8aee84dd tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Lock "3df33475-981e-4608-9b08-6d414554a322" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:23:53 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-27b24f92-8e97-4afd-8758-788d8aee84dd tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Acquiring lock "3df33475-981e-4608-9b08-6d414554a322-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:23:53 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-27b24f92-8e97-4afd-8758-788d8aee84dd tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Lock "3df33475-981e-4608-9b08-6d414554a322-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:23:53 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-27b24f92-8e97-4afd-8758-788d8aee84dd tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Lock "3df33475-981e-4608-9b08-6d414554a322-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:23:53 user nova-compute[72362]: INFO nova.compute.manager [None req-27b24f92-8e97-4afd-8758-788d8aee84dd tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] [instance: 3df33475-981e-4608-9b08-6d414554a322] Terminating instance
Aug 09 10:23:53 user nova-compute[72362]: DEBUG nova.compute.manager [None req-27b24f92-8e97-4afd-8758-788d8aee84dd tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] [instance: 3df33475-981e-4608-9b08-6d414554a322] Start destroying the instance on the hypervisor. {{(pid=72362) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 10:23:54 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:54 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:54 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:23:54 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:54 user nova-compute[72362]: DEBUG nova.compute.manager [req-56fd575e-c214-474d-a907-d285eab1d3f9 req-635bab78-63f4-455f-a6a7-205d346435c7 service nova] [instance: 3df33475-981e-4608-9b08-6d414554a322] Received event network-vif-unplugged-723765ac-a8d0-47de-959f-2eeeda11d7d9 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:23:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-56fd575e-c214-474d-a907-d285eab1d3f9 req-635bab78-63f4-455f-a6a7-205d346435c7 service nova] Acquiring lock "3df33475-981e-4608-9b08-6d414554a322-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:23:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-56fd575e-c214-474d-a907-d285eab1d3f9 req-635bab78-63f4-455f-a6a7-205d346435c7 service nova] Lock "3df33475-981e-4608-9b08-6d414554a322-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:23:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-56fd575e-c214-474d-a907-d285eab1d3f9 req-635bab78-63f4-455f-a6a7-205d346435c7 service nova] Lock "3df33475-981e-4608-9b08-6d414554a322-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:23:54 user nova-compute[72362]: DEBUG nova.compute.manager [req-56fd575e-c214-474d-a907-d285eab1d3f9 req-635bab78-63f4-455f-a6a7-205d346435c7 service nova] [instance: 3df33475-981e-4608-9b08-6d414554a322] No waiting events found dispatching network-vif-unplugged-723765ac-a8d0-47de-959f-2eeeda11d7d9 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:23:54 user nova-compute[72362]: DEBUG nova.compute.manager [req-56fd575e-c214-474d-a907-d285eab1d3f9 req-635bab78-63f4-455f-a6a7-205d346435c7 service nova] [instance: 3df33475-981e-4608-9b08-6d414554a322] Received event network-vif-unplugged-723765ac-a8d0-47de-959f-2eeeda11d7d9 for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:23:54 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 3df33475-981e-4608-9b08-6d414554a322] Instance destroyed successfully.
Aug 09 10:23:54 user nova-compute[72362]: DEBUG nova.objects.instance [None req-27b24f92-8e97-4afd-8758-788d8aee84dd tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Lazy-loading 'resources' on Instance uuid 3df33475-981e-4608-9b08-6d414554a322 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:23:54 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-27b24f92-8e97-4afd-8758-788d8aee84dd tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:22:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1799912781',display_name='tempest-VolumesNegativeTest-instance-1799912781',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1799912781',id=20,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:22:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0193988e7d5d4484bad7645b4dec9b04',ramdisk_id='',reservation_id='r-ov5fd4p9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-295872054',owner_user_name='tempest-VolumesNegativeTest-295872054-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:22:12Z,user_data=None,user_id='fdfb320ba56d4f7d99bd311edb1d28e5',uuid=3df33475-981e-4608-9b08-6d414554a322,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "723765ac-a8d0-47de-959f-2eeeda11d7d9", "address": "fa:16:3e:74:a8:b3", "network": {"id": "9e33cbad-7ecf-4003-9303-19bbfa16df56", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "60b108dbc1e84afa9ca07b0a7793a358", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap723765ac-a8", "ovs_interfaceid": "723765ac-a8d0-47de-959f-2eeeda11d7d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:23:54 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-27b24f92-8e97-4afd-8758-788d8aee84dd tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Converting VIF {"id": "723765ac-a8d0-47de-959f-2eeeda11d7d9", "address": "fa:16:3e:74:a8:b3", "network": {"id": "9e33cbad-7ecf-4003-9303-19bbfa16df56", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "60b108dbc1e84afa9ca07b0a7793a358", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap723765ac-a8", "ovs_interfaceid": "723765ac-a8d0-47de-959f-2eeeda11d7d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:23:54 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-27b24f92-8e97-4afd-8758-788d8aee84dd tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:a8:b3,bridge_name='br-int',has_traffic_filtering=True,id=723765ac-a8d0-47de-959f-2eeeda11d7d9,network=Network(9e33cbad-7ecf-4003-9303-19bbfa16df56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap723765ac-a8') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:23:54 user nova-compute[72362]: DEBUG os_vif [None req-27b24f92-8e97-4afd-8758-788d8aee84dd tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:a8:b3,bridge_name='br-int',has_traffic_filtering=True,id=723765ac-a8d0-47de-959f-2eeeda11d7d9,network=Network(9e33cbad-7ecf-4003-9303-19bbfa16df56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap723765ac-a8') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:23:54 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:54 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap723765ac-a8, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:23:54 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:54 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:23:54 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:54 user nova-compute[72362]: INFO os_vif [None req-27b24f92-8e97-4afd-8758-788d8aee84dd tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:a8:b3,bridge_name='br-int',has_traffic_filtering=True,id=723765ac-a8d0-47de-959f-2eeeda11d7d9,network=Network(9e33cbad-7ecf-4003-9303-19bbfa16df56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap723765ac-a8')
Aug 09 10:23:54 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-27b24f92-8e97-4afd-8758-788d8aee84dd tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] [instance: 3df33475-981e-4608-9b08-6d414554a322] Deleting instance files /opt/stack/data/nova/instances/3df33475-981e-4608-9b08-6d414554a322_del
Aug 09 10:23:54 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-27b24f92-8e97-4afd-8758-788d8aee84dd tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] [instance: 3df33475-981e-4608-9b08-6d414554a322] Deletion of /opt/stack/data/nova/instances/3df33475-981e-4608-9b08-6d414554a322_del complete
Aug 09 10:23:55 user nova-compute[72362]: INFO nova.compute.manager [None req-27b24f92-8e97-4afd-8758-788d8aee84dd tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] [instance: 3df33475-981e-4608-9b08-6d414554a322] Took 1.14 seconds to destroy the instance on the hypervisor.
Aug 09 10:23:55 user nova-compute[72362]: DEBUG oslo.service.loopingcall [None req-27b24f92-8e97-4afd-8758-788d8aee84dd tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72362) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 10:23:55 user nova-compute[72362]: DEBUG nova.compute.manager [-] [instance: 3df33475-981e-4608-9b08-6d414554a322] Deallocating network for instance {{(pid=72362) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 10:23:55 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 3df33475-981e-4608-9b08-6d414554a322] deallocate_for_instance() {{(pid=72362) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 10:23:55 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:23:55 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:23:55 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:23:55 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 10:23:55 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 3df33475-981e-4608-9b08-6d414554a322] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:23:55 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 3df33475-981e-4608-9b08-6d414554a322] Took 0.53 seconds to deallocate network for instance.
Aug 09 10:23:55 user nova-compute[72362]: DEBUG nova.compute.manager [req-c80eafa1-3d73-4221-a02e-fb5f6604fe39 req-461a66d9-6c56-4555-84f4-9132b5d0b31c service nova] [instance: 3df33475-981e-4608-9b08-6d414554a322] Received event network-vif-deleted-723765ac-a8d0-47de-959f-2eeeda11d7d9 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:23:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-27b24f92-8e97-4afd-8758-788d8aee84dd tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:23:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-27b24f92-8e97-4afd-8758-788d8aee84dd tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:23:55 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:23:56 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:56 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-27b24f92-8e97-4afd-8758-788d8aee84dd tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:23:56 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-27b24f92-8e97-4afd-8758-788d8aee84dd tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:23:56 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-27b24f92-8e97-4afd-8758-788d8aee84dd tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.446s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:23:56 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-27b24f92-8e97-4afd-8758-788d8aee84dd tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Deleted allocations for instance 3df33475-981e-4608-9b08-6d414554a322
Aug 09 10:23:56 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-27b24f92-8e97-4afd-8758-788d8aee84dd tempest-VolumesNegativeTest-295872054 tempest-VolumesNegativeTest-295872054-project-member] Lock "3df33475-981e-4608-9b08-6d414554a322" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.348s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:23:56 user nova-compute[72362]: DEBUG nova.compute.manager [req-8711d85b-5ba0-4e02-9c4a-1dc2f5119298 req-9a5fc2a0-5016-4590-b9b9-5a85752bab2f service nova] [instance: 3df33475-981e-4608-9b08-6d414554a322] Received event network-vif-plugged-723765ac-a8d0-47de-959f-2eeeda11d7d9 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:23:56 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8711d85b-5ba0-4e02-9c4a-1dc2f5119298 req-9a5fc2a0-5016-4590-b9b9-5a85752bab2f service nova] Acquiring lock "3df33475-981e-4608-9b08-6d414554a322-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:23:56 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8711d85b-5ba0-4e02-9c4a-1dc2f5119298 req-9a5fc2a0-5016-4590-b9b9-5a85752bab2f service nova] Lock "3df33475-981e-4608-9b08-6d414554a322-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:23:56 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8711d85b-5ba0-4e02-9c4a-1dc2f5119298 req-9a5fc2a0-5016-4590-b9b9-5a85752bab2f service nova] Lock "3df33475-981e-4608-9b08-6d414554a322-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:23:56 user nova-compute[72362]: DEBUG nova.compute.manager [req-8711d85b-5ba0-4e02-9c4a-1dc2f5119298 req-9a5fc2a0-5016-4590-b9b9-5a85752bab2f service nova] [instance: 3df33475-981e-4608-9b08-6d414554a322] No waiting events found dispatching network-vif-plugged-723765ac-a8d0-47de-959f-2eeeda11d7d9 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:23:56 user nova-compute[72362]: WARNING nova.compute.manager [req-8711d85b-5ba0-4e02-9c4a-1dc2f5119298 req-9a5fc2a0-5016-4590-b9b9-5a85752bab2f service nova] [instance: 3df33475-981e-4608-9b08-6d414554a322] Received unexpected event network-vif-plugged-723765ac-a8d0-47de-959f-2eeeda11d7d9 for instance with vm_state deleted and task_state None.
Aug 09 10:23:56 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:23:57 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691576622.3876956, a6000393-6044-4b54-ac0b-1d631e2ed0ae => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:23:57 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] VM Stopped (Lifecycle Event)
Aug 09 10:23:57 user nova-compute[72362]: DEBUG nova.compute.manager [None req-4260ff15-3ce5-4ff8-913b-8bf45157511a None None] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:23:57 user nova-compute[72362]: DEBUG nova.compute.manager [None req-4260ff15-3ce5-4ff8-913b-8bf45157511a None None] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:23:57 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:23:57 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 10:23:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "refresh_cache-8e055c58-a365-4f18-a6e3-377e32e2189d" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:23:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquired lock "refresh_cache-8e055c58-a365-4f18-a6e3-377e32e2189d" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:23:58 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Forcefully refreshing network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 10:23:58 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Updating instance_info_cache with network_info: [{"id": "f1a870b6-1d3b-4567-b165-8f2571edf9bd", "address": "fa:16:3e:d7:84:09", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a870b6-1d", "ovs_interfaceid": "f1a870b6-1d3b-4567-b165-8f2571edf9bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:23:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Releasing lock "refresh_cache-8e055c58-a365-4f18-a6e3-377e32e2189d" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:23:58 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Updated the network info_cache for instance {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 10:23:58 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:23:58 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:23:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a363dbf2-302e-45cc-9f19-4f4784d95df5 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Acquiring lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:23:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a363dbf2-302e-45cc-9f19-4f4784d95df5 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:23:59 user nova-compute[72362]: INFO nova.compute.manager [None req-a363dbf2-302e-45cc-9f19-4f4784d95df5 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Detaching volume f975f699-138e-44a5-b600-8d0b666c0361
Aug 09 10:23:59 user nova-compute[72362]: INFO nova.virt.block_device [None req-a363dbf2-302e-45cc-9f19-4f4784d95df5 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Attempting to driver detach volume f975f699-138e-44a5-b600-8d0b666c0361 from mountpoint /dev/vdb
Aug 09 10:23:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-a363dbf2-302e-45cc-9f19-4f4784d95df5 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Attempting to detach device vdb from instance 4746beb1-d313-4cea-bf7b-75b507ebbdd2 from the persistent domain config. {{(pid=72362) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 10:23:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-a363dbf2-302e-45cc-9f19-4f4784d95df5 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 10:23:59 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:23:59 user nova-compute[72362]:   <source dev="/dev/sdc"/>
Aug 09 10:23:59 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:23:59 user nova-compute[72362]:   <serial>f975f699-138e-44a5-b600-8d0b666c0361</serial>
Aug 09 10:23:59 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 10:23:59 user nova-compute[72362]: </disk>
Aug 09 10:23:59 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:23:59 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-a363dbf2-302e-45cc-9f19-4f4784d95df5 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Successfully detached device vdb from instance 4746beb1-d313-4cea-bf7b-75b507ebbdd2 from the persistent domain config.
Aug 09 10:23:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-a363dbf2-302e-45cc-9f19-4f4784d95df5 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4746beb1-d313-4cea-bf7b-75b507ebbdd2 from the live domain config. {{(pid=72362) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 10:23:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-a363dbf2-302e-45cc-9f19-4f4784d95df5 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 10:23:59 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:23:59 user nova-compute[72362]:   <source dev="/dev/sdc"/>
Aug 09 10:23:59 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:23:59 user nova-compute[72362]:   <serial>f975f699-138e-44a5-b600-8d0b666c0361</serial>
Aug 09 10:23:59 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 10:23:59 user nova-compute[72362]: </disk>
Aug 09 10:23:59 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:23:59 user nova-compute[72362]: INFO nova.compute.manager [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] [instance: 09a20950-bce9-4c83-82db-e058872ae358] Took 11.19 seconds to detach 3 volumes for instance.
Aug 09 10:23:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:23:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:23:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Received event <DeviceRemovedEvent: 1691576639.7952054, 4746beb1-d313-4cea-bf7b-75b507ebbdd2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72362) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 10:23:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-a363dbf2-302e-45cc-9f19-4f4784d95df5 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4746beb1-d313-4cea-bf7b-75b507ebbdd2 {{(pid=72362) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 10:23:59 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-a363dbf2-302e-45cc-9f19-4f4784d95df5 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Successfully detached device vdb from instance 4746beb1-d313-4cea-bf7b-75b507ebbdd2 from the live domain config.
Aug 09 10:23:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a363dbf2-302e-45cc-9f19-4f4784d95df5 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:23:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a363dbf2-302e-45cc-9f19-4f4784d95df5 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ozNyCfra', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:23:59 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-a363dbf2-302e-45cc-9f19-4f4784d95df5 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:23:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-a363dbf2-302e-45cc-9f19-4f4784d95df5 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:23:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-a363dbf2-302e-45cc-9f19-4f4784d95df5 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:23:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a363dbf2-302e-45cc-9f19-4f4784d95df5 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:23:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:59 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:23:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[42205c32-1ce4-4f6f-b92c-526fc91a4506]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:59 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:23:59 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:23:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7a6170-f428-4653-ba7c-ea0f100db9d2]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a363dbf2-302e-45cc-9f19-4f4784d95df5 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:23:59 user nova-compute[72362]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:23:59 user nova-compute[72362]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361 (non-flash)
Aug 09 10:23:59 user nova-compute[72362]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:23:59 user nova-compute[72362]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)
Aug 09 10:23:59 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:23:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a363dbf2-302e-45cc-9f19-4f4784d95df5 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:23:59 user nova-compute[72362]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:23:59 user nova-compute[72362]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361 (non-flash)
Aug 09 10:23:59 user nova-compute[72362]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:23:59 user nova-compute[72362]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)
Aug 09 10:23:59 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:23:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a363dbf2-302e-45cc-9f19-4f4784d95df5 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e454a7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361'): ({'sdc'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:23:59 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-a363dbf2-302e-45cc-9f19-4f4784d95df5 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Removing single pathed devices sdc {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:23:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.321s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:23:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[96cadaa4-ccb1-4cda-8a51-0dbce52447af]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:59 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Deleted allocations for instance 09a20950-bce9-4c83-82db-e058872ae358
Aug 09 10:23:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c5827c-15b9-4d36-929d-4e9382d80ed2]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:59 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-a363dbf2-302e-45cc-9f19-4f4784d95df5 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Flushing IO for device /dev/sdc {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:23:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83fdd96-de57-47bd-ab28-8aae98a7dba4]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:59 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-a363dbf2-302e-45cc-9f19-4f4784d95df5 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:23:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:23:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:23:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5f4ff6-6d5b-48c6-97b4-e6eae6a5400b]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:23:59 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-a363dbf2-302e-45cc-9f19-4f4784d95df5 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:23:59 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-a363dbf2-302e-45cc-9f19-4f4784d95df5 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] SCSI volumes sdc have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:23:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a363dbf2-302e-45cc-9f19-4f4784d95df5 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:24:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:00 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a1dea7-3dbb-4394-badb-54589e238258]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:00 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a363dbf2-302e-45cc-9f19-4f4784d95df5 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:24:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361 -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-303f36a3-d1df-4768-b257-c45cd046022d tempest-TaggedBootDevicesTest-1095709842 tempest-TaggedBootDevicesTest-1095709842-project-member] Lock "09a20950-bce9-4c83-82db-e058872ae358" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 24.356s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:24:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:00 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf81181-eb7a-4f7a-afa8-7915dbc030c4]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:00 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a363dbf2-302e-45cc-9f19-4f4784d95df5 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361, portal: 172.16.0.220,3260]
Aug 09 10:24:00 user nova-compute[72362]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361, portal: 172.16.0.220,3260] successful.
Aug 09 10:24:00 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:24:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361 -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f975f699-138e-44a5-b600-8d0b666c0361 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:00 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[87292a72-292e-407d-a8fd-f200538e6500]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:00 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a363dbf2-302e-45cc-9f19-4f4784d95df5 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:24:00 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-a363dbf2-302e-45cc-9f19-4f4784d95df5 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:24:00 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a363dbf2-302e-45cc-9f19-4f4784d95df5 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] <== disconnect_volume: return (303ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:24:00 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a363dbf2-302e-45cc-9f19-4f4784d95df5 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:24:00 user nova-compute[72362]: DEBUG nova.objects.instance [None req-a363dbf2-302e-45cc-9f19-4f4784d95df5 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lazy-loading 'flavor' on Instance uuid 4746beb1-d313-4cea-bf7b-75b507ebbdd2 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:24:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a363dbf2-302e-45cc-9f19-4f4784d95df5 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.674s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:24:00 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:24:03 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:24:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:24:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:24:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:24:03 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 10:24:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:04 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:24:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:24:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:04 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:24:04 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:24:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca002e73-ddf7-4452-82b6-0d831d984756/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca002e73-ddf7-4452-82b6-0d831d984756/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca002e73-ddf7-4452-82b6-0d831d984756/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca002e73-ddf7-4452-82b6-0d831d984756/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4746beb1-d313-4cea-bf7b-75b507ebbdd2/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4746beb1-d313-4cea-bf7b-75b507ebbdd2/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4746beb1-d313-4cea-bf7b-75b507ebbdd2/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4746beb1-d313-4cea-bf7b-75b507ebbdd2/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:24:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:24:06 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:24:06 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:24:06 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=7816MB free_disk=25.423931121826172GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 10:24:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:24:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:24:06 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance ca002e73-ddf7-4452-82b6-0d831d984756 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:24:06 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 8e055c58-a365-4f18-a6e3-377e32e2189d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:24:06 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 0e8a7668-1635-4cbc-8c09-ece19ff67d4f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:24:06 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:24:06 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 6493ab9a-4d69-434d-bed7-e51f1c5f3497 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:24:06 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 4746beb1-d313-4cea-bf7b-75b507ebbdd2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:24:06 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance a6000393-6044-4b54-ac0b-1d631e2ed0ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:24:06 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 30213e67-6b1d-4d97-a971-1544335d02fb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:24:06 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 10:24:06 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 10:24:06 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:24:06 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:24:06 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 10:24:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.384s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:24:09 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691576634.8094628, 3df33475-981e-4608-9b08-6d414554a322 => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:24:09 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 3df33475-981e-4608-9b08-6d414554a322] VM Stopped (Lifecycle Event)
Aug 09 10:24:09 user nova-compute[72362]: DEBUG nova.compute.manager [None req-3ef56ba2-f6f3-4667-8abb-b5826e9754d6 None None] [instance: 3df33475-981e-4608-9b08-6d414554a322] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:24:09 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:24:11 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:24:14 user nova-compute[72362]: INFO nova.compute.manager [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Rescuing
Aug 09 10:24:14 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquiring lock "refresh_cache-30213e67-6b1d-4d97-a971-1544335d02fb" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:24:14 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquired lock "refresh_cache-30213e67-6b1d-4d97-a971-1544335d02fb" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:24:14 user nova-compute[72362]: DEBUG nova.network.neutron [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:24:14 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:24:15 user nova-compute[72362]: DEBUG nova.network.neutron [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Updating instance_info_cache with network_info: [{"id": "86a5b4ed-c891-4322-9ed4-4ddb3795148c", "address": "fa:16:3e:7b:56:f2", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a5b4ed-c8", "ovs_interfaceid": "86a5b4ed-c891-4322-9ed4-4ddb3795148c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:24:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Releasing lock "refresh_cache-30213e67-6b1d-4d97-a971-1544335d02fb" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:24:15 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:24:15 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:24:15 user nova-compute[72362]: DEBUG nova.compute.manager [req-becf467c-07f4-4be2-95a3-64f4f40e6b74 req-15b6855d-3b00-4055-b1f4-7dfb5a6c5b03 service nova] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Received event network-vif-unplugged-86a5b4ed-c891-4322-9ed4-4ddb3795148c {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:24:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-becf467c-07f4-4be2-95a3-64f4f40e6b74 req-15b6855d-3b00-4055-b1f4-7dfb5a6c5b03 service nova] Acquiring lock "30213e67-6b1d-4d97-a971-1544335d02fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:24:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-becf467c-07f4-4be2-95a3-64f4f40e6b74 req-15b6855d-3b00-4055-b1f4-7dfb5a6c5b03 service nova] Lock "30213e67-6b1d-4d97-a971-1544335d02fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:24:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-becf467c-07f4-4be2-95a3-64f4f40e6b74 req-15b6855d-3b00-4055-b1f4-7dfb5a6c5b03 service nova] Lock "30213e67-6b1d-4d97-a971-1544335d02fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:24:15 user nova-compute[72362]: DEBUG nova.compute.manager [req-becf467c-07f4-4be2-95a3-64f4f40e6b74 req-15b6855d-3b00-4055-b1f4-7dfb5a6c5b03 service nova] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] No waiting events found dispatching network-vif-unplugged-86a5b4ed-c891-4322-9ed4-4ddb3795148c {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:24:15 user nova-compute[72362]: WARNING nova.compute.manager [req-becf467c-07f4-4be2-95a3-64f4f40e6b74 req-15b6855d-3b00-4055-b1f4-7dfb5a6c5b03 service nova] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Received unexpected event network-vif-unplugged-86a5b4ed-c891-4322-9ed4-4ddb3795148c for instance with vm_state active and task_state rescuing.
Aug 09 10:24:15 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:24:15 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:24:16 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Instance destroyed successfully.
Aug 09 10:24:16 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Attempting a stable device rescue
Aug 09 10:24:16 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72362) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 09 10:24:16 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:24:16 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Instance directory exists: not creating {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 10:24:16 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Creating image(s)
Aug 09 10:24:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquiring lock "/opt/stack/data/nova/instances/30213e67-6b1d-4d97-a971-1544335d02fb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:24:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "/opt/stack/data/nova/instances/30213e67-6b1d-4d97-a971-1544335d02fb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:24:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "/opt/stack/data/nova/instances/30213e67-6b1d-4d97-a971-1544335d02fb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:24:16 user nova-compute[72362]: DEBUG nova.objects.instance [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lazy-loading 'trusted_certs' on Instance uuid 30213e67-6b1d-4d97-a971-1544335d02fb {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:24:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquiring lock "444f801eda1801365973dad8fdd06f91be14bffa" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:24:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "444f801eda1801365973dad8fdd06f91be14bffa" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:24:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/444f801eda1801365973dad8fdd06f91be14bffa.part --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/444f801eda1801365973dad8fdd06f91be14bffa.part --force-share --output=json" returned: 0 in 0.153s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:17 user nova-compute[72362]: DEBUG nova.virt.images [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] fbfb2e90-0cb4-457b-9531-8e67d2d6b1ce was qcow2, converting to raw {{(pid=72362) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 10:24:17 user nova-compute[72362]: DEBUG nova.privsep.utils [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72362) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 10:24:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/444f801eda1801365973dad8fdd06f91be14bffa.part /opt/stack/data/nova/instances/_base/444f801eda1801365973dad8fdd06f91be14bffa.converted {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:17 user nova-compute[72362]: DEBUG nova.compute.manager [req-f7312222-4864-45f6-9da9-57950977e4bb req-bf6f98c3-260d-42cf-999c-0cb85b348ac3 service nova] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Received event network-vif-plugged-86a5b4ed-c891-4322-9ed4-4ddb3795148c {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:24:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f7312222-4864-45f6-9da9-57950977e4bb req-bf6f98c3-260d-42cf-999c-0cb85b348ac3 service nova] Acquiring lock "30213e67-6b1d-4d97-a971-1544335d02fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:24:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f7312222-4864-45f6-9da9-57950977e4bb req-bf6f98c3-260d-42cf-999c-0cb85b348ac3 service nova] Lock "30213e67-6b1d-4d97-a971-1544335d02fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:24:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f7312222-4864-45f6-9da9-57950977e4bb req-bf6f98c3-260d-42cf-999c-0cb85b348ac3 service nova] Lock "30213e67-6b1d-4d97-a971-1544335d02fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:24:17 user nova-compute[72362]: DEBUG nova.compute.manager [req-f7312222-4864-45f6-9da9-57950977e4bb req-bf6f98c3-260d-42cf-999c-0cb85b348ac3 service nova] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] No waiting events found dispatching network-vif-plugged-86a5b4ed-c891-4322-9ed4-4ddb3795148c {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:24:17 user nova-compute[72362]: WARNING nova.compute.manager [req-f7312222-4864-45f6-9da9-57950977e4bb req-bf6f98c3-260d-42cf-999c-0cb85b348ac3 service nova] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Received unexpected event network-vif-plugged-86a5b4ed-c891-4322-9ed4-4ddb3795148c for instance with vm_state active and task_state rescuing.
Aug 09 10:24:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/444f801eda1801365973dad8fdd06f91be14bffa.part /opt/stack/data/nova/instances/_base/444f801eda1801365973dad8fdd06f91be14bffa.converted" returned: 0 in 0.292s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/444f801eda1801365973dad8fdd06f91be14bffa.converted --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/444f801eda1801365973dad8fdd06f91be14bffa.converted --force-share --output=json" returned: 0 in 0.164s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "444f801eda1801365973dad8fdd06f91be14bffa" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.836s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:24:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquiring lock "444f801eda1801365973dad8fdd06f91be14bffa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:24:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "444f801eda1801365973dad8fdd06f91be14bffa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:24:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/444f801eda1801365973dad8fdd06f91be14bffa --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/444f801eda1801365973dad8fdd06f91be14bffa --force-share --output=json" returned: 0 in 0.150s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/444f801eda1801365973dad8fdd06f91be14bffa,backing_fmt=raw /opt/stack/data/nova/instances/30213e67-6b1d-4d97-a971-1544335d02fb/disk.rescue {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/444f801eda1801365973dad8fdd06f91be14bffa,backing_fmt=raw /opt/stack/data/nova/instances/30213e67-6b1d-4d97-a971-1544335d02fb/disk.rescue" returned: 0 in 0.050s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "444f801eda1801365973dad8fdd06f91be14bffa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG nova.objects.instance [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lazy-loading 'migration_context' on Instance uuid 30213e67-6b1d-4d97-a971-1544335d02fb {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Created local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Start _get_guest_xml network_info=[{"id": "86a5b4ed-c891-4322-9ed4-4ddb3795148c", "address": "fa:16:3e:7b:56:f2", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "vif_mac": "fa:16:3e:7b:56:f2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a5b4ed-c8", "ovs_interfaceid": "86a5b4ed-c891-4322-9ed4-4ddb3795148c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'fbfb2e90-0cb4-457b-9531-8e67d2d6b1ce', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '519da4a4-5f90-408b-932b-b112c10f58ba', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vHFgXAfm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '30213e67-6b1d-4d97-a971-1544335d02fb', 'attached_at': '', 'detached_at': '', 'volume_id': '68af9a24-14e2-4f6b-902b-08139cf943b9', 'serial': '68af9a24-14e2-4f6b-902b-08139cf943b9'}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG nova.objects.instance [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lazy-loading 'resources' on Instance uuid 30213e67-6b1d-4d97-a971-1544335d02fb {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG nova.objects.instance [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lazy-loading 'numa_topology' on Instance uuid 30213e67-6b1d-4d97-a971-1544335d02fb {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:24:18 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:24:18 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:24:18 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG nova.objects.instance [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lazy-loading 'vcpu_model' on Instance uuid 30213e67-6b1d-4d97-a971-1544335d02fb {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vHFgXAfm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:24:18 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:24:18 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:24:18 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:24:18 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:24:18 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:24:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf82b1c-f8f6-455d-9b43-3cf3c11fb494]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = vHFgXAfm\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 09 10:24:18 user nova-compute[72362]: node.name = iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9
Aug 09 10:24:18 user nova-compute[72362]: node.tpgt = -1
Aug 09 10:24:18 user nova-compute[72362]: node.startup = automatic
Aug 09 10:24:18 user nova-compute[72362]: node.leading_login = No
Aug 09 10:24:18 user nova-compute[72362]: iface.iscsi_ifacename = default
Aug 09 10:24:18 user nova-compute[72362]: iface.net_ifacename = <empty>
Aug 09 10:24:18 user nova-compute[72362]: iface.ipaddress = <empty>
Aug 09 10:24:18 user nova-compute[72362]: iface.prefix_len = 0
Aug 09 10:24:18 user nova-compute[72362]: iface.hwaddress = <empty>
Aug 09 10:24:18 user nova-compute[72362]: iface.transport_name = tcp
Aug 09 10:24:18 user nova-compute[72362]: iface.initiatorname = <empty>
Aug 09 10:24:18 user nova-compute[72362]: iface.state = <empty>
Aug 09 10:24:18 user nova-compute[72362]: iface.vlan_id = 0
Aug 09 10:24:18 user nova-compute[72362]: iface.vlan_priority = 0
Aug 09 10:24:18 user nova-compute[72362]: iface.vlan_state = <empty>
Aug 09 10:24:18 user nova-compute[72362]: iface.iface_num = 0
Aug 09 10:24:18 user nova-compute[72362]: iface.mtu = 0
Aug 09 10:24:18 user nova-compute[72362]: iface.port = 0
Aug 09 10:24:18 user nova-compute[72362]: iface.bootproto = <empty>
Aug 09 10:24:18 user nova-compute[72362]: iface.subnet_mask = <empty>
Aug 09 10:24:18 user nova-compute[72362]: iface.gateway = <empty>
Aug 09 10:24:18 user nova-compute[72362]: iface.dhcp_alt_client_id_state = <empty>
Aug 09 10:24:18 user nova-compute[72362]: iface.dhcp_alt_client_id = <empty>
Aug 09 10:24:18 user nova-compute[72362]: iface.dhcp_dns = <empty>
Aug 09 10:24:18 user nova-compute[72362]: iface.dhcp_learn_iqn = <empty>
Aug 09 10:24:18 user nova-compute[72362]: iface.dhcp_req_vendor_id_state = <empty>
Aug 09 10:24:18 user nova-compute[72362]: iface.dhcp_vendor_id_state = <empty>
Aug 09 10:24:18 user nova-compute[72362]: iface.dhcp_vendor_id = <empty>
Aug 09 10:24:18 user nova-compute[72362]: iface.dhcp_slp_da = <empty>
Aug 09 10:24:18 user nova-compute[72362]: iface.fragmentation = <empty>
Aug 09 10:24:18 user nova-compute[72362]: iface.gratuitous_arp = <empty>
Aug 09 10:24:18 user nova-compute[72362]: iface.incoming_forwarding = <empty>
Aug 09 10:24:18 user nova-compute[72362]: iface.tos_state = <empty>
Aug 09 10:24:18 user nova-compute[72362]: iface.tos = 0
Aug 09 10:24:18 user nova-compute[72362]: iface.ttl = 0
Aug 09 10:24:18 user nova-compute[72362]: iface.delayed_ack = <empty>
Aug 09 10:24:18 user nova-compute[72362]: iface.tcp_nagle = <empty>
Aug 09 10:24:18 user nova-compute[72362]: iface.tcp_wsf_state = <empty>
Aug 09 10:24:18 user nova-compute[72362]: iface.tcp_wsf = 0
Aug 09 10:24:18 user nova-compute[72362]: iface.tcp_timer_scale = 0
Aug 09 10:24:18 user nova-compute[72362]: iface.tcp_timestamp = <empty>
Aug 09 10:24:18 user nova-compute[72362]: iface.redirect = <empty>
Aug 09 10:24:18 user nova-compute[72362]: iface.def_task_mgmt_timeout = 0
Aug 09 10:24:18 user nova-compute[72362]: iface.header_digest = <empty>
Aug 09 10:24:18 user nova-compute[72362]: iface.data_digest = <empty>
Aug 09 10:24:18 user nova-compute[72362]: iface.immediate_data = <empty>
Aug 09 10:24:18 user nova-compute[72362]: iface.initial_r2t = <empty>
Aug 09 10:24:18 user nova-compute[72362]: iface.data_seq_inorder = <empty>
Aug 09 10:24:18 user nova-compute[72362]: iface.data_pdu_inorder = <empty>
Aug 09 10:24:18 user nova-compute[72362]: iface.erl = 0
Aug 09 10:24:18 user nova-compute[72362]: iface.max_receive_data_len = 0
Aug 09 10:24:18 user nova-compute[72362]: iface.first_burst_len = 0
Aug 09 10:24:18 user nova-compute[72362]: iface.max_outstanding_r2t = 0
Aug 09 10:24:18 user nova-compute[72362]: iface.max_burst_len = 0
Aug 09 10:24:18 user nova-compute[72362]: iface.chap_auth = <empty>
Aug 09 10:24:18 user nova-compute[72362]: iface.bidi_chap = <empty>
Aug 09 10:24:18 user nova-compute[72362]: iface.strict_login_compliance = <empty>
Aug 09 10:24:18 user nova-compute[72362]: iface.discovery_auth = <empty>
Aug 09 10:24:18 user nova-compute[72362]: iface.discovery_logout = <empty>
Aug 09 10:24:18 user nova-compute[72362]: node.discovery_address = <empty>
Aug 09 10:24:18 user nova-compute[72362]: node.discovery_port = 0
Aug 09 10:24:18 user nova-compute[72362]: node.discovery_type = static
Aug 09 10:24:18 user nova-compute[72362]: node.session.initial_cmdsn = 0
Aug 09 10:24:18 user nova-compute[72362]: node.session.initial_login_retry_max = 8
Aug 09 10:24:18 user nova-compute[72362]: node.session.xmit_thread_priority = -20
Aug 09 10:24:18 user nova-compute[72362]: node.session.cmds_max = 128
Aug 09 10:24:18 user nova-compute[72362]: node.session.queue_depth = 32
Aug 09 10:24:18 user nova-compute[72362]: node.session.nr_sessions = 1
Aug 09 10:24:18 user nova-compute[72362]: node.session.auth.authmethod = CHAP
Aug 09 10:24:18 user nova-compute[72362]: node.session.auth.username = vHFgXAfm
Aug 09 10:24:18 user nova-compute[72362]: node.session.auth.password = ***
Aug 09 10:24:18 user nova-compute[72362]: node.session.auth.username_in = <empty>
Aug 09 10:24:18 user nova-compute[72362]: node.session.auth.password_in = <empty>
Aug 09 10:24:18 user nova-compute[72362]: node.session.auth.chap_algs = MD5
Aug 09 10:24:18 user nova-compute[72362]: node.session.timeo.replacement_timeout = 120
Aug 09 10:24:18 user nova-compute[72362]: node.session.err_timeo.abort_timeout = 15
Aug 09 10:24:18 user nova-compute[72362]: node.session.err_timeo.lu_reset_timeout = 30
Aug 09 10:24:18 user nova-compute[72362]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 09 10:24:18 user nova-compute[72362]: node.session.err_timeo.host_reset_timeout = 60
Aug 09 10:24:18 user nova-compute[72362]: node.session.iscsi.FastAbort = Yes
Aug 09 10:24:18 user nova-compute[72362]: node.session.iscsi.InitialR2T = No
Aug 09 10:24:18 user nova-compute[72362]: node.session.iscsi.ImmediateData = Yes
Aug 09 10:24:18 user nova-compute[72362]: node.session.iscsi.FirstBurstLength = 262144
Aug 09 10:24:18 user nova-compute[72362]: node.session.iscsi.MaxBurstLength = 16776192
Aug 09 10:24:18 user nova-compute[72362]: node.session.iscsi.DefaultTime2Retain = 0
Aug 09 10:24:18 user nova-compute[72362]: node.session.iscsi.DefaultTime2Wait = 2
Aug 09 10:24:18 user nova-compute[72362]: node.session.iscsi.MaxConnections = 1
Aug 09 10:24:18 user nova-compute[72362]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 09 10:24:18 user nova-compute[72362]: node.session.iscsi.ERL = 0
Aug 09 10:24:18 user nova-compute[72362]: node.session.scan = manual
Aug 09 10:24:18 user nova-compute[72362]: node.session.reopen_max = 0
Aug 09 10:24:18 user nova-compute[72362]: node.conn[0].address = 172.16.0.220
Aug 09 10:24:18 user nova-compute[72362]: node.conn[0].port = 3260
Aug 09 10:24:18 user nova-compute[72362]: node.conn[0].startup = manual
Aug 09 10:24:18 user nova-compute[72362]: node.conn[0].tcp.window_size = 524288
Aug 09 10:24:18 user nova-compute[72362]: node.conn[0].tcp.type_of_service = 0
Aug 09 10:24:18 user nova-compute[72362]: node.conn[0].timeo.logout_timeout = 15
Aug 09 10:24:18 user nova-compute[72362]: node.conn[0].timeo.login_timeout = 15
Aug 09 10:24:18 user nova-compute[72362]: node.conn[0].timeo.auth_timeout = 45
Aug 09 10:24:18 user nova-compute[72362]: node.conn[0].timeo.noop_out_interval = 5
Aug 09 10:24:18 user nova-compute[72362]: node.conn[0].timeo.noop_out_timeout = 5
Aug 09 10:24:18 user nova-compute[72362]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 09 10:24:18 user nova-compute[72362]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 09 10:24:18 user nova-compute[72362]: node.conn[0].iscsi.HeaderDigest = None
Aug 09 10:24:18 user nova-compute[72362]: node.conn[0].iscsi.DataDigest = None
Aug 09 10:24:18 user nova-compute[72362]: node.conn[0].iscsi.IFMarker = No
Aug 09 10:24:18 user nova-compute[72362]: node.conn[0].iscsi.OFMarker = No
Aug 09 10:24:18 user nova-compute[72362]: # END RECORD
Aug 09 10:24:18 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa4bdad-0dab-4bdb-af84-9a42219b73b7]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ead4556-2f27-45e5-b940-d22d4b834004]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vHFgXAfm {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vHFgXAfm" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77c8fa7-ab7e-4dab-b359-9c23b9e5eb99]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vHFgXAfm'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c631e91-f1c1-457d-bbbc-4c20e8974a83]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ea60aa-5b00-46f6-877f-445defdf1c54]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:24:18 user nova-compute[72362]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:24:18 user nova-compute[72362]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:24:18 user nova-compute[72362]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)
Aug 09 10:24:18 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:24:18 user nova-compute[72362]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:24:18 user nova-compute[72362]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:24:18 user nova-compute[72362]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)
Aug 09 10:24:18 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.166s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] HCTL ('39', '0', '0', 0) found on session 20 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Scanning host 39 c: 0, t: 0, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.013s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[013ca01d-50bb-4e88-b0f1-4cf98b38499e]: (4, ('0 0 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Searching for a device in session 20 and hctl ('39', '0', '0', 0) yield: sdh {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vHFgXAfm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.190s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] <== connect_volume: return (191ms) {'type': 'block', 'scsi_wwn': '26330393865653433', 'path': '/dev/sdh'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330393865653433', 'path': '/dev/sdh'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:22:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-358044317',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-358044317',id=21,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:22:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f206cedc59df46deb91e7ec2167c1f2b',ramdisk_id='',reservation_id='r-0rukucvy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1706340435',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:22:48Z,user_data=None,user_id='4a1904ffd10b4e8b959971b5e2383113',uuid=30213e67-6b1d-4d97-a971-1544335d02fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86a5b4ed-c891-4322-9ed4-4ddb3795148c", "address": "fa:16:3e:7b:56:f2", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "vif_mac": "fa:16:3e:7b:56:f2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a5b4ed-c8", "ovs_interfaceid": "86a5b4ed-c891-4322-9ed4-4ddb3795148c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Converting VIF {"id": "86a5b4ed-c891-4322-9ed4-4ddb3795148c", "address": "fa:16:3e:7b:56:f2", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "vif_mac": "fa:16:3e:7b:56:f2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a5b4ed-c8", "ovs_interfaceid": "86a5b4ed-c891-4322-9ed4-4ddb3795148c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:56:f2,bridge_name='br-int',has_traffic_filtering=True,id=86a5b4ed-c891-4322-9ed4-4ddb3795148c,network=Network(bb852331-57aa-4911-b8ff-30f5411f65b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86a5b4ed-c8') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG nova.objects.instance [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lazy-loading 'pci_devices' on Instance uuid 30213e67-6b1d-4d97-a971-1544335d02fb {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:24:18 user nova-compute[72362]:   <uuid>30213e67-6b1d-4d97-a971-1544335d02fb</uuid>
Aug 09 10:24:18 user nova-compute[72362]:   <name>instance-00000015</name>
Aug 09 10:24:18 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:24:18 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:24:18 user nova-compute[72362]:   <metadata>
Aug 09 10:24:18 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:24:18 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:24:18 user nova-compute[72362]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-358044317</nova:name>
Aug 09 10:24:18 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:24:18</nova:creationTime>
Aug 09 10:24:18 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:24:18 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:24:18 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:24:18 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:24:18 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:24:18 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:24:18 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:24:18 user nova-compute[72362]:       <nova:owner>
Aug 09 10:24:18 user nova-compute[72362]:         <nova:user uuid="4a1904ffd10b4e8b959971b5e2383113">tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member</nova:user>
Aug 09 10:24:18 user nova-compute[72362]:         <nova:project uuid="f206cedc59df46deb91e7ec2167c1f2b">tempest-ServerBootFromVolumeStableRescueTest-1706340435</nova:project>
Aug 09 10:24:18 user nova-compute[72362]:       </nova:owner>
Aug 09 10:24:18 user nova-compute[72362]:       <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:24:18 user nova-compute[72362]:       <nova:ports>
Aug 09 10:24:18 user nova-compute[72362]:         <nova:port uuid="86a5b4ed-c891-4322-9ed4-4ddb3795148c">
Aug 09 10:24:18 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 10:24:18 user nova-compute[72362]:         </nova:port>
Aug 09 10:24:18 user nova-compute[72362]:       </nova:ports>
Aug 09 10:24:18 user nova-compute[72362]:     </nova:instance>
Aug 09 10:24:18 user nova-compute[72362]:   </metadata>
Aug 09 10:24:18 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:24:18 user nova-compute[72362]:     <system>
Aug 09 10:24:18 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:24:18 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:24:18 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:24:18 user nova-compute[72362]:       <entry name="serial">30213e67-6b1d-4d97-a971-1544335d02fb</entry>
Aug 09 10:24:18 user nova-compute[72362]:       <entry name="uuid">30213e67-6b1d-4d97-a971-1544335d02fb</entry>
Aug 09 10:24:18 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:24:18 user nova-compute[72362]:     </system>
Aug 09 10:24:18 user nova-compute[72362]:   </sysinfo>
Aug 09 10:24:18 user nova-compute[72362]:   <os>
Aug 09 10:24:18 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:24:18 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:24:18 user nova-compute[72362]:   </os>
Aug 09 10:24:18 user nova-compute[72362]:   <features>
Aug 09 10:24:18 user nova-compute[72362]:     <acpi/>
Aug 09 10:24:18 user nova-compute[72362]:     <apic/>
Aug 09 10:24:18 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:24:18 user nova-compute[72362]:   </features>
Aug 09 10:24:18 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:24:18 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:24:18 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:24:18 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:24:18 user nova-compute[72362]:   </clock>
Aug 09 10:24:18 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:24:18 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:24:18 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:24:18 user nova-compute[72362]:   </cpu>
Aug 09 10:24:18 user nova-compute[72362]:   <devices>
Aug 09 10:24:18 user nova-compute[72362]:     <disk type="block" device="disk">
Aug 09 10:24:18 user nova-compute[72362]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:24:18 user nova-compute[72362]:       <source dev="/dev/sdh"/>
Aug 09 10:24:18 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:24:18 user nova-compute[72362]:       <serial>68af9a24-14e2-4f6b-902b-08139cf943b9</serial>
Aug 09 10:24:18 user nova-compute[72362]:     </disk>
Aug 09 10:24:18 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:24:18 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:24:18 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/30213e67-6b1d-4d97-a971-1544335d02fb/disk.rescue"/>
Aug 09 10:24:18 user nova-compute[72362]:       <target dev="vdb" bus="virtio"/>
Aug 09 10:24:18 user nova-compute[72362]:       <boot order="1"/>
Aug 09 10:24:18 user nova-compute[72362]:     </disk>
Aug 09 10:24:18 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:24:18 user nova-compute[72362]:       <mac address="fa:16:3e:7b:56:f2"/>
Aug 09 10:24:18 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:24:18 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:24:18 user nova-compute[72362]:       <target dev="tap86a5b4ed-c8"/>
Aug 09 10:24:18 user nova-compute[72362]:     </interface>
Aug 09 10:24:18 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:24:18 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/30213e67-6b1d-4d97-a971-1544335d02fb/console.log" append="off"/>
Aug 09 10:24:18 user nova-compute[72362]:     </serial>
Aug 09 10:24:18 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:24:18 user nova-compute[72362]:     <video>
Aug 09 10:24:18 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:24:18 user nova-compute[72362]:     </video>
Aug 09 10:24:18 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:24:18 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:24:18 user nova-compute[72362]:     </rng>
Aug 09 10:24:18 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:24:18 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:24:18 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:24:18 user nova-compute[72362]:     </memballoon>
Aug 09 10:24:18 user nova-compute[72362]:   </devices>
Aug 09 10:24:18 user nova-compute[72362]: </domain>
Aug 09 10:24:18 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:24:18 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Instance destroyed successfully.
Aug 09 10:24:18 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:24:18 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] No VIF found with MAC fa:16:3e:7b:56:f2, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:24:19 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:24:19 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:24:19 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:24:19 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:24:20 user nova-compute[72362]: DEBUG nova.compute.manager [req-8c6e938e-e59e-4e5b-af2c-541dbabca3ff req-7dca7484-09c1-4a7d-9bbb-8f777a72e8a5 service nova] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Received event network-vif-plugged-86a5b4ed-c891-4322-9ed4-4ddb3795148c {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:24:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8c6e938e-e59e-4e5b-af2c-541dbabca3ff req-7dca7484-09c1-4a7d-9bbb-8f777a72e8a5 service nova] Acquiring lock "30213e67-6b1d-4d97-a971-1544335d02fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:24:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8c6e938e-e59e-4e5b-af2c-541dbabca3ff req-7dca7484-09c1-4a7d-9bbb-8f777a72e8a5 service nova] Lock "30213e67-6b1d-4d97-a971-1544335d02fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:24:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8c6e938e-e59e-4e5b-af2c-541dbabca3ff req-7dca7484-09c1-4a7d-9bbb-8f777a72e8a5 service nova] Lock "30213e67-6b1d-4d97-a971-1544335d02fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:24:20 user nova-compute[72362]: DEBUG nova.compute.manager [req-8c6e938e-e59e-4e5b-af2c-541dbabca3ff req-7dca7484-09c1-4a7d-9bbb-8f777a72e8a5 service nova] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] No waiting events found dispatching network-vif-plugged-86a5b4ed-c891-4322-9ed4-4ddb3795148c {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:24:20 user nova-compute[72362]: WARNING nova.compute.manager [req-8c6e938e-e59e-4e5b-af2c-541dbabca3ff req-7dca7484-09c1-4a7d-9bbb-8f777a72e8a5 service nova] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Received unexpected event network-vif-plugged-86a5b4ed-c891-4322-9ed4-4ddb3795148c for instance with vm_state active and task_state rescuing.
Aug 09 10:24:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:24:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:24:21 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:24:22 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Removed pending event for 30213e67-6b1d-4d97-a971-1544335d02fb due to event {{(pid=72362) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 10:24:22 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576662.095051, 30213e67-6b1d-4d97-a971-1544335d02fb => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:24:22 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] VM Resumed (Lifecycle Event)
Aug 09 10:24:22 user nova-compute[72362]: DEBUG nova.compute.manager [None req-52e93020-d01b-4303-aa1a-f7c34e4af982 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:24:22 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:24:22 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:24:22 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 10:24:22 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576662.0968416, 30213e67-6b1d-4d97-a971-1544335d02fb => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:24:22 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] VM Started (Lifecycle Event)
Aug 09 10:24:22 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:24:22 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:24:22 user nova-compute[72362]: DEBUG nova.compute.manager [req-a53ba5df-4756-418d-a6ea-da0807c29279 req-677f47db-3a09-4ed1-9bd3-517afff1c5cf service nova] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Received event network-vif-plugged-86a5b4ed-c891-4322-9ed4-4ddb3795148c {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:24:22 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-a53ba5df-4756-418d-a6ea-da0807c29279 req-677f47db-3a09-4ed1-9bd3-517afff1c5cf service nova] Acquiring lock "30213e67-6b1d-4d97-a971-1544335d02fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:24:22 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-a53ba5df-4756-418d-a6ea-da0807c29279 req-677f47db-3a09-4ed1-9bd3-517afff1c5cf service nova] Lock "30213e67-6b1d-4d97-a971-1544335d02fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:24:22 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-a53ba5df-4756-418d-a6ea-da0807c29279 req-677f47db-3a09-4ed1-9bd3-517afff1c5cf service nova] Lock "30213e67-6b1d-4d97-a971-1544335d02fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:24:22 user nova-compute[72362]: DEBUG nova.compute.manager [req-a53ba5df-4756-418d-a6ea-da0807c29279 req-677f47db-3a09-4ed1-9bd3-517afff1c5cf service nova] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] No waiting events found dispatching network-vif-plugged-86a5b4ed-c891-4322-9ed4-4ddb3795148c {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:24:22 user nova-compute[72362]: WARNING nova.compute.manager [req-a53ba5df-4756-418d-a6ea-da0807c29279 req-677f47db-3a09-4ed1-9bd3-517afff1c5cf service nova] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Received unexpected event network-vif-plugged-86a5b4ed-c891-4322-9ed4-4ddb3795148c for instance with vm_state rescued and task_state None.
Aug 09 10:24:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:24:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:24:29 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:24:29 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:24:31 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c16f1563-d5d4-4d06-beb0-2dfe11b7cd92 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Acquiring lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:24:31 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c16f1563-d5d4-4d06-beb0-2dfe11b7cd92 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:24:31 user nova-compute[72362]: DEBUG nova.objects.instance [None req-c16f1563-d5d4-4d06-beb0-2dfe11b7cd92 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lazy-loading 'flavor' on Instance uuid 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:24:31 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c16f1563-d5d4-4d06-beb0-2dfe11b7cd92 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:24:31 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c16f1563-d5d4-4d06-beb0-2dfe11b7cd92 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Acquiring lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:24:31 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c16f1563-d5d4-4d06-beb0-2dfe11b7cd92 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:24:31 user nova-compute[72362]: INFO nova.compute.manager [None req-c16f1563-d5d4-4d06-beb0-2dfe11b7cd92 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Attaching volume 9fd78518-fb6e-47ac-a671-2b5e62efe4ec to /dev/vdb
Aug 09 10:24:31 user nova-compute[72362]: DEBUG os_brick.utils [None req-c16f1563-d5d4-4d06-beb0-2dfe11b7cd92 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:24:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:31 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a61bac6-6a38-43ff-9e6c-eb91dad70df5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:31 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d75ce7-64a4-4391-9561-965d6ee210fc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:31 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[751ef4f9-ac5e-4f25-acff-12c2f7e56639]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:31 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c79c72-aa29-4604-8306-e933ee8fd193]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-c16f1563-d5d4-4d06-beb0-2dfe11b7cd92 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-c16f1563-d5d4-4d06-beb0-2dfe11b7cd92 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:24:31 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c16f1563-d5d4-4d06-beb0-2dfe11b7cd92 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:24:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:24:31 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:24:31 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5040b4a4-ec13-4436-96f5-14571c3a7f11]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:31 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-c16f1563-d5d4-4d06-beb0-2dfe11b7cd92 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:24:31 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-c16f1563-d5d4-4d06-beb0-2dfe11b7cd92 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:24:31 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-c16f1563-d5d4-4d06-beb0-2dfe11b7cd92 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:24:31 user nova-compute[72362]: DEBUG os_brick.utils [None req-c16f1563-d5d4-4d06-beb0-2dfe11b7cd92 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:24:31 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-c16f1563-d5d4-4d06-beb0-2dfe11b7cd92 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Updating existing volume attachment record: cf8f3414-49a8-4fc1-a204-fb45a9b88415 {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 10:24:34 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:24:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:24:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c16f1563-d5d4-4d06-beb0-2dfe11b7cd92 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:24:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16f1563-d5d4-4d06-beb0-2dfe11b7cd92 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yMmUbTGO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:24:40 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-c16f1563-d5d4-4d06-beb0-2dfe11b7cd92 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:24:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-c16f1563-d5d4-4d06-beb0-2dfe11b7cd92 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:24:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-c16f1563-d5d4-4d06-beb0-2dfe11b7cd92 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:24:40 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-c16f1563-d5d4-4d06-beb0-2dfe11b7cd92 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:24:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-c16f1563-d5d4-4d06-beb0-2dfe11b7cd92 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:24:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-c16f1563-d5d4-4d06-beb0-2dfe11b7cd92 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:24:40 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-c16f1563-d5d4-4d06-beb0-2dfe11b7cd92 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:24:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec -p 172.16.0.220:3260" returned: 21 in 0.037s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:41 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[70171309-c8f8-4bba-8537-4d9a39cd2e71]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:41 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16f1563-d5d4-4d06-beb0-2dfe11b7cd92 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:24:41 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:24:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:41 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c1525e-cffe-4ceb-96fa-13957f10974f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:41 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16f1563-d5d4-4d06-beb0-2dfe11b7cd92 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec] added
Aug 09 10:24:41 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:24:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:41 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb7133d-c744-438e-8e8f-06fe072d40ee]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:41 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16f1563-d5d4-4d06-beb0-2dfe11b7cd92 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:24:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:41 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79c191a-c638-4319-a723-9d63063e01a9]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:41 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16f1563-d5d4-4d06-beb0-2dfe11b7cd92 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:24:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yMmUbTGO {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:24:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yMmUbTGO" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:41 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b589cdf-d9ce-4a97-871c-92fbb25fd91a]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:41 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16f1563-d5d4-4d06-beb0-2dfe11b7cd92 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yMmUbTGO'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:24:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:41 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a4ce5d-57e3-4469-9124-5463f912afd7]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:41 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16f1563-d5d4-4d06-beb0-2dfe11b7cd92 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:24:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:41 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d87aa3-70a4-48c5-8ef3-c314f29dcf1f]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:41 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16f1563-d5d4-4d06-beb0-2dfe11b7cd92 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:24:41 user nova-compute[72362]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:24:41 user nova-compute[72362]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:24:41 user nova-compute[72362]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)
Aug 09 10:24:41 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:24:41 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16f1563-d5d4-4d06-beb0-2dfe11b7cd92 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:24:41 user nova-compute[72362]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:24:41 user nova-compute[72362]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:24:41 user nova-compute[72362]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)
Aug 09 10:24:41 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:24:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:41 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[19dd9508-41bb-4a17-b1a0-1380ccb3a849]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:41 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16f1563-d5d4-4d06-beb0-2dfe11b7cd92 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec, portal: 172.16.0.220,3260]
Aug 09 10:24:41 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec, portal: 172.16.0.220,3260] successful.
Aug 09 10:24:41 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:24:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:41 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b9d050-506d-4355-92ae-4965e6b92c6d]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:41 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16f1563-d5d4-4d06-beb0-2dfe11b7cd92 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:24:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:41 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0887e5e3-7604-4acb-a042-29fe3ca4486e]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:41 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16f1563-d5d4-4d06-beb0-2dfe11b7cd92 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:24:41 user nova-compute[72362]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:24:41 user nova-compute[72362]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:24:41 user nova-compute[72362]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)
Aug 09 10:24:41 user nova-compute[72362]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)
Aug 09 10:24:41 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:24:41 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16f1563-d5d4-4d06-beb0-2dfe11b7cd92 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:24:41 user nova-compute[72362]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:24:41 user nova-compute[72362]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:24:41 user nova-compute[72362]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)
Aug 09 10:24:41 user nova-compute[72362]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)
Aug 09 10:24:41 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:24:41 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-c16f1563-d5d4-4d06-beb0-2dfe11b7cd92 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:24:41 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16f1563-d5d4-4d06-beb0-2dfe11b7cd92 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:24:41 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-c16f1563-d5d4-4d06-beb0-2dfe11b7cd92 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:24:41 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-c16f1563-d5d4-4d06-beb0-2dfe11b7cd92 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:24:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:41 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc6669b-b96e-469b-a217-ab6e26073f22]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:41 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-c16f1563-d5d4-4d06-beb0-2dfe11b7cd92 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: None {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:24:42 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-c16f1563-d5d4-4d06-beb0-2dfe11b7cd92 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:24:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16f1563-d5d4-4d06-beb0-2dfe11b7cd92 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yMmUbTGO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:24:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-c16f1563-d5d4-4d06-beb0-2dfe11b7cd92 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:24:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16f1563-d5d4-4d06-beb0-2dfe11b7cd92 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '26532636131386230', 'path': '/dev/sdc'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:24:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c16f1563-d5d4-4d06-beb0-2dfe11b7cd92 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532636131386230', 'path': '/dev/sdc'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:24:42 user nova-compute[72362]: DEBUG nova.objects.instance [None req-c16f1563-d5d4-4d06-beb0-2dfe11b7cd92 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lazy-loading 'flavor' on Instance uuid 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:24:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-c16f1563-d5d4-4d06-beb0-2dfe11b7cd92 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 10:24:42 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:24:42 user nova-compute[72362]:   <source dev="/dev/sdc"/>
Aug 09 10:24:42 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:24:42 user nova-compute[72362]:   <serial>9fd78518-fb6e-47ac-a671-2b5e62efe4ec</serial>
Aug 09 10:24:42 user nova-compute[72362]: </disk>
Aug 09 10:24:42 user nova-compute[72362]:  {{(pid=72362) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 10:24:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-c16f1563-d5d4-4d06-beb0-2dfe11b7cd92 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:24:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-c16f1563-d5d4-4d06-beb0-2dfe11b7cd92 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:24:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-c16f1563-d5d4-4d06-beb0-2dfe11b7cd92 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] No VIF found with MAC fa:16:3e:91:34:e3, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:24:42 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c16f1563-d5d4-4d06-beb0-2dfe11b7cd92 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.683s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:24:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-277a3a09-d29e-418d-9307-a07a4e5ad6d5 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Acquiring lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:24:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-277a3a09-d29e-418d-9307-a07a4e5ad6d5 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:24:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-277a3a09-d29e-418d-9307-a07a4e5ad6d5 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Acquiring lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:24:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-277a3a09-d29e-418d-9307-a07a4e5ad6d5 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:24:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-277a3a09-d29e-418d-9307-a07a4e5ad6d5 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:24:43 user nova-compute[72362]: INFO nova.compute.manager [None req-277a3a09-d29e-418d-9307-a07a4e5ad6d5 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Terminating instance
Aug 09 10:24:43 user nova-compute[72362]: DEBUG nova.compute.manager [None req-277a3a09-d29e-418d-9307-a07a4e5ad6d5 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Start destroying the instance on the hypervisor. {{(pid=72362) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 10:24:43 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:24:43 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:24:43 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:24:43 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:24:43 user nova-compute[72362]: DEBUG nova.compute.manager [req-c40afa60-f560-47aa-8fdb-9847743fb0aa req-d9f77590-354a-4468-a1d3-ab141e218efe service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Received event network-vif-unplugged-ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:24:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c40afa60-f560-47aa-8fdb-9847743fb0aa req-d9f77590-354a-4468-a1d3-ab141e218efe service nova] Acquiring lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:24:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c40afa60-f560-47aa-8fdb-9847743fb0aa req-d9f77590-354a-4468-a1d3-ab141e218efe service nova] Lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:24:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c40afa60-f560-47aa-8fdb-9847743fb0aa req-d9f77590-354a-4468-a1d3-ab141e218efe service nova] Lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:24:43 user nova-compute[72362]: DEBUG nova.compute.manager [req-c40afa60-f560-47aa-8fdb-9847743fb0aa req-d9f77590-354a-4468-a1d3-ab141e218efe service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] No waiting events found dispatching network-vif-unplugged-ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:24:43 user nova-compute[72362]: DEBUG nova.compute.manager [req-c40afa60-f560-47aa-8fdb-9847743fb0aa req-d9f77590-354a-4468-a1d3-ab141e218efe service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Received event network-vif-unplugged-ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:24:43 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Instance destroyed successfully.
Aug 09 10:24:43 user nova-compute[72362]: DEBUG nova.objects.instance [None req-277a3a09-d29e-418d-9307-a07a4e5ad6d5 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lazy-loading 'resources' on Instance uuid 0e8a7668-1635-4cbc-8c09-ece19ff67d4f {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:24:43 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-277a3a09-d29e-418d-9307-a07a4e5ad6d5 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:15:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-419570951',display_name='tempest-ServerActionsTestOtherB-server-419570951',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-419570951',id=2,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAlSzovB4mzuHqVxORdW0QCnCxzvtrYywTRh5RUAkSVJoqhjnBo5zwvIiDyhRaMXzyUvfprKRDpBxT96lz++BVUa0Y8Z7q5AuzttS0DGZzN7x8fIo5ox8C7rVw5EduEeQ==',key_name='tempest-keypair-2060096321',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:22:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5438525a82b4ab08734e363ab1f80ec',ramdisk_id='',reservation_id='r-gepn5vk7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-767949360',owner_user_name='tempest-ServerActionsTestOtherB-767949360-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:22:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ffd407a36c74b8ea1bc88b98366876e',uuid=0e8a7668-1635-4cbc-8c09-ece19ff67d4f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "address": "fa:16:3e:16:b7:79", "network": {"id": "446f0622-648e-499f-bbb1-e4c0d89ab4df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-409995858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5438525a82b4ab08734e363ab1f80ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec7889ae-0c", "ovs_interfaceid": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:24:43 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-277a3a09-d29e-418d-9307-a07a4e5ad6d5 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Converting VIF {"id": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "address": "fa:16:3e:16:b7:79", "network": {"id": "446f0622-648e-499f-bbb1-e4c0d89ab4df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-409995858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5438525a82b4ab08734e363ab1f80ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec7889ae-0c", "ovs_interfaceid": "ec7889ae-0cbc-41e3-a750-a5cb2b522ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:24:43 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-277a3a09-d29e-418d-9307-a07a4e5ad6d5 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:b7:79,bridge_name='br-int',has_traffic_filtering=True,id=ec7889ae-0cbc-41e3-a750-a5cb2b522ce9,network=Network(446f0622-648e-499f-bbb1-e4c0d89ab4df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec7889ae-0c') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:24:43 user nova-compute[72362]: DEBUG os_vif [None req-277a3a09-d29e-418d-9307-a07a4e5ad6d5 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:b7:79,bridge_name='br-int',has_traffic_filtering=True,id=ec7889ae-0cbc-41e3-a750-a5cb2b522ce9,network=Network(446f0622-648e-499f-bbb1-e4c0d89ab4df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec7889ae-0c') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:24:43 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:24:43 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec7889ae-0c, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:24:43 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:24:43 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:24:43 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:24:43 user nova-compute[72362]: INFO os_vif [None req-277a3a09-d29e-418d-9307-a07a4e5ad6d5 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:b7:79,bridge_name='br-int',has_traffic_filtering=True,id=ec7889ae-0cbc-41e3-a750-a5cb2b522ce9,network=Network(446f0622-648e-499f-bbb1-e4c0d89ab4df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec7889ae-0c')
Aug 09 10:24:43 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-277a3a09-d29e-418d-9307-a07a4e5ad6d5 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:24:43 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-277a3a09-d29e-418d-9307-a07a4e5ad6d5 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MhmCwvOG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:24:43 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-277a3a09-d29e-418d-9307-a07a4e5ad6d5 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:24:43 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-277a3a09-d29e-418d-9307-a07a4e5ad6d5 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:24:43 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-277a3a09-d29e-418d-9307-a07a4e5ad6d5 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:24:43 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-277a3a09-d29e-418d-9307-a07a4e5ad6d5 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:24:43 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:43 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:43 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d715cce5-e75f-4f9a-991c-cf7268d68d9d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:43 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d39978-3868-466f-adc7-8b1637ba6513]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-277a3a09-d29e-418d-9307-a07a4e5ad6d5 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:24:44 user nova-compute[72362]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:24:44 user nova-compute[72362]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:24:44 user nova-compute[72362]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)
Aug 09 10:24:44 user nova-compute[72362]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)
Aug 09 10:24:44 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-277a3a09-d29e-418d-9307-a07a4e5ad6d5 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 (non-flash)
Aug 09 10:24:44 user nova-compute[72362]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:24:44 user nova-compute[72362]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:24:44 user nova-compute[72362]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)
Aug 09 10:24:44 user nova-compute[72362]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)
Aug 09 10:24:44 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-277a3a09-d29e-418d-9307-a07a4e5ad6d5 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34ee9749d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7'): ({'sdb'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-277a3a09-d29e-418d-9307-a07a4e5ad6d5 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Removing single pathed devices sdb {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[081e40b0-4d00-4066-ad95-aef7e88d747b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[99aa550e-13d5-4977-a4a9-d4242a37fdb2]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-277a3a09-d29e-418d-9307-a07a4e5ad6d5 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Flushing IO for device /dev/sdb {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.032s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e46a0f-d147-4893-a103-32a0c726191d]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-277a3a09-d29e-418d-9307-a07a4e5ad6d5 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.154s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88df5f6-ab6e-4fd7-b84c-ee2b4c373ceb]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-277a3a09-d29e-418d-9307-a07a4e5ad6d5 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-277a3a09-d29e-418d-9307-a07a4e5ad6d5 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] SCSI volumes sdb have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-277a3a09-d29e-418d-9307-a07a4e5ad6d5 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:44 user nova-compute[72362]: INFO nova.compute.manager [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Rebuilding instance
Aug 09 10:24:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6400a0-0b6a-4a9e-a696-a4f71c159993]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-277a3a09-d29e-418d-9307-a07a4e5ad6d5 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG nova.objects.instance [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d69b7c-1976-44b9-96bd-33695fb66c86]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-277a3a09-d29e-418d-9307-a07a4e5ad6d5 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7, portal: 172.16.0.220,3260]
Aug 09 10:24:44 user nova-compute[72362]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7, portal: 172.16.0.220,3260] successful.
Aug 09 10:24:44 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG nova.compute.manager [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ef319fe-2472-41ac-86a6-0e4f3522e7c7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a8f93e-89f9-4f00-b185-6f18d90da713]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-277a3a09-d29e-418d-9307-a07a4e5ad6d5 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-277a3a09-d29e-418d-9307-a07a4e5ad6d5 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.496s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-277a3a09-d29e-418d-9307-a07a4e5ad6d5 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] <== disconnect_volume: return (498ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-277a3a09-d29e-418d-9307-a07a4e5ad6d5 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:24:44 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-277a3a09-d29e-418d-9307-a07a4e5ad6d5 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Deleting instance files /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f_del
Aug 09 10:24:44 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-277a3a09-d29e-418d-9307-a07a4e5ad6d5 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Deletion of /opt/stack/data/nova/instances/0e8a7668-1635-4cbc-8c09-ece19ff67d4f_del complete
Aug 09 10:24:44 user nova-compute[72362]: DEBUG nova.objects.instance [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lazy-loading 'pci_requests' on Instance uuid 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG nova.objects.instance [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG nova.objects.instance [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lazy-loading 'resources' on Instance uuid 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:24:44 user nova-compute[72362]: INFO nova.compute.manager [None req-277a3a09-d29e-418d-9307-a07a4e5ad6d5 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Took 1.42 seconds to destroy the instance on the hypervisor.
Aug 09 10:24:44 user nova-compute[72362]: DEBUG oslo.service.loopingcall [None req-277a3a09-d29e-418d-9307-a07a4e5ad6d5 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72362) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG nova.compute.manager [-] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Deallocating network for instance {{(pid=72362) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] deallocate_for_instance() {{(pid=72362) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG nova.objects.instance [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lazy-loading 'migration_context' on Instance uuid 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG nova.objects.instance [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72362) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG nova.compute.manager [req-362ad9de-9442-435f-9e8c-5ea35b9dddd8 req-62b30ef2-1c4a-4a5e-bda9-1631db93fd8e service nova] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Received event network-vif-unplugged-9735e8ce-a2bd-49c8-adcf-846c05b7427e {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-362ad9de-9442-435f-9e8c-5ea35b9dddd8 req-62b30ef2-1c4a-4a5e-bda9-1631db93fd8e service nova] Acquiring lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-362ad9de-9442-435f-9e8c-5ea35b9dddd8 req-62b30ef2-1c4a-4a5e-bda9-1631db93fd8e service nova] Lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-362ad9de-9442-435f-9e8c-5ea35b9dddd8 req-62b30ef2-1c4a-4a5e-bda9-1631db93fd8e service nova] Lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:24:44 user nova-compute[72362]: DEBUG nova.compute.manager [req-362ad9de-9442-435f-9e8c-5ea35b9dddd8 req-62b30ef2-1c4a-4a5e-bda9-1631db93fd8e service nova] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] No waiting events found dispatching network-vif-unplugged-9735e8ce-a2bd-49c8-adcf-846c05b7427e {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:24:44 user nova-compute[72362]: WARNING nova.compute.manager [req-362ad9de-9442-435f-9e8c-5ea35b9dddd8 req-62b30ef2-1c4a-4a5e-bda9-1631db93fd8e service nova] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Received unexpected event network-vif-unplugged-9735e8ce-a2bd-49c8-adcf-846c05b7427e for instance with vm_state active and task_state rebuilding.
Aug 09 10:24:45 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Instance destroyed successfully.
Aug 09 10:24:45 user nova-compute[72362]: INFO nova.compute.manager [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Detaching volume 9fd78518-fb6e-47ac-a671-2b5e62efe4ec
Aug 09 10:24:45 user nova-compute[72362]: DEBUG nova.compute.manager [req-e882d6b9-daa0-439c-a60b-2420f1dbcf1c req-d30ad68c-7dd0-4a91-bb22-2af2afb9a27d service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Received event network-vif-plugged-ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:24:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e882d6b9-daa0-439c-a60b-2420f1dbcf1c req-d30ad68c-7dd0-4a91-bb22-2af2afb9a27d service nova] Acquiring lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:24:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e882d6b9-daa0-439c-a60b-2420f1dbcf1c req-d30ad68c-7dd0-4a91-bb22-2af2afb9a27d service nova] Lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:24:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e882d6b9-daa0-439c-a60b-2420f1dbcf1c req-d30ad68c-7dd0-4a91-bb22-2af2afb9a27d service nova] Lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:24:45 user nova-compute[72362]: DEBUG nova.compute.manager [req-e882d6b9-daa0-439c-a60b-2420f1dbcf1c req-d30ad68c-7dd0-4a91-bb22-2af2afb9a27d service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] No waiting events found dispatching network-vif-plugged-ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:24:45 user nova-compute[72362]: WARNING nova.compute.manager [req-e882d6b9-daa0-439c-a60b-2420f1dbcf1c req-d30ad68c-7dd0-4a91-bb22-2af2afb9a27d service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Received unexpected event network-vif-plugged-ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 for instance with vm_state active and task_state deleting.
Aug 09 10:24:45 user nova-compute[72362]: INFO nova.virt.block_device [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Attempting to driver detach volume 9fd78518-fb6e-47ac-a671-2b5e62efe4ec from mountpoint /dev/vdb
Aug 09 10:24:45 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Attempting to detach device vdb from instance 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f from the persistent domain config. {{(pid=72362) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 10:24:45 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 10:24:45 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:24:45 user nova-compute[72362]:   <source dev="/dev/sdc"/>
Aug 09 10:24:45 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:24:45 user nova-compute[72362]:   <serial>9fd78518-fb6e-47ac-a671-2b5e62efe4ec</serial>
Aug 09 10:24:45 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 10:24:45 user nova-compute[72362]: </disk>
Aug 09 10:24:45 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:24:45 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Successfully detached device vdb from instance 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f from the persistent domain config.
Aug 09 10:24:45 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:24:45 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yMmUbTGO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:24:45 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 10:24:45 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:24:45 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:24:45 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:24:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:45 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a129be07-8d91-43c5-bd2e-7a35923970a4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:45 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c33ef0-b736-4276-b23f-fc5ff0b3d52e]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:45 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:24:45 user nova-compute[72362]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:24:45 user nova-compute[72362]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)
Aug 09 10:24:45 user nova-compute[72362]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)
Aug 09 10:24:45 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:24:45 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:24:45 user nova-compute[72362]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:24:45 user nova-compute[72362]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)
Aug 09 10:24:45 user nova-compute[72362]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)
Aug 09 10:24:45 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:24:45 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e4274e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec'): ({'sdc'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:24:45 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Removing single pathed devices sdc {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:24:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:45 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54ee1f5-b453-4801-af44-f692530ecdae]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:45 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf49053-7051-4334-8e4c-65ab4d78ed7a]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:45 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Flushing IO for device /dev/sdc {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:24:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:45 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b9302a-66bb-4816-a4fd-517c106b1444]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:45 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:24:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:45 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c344347-eba5-4e53-bb15-b6afa4e57898]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:45 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:24:45 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] SCSI volumes sdc have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:24:45 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:24:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:45 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5aaf1a5-271b-4347-82a8-ff0ecbacb77d]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:45 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:24:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:45 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c0e124-accc-418a-b301-380614723994]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:45 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec, portal: 172.16.0.220,3260]
Aug 09 10:24:45 user nova-compute[72362]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec, portal: 172.16.0.220,3260] successful.
Aug 09 10:24:45 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:24:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:45 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a53deb-73df-451d-b3c4-0a143af72e48]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:45 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:24:45 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:24:45 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] <== disconnect_volume: return (315ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:24:45 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:24:46 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:24:46 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Took 1.56 seconds to deallocate network for instance.
Aug 09 10:24:46 user nova-compute[72362]: DEBUG nova.compute.manager [req-b28904db-2283-4809-be53-4531a9735e0c req-60a76dfe-7bc1-42a2-8ebb-3611241a7fef service nova] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Received event network-vif-deleted-ec7889ae-0cbc-41e3-a750-a5cb2b522ce9 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:24:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:24:46 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Instance destroyed successfully.
Aug 09 10:24:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:20:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-992323535',display_name='tempest-ServerActionsTestOtherA-server-1403657354',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-992323535',id=15,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwSFF251eQti/qkoXtJtG/hsB95elMyv8iaeRUjgcdf3ZQpb25r9rbEB2fGNjqP3pvOqQxJNR/NqVUD62omNMx/akMv5+i7VAu1R/GqhP2vqtVAvdiRNee4z2ROG7Jd8w==',key_name='tempest-keypair-122703468',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:20:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8ac22022944542c0b52dd912d3dbcce2',ramdisk_id='',reservation_id='r-aza1h2p7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2101881579',owner_user_name='tempest-ServerActionsTestOtherA-2101881579-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:24:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='990e2d160fdc4c599cee9f65d6d4e41d',uuid=3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9735e8ce-a2bd-49c8-adcf-846c05b7427e", "address": "fa:16:3e:91:34:e3", "network": {"id": "e6c54663-74e3-43e2-8f0d-61b300c1f68d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1222286883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ac22022944542c0b52dd912d3dbcce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9735e8ce-a2", "ovs_interfaceid": "9735e8ce-a2bd-49c8-adcf-846c05b7427e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:24:46 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Converting VIF {"id": "9735e8ce-a2bd-49c8-adcf-846c05b7427e", "address": "fa:16:3e:91:34:e3", "network": {"id": "e6c54663-74e3-43e2-8f0d-61b300c1f68d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1222286883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ac22022944542c0b52dd912d3dbcce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9735e8ce-a2", "ovs_interfaceid": "9735e8ce-a2bd-49c8-adcf-846c05b7427e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:24:46 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:34:e3,bridge_name='br-int',has_traffic_filtering=True,id=9735e8ce-a2bd-49c8-adcf-846c05b7427e,network=Network(e6c54663-74e3-43e2-8f0d-61b300c1f68d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9735e8ce-a2') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:24:46 user nova-compute[72362]: DEBUG os_vif [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:34:e3,bridge_name='br-int',has_traffic_filtering=True,id=9735e8ce-a2bd-49c8-adcf-846c05b7427e,network=Network(e6c54663-74e3-43e2-8f0d-61b300c1f68d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9735e8ce-a2') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:24:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:24:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9735e8ce-a2, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:24:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:24:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:24:46 user nova-compute[72362]: INFO os_vif [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:34:e3,bridge_name='br-int',has_traffic_filtering=True,id=9735e8ce-a2bd-49c8-adcf-846c05b7427e,network=Network(e6c54663-74e3-43e2-8f0d-61b300c1f68d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9735e8ce-a2')
Aug 09 10:24:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:24:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yMmUbTGO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:24:46 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 10:24:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:24:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:24:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:24:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:46 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4767eee7-7fcc-42ff-b244-d2c5c53b12ec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:46 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e93968-81d6-40b4-a232-2f36377446dc]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:24:46 user nova-compute[72362]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:24:46 user nova-compute[72362]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)
Aug 09 10:24:46 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:24:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:24:46 user nova-compute[72362]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:24:46 user nova-compute[72362]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)
Aug 09 10:24:46 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:24:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e45dd870>, {}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:24:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Disconnecting from: [] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:24:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.057s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:24:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] <== disconnect_volume: return (59ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:24:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:24:46 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Deleting instance files /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f_del
Aug 09 10:24:46 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Deletion of /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f_del complete
Aug 09 10:24:46 user nova-compute[72362]: DEBUG nova.compute.manager [req-90c41bfe-eb30-4b10-8891-8ec1cdb9d70f req-0a4847f3-4914-4e4b-b23a-68e90bb94d4f service nova] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Received event network-vif-plugged-9735e8ce-a2bd-49c8-adcf-846c05b7427e {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:24:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-90c41bfe-eb30-4b10-8891-8ec1cdb9d70f req-0a4847f3-4914-4e4b-b23a-68e90bb94d4f service nova] Acquiring lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:24:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-90c41bfe-eb30-4b10-8891-8ec1cdb9d70f req-0a4847f3-4914-4e4b-b23a-68e90bb94d4f service nova] Lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:24:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-90c41bfe-eb30-4b10-8891-8ec1cdb9d70f req-0a4847f3-4914-4e4b-b23a-68e90bb94d4f service nova] Lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:24:46 user nova-compute[72362]: DEBUG nova.compute.manager [req-90c41bfe-eb30-4b10-8891-8ec1cdb9d70f req-0a4847f3-4914-4e4b-b23a-68e90bb94d4f service nova] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] No waiting events found dispatching network-vif-plugged-9735e8ce-a2bd-49c8-adcf-846c05b7427e {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:24:46 user nova-compute[72362]: WARNING nova.compute.manager [req-90c41bfe-eb30-4b10-8891-8ec1cdb9d70f req-0a4847f3-4914-4e4b-b23a-68e90bb94d4f service nova] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Received unexpected event network-vif-plugged-9735e8ce-a2bd-49c8-adcf-846c05b7427e for instance with vm_state active and task_state rebuilding.
Aug 09 10:24:46 user nova-compute[72362]: INFO nova.compute.manager [None req-277a3a09-d29e-418d-9307-a07a4e5ad6d5 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Took 0.88 seconds to detach 1 volumes for instance.
Aug 09 10:24:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-277a3a09-d29e-418d-9307-a07a4e5ad6d5 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:24:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-277a3a09-d29e-418d-9307-a07a4e5ad6d5 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:24:47 user nova-compute[72362]: INFO nova.virt.block_device [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Booting with volume 9fd78518-fb6e-47ac-a671-2b5e62efe4ec at /dev/vdb
Aug 09 10:24:47 user nova-compute[72362]: DEBUG os_brick.utils [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:24:47 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:47 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:47 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[88017283-b7ba-4710-b653-6c61e04ed7bc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:47 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:47 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:47 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28bb2a5-29b5-4ebc-8ae2-6883e9a5508c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:47 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:47 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:47 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fdede4a-fd5b-4c34-83da-a56c80a195b8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:47 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[37831f51-6864-4f3f-b445-dd405bb12a49]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:47 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:47 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:24:47 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:24:47 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:47 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:24:47 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:24:47 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[8172fa3d-98aa-4662-bbc6-a70717a9ecdf]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:47 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:24:47 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:24:47 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:24:47 user nova-compute[72362]: DEBUG os_brick.utils [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:24:47 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Updating existing volume attachment record: 223fc69f-5908-4643-8365-2db121a56bfb {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 10:24:47 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-277a3a09-d29e-418d-9307-a07a4e5ad6d5 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:24:47 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-277a3a09-d29e-418d-9307-a07a4e5ad6d5 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:24:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-277a3a09-d29e-418d-9307-a07a4e5ad6d5 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.395s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:24:47 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-277a3a09-d29e-418d-9307-a07a4e5ad6d5 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Deleted allocations for instance 0e8a7668-1635-4cbc-8c09-ece19ff67d4f
Aug 09 10:24:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-277a3a09-d29e-418d-9307-a07a4e5ad6d5 tempest-ServerActionsTestOtherB-767949360 tempest-ServerActionsTestOtherB-767949360-project-member] Lock "0e8a7668-1635-4cbc-8c09-ece19ff67d4f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.505s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:24:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:24:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:24:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:24:53 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-48b0faca-6eb1-4a72-bf59-20120f21204c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Acquiring lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:24:53 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-48b0faca-6eb1-4a72-bf59-20120f21204c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:24:53 user nova-compute[72362]: DEBUG nova.objects.instance [None req-48b0faca-6eb1-4a72-bf59-20120f21204c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lazy-loading 'flavor' on Instance uuid 4746beb1-d313-4cea-bf7b-75b507ebbdd2 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:24:53 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-48b0faca-6eb1-4a72-bf59-20120f21204c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:24:53 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-48b0faca-6eb1-4a72-bf59-20120f21204c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Acquiring lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:24:53 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-48b0faca-6eb1-4a72-bf59-20120f21204c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:24:53 user nova-compute[72362]: INFO nova.compute.manager [None req-48b0faca-6eb1-4a72-bf59-20120f21204c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Attaching volume 4f647d5a-1ce2-4186-81fb-70ca0c123367 to /dev/vdb
Aug 09 10:24:53 user nova-compute[72362]: DEBUG os_brick.utils [None req-48b0faca-6eb1-4a72-bf59-20120f21204c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:24:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:54 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[55abc379-2675-4da4-8c18-3e5f364b5ce3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:54 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41fa417-fca2-49e8-a142-d4617cbf7d77]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:54 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bfe5632-25e4-43ff-adaf-35e2c0ac4e7b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:54 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3814d7a6-4a48-44a7-a815-80da69db9d13]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-48b0faca-6eb1-4a72-bf59-20120f21204c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-48b0faca-6eb1-4a72-bf59-20120f21204c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:24:54 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-48b0faca-6eb1-4a72-bf59-20120f21204c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:24:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:24:54 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:24:54 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6daafc21-fe97-4801-889e-4abfd7b110fb]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:54 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-48b0faca-6eb1-4a72-bf59-20120f21204c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:24:54 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-48b0faca-6eb1-4a72-bf59-20120f21204c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:24:54 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-48b0faca-6eb1-4a72-bf59-20120f21204c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:24:54 user nova-compute[72362]: DEBUG os_brick.utils [None req-48b0faca-6eb1-4a72-bf59-20120f21204c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:24:54 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-48b0faca-6eb1-4a72-bf59-20120f21204c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Updating existing volume attachment record: 49761878-7434-4841-95b2-83d6f9cad188 {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 10:24:54 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:24:55 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:24:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4c5c2754-5ce1-413a-b8f9-31087db0a094 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Acquiring lock "6493ab9a-4d69-434d-bed7-e51f1c5f3497" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:24:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4c5c2754-5ce1-413a-b8f9-31087db0a094 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Lock "6493ab9a-4d69-434d-bed7-e51f1c5f3497" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:24:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4c5c2754-5ce1-413a-b8f9-31087db0a094 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Acquiring lock "6493ab9a-4d69-434d-bed7-e51f1c5f3497-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:24:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4c5c2754-5ce1-413a-b8f9-31087db0a094 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Lock "6493ab9a-4d69-434d-bed7-e51f1c5f3497-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:24:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4c5c2754-5ce1-413a-b8f9-31087db0a094 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Lock "6493ab9a-4d69-434d-bed7-e51f1c5f3497-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:24:55 user nova-compute[72362]: INFO nova.compute.manager [None req-4c5c2754-5ce1-413a-b8f9-31087db0a094 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Terminating instance
Aug 09 10:24:55 user nova-compute[72362]: DEBUG nova.compute.manager [None req-4c5c2754-5ce1-413a-b8f9-31087db0a094 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Start destroying the instance on the hypervisor. {{(pid=72362) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 10:24:55 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:24:55 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:24:55 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:24:55 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:24:55 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:24:55 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:24:55 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG nova.compute.manager [req-39790a69-aff1-4b5c-827b-15ce68a05d37 req-7da2c63d-8af5-4008-93f0-12e1879d1325 service nova] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Received event network-vif-unplugged-a9017bf2-874f-419a-aae5-43f2ce4a63dd {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-39790a69-aff1-4b5c-827b-15ce68a05d37 req-7da2c63d-8af5-4008-93f0-12e1879d1325 service nova] Acquiring lock "6493ab9a-4d69-434d-bed7-e51f1c5f3497-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-39790a69-aff1-4b5c-827b-15ce68a05d37 req-7da2c63d-8af5-4008-93f0-12e1879d1325 service nova] Lock "6493ab9a-4d69-434d-bed7-e51f1c5f3497-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-39790a69-aff1-4b5c-827b-15ce68a05d37 req-7da2c63d-8af5-4008-93f0-12e1879d1325 service nova] Lock "6493ab9a-4d69-434d-bed7-e51f1c5f3497-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG nova.compute.manager [req-39790a69-aff1-4b5c-827b-15ce68a05d37 req-7da2c63d-8af5-4008-93f0-12e1879d1325 service nova] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] No waiting events found dispatching network-vif-unplugged-a9017bf2-874f-419a-aae5-43f2ce4a63dd {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG nova.compute.manager [req-39790a69-aff1-4b5c-827b-15ce68a05d37 req-7da2c63d-8af5-4008-93f0-12e1879d1325 service nova] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Received event network-vif-unplugged-a9017bf2-874f-419a-aae5-43f2ce4a63dd for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:24:56 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Instance destroyed successfully.
Aug 09 10:24:56 user nova-compute[72362]: DEBUG nova.objects.instance [None req-4c5c2754-5ce1-413a-b8f9-31087db0a094 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Lazy-loading 'resources' on Instance uuid 6493ab9a-4d69-434d-bed7-e51f1c5f3497 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-4c5c2754-5ce1-413a-b8f9-31087db0a094 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T10:21:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-405979082',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-794271322',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFPlCV+krNMhby8imZncFRp5DGbA/vMmO2zNpzm0Pvmj5dU73J2HkJnfxWbQ3K2RYIgrwe8xBwFNEDCwdB9IYNqQGuPlU9V+VeI/1xppVZd/VycFGQoWDxVC9NrPc4QD9w==',key_name='tempest-keypair-286170421',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:23:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ec98263d80c34ed19b02d7c8cdb8a627',ramdisk_id='',reservation_id='r-8d9h038f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-773277146',owner_user_name='tempest-ServerActionsV293TestJSON-773277146-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:23:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='731b08d22e494215be0dd798362a6f91',uuid=6493ab9a-4d69-434d-bed7-e51f1c5f3497,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a9017bf2-874f-419a-aae5-43f2ce4a63dd", "address": "fa:16:3e:ac:ef:70", "network": {"id": "0f5e6621-493c-440d-aaec-419fc6111969", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1795951162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec98263d80c34ed19b02d7c8cdb8a627", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9017bf2-87", "ovs_interfaceid": "a9017bf2-874f-419a-aae5-43f2ce4a63dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-4c5c2754-5ce1-413a-b8f9-31087db0a094 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Converting VIF {"id": "a9017bf2-874f-419a-aae5-43f2ce4a63dd", "address": "fa:16:3e:ac:ef:70", "network": {"id": "0f5e6621-493c-440d-aaec-419fc6111969", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1795951162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec98263d80c34ed19b02d7c8cdb8a627", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9017bf2-87", "ovs_interfaceid": "a9017bf2-874f-419a-aae5-43f2ce4a63dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-4c5c2754-5ce1-413a-b8f9-31087db0a094 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:ef:70,bridge_name='br-int',has_traffic_filtering=True,id=a9017bf2-874f-419a-aae5-43f2ce4a63dd,network=Network(0f5e6621-493c-440d-aaec-419fc6111969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9017bf2-87') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG os_vif [None req-4c5c2754-5ce1-413a-b8f9-31087db0a094 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:ef:70,bridge_name='br-int',has_traffic_filtering=True,id=a9017bf2-874f-419a-aae5-43f2ce4a63dd,network=Network(0f5e6621-493c-440d-aaec-419fc6111969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9017bf2-87') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa9017bf2-87, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:24:56 user nova-compute[72362]: INFO os_vif [None req-4c5c2754-5ce1-413a-b8f9-31087db0a094 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:ef:70,bridge_name='br-int',has_traffic_filtering=True,id=a9017bf2-874f-419a-aae5-43f2ce4a63dd,network=Network(0f5e6621-493c-440d-aaec-419fc6111969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9017bf2-87')
Aug 09 10:24:56 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c5c2754-5ce1-413a-b8f9-31087db0a094 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c5c2754-5ce1-413a-b8f9-31087db0a094 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KJEmzxkc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:24:56 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-4c5c2754-5ce1-413a-b8f9-31087db0a094 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:24:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-4c5c2754-5ce1-413a-b8f9-31087db0a094 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-4c5c2754-5ce1-413a-b8f9-31087db0a094 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c5c2754-5ce1-413a-b8f9-31087db0a094 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b469a64-e78d-425b-b545-d9717cc1569e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1becdf7-e1b6-4484-8b90-f4ccd698ef1d]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c5c2754-5ce1-413a-b8f9-31087db0a094 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:24:56 user nova-compute[72362]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:24:56 user nova-compute[72362]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)
Aug 09 10:24:56 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c5c2754-5ce1-413a-b8f9-31087db0a094 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:24:56 user nova-compute[72362]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:24:56 user nova-compute[72362]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 (non-flash)
Aug 09 10:24:56 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c5c2754-5ce1-413a-b8f9-31087db0a094 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e43c4310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6'): ({'sde'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-4c5c2754-5ce1-413a-b8f9-31087db0a094 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Removing single pathed devices sde {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1b0590-a59b-49da-bdef-452eff484a6b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.027s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e3433f-6599-4afe-895a-916ec179d4ea]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-4c5c2754-5ce1-413a-b8f9-31087db0a094 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Flushing IO for device /dev/sde {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b417df-f3c6-40ad-8697-af39c9e47f7e]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-4c5c2754-5ce1-413a-b8f9-31087db0a094 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6cfc95-87cc-4c38-85d3-6dc259680b2b]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-4c5c2754-5ce1-413a-b8f9-31087db0a094 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-4c5c2754-5ce1-413a-b8f9-31087db0a094 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] SCSI volumes sde have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26338623666333432', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_cd941ff4', '/dev/disk/by-id/scsi-1SCST_BIOcd941ff4-c8b6f342f505e44f') {{(pid=84003) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 10:24:56 user nova-compute[72362]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26338623666333432
Aug 09 10:24:56 user nova-compute[72362]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_cd941ff4
Aug 09 10:24:56 user nova-compute[72362]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOcd941ff4-c8b6f342f505e44f
Aug 09 10:24:56 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b26810f-f76e-423a-8cdb-6adda769c7a9]: (4, None) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c5c2754-5ce1-413a-b8f9-31087db0a094 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f197df69-220d-497e-8fee-d6d26a3fe54b]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c5c2754-5ce1-413a-b8f9-31087db0a094 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90a9d6f-92ac-4ff2-83e5-a206875e9025]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c5c2754-5ce1-413a-b8f9-31087db0a094 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6, portal: 172.16.0.220,3260]
Aug 09 10:24:56 user nova-compute[72362]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6, portal: 172.16.0.220,3260] successful.
Aug 09 10:24:56 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2bcc794-ae54-4b73-8b5e-751599d537f6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8b719b-1001-4b4a-a9ae-4e2cce84b2ca]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c5c2754-5ce1-413a-b8f9-31087db0a094 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-4c5c2754-5ce1-413a-b8f9-31087db0a094 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c5c2754-5ce1-413a-b8f9-31087db0a094 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] <== disconnect_volume: return (368ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:24:56 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c5c2754-5ce1-413a-b8f9-31087db0a094 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:24:56 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-4c5c2754-5ce1-413a-b8f9-31087db0a094 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Deleting instance files /opt/stack/data/nova/instances/6493ab9a-4d69-434d-bed7-e51f1c5f3497_del
Aug 09 10:24:56 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-4c5c2754-5ce1-413a-b8f9-31087db0a094 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Deletion of /opt/stack/data/nova/instances/6493ab9a-4d69-434d-bed7-e51f1c5f3497_del complete
Aug 09 10:24:57 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:24:57 user nova-compute[72362]: INFO nova.compute.manager [None req-4c5c2754-5ce1-413a-b8f9-31087db0a094 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Took 1.42 seconds to destroy the instance on the hypervisor.
Aug 09 10:24:57 user nova-compute[72362]: DEBUG oslo.service.loopingcall [None req-4c5c2754-5ce1-413a-b8f9-31087db0a094 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72362) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 10:24:57 user nova-compute[72362]: DEBUG nova.compute.manager [-] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Deallocating network for instance {{(pid=72362) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 10:24:57 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] deallocate_for_instance() {{(pid=72362) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 10:24:57 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:24:57 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Creating image(s)
Aug 09 10:24:57 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Acquiring lock "/opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:24:57 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "/opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:24:57 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "/opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:24:57 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:57 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.145s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:57 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Acquiring lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:24:57 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:24:57 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:57 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.159s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:57 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk 1073741824 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:57 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk 1073741824" returned: 0 in 0.066s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:57 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:24:57 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:57 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.175s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:57 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk. size=1073741824 {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 10:24:57 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:57 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Cannot resize image /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk to a smaller size. {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Created local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Ensure instance console log exists: /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Start _get_guest_xml network_info=[{"id": "9735e8ce-a2bd-49c8-adcf-846c05b7427e", "address": "fa:16:3e:91:34:e3", "network": {"id": "e6c54663-74e3-43e2-8f0d-61b300c1f68d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1222286883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ac22022944542c0b52dd912d3dbcce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9735e8ce-a2", "ovs_interfaceid": "9735e8ce-a2bd-49c8-adcf-846c05b7427e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': 'a08d1a11-49eb-4212-a351-e11ee9553b95'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '223fc69f-5908-4643-8365-2db121a56bfb', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yMmUbTGO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f', 'attached_at': '', 'detached_at': '', 'volume_id': '9fd78518-fb6e-47ac-a671-2b5e62efe4ec', 'serial': '9fd78518-fb6e-47ac-a671-2b5e62efe4ec'}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:24:58 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 09 10:24:58 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 09 10:24:58 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG nova.objects.instance [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yMmUbTGO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:24:58 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 10:24:58 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:24:58 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 10:24:58 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:24:58 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:24:58 user nova-compute[72362]: DEBUG nova.compute.manager [req-4086bd10-79bc-4d6d-8412-74a5cc9ed060 req-d2893d0e-e849-45ed-a4fc-b70ec868a8f7 service nova] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Received event network-vif-plugged-a9017bf2-874f-419a-aae5-43f2ce4a63dd {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-4086bd10-79bc-4d6d-8412-74a5cc9ed060 req-d2893d0e-e849-45ed-a4fc-b70ec868a8f7 service nova] Acquiring lock "6493ab9a-4d69-434d-bed7-e51f1c5f3497-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-4086bd10-79bc-4d6d-8412-74a5cc9ed060 req-d2893d0e-e849-45ed-a4fc-b70ec868a8f7 service nova] Lock "6493ab9a-4d69-434d-bed7-e51f1c5f3497-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-4086bd10-79bc-4d6d-8412-74a5cc9ed060 req-d2893d0e-e849-45ed-a4fc-b70ec868a8f7 service nova] Lock "6493ab9a-4d69-434d-bed7-e51f1c5f3497-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG nova.compute.manager [req-4086bd10-79bc-4d6d-8412-74a5cc9ed060 req-d2893d0e-e849-45ed-a4fc-b70ec868a8f7 service nova] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] No waiting events found dispatching network-vif-plugged-a9017bf2-874f-419a-aae5-43f2ce4a63dd {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:24:58 user nova-compute[72362]: WARNING nova.compute.manager [req-4086bd10-79bc-4d6d-8412-74a5cc9ed060 req-d2893d0e-e849-45ed-a4fc-b70ec868a8f7 service nova] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Received unexpected event network-vif-plugged-a9017bf2-874f-419a-aae5-43f2ce4a63dd for instance with vm_state active and task_state deleting.
Aug 09 10:24:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a38bee-f29c-449a-b06b-0e027e67a578]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:24:58 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[084f5b00-6bba-4a11-a8b5-691c546f4844]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec] added
Aug 09 10:24:58 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb67f7a-6f9f-4845-b6a9-30492ac72adb]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05d2990-d97c-47bf-b93c-3fcfcac316df]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yMmUbTGO {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yMmUbTGO" returned: 0 in 0.029s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4279fb-70bf-47fb-a2e7-5f84add2d38e]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yMmUbTGO'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f12193-e096-4a05-96af-46533211fd0a]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef742533-3018-4742-9c65-356aaeb8ec18]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:24:58 user nova-compute[72362]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:24:58 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:24:58 user nova-compute[72362]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:24:58 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[358152a4-b127-4e7b-9e22-e43c90443c9f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec, portal: 172.16.0.220,3260]
Aug 09 10:24:58 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec, portal: 172.16.0.220,3260] successful.
Aug 09 10:24:58 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5f5d50-a2c3-4081-a3b5-4ba7a0a8d2d6]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb17f2a-49ba-431e-81ce-1baea3f3dd3c]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:24:58 user nova-compute[72362]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:24:58 user nova-compute[72362]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)
Aug 09 10:24:58 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:24:58 user nova-compute[72362]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:24:58 user nova-compute[72362]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)
Aug 09 10:24:58 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f502902-9e67-4695-9274-f650f9acc7ea]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yMmUbTGO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:24:58 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Took 1.60 seconds to deallocate network for instance.
Aug 09 10:24:58 user nova-compute[72362]: DEBUG nova.compute.manager [req-eab3f597-247e-4f81-b77c-773420ce9f1f req-42a775e2-2745-42ec-bf1d-ed976766cb5f service nova] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Received event network-vif-deleted-a9017bf2-874f-419a-aae5-43f2ce4a63dd {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:24:58 user nova-compute[72362]: INFO nova.compute.manager [req-eab3f597-247e-4f81-b77c-773420ce9f1f req-42a775e2-2745-42ec-bf1d-ed976766cb5f service nova] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Neutron deleted interface a9017bf2-874f-419a-aae5-43f2ce4a63dd; detaching it from the instance and deleting it from the info cache
Aug 09 10:24:58 user nova-compute[72362]: DEBUG nova.network.neutron [req-eab3f597-247e-4f81-b77c-773420ce9f1f req-42a775e2-2745-42ec-bf1d-ed976766cb5f service nova] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG nova.compute.manager [req-eab3f597-247e-4f81-b77c-773420ce9f1f req-42a775e2-2745-42ec-bf1d-ed976766cb5f service nova] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Detach interface failed, port_id=a9017bf2-874f-419a-aae5-43f2ce4a63dd, reason: Instance 6493ab9a-4d69-434d-bed7-e51f1c5f3497 could not be found. {{(pid=72362) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691576683.870645, 0e8a7668-1635-4cbc-8c09-ece19ff67d4f => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:24:58 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] VM Stopped (Lifecycle Event)
Aug 09 10:24:58 user nova-compute[72362]: DEBUG nova.compute.manager [None req-d2f5104c-e6c1-4184-bd12-bc81410fa228 None None] [instance: 0e8a7668-1635-4cbc-8c09-ece19ff67d4f] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:24:58 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 10:24:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "refresh_cache-3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:24:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquired lock "refresh_cache-3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:24:59 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Forcefully refreshing network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 10:24:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:24:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] <== connect_volume: return (1403ms) {'type': 'block', 'scsi_wwn': '26532636131386230', 'path': '/dev/sdb'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:24:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532636131386230', 'path': '/dev/sdb'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:24:59 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Updating instance_info_cache with network_info: [{"id": "9735e8ce-a2bd-49c8-adcf-846c05b7427e", "address": "fa:16:3e:91:34:e3", "network": {"id": "e6c54663-74e3-43e2-8f0d-61b300c1f68d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1222286883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ac22022944542c0b52dd912d3dbcce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9735e8ce-a2", "ovs_interfaceid": "9735e8ce-a2bd-49c8-adcf-846c05b7427e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:24:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T10:20:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-992323535',display_name='tempest-ServerActionsTestOtherA-server-1403657354',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-992323535',id=15,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwSFF251eQti/qkoXtJtG/hsB95elMyv8iaeRUjgcdf3ZQpb25r9rbEB2fGNjqP3pvOqQxJNR/NqVUD62omNMx/akMv5+i7VAu1R/GqhP2vqtVAvdiRNee4z2ROG7Jd8w==',key_name='tempest-keypair-122703468',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:20:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8ac22022944542c0b52dd912d3dbcce2',ramdisk_id='',reservation_id='r-aza1h2p7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2101881579',owner_user_name='tempest-ServerActionsTestOtherA-2101881579-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:24:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='990e2d160fdc4c599cee9f65d6d4e41d',uuid=3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9735e8ce-a2bd-49c8-adcf-846c05b7427e", "address": "fa:16:3e:91:34:e3", "network": {"id": "e6c54663-74e3-43e2-8f0d-61b300c1f68d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1222286883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ac22022944542c0b52dd912d3dbcce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9735e8ce-a2", "ovs_interfaceid": "9735e8ce-a2bd-49c8-adcf-846c05b7427e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:24:59 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Converting VIF {"id": "9735e8ce-a2bd-49c8-adcf-846c05b7427e", "address": "fa:16:3e:91:34:e3", "network": {"id": "e6c54663-74e3-43e2-8f0d-61b300c1f68d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1222286883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ac22022944542c0b52dd912d3dbcce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9735e8ce-a2", "ovs_interfaceid": "9735e8ce-a2bd-49c8-adcf-846c05b7427e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:24:59 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:34:e3,bridge_name='br-int',has_traffic_filtering=True,id=9735e8ce-a2bd-49c8-adcf-846c05b7427e,network=Network(e6c54663-74e3-43e2-8f0d-61b300c1f68d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9735e8ce-a2') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:24:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:24:59 user nova-compute[72362]:   <uuid>3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f</uuid>
Aug 09 10:24:59 user nova-compute[72362]:   <name>instance-0000000f</name>
Aug 09 10:24:59 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:24:59 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:24:59 user nova-compute[72362]:   <metadata>
Aug 09 10:24:59 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:24:59 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:24:59 user nova-compute[72362]:       <nova:name>tempest-ServerActionsTestOtherA-server-1403657354</nova:name>
Aug 09 10:24:59 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:24:58</nova:creationTime>
Aug 09 10:24:59 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:24:59 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:24:59 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:24:59 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:24:59 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:24:59 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:24:59 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:24:59 user nova-compute[72362]:       <nova:owner>
Aug 09 10:24:59 user nova-compute[72362]:         <nova:user uuid="990e2d160fdc4c599cee9f65d6d4e41d">tempest-ServerActionsTestOtherA-2101881579-project-member</nova:user>
Aug 09 10:24:59 user nova-compute[72362]:         <nova:project uuid="8ac22022944542c0b52dd912d3dbcce2">tempest-ServerActionsTestOtherA-2101881579</nova:project>
Aug 09 10:24:59 user nova-compute[72362]:       </nova:owner>
Aug 09 10:24:59 user nova-compute[72362]:       <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:24:59 user nova-compute[72362]:       <nova:ports>
Aug 09 10:24:59 user nova-compute[72362]:         <nova:port uuid="9735e8ce-a2bd-49c8-adcf-846c05b7427e">
Aug 09 10:24:59 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 10:24:59 user nova-compute[72362]:         </nova:port>
Aug 09 10:24:59 user nova-compute[72362]:       </nova:ports>
Aug 09 10:24:59 user nova-compute[72362]:     </nova:instance>
Aug 09 10:24:59 user nova-compute[72362]:   </metadata>
Aug 09 10:24:59 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:24:59 user nova-compute[72362]:     <system>
Aug 09 10:24:59 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:24:59 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:24:59 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:24:59 user nova-compute[72362]:       <entry name="serial">3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f</entry>
Aug 09 10:24:59 user nova-compute[72362]:       <entry name="uuid">3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f</entry>
Aug 09 10:24:59 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:24:59 user nova-compute[72362]:     </system>
Aug 09 10:24:59 user nova-compute[72362]:   </sysinfo>
Aug 09 10:24:59 user nova-compute[72362]:   <os>
Aug 09 10:24:59 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:24:59 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:24:59 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:24:59 user nova-compute[72362]:   </os>
Aug 09 10:24:59 user nova-compute[72362]:   <features>
Aug 09 10:24:59 user nova-compute[72362]:     <acpi/>
Aug 09 10:24:59 user nova-compute[72362]:     <apic/>
Aug 09 10:24:59 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:24:59 user nova-compute[72362]:   </features>
Aug 09 10:24:59 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:24:59 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:24:59 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:24:59 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:24:59 user nova-compute[72362]:   </clock>
Aug 09 10:24:59 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:24:59 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:24:59 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:24:59 user nova-compute[72362]:   </cpu>
Aug 09 10:24:59 user nova-compute[72362]:   <devices>
Aug 09 10:24:59 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:24:59 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:24:59 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk"/>
Aug 09 10:24:59 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:24:59 user nova-compute[72362]:     </disk>
Aug 09 10:24:59 user nova-compute[72362]:     <disk type="block" device="disk">
Aug 09 10:24:59 user nova-compute[72362]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:24:59 user nova-compute[72362]:       <source dev="/dev/sdb"/>
Aug 09 10:24:59 user nova-compute[72362]:       <target dev="vdb" bus="virtio"/>
Aug 09 10:24:59 user nova-compute[72362]:       <serial>9fd78518-fb6e-47ac-a671-2b5e62efe4ec</serial>
Aug 09 10:24:59 user nova-compute[72362]:     </disk>
Aug 09 10:24:59 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:24:59 user nova-compute[72362]:       <mac address="fa:16:3e:91:34:e3"/>
Aug 09 10:24:59 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:24:59 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:24:59 user nova-compute[72362]:       <target dev="tap9735e8ce-a2"/>
Aug 09 10:24:59 user nova-compute[72362]:     </interface>
Aug 09 10:24:59 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:24:59 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/console.log" append="off"/>
Aug 09 10:24:59 user nova-compute[72362]:     </serial>
Aug 09 10:24:59 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:24:59 user nova-compute[72362]:     <video>
Aug 09 10:24:59 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:24:59 user nova-compute[72362]:     </video>
Aug 09 10:24:59 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:24:59 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:24:59 user nova-compute[72362]:     </rng>
Aug 09 10:24:59 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:24:59 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:24:59 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:24:59 user nova-compute[72362]:     </memballoon>
Aug 09 10:24:59 user nova-compute[72362]:   </devices>
Aug 09 10:24:59 user nova-compute[72362]: </domain>
Aug 09 10:24:59 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:24:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T10:20:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-992323535',display_name='tempest-ServerActionsTestOtherA-server-1403657354',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-992323535',id=15,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwSFF251eQti/qkoXtJtG/hsB95elMyv8iaeRUjgcdf3ZQpb25r9rbEB2fGNjqP3pvOqQxJNR/NqVUD62omNMx/akMv5+i7VAu1R/GqhP2vqtVAvdiRNee4z2ROG7Jd8w==',key_name='tempest-keypair-122703468',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:20:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8ac22022944542c0b52dd912d3dbcce2',ramdisk_id='',reservation_id='r-aza1h2p7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2101881579',owner_user_name='tempest-ServerActionsTestOtherA-2101881579-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:24:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='990e2d160fdc4c599cee9f65d6d4e41d',uuid=3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9735e8ce-a2bd-49c8-adcf-846c05b7427e", "address": "fa:16:3e:91:34:e3", "network": {"id": "e6c54663-74e3-43e2-8f0d-61b300c1f68d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1222286883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ac22022944542c0b52dd912d3dbcce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9735e8ce-a2", "ovs_interfaceid": "9735e8ce-a2bd-49c8-adcf-846c05b7427e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:24:59 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Converting VIF {"id": "9735e8ce-a2bd-49c8-adcf-846c05b7427e", "address": "fa:16:3e:91:34:e3", "network": {"id": "e6c54663-74e3-43e2-8f0d-61b300c1f68d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1222286883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ac22022944542c0b52dd912d3dbcce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9735e8ce-a2", "ovs_interfaceid": "9735e8ce-a2bd-49c8-adcf-846c05b7427e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:24:59 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:34:e3,bridge_name='br-int',has_traffic_filtering=True,id=9735e8ce-a2bd-49c8-adcf-846c05b7427e,network=Network(e6c54663-74e3-43e2-8f0d-61b300c1f68d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9735e8ce-a2') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:24:59 user nova-compute[72362]: DEBUG os_vif [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:34:e3,bridge_name='br-int',has_traffic_filtering=True,id=9735e8ce-a2bd-49c8-adcf-846c05b7427e,network=Network(e6c54663-74e3-43e2-8f0d-61b300c1f68d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9735e8ce-a2') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:24:59 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:24:59 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:24:59 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:24:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Releasing lock "refresh_cache-3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:24:59 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Updated the network info_cache for instance {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 10:24:59 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:24:59 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9735e8ce-a2, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:24:59 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9735e8ce-a2, col_values=(('external_ids', {'iface-id': '9735e8ce-a2bd-49c8-adcf-846c05b7427e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:34:e3', 'vm-uuid': '3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:24:59 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:24:59 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:24:59 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:24:59 user nova-compute[72362]: INFO os_vif [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:34:e3,bridge_name='br-int',has_traffic_filtering=True,id=9735e8ce-a2bd-49c8-adcf-846c05b7427e,network=Network(e6c54663-74e3-43e2-8f0d-61b300c1f68d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9735e8ce-a2')
Aug 09 10:24:59 user nova-compute[72362]: INFO nova.compute.manager [None req-4c5c2754-5ce1-413a-b8f9-31087db0a094 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Took 1.08 seconds to detach 1 volumes for instance.
Aug 09 10:24:59 user nova-compute[72362]: DEBUG nova.compute.manager [None req-4c5c2754-5ce1-413a-b8f9-31087db0a094 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Deleting volume: b2bcc794-ae54-4b73-8b5e-751599d537f6 {{(pid=72362) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 09 10:24:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:24:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:24:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] No VIF found with MAC fa:16:3e:91:34:e3, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:24:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4c5c2754-5ce1-413a-b8f9-31087db0a094 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:24:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4c5c2754-5ce1-413a-b8f9-31087db0a094 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:24:59 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:25:00 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-4c5c2754-5ce1-413a-b8f9-31087db0a094 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:25:00 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-4c5c2754-5ce1-413a-b8f9-31087db0a094 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:25:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4c5c2754-5ce1-413a-b8f9-31087db0a094 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.334s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:25:00 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-4c5c2754-5ce1-413a-b8f9-31087db0a094 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Deleted allocations for instance 6493ab9a-4d69-434d-bed7-e51f1c5f3497
Aug 09 10:25:00 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691576685.3206944, 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:25:00 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] VM Stopped (Lifecycle Event)
Aug 09 10:25:00 user nova-compute[72362]: DEBUG nova.compute.manager [None req-c58a828d-b419-4cdb-b7a9-ebd19a295785 None None] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:25:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4c5c2754-5ce1-413a-b8f9-31087db0a094 tempest-ServerActionsV293TestJSON-773277146 tempest-ServerActionsV293TestJSON-773277146-project-member] Lock "6493ab9a-4d69-434d-bed7-e51f1c5f3497" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.741s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:25:00 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:25:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:01 user nova-compute[72362]: DEBUG nova.compute.manager [req-028bdd78-15f5-40e1-bcc4-fea03b53bb41 req-d0e6e14c-6613-4cb5-9dbf-6dc0ad506cc0 service nova] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Received event network-vif-plugged-9735e8ce-a2bd-49c8-adcf-846c05b7427e {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:25:01 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-028bdd78-15f5-40e1-bcc4-fea03b53bb41 req-d0e6e14c-6613-4cb5-9dbf-6dc0ad506cc0 service nova] Acquiring lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:25:01 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-028bdd78-15f5-40e1-bcc4-fea03b53bb41 req-d0e6e14c-6613-4cb5-9dbf-6dc0ad506cc0 service nova] Lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:25:01 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-028bdd78-15f5-40e1-bcc4-fea03b53bb41 req-d0e6e14c-6613-4cb5-9dbf-6dc0ad506cc0 service nova] Lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:25:01 user nova-compute[72362]: DEBUG nova.compute.manager [req-028bdd78-15f5-40e1-bcc4-fea03b53bb41 req-d0e6e14c-6613-4cb5-9dbf-6dc0ad506cc0 service nova] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] No waiting events found dispatching network-vif-plugged-9735e8ce-a2bd-49c8-adcf-846c05b7427e {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:25:01 user nova-compute[72362]: WARNING nova.compute.manager [req-028bdd78-15f5-40e1-bcc4-fea03b53bb41 req-d0e6e14c-6613-4cb5-9dbf-6dc0ad506cc0 service nova] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Received unexpected event network-vif-plugged-9735e8ce-a2bd-49c8-adcf-846c05b7427e for instance with vm_state active and task_state rebuild_spawning.
Aug 09 10:25:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:03 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:03 user nova-compute[72362]: DEBUG nova.compute.manager [req-587d0b5e-cc73-49f2-8b72-e18e703e6d4d req-23146747-25eb-4526-bd69-306b9c8fd397 service nova] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Received event network-vif-plugged-9735e8ce-a2bd-49c8-adcf-846c05b7427e {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:25:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-587d0b5e-cc73-49f2-8b72-e18e703e6d4d req-23146747-25eb-4526-bd69-306b9c8fd397 service nova] Acquiring lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:25:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-587d0b5e-cc73-49f2-8b72-e18e703e6d4d req-23146747-25eb-4526-bd69-306b9c8fd397 service nova] Lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:25:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-587d0b5e-cc73-49f2-8b72-e18e703e6d4d req-23146747-25eb-4526-bd69-306b9c8fd397 service nova] Lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:25:03 user nova-compute[72362]: DEBUG nova.compute.manager [req-587d0b5e-cc73-49f2-8b72-e18e703e6d4d req-23146747-25eb-4526-bd69-306b9c8fd397 service nova] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] No waiting events found dispatching network-vif-plugged-9735e8ce-a2bd-49c8-adcf-846c05b7427e {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:25:03 user nova-compute[72362]: WARNING nova.compute.manager [req-587d0b5e-cc73-49f2-8b72-e18e703e6d4d req-23146747-25eb-4526-bd69-306b9c8fd397 service nova] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Received unexpected event network-vif-plugged-9735e8ce-a2bd-49c8-adcf-846c05b7427e for instance with vm_state active and task_state rebuild_spawning.
Aug 09 10:25:03 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576703.6002774, 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:25:03 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] VM Resumed (Lifecycle Event)
Aug 09 10:25:03 user nova-compute[72362]: DEBUG nova.compute.manager [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:25:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:25:03 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Instance spawned successfully.
Aug 09 10:25:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 10:25:03 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:25:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b04223ef-30c8-4276-9dbf-90837ec651f2 tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Acquiring lock "ca002e73-ddf7-4452-82b6-0d831d984756" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:25:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b04223ef-30c8-4276-9dbf-90837ec651f2 tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Lock "ca002e73-ddf7-4452-82b6-0d831d984756" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:25:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b04223ef-30c8-4276-9dbf-90837ec651f2 tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Acquiring lock "ca002e73-ddf7-4452-82b6-0d831d984756-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:25:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b04223ef-30c8-4276-9dbf-90837ec651f2 tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Lock "ca002e73-ddf7-4452-82b6-0d831d984756-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:25:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b04223ef-30c8-4276-9dbf-90837ec651f2 tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Lock "ca002e73-ddf7-4452-82b6-0d831d984756-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:25:03 user nova-compute[72362]: INFO nova.compute.manager [None req-b04223ef-30c8-4276-9dbf-90837ec651f2 tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Terminating instance
Aug 09 10:25:03 user nova-compute[72362]: DEBUG nova.compute.manager [None req-b04223ef-30c8-4276-9dbf-90837ec651f2 tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Start destroying the instance on the hypervisor. {{(pid=72362) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 10:25:03 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:25:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Found default for hw_cdrom_bus of ide {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:25:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Found default for hw_disk_bus of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:25:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:25:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:25:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Found default for hw_video_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:25:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Found default for hw_vif_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:25:03 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 09 10:25:03 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576703.603598, 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:25:03 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] VM Started (Lifecycle Event)
Aug 09 10:25:03 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:25:03 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:25:03 user nova-compute[72362]: DEBUG nova.compute.manager [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:25:03 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 09 10:25:03 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:03 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:03 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:03 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:03 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:25:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.003s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:25:04 user nova-compute[72362]: DEBUG nova.objects.instance [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72362) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 09 10:25:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a480ba51-2049-46f0-9af6-dbdbfb03eb6d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.102s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:25:04 user nova-compute[72362]: DEBUG nova.compute.manager [req-27f6df7b-96de-493d-b829-7fa65e55c9d3 req-9738dca9-d21a-4aee-a460-d248eac54b02 service nova] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Received event network-vif-unplugged-7ce03c91-ff2d-4735-bc98-088dc96293d0 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:25:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-27f6df7b-96de-493d-b829-7fa65e55c9d3 req-9738dca9-d21a-4aee-a460-d248eac54b02 service nova] Acquiring lock "ca002e73-ddf7-4452-82b6-0d831d984756-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:25:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-27f6df7b-96de-493d-b829-7fa65e55c9d3 req-9738dca9-d21a-4aee-a460-d248eac54b02 service nova] Lock "ca002e73-ddf7-4452-82b6-0d831d984756-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:25:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-27f6df7b-96de-493d-b829-7fa65e55c9d3 req-9738dca9-d21a-4aee-a460-d248eac54b02 service nova] Lock "ca002e73-ddf7-4452-82b6-0d831d984756-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:25:04 user nova-compute[72362]: DEBUG nova.compute.manager [req-27f6df7b-96de-493d-b829-7fa65e55c9d3 req-9738dca9-d21a-4aee-a460-d248eac54b02 service nova] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] No waiting events found dispatching network-vif-unplugged-7ce03c91-ff2d-4735-bc98-088dc96293d0 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:25:04 user nova-compute[72362]: DEBUG nova.compute.manager [req-27f6df7b-96de-493d-b829-7fa65e55c9d3 req-9738dca9-d21a-4aee-a460-d248eac54b02 service nova] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Received event network-vif-unplugged-7ce03c91-ff2d-4735-bc98-088dc96293d0 for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:25:04 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Instance destroyed successfully.
Aug 09 10:25:04 user nova-compute[72362]: DEBUG nova.objects.instance [None req-b04223ef-30c8-4276-9dbf-90837ec651f2 tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Lazy-loading 'resources' on Instance uuid ca002e73-ddf7-4452-82b6-0d831d984756 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:25:04 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-b04223ef-30c8-4276-9dbf-90837ec651f2 tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:15:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-664446229',display_name='tempest-ServersNegativeTestJSON-server-664446229',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-664446229',id=3,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:16:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d000751b939e4805abb861b91d698b6c',ramdisk_id='',reservation_id='r-wunisxu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1689094468',owner_user_name='tempest-ServersNegativeTestJSON-1689094468-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:16:15Z,user_data=None,user_id='8a4feca60bf046c6bfdd136c25ecbee3',uuid=ca002e73-ddf7-4452-82b6-0d831d984756,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ce03c91-ff2d-4735-bc98-088dc96293d0", "address": "fa:16:3e:57:3a:02", "network": {"id": "f6bb574e-dc90-445b-b678-6e7d825a8437", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-198645654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d000751b939e4805abb861b91d698b6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce03c91-ff", "ovs_interfaceid": "7ce03c91-ff2d-4735-bc98-088dc96293d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:25:04 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-b04223ef-30c8-4276-9dbf-90837ec651f2 tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Converting VIF {"id": "7ce03c91-ff2d-4735-bc98-088dc96293d0", "address": "fa:16:3e:57:3a:02", "network": {"id": "f6bb574e-dc90-445b-b678-6e7d825a8437", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-198645654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d000751b939e4805abb861b91d698b6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce03c91-ff", "ovs_interfaceid": "7ce03c91-ff2d-4735-bc98-088dc96293d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:25:04 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-b04223ef-30c8-4276-9dbf-90837ec651f2 tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:3a:02,bridge_name='br-int',has_traffic_filtering=True,id=7ce03c91-ff2d-4735-bc98-088dc96293d0,network=Network(f6bb574e-dc90-445b-b678-6e7d825a8437),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ce03c91-ff') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:25:04 user nova-compute[72362]: DEBUG os_vif [None req-b04223ef-30c8-4276-9dbf-90837ec651f2 tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:3a:02,bridge_name='br-int',has_traffic_filtering=True,id=7ce03c91-ff2d-4735-bc98-088dc96293d0,network=Network(f6bb574e-dc90-445b-b678-6e7d825a8437),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ce03c91-ff') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:25:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ce03c91-ff, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:25:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:25:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:04 user nova-compute[72362]: INFO os_vif [None req-b04223ef-30c8-4276-9dbf-90837ec651f2 tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:3a:02,bridge_name='br-int',has_traffic_filtering=True,id=7ce03c91-ff2d-4735-bc98-088dc96293d0,network=Network(f6bb574e-dc90-445b-b678-6e7d825a8437),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ce03c91-ff')
Aug 09 10:25:04 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-b04223ef-30c8-4276-9dbf-90837ec651f2 tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Deleting instance files /opt/stack/data/nova/instances/ca002e73-ddf7-4452-82b6-0d831d984756_del
Aug 09 10:25:04 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-b04223ef-30c8-4276-9dbf-90837ec651f2 tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Deletion of /opt/stack/data/nova/instances/ca002e73-ddf7-4452-82b6-0d831d984756_del complete
Aug 09 10:25:04 user nova-compute[72362]: INFO nova.compute.manager [None req-b04223ef-30c8-4276-9dbf-90837ec651f2 tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Took 1.12 seconds to destroy the instance on the hypervisor.
Aug 09 10:25:04 user nova-compute[72362]: DEBUG oslo.service.loopingcall [None req-b04223ef-30c8-4276-9dbf-90837ec651f2 tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72362) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 10:25:04 user nova-compute[72362]: DEBUG nova.compute.manager [-] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Deallocating network for instance {{(pid=72362) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 10:25:04 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] deallocate_for_instance() {{(pid=72362) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 10:25:04 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:25:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:25:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:25:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:25:05 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 10:25:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:05 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:25:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:05 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Took 0.81 seconds to deallocate network for instance.
Aug 09 10:25:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b04223ef-30c8-4276-9dbf-90837ec651f2 tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:25:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b04223ef-30c8-4276-9dbf-90837ec651f2 tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:25:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:25:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:06 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-b04223ef-30c8-4276-9dbf-90837ec651f2 tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:25:06 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-b04223ef-30c8-4276-9dbf-90837ec651f2 tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:25:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b04223ef-30c8-4276-9dbf-90837ec651f2 tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.447s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:25:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:06 user nova-compute[72362]: DEBUG nova.compute.manager [req-d3ef1b7a-0ba7-4441-8285-2f48b1f849e7 req-cedf7c63-3954-4115-bfd1-999d08cae771 service nova] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Received event network-vif-plugged-7ce03c91-ff2d-4735-bc98-088dc96293d0 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:25:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-d3ef1b7a-0ba7-4441-8285-2f48b1f849e7 req-cedf7c63-3954-4115-bfd1-999d08cae771 service nova] Acquiring lock "ca002e73-ddf7-4452-82b6-0d831d984756-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:25:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-d3ef1b7a-0ba7-4441-8285-2f48b1f849e7 req-cedf7c63-3954-4115-bfd1-999d08cae771 service nova] Lock "ca002e73-ddf7-4452-82b6-0d831d984756-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:25:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-d3ef1b7a-0ba7-4441-8285-2f48b1f849e7 req-cedf7c63-3954-4115-bfd1-999d08cae771 service nova] Lock "ca002e73-ddf7-4452-82b6-0d831d984756-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:25:06 user nova-compute[72362]: DEBUG nova.compute.manager [req-d3ef1b7a-0ba7-4441-8285-2f48b1f849e7 req-cedf7c63-3954-4115-bfd1-999d08cae771 service nova] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] No waiting events found dispatching network-vif-plugged-7ce03c91-ff2d-4735-bc98-088dc96293d0 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:25:06 user nova-compute[72362]: WARNING nova.compute.manager [req-d3ef1b7a-0ba7-4441-8285-2f48b1f849e7 req-cedf7c63-3954-4115-bfd1-999d08cae771 service nova] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Received unexpected event network-vif-plugged-7ce03c91-ff2d-4735-bc98-088dc96293d0 for instance with vm_state deleted and task_state None.
Aug 09 10:25:06 user nova-compute[72362]: DEBUG nova.compute.manager [req-d3ef1b7a-0ba7-4441-8285-2f48b1f849e7 req-cedf7c63-3954-4115-bfd1-999d08cae771 service nova] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Received event network-vif-deleted-7ce03c91-ff2d-4735-bc98-088dc96293d0 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:25:06 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-b04223ef-30c8-4276-9dbf-90837ec651f2 tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Deleted allocations for instance ca002e73-ddf7-4452-82b6-0d831d984756
Aug 09 10:25:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:06 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:25:06 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:25:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30213e67-6b1d-4d97-a971-1544335d02fb/disk.rescue --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b04223ef-30c8-4276-9dbf-90837ec651f2 tempest-ServersNegativeTestJSON-1689094468 tempest-ServersNegativeTestJSON-1689094468-project-member] Lock "ca002e73-ddf7-4452-82b6-0d831d984756" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.724s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:25:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30213e67-6b1d-4d97-a971-1544335d02fb/disk.rescue --force-share --output=json" returned: 0 in 0.154s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30213e67-6b1d-4d97-a971-1544335d02fb/disk.rescue --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30213e67-6b1d-4d97-a971-1544335d02fb/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4746beb1-d313-4cea-bf7b-75b507ebbdd2/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4746beb1-d313-4cea-bf7b-75b507ebbdd2/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4746beb1-d313-4cea-bf7b-75b507ebbdd2/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:07 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4746beb1-d313-4cea-bf7b-75b507ebbdd2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:07 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:25:07 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:25:07 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=8165MB free_disk=25.389163970947266GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 10:25:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:25:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:25:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:07 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 8e055c58-a365-4f18-a6e3-377e32e2189d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:25:07 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:25:07 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 4746beb1-d313-4cea-bf7b-75b507ebbdd2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:25:07 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance a6000393-6044-4b54-ac0b-1d631e2ed0ae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:25:07 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 30213e67-6b1d-4d97-a971-1544335d02fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:25:07 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 10:25:07 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 10:25:07 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:25:07 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:25:07 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 10:25:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.420s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:25:09 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:10 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48b0faca-6eb1-4a72-bf59-20120f21204c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:25:10 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b0faca-6eb1-4a72-bf59-20120f21204c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4f647d5a-1ce2-4186-81fb-70ca0c123367'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MKCuZFty', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:25:10 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-48b0faca-6eb1-4a72-bf59-20120f21204c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:25:10 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-48b0faca-6eb1-4a72-bf59-20120f21204c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:25:10 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-48b0faca-6eb1-4a72-bf59-20120f21204c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:25:10 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-48b0faca-6eb1-4a72-bf59-20120f21204c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:25:10 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-48b0faca-6eb1-4a72-bf59-20120f21204c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f647d5a-1ce2-4186-81fb-70ca0c123367" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:25:10 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-48b0faca-6eb1-4a72-bf59-20120f21204c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f647d5a-1ce2-4186-81fb-70ca0c123367" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:25:10 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-48b0faca-6eb1-4a72-bf59-20120f21204c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:25:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f647d5a-1ce2-4186-81fb-70ca0c123367 -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f647d5a-1ce2-4186-81fb-70ca0c123367 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:10 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec756452-3fe8-4735-8445-5da49f233f8e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:25:10 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b0faca-6eb1-4a72-bf59-20120f21204c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:25:10 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:25:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f647d5a-1ce2-4186-81fb-70ca0c123367 -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f647d5a-1ce2-4186-81fb-70ca0c123367 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:10 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6567926e-f8bb-4884-96bf-8996a067ef78]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f647d5a-1ce2-4186-81fb-70ca0c123367] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:25:10 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b0faca-6eb1-4a72-bf59-20120f21204c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f647d5a-1ce2-4186-81fb-70ca0c123367] added
Aug 09 10:25:10 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:25:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f647d5a-1ce2-4186-81fb-70ca0c123367 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f647d5a-1ce2-4186-81fb-70ca0c123367 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:10 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[011c4fcc-ce17-4095-999f-22a7cffe8a4e]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:25:10 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b0faca-6eb1-4a72-bf59-20120f21204c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:25:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f647d5a-1ce2-4186-81fb-70ca0c123367 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f647d5a-1ce2-4186-81fb-70ca0c123367 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:10 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[397b1edb-67ab-4a7e-9b76-dae24017661a]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:25:10 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b0faca-6eb1-4a72-bf59-20120f21204c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:25:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f647d5a-1ce2-4186-81fb-70ca0c123367 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MKCuZFty {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f647d5a-1ce2-4186-81fb-70ca0c123367 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MKCuZFty" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:10 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efc51e4-1ffb-417d-8410-7be6c507371f]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:25:10 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b0faca-6eb1-4a72-bf59-20120f21204c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MKCuZFty'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:25:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f647d5a-1ce2-4186-81fb-70ca0c123367 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f647d5a-1ce2-4186-81fb-70ca0c123367 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:10 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[feae9ec5-b31c-4c73-afa5-9f87bb193fd0]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:25:10 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b0faca-6eb1-4a72-bf59-20120f21204c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:25:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:10 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e45dbb-b2ac-4f72-93a2-50d692c76c53]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:25:10 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b0faca-6eb1-4a72-bf59-20120f21204c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:25:10 user nova-compute[72362]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:25:10 user nova-compute[72362]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)
Aug 09 10:25:10 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:25:10 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b0faca-6eb1-4a72-bf59-20120f21204c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:25:10 user nova-compute[72362]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:25:10 user nova-compute[72362]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)
Aug 09 10:25:10 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:25:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f647d5a-1ce2-4186-81fb-70ca0c123367 -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f647d5a-1ce2-4186-81fb-70ca0c123367 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:11 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5919f006-2b90-4ef8-8095-e19582718f8a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f647d5a-1ce2-4186-81fb-70ca0c123367, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4f647d5a-1ce2-4186-81fb-70ca0c123367, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:25:11 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b0faca-6eb1-4a72-bf59-20120f21204c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f647d5a-1ce2-4186-81fb-70ca0c123367, portal: 172.16.0.220,3260]
Aug 09 10:25:11 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:4f647d5a-1ce2-4186-81fb-70ca0c123367, portal: 172.16.0.220,3260] successful.
Aug 09 10:25:11 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:25:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f647d5a-1ce2-4186-81fb-70ca0c123367 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f647d5a-1ce2-4186-81fb-70ca0c123367 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:11 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd86b9cf-200b-4c73-9604-70881c6d7e0c]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:25:11 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b0faca-6eb1-4a72-bf59-20120f21204c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:25:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:11 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:11 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[683315d6-fda1-4a03-b553-108924804546]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f647d5a-1ce2-4186-81fb-70ca0c123367 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:25:11 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b0faca-6eb1-4a72-bf59-20120f21204c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:25:11 user nova-compute[72362]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:25:11 user nova-compute[72362]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)
Aug 09 10:25:11 user nova-compute[72362]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f647d5a-1ce2-4186-81fb-70ca0c123367 (non-flash)
Aug 09 10:25:11 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:25:11 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b0faca-6eb1-4a72-bf59-20120f21204c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:25:11 user nova-compute[72362]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:25:11 user nova-compute[72362]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)
Aug 09 10:25:11 user nova-compute[72362]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f647d5a-1ce2-4186-81fb-70ca0c123367 (non-flash)
Aug 09 10:25:11 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:25:11 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-48b0faca-6eb1-4a72-bf59-20120f21204c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f647d5a-1ce2-4186-81fb-70ca0c123367" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:25:11 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b0faca-6eb1-4a72-bf59-20120f21204c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:25:11 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-48b0faca-6eb1-4a72-bf59-20120f21204c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:25:11 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-48b0faca-6eb1-4a72-bf59-20120f21204c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:25:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:11 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[289eb08f-96de-4258-8002-54c87d3b7852]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:25:11 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-48b0faca-6eb1-4a72-bf59-20120f21204c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:25:11 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b0faca-6eb1-4a72-bf59-20120f21204c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MKCuZFty', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:25:11 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691576696.449411, 6493ab9a-4d69-434d-bed7-e51f1c5f3497 => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:25:11 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] VM Stopped (Lifecycle Event)
Aug 09 10:25:11 user nova-compute[72362]: DEBUG nova.compute.manager [None req-c7754ce6-ae6a-4d99-965e-fb68c0727cc2 None None] [instance: 6493ab9a-4d69-434d-bed7-e51f1c5f3497] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:25:12 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-48b0faca-6eb1-4a72-bf59-20120f21204c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:25:12 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b0faca-6eb1-4a72-bf59-20120f21204c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '23162313262376137', 'path': '/dev/sdc'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:25:12 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48b0faca-6eb1-4a72-bf59-20120f21204c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162313262376137', 'path': '/dev/sdc'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:25:12 user nova-compute[72362]: DEBUG nova.objects.instance [None req-48b0faca-6eb1-4a72-bf59-20120f21204c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lazy-loading 'flavor' on Instance uuid 4746beb1-d313-4cea-bf7b-75b507ebbdd2 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:25:12 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-48b0faca-6eb1-4a72-bf59-20120f21204c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 10:25:12 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:25:12 user nova-compute[72362]:   <source dev="/dev/sdc"/>
Aug 09 10:25:12 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:25:12 user nova-compute[72362]:   <serial>4f647d5a-1ce2-4186-81fb-70ca0c123367</serial>
Aug 09 10:25:12 user nova-compute[72362]: </disk>
Aug 09 10:25:12 user nova-compute[72362]:  {{(pid=72362) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 10:25:12 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-48b0faca-6eb1-4a72-bf59-20120f21204c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:25:12 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-48b0faca-6eb1-4a72-bf59-20120f21204c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:25:12 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-48b0faca-6eb1-4a72-bf59-20120f21204c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] No VIF found with MAC fa:16:3e:03:05:4e, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:25:12 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-48b0faca-6eb1-4a72-bf59-20120f21204c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.940s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:25:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:14 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7d7a3ac2-2d09-4b36-aa40-b87678178103 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Acquiring lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:25:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7d7a3ac2-2d09-4b36-aa40-b87678178103 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:25:15 user nova-compute[72362]: INFO nova.compute.manager [None req-7d7a3ac2-2d09-4b36-aa40-b87678178103 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Detaching volume 4f647d5a-1ce2-4186-81fb-70ca0c123367
Aug 09 10:25:15 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:15 user nova-compute[72362]: INFO nova.virt.block_device [None req-7d7a3ac2-2d09-4b36-aa40-b87678178103 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Attempting to driver detach volume 4f647d5a-1ce2-4186-81fb-70ca0c123367 from mountpoint /dev/vdb
Aug 09 10:25:15 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7d7a3ac2-2d09-4b36-aa40-b87678178103 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Attempting to detach device vdb from instance 4746beb1-d313-4cea-bf7b-75b507ebbdd2 from the persistent domain config. {{(pid=72362) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 10:25:15 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-7d7a3ac2-2d09-4b36-aa40-b87678178103 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 10:25:15 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:25:15 user nova-compute[72362]:   <source dev="/dev/sdc"/>
Aug 09 10:25:15 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:25:15 user nova-compute[72362]:   <serial>4f647d5a-1ce2-4186-81fb-70ca0c123367</serial>
Aug 09 10:25:15 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 10:25:15 user nova-compute[72362]: </disk>
Aug 09 10:25:15 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:25:15 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-7d7a3ac2-2d09-4b36-aa40-b87678178103 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Successfully detached device vdb from instance 4746beb1-d313-4cea-bf7b-75b507ebbdd2 from the persistent domain config.
Aug 09 10:25:15 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7d7a3ac2-2d09-4b36-aa40-b87678178103 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4746beb1-d313-4cea-bf7b-75b507ebbdd2 from the live domain config. {{(pid=72362) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 10:25:15 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-7d7a3ac2-2d09-4b36-aa40-b87678178103 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 10:25:15 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:25:15 user nova-compute[72362]:   <source dev="/dev/sdc"/>
Aug 09 10:25:15 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:25:15 user nova-compute[72362]:   <serial>4f647d5a-1ce2-4186-81fb-70ca0c123367</serial>
Aug 09 10:25:15 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 10:25:15 user nova-compute[72362]: </disk>
Aug 09 10:25:15 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:25:16 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Received event <DeviceRemovedEvent: 1691576716.0444252, 4746beb1-d313-4cea-bf7b-75b507ebbdd2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72362) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 10:25:16 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7d7a3ac2-2d09-4b36-aa40-b87678178103 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4746beb1-d313-4cea-bf7b-75b507ebbdd2 {{(pid=72362) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 10:25:16 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-7d7a3ac2-2d09-4b36-aa40-b87678178103 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Successfully detached device vdb from instance 4746beb1-d313-4cea-bf7b-75b507ebbdd2 from the live domain config.
Aug 09 10:25:16 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d7a3ac2-2d09-4b36-aa40-b87678178103 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:25:16 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d7a3ac2-2d09-4b36-aa40-b87678178103 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:4f647d5a-1ce2-4186-81fb-70ca0c123367'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MKCuZFty', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:25:16 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-7d7a3ac2-2d09-4b36-aa40-b87678178103 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:25:16 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-7d7a3ac2-2d09-4b36-aa40-b87678178103 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:25:16 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-7d7a3ac2-2d09-4b36-aa40-b87678178103 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:25:16 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d7a3ac2-2d09-4b36-aa40-b87678178103 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f647d5a-1ce2-4186-81fb-70ca0c123367', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:25:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:16 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[20814282-4e0a-4b3f-909a-06759fdee4df]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f647d5a-1ce2-4186-81fb-70ca0c123367\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:25:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:16 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9157115-8314-447d-a130-5208ded6c1a5]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f647d5a-1ce2-4186-81fb-70ca0c123367 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:25:16 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d7a3ac2-2d09-4b36-aa40-b87678178103 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:25:16 user nova-compute[72362]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:25:16 user nova-compute[72362]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)
Aug 09 10:25:16 user nova-compute[72362]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f647d5a-1ce2-4186-81fb-70ca0c123367 (non-flash)
Aug 09 10:25:16 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:25:16 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d7a3ac2-2d09-4b36-aa40-b87678178103 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:25:16 user nova-compute[72362]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:25:16 user nova-compute[72362]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)
Aug 09 10:25:16 user nova-compute[72362]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f647d5a-1ce2-4186-81fb-70ca0c123367 (non-flash)
Aug 09 10:25:16 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:25:16 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d7a3ac2-2d09-4b36-aa40-b87678178103 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e4449f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f647d5a-1ce2-4186-81fb-70ca0c123367'): ({'sdc'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:25:16 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-7d7a3ac2-2d09-4b36-aa40-b87678178103 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Removing single pathed devices sdc {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:25:16 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:16 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7ee63c-04f7-4572-8b7c-c08a1acd1a0d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:25:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:16 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[749948f1-6ef0-4313-b4e9-e5d7e1a311e3]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:25:16 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-7d7a3ac2-2d09-4b36-aa40-b87678178103 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Flushing IO for device /dev/sdc {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:25:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:16 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[86028930-098a-4f2f-bdb7-f56ef262cd14]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:25:16 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-7d7a3ac2-2d09-4b36-aa40-b87678178103 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:25:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.029s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:16 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ebdac3-3daf-48b8-a069-f4af00171bcb]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:25:16 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-7d7a3ac2-2d09-4b36-aa40-b87678178103 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:25:16 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-7d7a3ac2-2d09-4b36-aa40-b87678178103 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] SCSI volumes sdc have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:25:16 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d7a3ac2-2d09-4b36-aa40-b87678178103 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f647d5a-1ce2-4186-81fb-70ca0c123367')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:25:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f647d5a-1ce2-4186-81fb-70ca0c123367 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f647d5a-1ce2-4186-81fb-70ca0c123367 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:16 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[679171a9-49a6-443b-be8a-5e4fb291848f]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:25:16 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d7a3ac2-2d09-4b36-aa40-b87678178103 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:25:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f647d5a-1ce2-4186-81fb-70ca0c123367 -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f647d5a-1ce2-4186-81fb-70ca0c123367 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:16 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bd3b0c-250d-4644-ad70-4b9e2303377b]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:4f647d5a-1ce2-4186-81fb-70ca0c123367, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:4f647d5a-1ce2-4186-81fb-70ca0c123367, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:25:16 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d7a3ac2-2d09-4b36-aa40-b87678178103 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:4f647d5a-1ce2-4186-81fb-70ca0c123367, portal: 172.16.0.220,3260]
Aug 09 10:25:16 user nova-compute[72362]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:4f647d5a-1ce2-4186-81fb-70ca0c123367, portal: 172.16.0.220,3260] successful.
Aug 09 10:25:16 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:25:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f647d5a-1ce2-4186-81fb-70ca0c123367 -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f647d5a-1ce2-4186-81fb-70ca0c123367 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:16 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1694cb9-6a43-42f7-b204-abd9f48166fc]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:25:16 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d7a3ac2-2d09-4b36-aa40-b87678178103 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:25:16 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-7d7a3ac2-2d09-4b36-aa40-b87678178103 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:25:16 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d7a3ac2-2d09-4b36-aa40-b87678178103 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] <== disconnect_volume: return (282ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:25:16 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d7a3ac2-2d09-4b36-aa40-b87678178103 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:25:17 user nova-compute[72362]: DEBUG nova.objects.instance [None req-7d7a3ac2-2d09-4b36-aa40-b87678178103 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lazy-loading 'flavor' on Instance uuid 4746beb1-d313-4cea-bf7b-75b507ebbdd2 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:25:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7d7a3ac2-2d09-4b36-aa40-b87678178103 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.774s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:25:19 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691576704.537787, ca002e73-ddf7-4452-82b6-0d831d984756 => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:25:19 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] VM Stopped (Lifecycle Event)
Aug 09 10:25:19 user nova-compute[72362]: DEBUG nova.compute.manager [None req-690e9c51-ea59-41e3-b019-ef785ddff59a None None] [instance: ca002e73-ddf7-4452-82b6-0d831d984756] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:25:19 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:21 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:29 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:33 user nova-compute[72362]: DEBUG nova.objects.instance [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lazy-loading 'flavor' on Instance uuid a6000393-6044-4b54-ac0b-1d631e2ed0ae {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:25:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Acquiring lock "refresh_cache-a6000393-6044-4b54-ac0b-1d631e2ed0ae" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:25:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Acquired lock "refresh_cache-a6000393-6044-4b54-ac0b-1d631e2ed0ae" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:25:33 user nova-compute[72362]: DEBUG nova.network.neutron [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:25:33 user nova-compute[72362]: DEBUG nova.objects.instance [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lazy-loading 'info_cache' on Instance uuid a6000393-6044-4b54-ac0b-1d631e2ed0ae {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:25:33 user nova-compute[72362]: DEBUG nova.network.neutron [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Updating instance_info_cache with network_info: [{"id": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "address": "fa:16:3e:6e:b0:73", "network": {"id": "7358b925-3211-4419-84eb-df6967f5ea8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1360753488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dac04663e2f45378cc0e466740342d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c0230bc-c7", "ovs_interfaceid": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:25:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Releasing lock "refresh_cache-a6000393-6044-4b54-ac0b-1d631e2ed0ae" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:25:33 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Instance destroyed successfully.
Aug 09 10:25:33 user nova-compute[72362]: DEBUG nova.objects.instance [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lazy-loading 'resources' on Instance uuid a6000393-6044-4b54-ac0b-1d631e2ed0ae {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:25:33 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:21:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1940264170',display_name='tempest-AttachVolumeTestJSON-server-1940264170',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1940264170',id=19,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuD55hFJGS6ztpZ3pMNhoMVTtkOPfZJVd+6jLMFkU6lpGS3ntRkyZ61ihETUV7/q4X01P1baNsnIzL7TV/XH9281YGmZSyK/sCWwApv9GpxS0U8aCjbpuFwgIK7/Y1Z9Q==',key_name='tempest-keypair-208455084',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:21:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9dac04663e2f45378cc0e466740342d2',ramdisk_id='',reservation_id='r-i0cbsd0z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-986857971',owner_user_name='tempest-AttachVolumeTestJSON-986857971-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:23:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec007d0aa3c144f5a24a4913cc336ebb',uuid=a6000393-6044-4b54-ac0b-1d631e2ed0ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "address": "fa:16:3e:6e:b0:73", "network": {"id": "7358b925-3211-4419-84eb-df6967f5ea8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1360753488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dac04663e2f45378cc0e466740342d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c0230bc-c7", "ovs_interfaceid": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:25:33 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Converting VIF {"id": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "address": "fa:16:3e:6e:b0:73", "network": {"id": "7358b925-3211-4419-84eb-df6967f5ea8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1360753488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dac04663e2f45378cc0e466740342d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c0230bc-c7", "ovs_interfaceid": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:25:33 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:b0:73,bridge_name='br-int',has_traffic_filtering=True,id=8c0230bc-c7a7-4497-af9a-2fafb259605c,network=Network(7358b925-3211-4419-84eb-df6967f5ea8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c0230bc-c7') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:25:33 user nova-compute[72362]: DEBUG os_vif [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:b0:73,bridge_name='br-int',has_traffic_filtering=True,id=8c0230bc-c7a7-4497-af9a-2fafb259605c,network=Network(7358b925-3211-4419-84eb-df6967f5ea8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c0230bc-c7') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c0230bc-c7, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:25:34 user nova-compute[72362]: INFO os_vif [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:b0:73,bridge_name='br-int',has_traffic_filtering=True,id=8c0230bc-c7a7-4497-af9a-2fafb259605c,network=Network(7358b925-3211-4419-84eb-df6967f5ea8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c0230bc-c7')
Aug 09 10:25:34 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXfyDmWR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:25:34 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:25:34 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5964628-f6dc-4fbc-a005-053b0a4eac16]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ffe0e3-a4aa-4d24-a129-e68beee41962]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:25:34 user nova-compute[72362]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:25:34 user nova-compute[72362]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)
Aug 09 10:25:34 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:25:34 user nova-compute[72362]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:25:34 user nova-compute[72362]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)
Aug 09 10:25:34 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e43c75b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b'): ({'sdd'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Removing single pathed devices sdd {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04e1bb5-4af0-4655-8f94-a3ee36c9b0b5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e5debb-5dd1-4197-a753-933483ecda4e]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Flushing IO for device /dev/sdd {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d611d3ae-ff15-4302-8b65-a5e1eadb9850]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[442faad4-9f62-4193-98de-2172d688ab12]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] SCSI volumes sdd have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8941f8e-380e-4094-a4b8-bcd14817069e]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[676fdc90-5ff8-4d31-b683-239cb3f707b6]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b, portal: 172.16.0.220,3260]
Aug 09 10:25:34 user nova-compute[72362]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b, portal: 172.16.0.220,3260] successful.
Aug 09 10:25:34 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[791b1636-c165-43d8-b6ba-cbe576a20fcf]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] <== disconnect_volume: return (323ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Start _get_guest_xml network_info=[{"id": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "address": "fa:16:3e:6e:b0:73", "network": {"id": "7358b925-3211-4419-84eb-df6967f5ea8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1360753488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dac04663e2f45378cc0e466740342d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c0230bc-c7", "ovs_interfaceid": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': 'a08d1a11-49eb-4212-a351-e11ee9553b95'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'b5e8aee0-8c6e-4f46-9a23-fc047333f9c5', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXfyDmWR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'a6000393-6044-4b54-ac0b-1d631e2ed0ae', 'attached_at': '', 'detached_at': '', 'volume_id': 'cb2be0ee-763d-488d-b7e6-65e39d26b53b', 'serial': 'cb2be0ee-763d-488d-b7e6-65e39d26b53b'}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG nova.objects.instance [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lazy-loading 'numa_topology' on Instance uuid a6000393-6044-4b54-ac0b-1d631e2ed0ae {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:25:34 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:25:34 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:25:34 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG nova.objects.instance [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lazy-loading 'vcpu_model' on Instance uuid a6000393-6044-4b54-ac0b-1d631e2ed0ae {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXfyDmWR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:25:34 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:25:34 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:25:34 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:25:34 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:25:34 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[564aef52-3346-4233-bc57-f7b35ea92620]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:25:34 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[796b1653-ffc3-4d9a-acd6-3885b5df68c4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b] added
Aug 09 10:25:34 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51c0f9a-4dfa-4c14-9fb4-59af560d0a79]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[100bf72b-0536-48c0-93ea-3cec34499482]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EXfyDmWR {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EXfyDmWR" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[9966bafb-fc3c-4fd7-b141-fbc06027ff60]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EXfyDmWR'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ee55ea-b133-406c-b339-51ad5ac5f6a8]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db8f4c6-bd33-49b5-a5cd-10cc183bdfdd]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:25:34 user nova-compute[72362]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)
Aug 09 10:25:34 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:25:34 user nova-compute[72362]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)
Aug 09 10:25:34 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[88bff049-0af3-4fe9-888b-fd7bed843b0d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b, portal: 172.16.0.220,3260]
Aug 09 10:25:34 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b, portal: 172.16.0.220,3260] successful.
Aug 09 10:25:34 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[425048c9-dd2e-4577-a941-65ba032d71a0]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe9a246-2932-4451-9d3e-0a8dd599eeea]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:25:34 user nova-compute[72362]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)
Aug 09 10:25:34 user nova-compute[72362]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:25:34 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:25:34 user nova-compute[72362]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)
Aug 09 10:25:34 user nova-compute[72362]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:25:34 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d88fbc-24b5-440b-b3f9-bf4f02ff283e]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:25:34 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXfyDmWR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:25:35 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:25:35 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '26437336564613734', 'path': '/dev/sdc'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:25:35 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437336564613734', 'path': '/dev/sdc'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:25:35 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:21:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1940264170',display_name='tempest-AttachVolumeTestJSON-server-1940264170',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1940264170',id=19,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuD55hFJGS6ztpZ3pMNhoMVTtkOPfZJVd+6jLMFkU6lpGS3ntRkyZ61ihETUV7/q4X01P1baNsnIzL7TV/XH9281YGmZSyK/sCWwApv9GpxS0U8aCjbpuFwgIK7/Y1Z9Q==',key_name='tempest-keypair-208455084',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:21:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9dac04663e2f45378cc0e466740342d2',ramdisk_id='',reservation_id='r-i0cbsd0z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-986857971',owner_user_name='tempest-AttachVolumeTestJSON-986857971-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:23:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec007d0aa3c144f5a24a4913cc336ebb',uuid=a6000393-6044-4b54-ac0b-1d631e2ed0ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "address": "fa:16:3e:6e:b0:73", "network": {"id": "7358b925-3211-4419-84eb-df6967f5ea8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1360753488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dac04663e2f45378cc0e466740342d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c0230bc-c7", "ovs_interfaceid": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:25:35 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Converting VIF {"id": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "address": "fa:16:3e:6e:b0:73", "network": {"id": "7358b925-3211-4419-84eb-df6967f5ea8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1360753488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dac04663e2f45378cc0e466740342d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c0230bc-c7", "ovs_interfaceid": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:25:35 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:b0:73,bridge_name='br-int',has_traffic_filtering=True,id=8c0230bc-c7a7-4497-af9a-2fafb259605c,network=Network(7358b925-3211-4419-84eb-df6967f5ea8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c0230bc-c7') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:25:35 user nova-compute[72362]: DEBUG nova.objects.instance [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lazy-loading 'pci_devices' on Instance uuid a6000393-6044-4b54-ac0b-1d631e2ed0ae {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:25:35 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:25:35 user nova-compute[72362]:   <uuid>a6000393-6044-4b54-ac0b-1d631e2ed0ae</uuid>
Aug 09 10:25:35 user nova-compute[72362]:   <name>instance-00000013</name>
Aug 09 10:25:35 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:25:35 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:25:35 user nova-compute[72362]:   <metadata>
Aug 09 10:25:35 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:25:35 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:25:35 user nova-compute[72362]:       <nova:name>tempest-AttachVolumeTestJSON-server-1940264170</nova:name>
Aug 09 10:25:35 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:25:34</nova:creationTime>
Aug 09 10:25:35 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:25:35 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:25:35 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:25:35 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:25:35 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:25:35 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:25:35 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:25:35 user nova-compute[72362]:       <nova:owner>
Aug 09 10:25:35 user nova-compute[72362]:         <nova:user uuid="ec007d0aa3c144f5a24a4913cc336ebb">tempest-AttachVolumeTestJSON-986857971-project-member</nova:user>
Aug 09 10:25:35 user nova-compute[72362]:         <nova:project uuid="9dac04663e2f45378cc0e466740342d2">tempest-AttachVolumeTestJSON-986857971</nova:project>
Aug 09 10:25:35 user nova-compute[72362]:       </nova:owner>
Aug 09 10:25:35 user nova-compute[72362]:       <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:25:35 user nova-compute[72362]:       <nova:ports>
Aug 09 10:25:35 user nova-compute[72362]:         <nova:port uuid="8c0230bc-c7a7-4497-af9a-2fafb259605c">
Aug 09 10:25:35 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 10:25:35 user nova-compute[72362]:         </nova:port>
Aug 09 10:25:35 user nova-compute[72362]:       </nova:ports>
Aug 09 10:25:35 user nova-compute[72362]:     </nova:instance>
Aug 09 10:25:35 user nova-compute[72362]:   </metadata>
Aug 09 10:25:35 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:25:35 user nova-compute[72362]:     <system>
Aug 09 10:25:35 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:25:35 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:25:35 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:25:35 user nova-compute[72362]:       <entry name="serial">a6000393-6044-4b54-ac0b-1d631e2ed0ae</entry>
Aug 09 10:25:35 user nova-compute[72362]:       <entry name="uuid">a6000393-6044-4b54-ac0b-1d631e2ed0ae</entry>
Aug 09 10:25:35 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:25:35 user nova-compute[72362]:     </system>
Aug 09 10:25:35 user nova-compute[72362]:   </sysinfo>
Aug 09 10:25:35 user nova-compute[72362]:   <os>
Aug 09 10:25:35 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:25:35 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:25:35 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:25:35 user nova-compute[72362]:   </os>
Aug 09 10:25:35 user nova-compute[72362]:   <features>
Aug 09 10:25:35 user nova-compute[72362]:     <acpi/>
Aug 09 10:25:35 user nova-compute[72362]:     <apic/>
Aug 09 10:25:35 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:25:35 user nova-compute[72362]:   </features>
Aug 09 10:25:35 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:25:35 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:25:35 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:25:35 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:25:35 user nova-compute[72362]:   </clock>
Aug 09 10:25:35 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:25:35 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:25:35 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:25:35 user nova-compute[72362]:   </cpu>
Aug 09 10:25:35 user nova-compute[72362]:   <devices>
Aug 09 10:25:35 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:25:35 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:25:35 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk"/>
Aug 09 10:25:35 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:25:35 user nova-compute[72362]:     </disk>
Aug 09 10:25:35 user nova-compute[72362]:     <disk type="block" device="disk">
Aug 09 10:25:35 user nova-compute[72362]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:25:35 user nova-compute[72362]:       <source dev="/dev/sdc"/>
Aug 09 10:25:35 user nova-compute[72362]:       <target dev="vdb" bus="virtio"/>
Aug 09 10:25:35 user nova-compute[72362]:       <serial>cb2be0ee-763d-488d-b7e6-65e39d26b53b</serial>
Aug 09 10:25:35 user nova-compute[72362]:     </disk>
Aug 09 10:25:35 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:25:35 user nova-compute[72362]:       <mac address="fa:16:3e:6e:b0:73"/>
Aug 09 10:25:35 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:25:35 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:25:35 user nova-compute[72362]:       <target dev="tap8c0230bc-c7"/>
Aug 09 10:25:35 user nova-compute[72362]:     </interface>
Aug 09 10:25:35 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:25:35 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/console.log" append="off"/>
Aug 09 10:25:35 user nova-compute[72362]:     </serial>
Aug 09 10:25:35 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:25:35 user nova-compute[72362]:     <video>
Aug 09 10:25:35 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:25:35 user nova-compute[72362]:     </video>
Aug 09 10:25:35 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:25:35 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:25:35 user nova-compute[72362]:     </rng>
Aug 09 10:25:35 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:25:35 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:25:35 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:25:35 user nova-compute[72362]:     </memballoon>
Aug 09 10:25:35 user nova-compute[72362]:   </devices>
Aug 09 10:25:35 user nova-compute[72362]: </domain>
Aug 09 10:25:35 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:25:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:25:36 user nova-compute[72362]: DEBUG nova.objects.instance [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lazy-loading 'trusted_certs' on Instance uuid a6000393-6044-4b54-ac0b-1d631e2ed0ae {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:25:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.160s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:36 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk. size=1073741824 {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 10:25:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:36 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Cannot resize image /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk to a smaller size. {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 10:25:36 user nova-compute[72362]: DEBUG nova.objects.instance [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lazy-loading 'migration_context' on Instance uuid a6000393-6044-4b54-ac0b-1d631e2ed0ae {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:25:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:21:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1940264170',display_name='tempest-AttachVolumeTestJSON-server-1940264170',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1940264170',id=19,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuD55hFJGS6ztpZ3pMNhoMVTtkOPfZJVd+6jLMFkU6lpGS3ntRkyZ61ihETUV7/q4X01P1baNsnIzL7TV/XH9281YGmZSyK/sCWwApv9GpxS0U8aCjbpuFwgIK7/Y1Z9Q==',key_name='tempest-keypair-208455084',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:21:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='9dac04663e2f45378cc0e466740342d2',ramdisk_id='',reservation_id='r-i0cbsd0z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-986857971',owner_user_name='tempest-AttachVolumeTestJSON-986857971-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:23:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec007d0aa3c144f5a24a4913cc336ebb',uuid=a6000393-6044-4b54-ac0b-1d631e2ed0ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "address": "fa:16:3e:6e:b0:73", "network": {"id": "7358b925-3211-4419-84eb-df6967f5ea8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1360753488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dac04663e2f45378cc0e466740342d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c0230bc-c7", "ovs_interfaceid": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:25:36 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Converting VIF {"id": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "address": "fa:16:3e:6e:b0:73", "network": {"id": "7358b925-3211-4419-84eb-df6967f5ea8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1360753488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dac04663e2f45378cc0e466740342d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c0230bc-c7", "ovs_interfaceid": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:25:36 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:b0:73,bridge_name='br-int',has_traffic_filtering=True,id=8c0230bc-c7a7-4497-af9a-2fafb259605c,network=Network(7358b925-3211-4419-84eb-df6967f5ea8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c0230bc-c7') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:25:36 user nova-compute[72362]: DEBUG os_vif [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:b0:73,bridge_name='br-int',has_traffic_filtering=True,id=8c0230bc-c7a7-4497-af9a-2fafb259605c,network=Network(7358b925-3211-4419-84eb-df6967f5ea8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c0230bc-c7') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:25:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:25:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:25:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c0230bc-c7, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:25:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8c0230bc-c7, col_values=(('external_ids', {'iface-id': '8c0230bc-c7a7-4497-af9a-2fafb259605c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:b0:73', 'vm-uuid': 'a6000393-6044-4b54-ac0b-1d631e2ed0ae'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:25:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:25:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:36 user nova-compute[72362]: INFO os_vif [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:b0:73,bridge_name='br-int',has_traffic_filtering=True,id=8c0230bc-c7a7-4497-af9a-2fafb259605c,network=Network(7358b925-3211-4419-84eb-df6967f5ea8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c0230bc-c7')
Aug 09 10:25:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:38 user nova-compute[72362]: DEBUG nova.compute.manager [req-f2ed2af9-36e5-4a36-8be3-b054d549eaaf req-b27018f5-45ac-4717-b97e-7796ace88061 service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Received event network-vif-plugged-8c0230bc-c7a7-4497-af9a-2fafb259605c {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:25:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f2ed2af9-36e5-4a36-8be3-b054d549eaaf req-b27018f5-45ac-4717-b97e-7796ace88061 service nova] Acquiring lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:25:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f2ed2af9-36e5-4a36-8be3-b054d549eaaf req-b27018f5-45ac-4717-b97e-7796ace88061 service nova] Lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:25:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f2ed2af9-36e5-4a36-8be3-b054d549eaaf req-b27018f5-45ac-4717-b97e-7796ace88061 service nova] Lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:25:38 user nova-compute[72362]: DEBUG nova.compute.manager [req-f2ed2af9-36e5-4a36-8be3-b054d549eaaf req-b27018f5-45ac-4717-b97e-7796ace88061 service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] No waiting events found dispatching network-vif-plugged-8c0230bc-c7a7-4497-af9a-2fafb259605c {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:25:38 user nova-compute[72362]: WARNING nova.compute.manager [req-f2ed2af9-36e5-4a36-8be3-b054d549eaaf req-b27018f5-45ac-4717-b97e-7796ace88061 service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Received unexpected event network-vif-plugged-8c0230bc-c7a7-4497-af9a-2fafb259605c for instance with vm_state stopped and task_state powering-on.
Aug 09 10:25:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:40 user nova-compute[72362]: DEBUG nova.compute.manager [req-06e15b11-63be-4436-b5fe-be390fbaf2d1 req-1401d151-c765-497b-afdc-e6445a253b52 service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Received event network-vif-plugged-8c0230bc-c7a7-4497-af9a-2fafb259605c {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:25:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-06e15b11-63be-4436-b5fe-be390fbaf2d1 req-1401d151-c765-497b-afdc-e6445a253b52 service nova] Acquiring lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:25:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-06e15b11-63be-4436-b5fe-be390fbaf2d1 req-1401d151-c765-497b-afdc-e6445a253b52 service nova] Lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:25:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-06e15b11-63be-4436-b5fe-be390fbaf2d1 req-1401d151-c765-497b-afdc-e6445a253b52 service nova] Lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:25:40 user nova-compute[72362]: DEBUG nova.compute.manager [req-06e15b11-63be-4436-b5fe-be390fbaf2d1 req-1401d151-c765-497b-afdc-e6445a253b52 service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] No waiting events found dispatching network-vif-plugged-8c0230bc-c7a7-4497-af9a-2fafb259605c {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:25:40 user nova-compute[72362]: WARNING nova.compute.manager [req-06e15b11-63be-4436-b5fe-be390fbaf2d1 req-1401d151-c765-497b-afdc-e6445a253b52 service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Received unexpected event network-vif-plugged-8c0230bc-c7a7-4497-af9a-2fafb259605c for instance with vm_state stopped and task_state powering-on.
Aug 09 10:25:40 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576740.7737288, a6000393-6044-4b54-ac0b-1d631e2ed0ae => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:25:40 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] VM Resumed (Lifecycle Event)
Aug 09 10:25:40 user nova-compute[72362]: DEBUG nova.compute.manager [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:25:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:40 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Instance rebooted successfully.
Aug 09 10:25:40 user nova-compute[72362]: DEBUG nova.compute.manager [None req-ccb4455b-e6b2-4d05-b118-a9f49870c204 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:25:40 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:25:40 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:25:40 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 09 10:25:40 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576740.7829366, a6000393-6044-4b54-ac0b-1d631e2ed0ae => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:25:40 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] VM Started (Lifecycle Event)
Aug 09 10:25:40 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:25:40 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:25:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Acquiring lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:25:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:25:44 user nova-compute[72362]: DEBUG nova.compute.manager [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Starting instance... {{(pid=72362) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 10:25:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:25:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:25:44 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:25:44 user nova-compute[72362]: INFO nova.compute.claims [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Claim successful on node user
Aug 09 10:25:44 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:25:44 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:25:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.312s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:25:44 user nova-compute[72362]: DEBUG nova.compute.manager [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Start building networks asynchronously for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 10:25:44 user nova-compute[72362]: DEBUG nova.compute.manager [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Allocating IP information in the background. {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 10:25:44 user nova-compute[72362]: DEBUG nova.network.neutron [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] allocate_for_instance() {{(pid=72362) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 10:25:44 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 10:25:44 user nova-compute[72362]: DEBUG nova.compute.manager [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Start building block device mappings for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 10:25:44 user nova-compute[72362]: INFO nova.virt.block_device [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Booting with volume fc8514c8-cef8-4746-80df-4ded7518bc1e at /dev/vda
Aug 09 10:25:44 user nova-compute[72362]: DEBUG os_brick.utils [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:25:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:44 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc42e2f-f2d7-44cd-b3f3-4a5e48eac15b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:25:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:44 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[57af83b7-ece2-44ed-854d-9497dfa1bc52]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:25:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:44 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ceda88f-35bd-4c4c-9fe3-203bcb87920d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:25:44 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c337af-3835-40fe-bdb0-d6691100ad65]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:25:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:25:44 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:25:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:25:44 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:25:44 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c604ab43-70e7-4e52-918d-8e3509c852af]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:25:44 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:25:44 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:25:44 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:25:44 user nova-compute[72362]: DEBUG os_brick.utils [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:25:44 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Updating existing volume attachment record: 619968d5-93dd-44e3-97b1-725920ac9b84 {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 10:25:44 user nova-compute[72362]: DEBUG nova.policy [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'db66f066669949739a5888f4fe24a6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c28082d2768043b197738d79c7fe9f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72362) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 10:25:45 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:46 user nova-compute[72362]: DEBUG nova.network.neutron [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Successfully created port: 0a6057db-abb0-4777-9aab-d3a2ba3f95ec {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:25:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:47 user nova-compute[72362]: DEBUG nova.network.neutron [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Successfully created port: 64f56105-6893-4ab5-86bf-380874d78f8c {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:25:49 user nova-compute[72362]: DEBUG nova.network.neutron [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Successfully created port: 31b0a33f-dad5-4ea1-8a20-d7c3fdedd352 {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:25:51 user nova-compute[72362]: DEBUG nova.network.neutron [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Successfully created port: 71a96106-1d45-4b94-a7da-893e8b6d92bd {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:25:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:52 user nova-compute[72362]: DEBUG nova.network.neutron [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Successfully created port: 945c59da-d927-49a5-82e7-7c591943fcd1 {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:25:53 user nova-compute[72362]: DEBUG nova.network.neutron [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Successfully updated port: 0a6057db-abb0-4777-9aab-d3a2ba3f95ec {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:25:53 user nova-compute[72362]: DEBUG nova.compute.manager [req-6cc39d39-b390-411e-a2c3-fb62c805d362 req-467150f8-8895-4b45-9f57-4afeddbd290b service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received event network-changed-0a6057db-abb0-4777-9aab-d3a2ba3f95ec {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:25:53 user nova-compute[72362]: DEBUG nova.compute.manager [req-6cc39d39-b390-411e-a2c3-fb62c805d362 req-467150f8-8895-4b45-9f57-4afeddbd290b service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Refreshing instance network info cache due to event network-changed-0a6057db-abb0-4777-9aab-d3a2ba3f95ec. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:25:53 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-6cc39d39-b390-411e-a2c3-fb62c805d362 req-467150f8-8895-4b45-9f57-4afeddbd290b service nova] Acquiring lock "refresh_cache-4ebbb1fa-12d7-4ebf-b73d-52c452077ec8" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:25:53 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-6cc39d39-b390-411e-a2c3-fb62c805d362 req-467150f8-8895-4b45-9f57-4afeddbd290b service nova] Acquired lock "refresh_cache-4ebbb1fa-12d7-4ebf-b73d-52c452077ec8" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:25:53 user nova-compute[72362]: DEBUG nova.network.neutron [req-6cc39d39-b390-411e-a2c3-fb62c805d362 req-467150f8-8895-4b45-9f57-4afeddbd290b service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Refreshing network info cache for port 0a6057db-abb0-4777-9aab-d3a2ba3f95ec {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:25:53 user nova-compute[72362]: DEBUG nova.network.neutron [req-6cc39d39-b390-411e-a2c3-fb62c805d362 req-467150f8-8895-4b45-9f57-4afeddbd290b service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:25:54 user nova-compute[72362]: DEBUG nova.network.neutron [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Successfully updated port: 4c5ba9f1-7d79-4f8a-8273-1fcf85b6ea71 {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:25:54 user nova-compute[72362]: DEBUG nova.network.neutron [req-6cc39d39-b390-411e-a2c3-fb62c805d362 req-467150f8-8895-4b45-9f57-4afeddbd290b service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:25:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-6cc39d39-b390-411e-a2c3-fb62c805d362 req-467150f8-8895-4b45-9f57-4afeddbd290b service nova] Releasing lock "refresh_cache-4ebbb1fa-12d7-4ebf-b73d-52c452077ec8" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:25:54 user nova-compute[72362]: INFO nova.virt.block_device [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Booting with volume 39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 at /dev/vdb
Aug 09 10:25:54 user nova-compute[72362]: DEBUG os_brick.utils [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:25:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:54 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b28be70-7944-4103-86c3-6657ceaf5ee5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:25:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:54 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2605ee-a91a-40f8-b044-c411c88b4ab5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:25:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:25:54 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf98f04-29e7-42c8-83df-9c1150eb5a5e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:25:54 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c67a9d-a6db-4750-ba9a-ee754fd587f1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:25:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:25:54 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:25:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:25:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:25:54 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:25:54 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d921d7-94c0-4cbd-8032-47da9af00ac8]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:25:55 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:25:55 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:25:55 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:25:55 user nova-compute[72362]: DEBUG os_brick.utils [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:25:55 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Updating existing volume attachment record: 1a50f567-55c6-4a7d-98d0-679492fcd9ab {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 10:25:55 user nova-compute[72362]: DEBUG nova.compute.manager [req-ca0f349e-8e26-4e78-8964-8295e69a49eb req-84d8a998-5fe7-458b-b5ca-5e41dbbc3592 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received event network-changed-4c5ba9f1-7d79-4f8a-8273-1fcf85b6ea71 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:25:55 user nova-compute[72362]: DEBUG nova.compute.manager [req-ca0f349e-8e26-4e78-8964-8295e69a49eb req-84d8a998-5fe7-458b-b5ca-5e41dbbc3592 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Refreshing instance network info cache due to event network-changed-4c5ba9f1-7d79-4f8a-8273-1fcf85b6ea71. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:25:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ca0f349e-8e26-4e78-8964-8295e69a49eb req-84d8a998-5fe7-458b-b5ca-5e41dbbc3592 service nova] Acquiring lock "refresh_cache-4ebbb1fa-12d7-4ebf-b73d-52c452077ec8" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:25:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ca0f349e-8e26-4e78-8964-8295e69a49eb req-84d8a998-5fe7-458b-b5ca-5e41dbbc3592 service nova] Acquired lock "refresh_cache-4ebbb1fa-12d7-4ebf-b73d-52c452077ec8" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:25:55 user nova-compute[72362]: DEBUG nova.network.neutron [req-ca0f349e-8e26-4e78-8964-8295e69a49eb req-84d8a998-5fe7-458b-b5ca-5e41dbbc3592 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Refreshing network info cache for port 4c5ba9f1-7d79-4f8a-8273-1fcf85b6ea71 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:25:55 user nova-compute[72362]: DEBUG nova.network.neutron [req-ca0f349e-8e26-4e78-8964-8295e69a49eb req-84d8a998-5fe7-458b-b5ca-5e41dbbc3592 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:25:55 user nova-compute[72362]: DEBUG nova.network.neutron [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Successfully updated port: ff7bc1ec-40b6-469c-8fec-e49752a917c6 {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:25:55 user nova-compute[72362]: DEBUG nova.network.neutron [req-ca0f349e-8e26-4e78-8964-8295e69a49eb req-84d8a998-5fe7-458b-b5ca-5e41dbbc3592 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:25:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ca0f349e-8e26-4e78-8964-8295e69a49eb req-84d8a998-5fe7-458b-b5ca-5e41dbbc3592 service nova] Releasing lock "refresh_cache-4ebbb1fa-12d7-4ebf-b73d-52c452077ec8" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:25:55 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:25:55 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:25:56 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:56 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:56 user nova-compute[72362]: DEBUG nova.network.neutron [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Successfully updated port: 64f56105-6893-4ab5-86bf-380874d78f8c {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:25:56 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:25:56 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:25:56 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 10:25:57 user nova-compute[72362]: DEBUG nova.network.neutron [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Successfully updated port: 31b0a33f-dad5-4ea1-8a20-d7c3fdedd352 {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:25:57 user nova-compute[72362]: DEBUG nova.compute.manager [req-a8139367-4bc9-4160-bfba-210d242939d8 req-44b1b3d8-b740-44e5-8d7f-e12d267da49b service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received event network-changed-ff7bc1ec-40b6-469c-8fec-e49752a917c6 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:25:57 user nova-compute[72362]: DEBUG nova.compute.manager [req-a8139367-4bc9-4160-bfba-210d242939d8 req-44b1b3d8-b740-44e5-8d7f-e12d267da49b service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Refreshing instance network info cache due to event network-changed-ff7bc1ec-40b6-469c-8fec-e49752a917c6. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:25:57 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-a8139367-4bc9-4160-bfba-210d242939d8 req-44b1b3d8-b740-44e5-8d7f-e12d267da49b service nova] Acquiring lock "refresh_cache-4ebbb1fa-12d7-4ebf-b73d-52c452077ec8" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:25:57 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-a8139367-4bc9-4160-bfba-210d242939d8 req-44b1b3d8-b740-44e5-8d7f-e12d267da49b service nova] Acquired lock "refresh_cache-4ebbb1fa-12d7-4ebf-b73d-52c452077ec8" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:25:57 user nova-compute[72362]: DEBUG nova.network.neutron [req-a8139367-4bc9-4160-bfba-210d242939d8 req-44b1b3d8-b740-44e5-8d7f-e12d267da49b service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Refreshing network info cache for port ff7bc1ec-40b6-469c-8fec-e49752a917c6 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:25:57 user nova-compute[72362]: DEBUG nova.network.neutron [req-a8139367-4bc9-4160-bfba-210d242939d8 req-44b1b3d8-b740-44e5-8d7f-e12d267da49b service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:25:57 user nova-compute[72362]: DEBUG nova.network.neutron [req-a8139367-4bc9-4160-bfba-210d242939d8 req-44b1b3d8-b740-44e5-8d7f-e12d267da49b service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:25:57 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-a8139367-4bc9-4160-bfba-210d242939d8 req-44b1b3d8-b740-44e5-8d7f-e12d267da49b service nova] Releasing lock "refresh_cache-4ebbb1fa-12d7-4ebf-b73d-52c452077ec8" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:25:57 user nova-compute[72362]: DEBUG nova.compute.manager [req-a8139367-4bc9-4160-bfba-210d242939d8 req-44b1b3d8-b740-44e5-8d7f-e12d267da49b service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received event network-changed-64f56105-6893-4ab5-86bf-380874d78f8c {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:25:57 user nova-compute[72362]: DEBUG nova.compute.manager [req-a8139367-4bc9-4160-bfba-210d242939d8 req-44b1b3d8-b740-44e5-8d7f-e12d267da49b service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Refreshing instance network info cache due to event network-changed-64f56105-6893-4ab5-86bf-380874d78f8c. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:25:57 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-a8139367-4bc9-4160-bfba-210d242939d8 req-44b1b3d8-b740-44e5-8d7f-e12d267da49b service nova] Acquiring lock "refresh_cache-4ebbb1fa-12d7-4ebf-b73d-52c452077ec8" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:25:57 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-a8139367-4bc9-4160-bfba-210d242939d8 req-44b1b3d8-b740-44e5-8d7f-e12d267da49b service nova] Acquired lock "refresh_cache-4ebbb1fa-12d7-4ebf-b73d-52c452077ec8" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:25:57 user nova-compute[72362]: DEBUG nova.network.neutron [req-a8139367-4bc9-4160-bfba-210d242939d8 req-44b1b3d8-b740-44e5-8d7f-e12d267da49b service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Refreshing network info cache for port 64f56105-6893-4ab5-86bf-380874d78f8c {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:25:57 user nova-compute[72362]: DEBUG nova.network.neutron [req-a8139367-4bc9-4160-bfba-210d242939d8 req-44b1b3d8-b740-44e5-8d7f-e12d267da49b service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:25:58 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:25:58 user nova-compute[72362]: DEBUG nova.network.neutron [req-a8139367-4bc9-4160-bfba-210d242939d8 req-44b1b3d8-b740-44e5-8d7f-e12d267da49b service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:25:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-a8139367-4bc9-4160-bfba-210d242939d8 req-44b1b3d8-b740-44e5-8d7f-e12d267da49b service nova] Releasing lock "refresh_cache-4ebbb1fa-12d7-4ebf-b73d-52c452077ec8" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:25:58 user nova-compute[72362]: DEBUG nova.compute.manager [req-a8139367-4bc9-4160-bfba-210d242939d8 req-44b1b3d8-b740-44e5-8d7f-e12d267da49b service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received event network-changed-31b0a33f-dad5-4ea1-8a20-d7c3fdedd352 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:25:58 user nova-compute[72362]: DEBUG nova.compute.manager [req-a8139367-4bc9-4160-bfba-210d242939d8 req-44b1b3d8-b740-44e5-8d7f-e12d267da49b service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Refreshing instance network info cache due to event network-changed-31b0a33f-dad5-4ea1-8a20-d7c3fdedd352. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:25:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-a8139367-4bc9-4160-bfba-210d242939d8 req-44b1b3d8-b740-44e5-8d7f-e12d267da49b service nova] Acquiring lock "refresh_cache-4ebbb1fa-12d7-4ebf-b73d-52c452077ec8" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:25:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-a8139367-4bc9-4160-bfba-210d242939d8 req-44b1b3d8-b740-44e5-8d7f-e12d267da49b service nova] Acquired lock "refresh_cache-4ebbb1fa-12d7-4ebf-b73d-52c452077ec8" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:25:58 user nova-compute[72362]: DEBUG nova.network.neutron [req-a8139367-4bc9-4160-bfba-210d242939d8 req-44b1b3d8-b740-44e5-8d7f-e12d267da49b service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Refreshing network info cache for port 31b0a33f-dad5-4ea1-8a20-d7c3fdedd352 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:25:58 user nova-compute[72362]: DEBUG nova.network.neutron [req-a8139367-4bc9-4160-bfba-210d242939d8 req-44b1b3d8-b740-44e5-8d7f-e12d267da49b service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:25:58 user nova-compute[72362]: DEBUG nova.network.neutron [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Successfully updated port: 71a96106-1d45-4b94-a7da-893e8b6d92bd {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:25:58 user nova-compute[72362]: DEBUG nova.network.neutron [req-a8139367-4bc9-4160-bfba-210d242939d8 req-44b1b3d8-b740-44e5-8d7f-e12d267da49b service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:25:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-a8139367-4bc9-4160-bfba-210d242939d8 req-44b1b3d8-b740-44e5-8d7f-e12d267da49b service nova] Releasing lock "refresh_cache-4ebbb1fa-12d7-4ebf-b73d-52c452077ec8" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:25:58 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:25:58 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:25:58 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 10:25:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "refresh_cache-4746beb1-d313-4cea-bf7b-75b507ebbdd2" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:25:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquired lock "refresh_cache-4746beb1-d313-4cea-bf7b-75b507ebbdd2" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:25:59 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Forcefully refreshing network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 10:25:59 user nova-compute[72362]: DEBUG nova.compute.manager [req-c7187f9d-bf21-4207-9e84-a2c0ab0a1bd4 req-1f6a9527-ebdf-4208-b13b-fb76e19e76f1 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received event network-changed-71a96106-1d45-4b94-a7da-893e8b6d92bd {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:25:59 user nova-compute[72362]: DEBUG nova.compute.manager [req-c7187f9d-bf21-4207-9e84-a2c0ab0a1bd4 req-1f6a9527-ebdf-4208-b13b-fb76e19e76f1 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Refreshing instance network info cache due to event network-changed-71a96106-1d45-4b94-a7da-893e8b6d92bd. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:25:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c7187f9d-bf21-4207-9e84-a2c0ab0a1bd4 req-1f6a9527-ebdf-4208-b13b-fb76e19e76f1 service nova] Acquiring lock "refresh_cache-4ebbb1fa-12d7-4ebf-b73d-52c452077ec8" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:25:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c7187f9d-bf21-4207-9e84-a2c0ab0a1bd4 req-1f6a9527-ebdf-4208-b13b-fb76e19e76f1 service nova] Acquired lock "refresh_cache-4ebbb1fa-12d7-4ebf-b73d-52c452077ec8" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:25:59 user nova-compute[72362]: DEBUG nova.network.neutron [req-c7187f9d-bf21-4207-9e84-a2c0ab0a1bd4 req-1f6a9527-ebdf-4208-b13b-fb76e19e76f1 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Refreshing network info cache for port 71a96106-1d45-4b94-a7da-893e8b6d92bd {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:25:59 user nova-compute[72362]: DEBUG nova.network.neutron [req-c7187f9d-bf21-4207-9e84-a2c0ab0a1bd4 req-1f6a9527-ebdf-4208-b13b-fb76e19e76f1 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:25:59 user nova-compute[72362]: DEBUG nova.network.neutron [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Successfully updated port: 945c59da-d927-49a5-82e7-7c591943fcd1 {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:25:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Acquiring lock "refresh_cache-4ebbb1fa-12d7-4ebf-b73d-52c452077ec8" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:25:59 user nova-compute[72362]: DEBUG nova.network.neutron [req-c7187f9d-bf21-4207-9e84-a2c0ab0a1bd4 req-1f6a9527-ebdf-4208-b13b-fb76e19e76f1 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:25:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c7187f9d-bf21-4207-9e84-a2c0ab0a1bd4 req-1f6a9527-ebdf-4208-b13b-fb76e19e76f1 service nova] Releasing lock "refresh_cache-4ebbb1fa-12d7-4ebf-b73d-52c452077ec8" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:25:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Acquired lock "refresh_cache-4ebbb1fa-12d7-4ebf-b73d-52c452077ec8" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:26:00 user nova-compute[72362]: DEBUG nova.network.neutron [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:26:00 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Updating instance_info_cache with network_info: [{"id": "a10771ea-ee0f-4376-88cc-97dd0eb98d8d", "address": "fa:16:3e:03:05:4e", "network": {"id": "557d516c-f355-4cc8-ae2e-5dbec7ce9762", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1511437856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99716e91e68b4abfba3a4c9335e42955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa10771ea-ee", "ovs_interfaceid": "a10771ea-ee0f-4376-88cc-97dd0eb98d8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:26:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Releasing lock "refresh_cache-4746beb1-d313-4cea-bf7b-75b507ebbdd2" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:26:00 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Updated the network info_cache for instance {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 10:26:00 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:26:00 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:26:00 user nova-compute[72362]: DEBUG nova.network.neutron [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:26:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:01 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:26:02 user nova-compute[72362]: DEBUG nova.compute.manager [req-dced57bb-db90-4bc5-bbca-d486ff403885 req-69a7706f-30c7-4b19-b019-6a2308ea5d50 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received event network-changed-945c59da-d927-49a5-82e7-7c591943fcd1 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:26:02 user nova-compute[72362]: DEBUG nova.compute.manager [req-dced57bb-db90-4bc5-bbca-d486ff403885 req-69a7706f-30c7-4b19-b019-6a2308ea5d50 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Refreshing instance network info cache due to event network-changed-945c59da-d927-49a5-82e7-7c591943fcd1. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:26:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-dced57bb-db90-4bc5-bbca-d486ff403885 req-69a7706f-30c7-4b19-b019-6a2308ea5d50 service nova] Acquiring lock "refresh_cache-4ebbb1fa-12d7-4ebf-b73d-52c452077ec8" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:26:03 user nova-compute[72362]: DEBUG nova.network.neutron [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Updating instance_info_cache with network_info: [{"id": "0a6057db-abb0-4777-9aab-d3a2ba3f95ec", "address": "fa:16:3e:48:68:7a", "network": {"id": "bea01ebc-53b7-4715-a159-6295257b1dd1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1313518742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6057db-ab", "ovs_interfaceid": "0a6057db-abb0-4777-9aab-d3a2ba3f95ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4c5ba9f1-7d79-4f8a-8273-1fcf85b6ea71", "address": "fa:16:3e:14:52:ad", "network": {"id": "6a6fcebc-f762-47d1-9213-265b323e18e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1150728202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c5ba9f1-7d", "ovs_interfaceid": "4c5ba9f1-7d79-4f8a-8273-1fcf85b6ea71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff7bc1ec-40b6-469c-8fec-e49752a917c6", "address": "fa:16:3e:1a:1f:d2", "network": {"id": "6a6fcebc-f762-47d1-9213-265b323e18e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1150728202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff7bc1ec-40", "ovs_interfaceid": "ff7bc1ec-40b6-469c-8fec-e49752a917c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "64f56105-6893-4ab5-86bf-380874d78f8c", "address": "fa:16:3e:df:37:39", "network": {"id": "6a6fcebc-f762-47d1-9213-265b323e18e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1150728202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64f56105-68", "ovs_interfaceid": "64f56105-6893-4ab5-86bf-380874d78f8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "31b0a33f-dad5-4ea1-8a20-d7c3fdedd352", "address": "fa:16:3e:4f:e5:8f", "network": {"id": "6a6fcebc-f762-47d1-9213-265b323e18e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1150728202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31b0a33f-da", "ovs_interfaceid": "31b0a33f-dad5-4ea1-8a20-d7c3fdedd352", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "71a96106-1d45-4b94-a7da-893e8b6d92bd", "address": "fa:16:3e:69:13:9b", "network": {"id": "355d69f9-75a6-4620-837c-cdc9269e990e", "bridge": "br-int", "label": "tempest-device-tagging-net2-969918414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71a96106-1d", "ovs_interfaceid": "71a96106-1d45-4b94-a7da-893e8b6d92bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "945c59da-d927-49a5-82e7-7c591943fcd1", "address": "fa:16:3e:11:1b:1b", "network": {"id": "355d69f9-75a6-4620-837c-cdc9269e990e", "bridge": "br-int", "label": "tempest-device-tagging-net2-969918414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap945c59da-d9", "ovs_interfaceid": "945c59da-d927-49a5-82e7-7c591943fcd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:26:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Releasing lock "refresh_cache-4ebbb1fa-12d7-4ebf-b73d-52c452077ec8" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:26:03 user nova-compute[72362]: DEBUG nova.compute.manager [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Instance network_info: |[{"id": "0a6057db-abb0-4777-9aab-d3a2ba3f95ec", "address": "fa:16:3e:48:68:7a", "network": {"id": "bea01ebc-53b7-4715-a159-6295257b1dd1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1313518742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6057db-ab", "ovs_interfaceid": "0a6057db-abb0-4777-9aab-d3a2ba3f95ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4c5ba9f1-7d79-4f8a-8273-1fcf85b6ea71", "address": "fa:16:3e:14:52:ad", "network": {"id": "6a6fcebc-f762-47d1-9213-265b323e18e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1150728202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c5ba9f1-7d", "ovs_interfaceid": "4c5ba9f1-7d79-4f8a-8273-1fcf85b6ea71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff7bc1ec-40b6-469c-8fec-e49752a917c6", "address": "fa:16:3e:1a:1f:d2", "network": {"id": "6a6fcebc-f762-47d1-9213-265b323e18e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1150728202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff7bc1ec-40", "ovs_interfaceid": "ff7bc1ec-40b6-469c-8fec-e49752a917c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "64f56105-6893-4ab5-86bf-380874d78f8c", "address": "fa:16:3e:df:37:39", "network": {"id": "6a6fcebc-f762-47d1-9213-265b323e18e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1150728202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64f56105-68", "ovs_interfaceid": "64f56105-6893-4ab5-86bf-380874d78f8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "31b0a33f-dad5-4ea1-8a20-d7c3fdedd352", "address": "fa:16:3e:4f:e5:8f", "network": {"id": "6a6fcebc-f762-47d1-9213-265b323e18e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1150728202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31b0a33f-da", "ovs_interfaceid": "31b0a33f-dad5-4ea1-8a20-d7c3fdedd352", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "71a96106-1d45-4b94-a7da-893e8b6d92bd", "address": "fa:16:3e:69:13:9b", "network": {"id": "355d69f9-75a6-4620-837c-cdc9269e990e", "bridge": "br-int", "label": "tempest-device-tagging-net2-969918414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71a96106-1d", "ovs_interfaceid": "71a96106-1d45-4b94-a7da-893e8b6d92bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "945c59da-d927-49a5-82e7-7c591943fcd1", "address": "fa:16:3e:11:1b:1b", "network": {"id": "355d69f9-75a6-4620-837c-cdc9269e990e", "bridge": "br-int", "label": "tempest-device-tagging-net2-969918414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap945c59da-d9", "ovs_interfaceid": "945c59da-d927-49a5-82e7-7c591943fcd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 10:26:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-dced57bb-db90-4bc5-bbca-d486ff403885 req-69a7706f-30c7-4b19-b019-6a2308ea5d50 service nova] Acquired lock "refresh_cache-4ebbb1fa-12d7-4ebf-b73d-52c452077ec8" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:26:03 user nova-compute[72362]: DEBUG nova.network.neutron [req-dced57bb-db90-4bc5-bbca-d486ff403885 req-69a7706f-30c7-4b19-b019-6a2308ea5d50 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Refreshing network info cache for port 945c59da-d927-49a5-82e7-7c591943fcd1 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:26:04 user nova-compute[72362]: DEBUG nova.network.neutron [req-dced57bb-db90-4bc5-bbca-d486ff403885 req-69a7706f-30c7-4b19-b019-6a2308ea5d50 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Updated VIF entry in instance network info cache for port 945c59da-d927-49a5-82e7-7c591943fcd1. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:26:04 user nova-compute[72362]: DEBUG nova.network.neutron [req-dced57bb-db90-4bc5-bbca-d486ff403885 req-69a7706f-30c7-4b19-b019-6a2308ea5d50 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Updating instance_info_cache with network_info: [{"id": "0a6057db-abb0-4777-9aab-d3a2ba3f95ec", "address": "fa:16:3e:48:68:7a", "network": {"id": "bea01ebc-53b7-4715-a159-6295257b1dd1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1313518742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6057db-ab", "ovs_interfaceid": "0a6057db-abb0-4777-9aab-d3a2ba3f95ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4c5ba9f1-7d79-4f8a-8273-1fcf85b6ea71", "address": "fa:16:3e:14:52:ad", "network": {"id": "6a6fcebc-f762-47d1-9213-265b323e18e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1150728202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c5ba9f1-7d", "ovs_interfaceid": "4c5ba9f1-7d79-4f8a-8273-1fcf85b6ea71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff7bc1ec-40b6-469c-8fec-e49752a917c6", "address": "fa:16:3e:1a:1f:d2", "network": {"id": "6a6fcebc-f762-47d1-9213-265b323e18e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1150728202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff7bc1ec-40", "ovs_interfaceid": "ff7bc1ec-40b6-469c-8fec-e49752a917c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "64f56105-6893-4ab5-86bf-380874d78f8c", "address": "fa:16:3e:df:37:39", "network": {"id": "6a6fcebc-f762-47d1-9213-265b323e18e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1150728202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64f56105-68", "ovs_interfaceid": "64f56105-6893-4ab5-86bf-380874d78f8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "31b0a33f-dad5-4ea1-8a20-d7c3fdedd352", "address": "fa:16:3e:4f:e5:8f", "network": {"id": "6a6fcebc-f762-47d1-9213-265b323e18e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1150728202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31b0a33f-da", "ovs_interfaceid": "31b0a33f-dad5-4ea1-8a20-d7c3fdedd352", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "71a96106-1d45-4b94-a7da-893e8b6d92bd", "address": "fa:16:3e:69:13:9b", "network": {"id": "355d69f9-75a6-4620-837c-cdc9269e990e", "bridge": "br-int", "label": "tempest-device-tagging-net2-969918414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71a96106-1d", "ovs_interfaceid": "71a96106-1d45-4b94-a7da-893e8b6d92bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "945c59da-d927-49a5-82e7-7c591943fcd1", "address": "fa:16:3e:11:1b:1b", "network": {"id": "355d69f9-75a6-4620-837c-cdc9269e990e", "bridge": "br-int", "label": "tempest-device-tagging-net2-969918414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap945c59da-d9", "ovs_interfaceid": "945c59da-d927-49a5-82e7-7c591943fcd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:26:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-dced57bb-db90-4bc5-bbca-d486ff403885 req-69a7706f-30c7-4b19-b019-6a2308ea5d50 service nova] Releasing lock "refresh_cache-4ebbb1fa-12d7-4ebf-b73d-52c452077ec8" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:26:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Acquiring lock "8d42f648-8616-4974-b416-0b6534b002cc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:26:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Lock "8d42f648-8616-4974-b416-0b6534b002cc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:26:04 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Starting instance... {{(pid=72362) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 10:26:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:26:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:26:04 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:26:04 user nova-compute[72362]: INFO nova.compute.claims [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Claim successful on node user
Aug 09 10:26:05 user nova-compute[72362]: INFO nova.virt.block_device [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Booting with volume 0ab739d8-a2a6-44f5-a553-89827f9c7ccb at /dev/vdc
Aug 09 10:26:05 user nova-compute[72362]: DEBUG os_brick.utils [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:26:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:05 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:26:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[90dd2092-5ca7-4024-a5fe-48e31b40cca1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:05 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:26:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be25f85-6e8b-4cfc-9592-0fb517349bcd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.495s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:26:05 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Start building networks asynchronously for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 10:26:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec2de8f-d44e-40a7-8bcb-d74fa8022138]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ad0b23-5565-4260-961f-4a7ade99edf2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:26:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:26:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:05 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Allocating IP information in the background. {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 10:26:05 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] allocate_for_instance() {{(pid=72362) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 10:26:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:26:05 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:26:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b39e3e-f9e7-4c60-9d9b-f5021c58d2d5]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:26:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:26:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:26:05 user nova-compute[72362]: DEBUG os_brick.utils [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:26:05 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Updating existing volume attachment record: c5968e23-b4f7-4d80-89b9-387cea56f97d {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 10:26:05 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 10:26:05 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Start building block device mappings for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 10:26:05 user nova-compute[72362]: INFO nova.virt.block_device [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Booting with volume df0efc51-3970-4983-a224-c79511fab3d9 at /dev/vda
Aug 09 10:26:05 user nova-compute[72362]: DEBUG nova.policy [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0b0a0c2a13af4b34ab0dedfaaeae864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b0b83578f14c84a8fadd12e66911f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72362) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 10:26:05 user nova-compute[72362]: DEBUG os_brick.utils [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:26:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[769f5ca6-21fb-4793-a0a2-c1aca574fa8d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e41b8c-1a8d-43e7-8e85-161a64547d0a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c2b659-7494-4e52-a5ca-29c344b06975]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[078ff9ae-0d34-44b5-9bec-55f0eed272e8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:26:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:26:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:26:05 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:26:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63483b1-7b17-4307-8a44-c3f842cc2a69]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:26:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:26:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:26:05 user nova-compute[72362]: DEBUG os_brick.utils [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:26:05 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Updating existing volume attachment record: dcf95e87-1846-4f89-ad76-081dc21bd9ca {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 10:26:05 user nova-compute[72362]: INFO nova.compute.manager [None req-79b87c1a-df22-4976-a411-4bfcf320636a tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Unrescuing
Aug 09 10:26:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-79b87c1a-df22-4976-a411-4bfcf320636a tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquiring lock "refresh_cache-30213e67-6b1d-4d97-a971-1544335d02fb" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:26:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-79b87c1a-df22-4976-a411-4bfcf320636a tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquired lock "refresh_cache-30213e67-6b1d-4d97-a971-1544335d02fb" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:26:05 user nova-compute[72362]: DEBUG nova.network.neutron [None req-79b87c1a-df22-4976-a411-4bfcf320636a tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:26:05 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:26:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:26:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:26:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:26:06 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 10:26:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:06 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Successfully created port: a722d26f-88e8-40a8-b13c-66ec2bc587cf {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:26:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:06 user nova-compute[72362]: DEBUG nova.network.neutron [None req-79b87c1a-df22-4976-a411-4bfcf320636a tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Updating instance_info_cache with network_info: [{"id": "86a5b4ed-c891-4322-9ed4-4ddb3795148c", "address": "fa:16:3e:7b:56:f2", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a5b4ed-c8", "ovs_interfaceid": "86a5b4ed-c891-4322-9ed4-4ddb3795148c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:26:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-79b87c1a-df22-4976-a411-4bfcf320636a tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Releasing lock "refresh_cache-30213e67-6b1d-4d97-a971-1544335d02fb" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:26:06 user nova-compute[72362]: DEBUG nova.objects.instance [None req-79b87c1a-df22-4976-a411-4bfcf320636a tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lazy-loading 'flavor' on Instance uuid 30213e67-6b1d-4d97-a971-1544335d02fb {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:26:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:06 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:26:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:07 user nova-compute[72362]: DEBUG nova.compute.manager [req-e1caf490-5608-478f-b306-13661f757ee5 req-fbfe604f-4e2d-4ee4-b4ee-548207035db3 service nova] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Received event network-vif-unplugged-86a5b4ed-c891-4322-9ed4-4ddb3795148c {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:26:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e1caf490-5608-478f-b306-13661f757ee5 req-fbfe604f-4e2d-4ee4-b4ee-548207035db3 service nova] Acquiring lock "30213e67-6b1d-4d97-a971-1544335d02fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:26:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e1caf490-5608-478f-b306-13661f757ee5 req-fbfe604f-4e2d-4ee4-b4ee-548207035db3 service nova] Lock "30213e67-6b1d-4d97-a971-1544335d02fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:26:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e1caf490-5608-478f-b306-13661f757ee5 req-fbfe604f-4e2d-4ee4-b4ee-548207035db3 service nova] Lock "30213e67-6b1d-4d97-a971-1544335d02fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:26:07 user nova-compute[72362]: DEBUG nova.compute.manager [req-e1caf490-5608-478f-b306-13661f757ee5 req-fbfe604f-4e2d-4ee4-b4ee-548207035db3 service nova] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] No waiting events found dispatching network-vif-unplugged-86a5b4ed-c891-4322-9ed4-4ddb3795148c {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:26:07 user nova-compute[72362]: WARNING nova.compute.manager [req-e1caf490-5608-478f-b306-13661f757ee5 req-fbfe604f-4e2d-4ee4-b4ee-548207035db3 service nova] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Received unexpected event network-vif-unplugged-86a5b4ed-c891-4322-9ed4-4ddb3795148c for instance with vm_state rescued and task_state unrescuing.
Aug 09 10:26:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:07 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:26:07 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30213e67-6b1d-4d97-a971-1544335d02fb/disk.rescue --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:07 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30213e67-6b1d-4d97-a971-1544335d02fb/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:07 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30213e67-6b1d-4d97-a971-1544335d02fb/disk.rescue --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:07 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30213e67-6b1d-4d97-a971-1544335d02fb/disk.rescue --force-share --output=json" returned: 0 in 0.153s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:07 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4746beb1-d313-4cea-bf7b-75b507ebbdd2/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:07 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Instance destroyed successfully.
Aug 09 10:26:07 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Successfully updated port: a722d26f-88e8-40a8-b13c-66ec2bc587cf {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:26:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Acquiring lock "refresh_cache-8d42f648-8616-4974-b416-0b6534b002cc" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:26:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Acquired lock "refresh_cache-8d42f648-8616-4974-b416-0b6534b002cc" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:26:07 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:26:07 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4746beb1-d313-4cea-bf7b-75b507ebbdd2/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:07 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4746beb1-d313-4cea-bf7b-75b507ebbdd2/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:07 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:26:07 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4746beb1-d313-4cea-bf7b-75b507ebbdd2/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:07 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:08 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Updating instance_info_cache with network_info: [{"id": "a722d26f-88e8-40a8-b13c-66ec2bc587cf", "address": "fa:16:3e:9d:b1:56", "network": {"id": "da288577-5a89-4a87-aa94-d70e8e98cf83", "bridge": "br-int", "label": "tempest-TestShelveInstance-2076187029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4b0b83578f14c84a8fadd12e66911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa722d26f-88", "ovs_interfaceid": "a722d26f-88e8-40a8-b13c-66ec2bc587cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:26:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:08 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:26:08 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Releasing lock "refresh_cache-8d42f648-8616-4974-b416-0b6534b002cc" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:26:08 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Instance network_info: |[{"id": "a722d26f-88e8-40a8-b13c-66ec2bc587cf", "address": "fa:16:3e:9d:b1:56", "network": {"id": "da288577-5a89-4a87-aa94-d70e8e98cf83", "bridge": "br-int", "label": "tempest-TestShelveInstance-2076187029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4b0b83578f14c84a8fadd12e66911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa722d26f-88", "ovs_interfaceid": "a722d26f-88e8-40a8-b13c-66ec2bc587cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 10:26:11 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:11 user nova-compute[72362]: DEBUG nova.compute.manager [req-87b9327a-e626-4a70-9cda-2b442f3c7590 req-2853b01d-ba65-403b-ac57-0a90a6625fa5 service nova] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Received event network-vif-plugged-86a5b4ed-c891-4322-9ed4-4ddb3795148c {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:26:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-87b9327a-e626-4a70-9cda-2b442f3c7590 req-2853b01d-ba65-403b-ac57-0a90a6625fa5 service nova] Acquiring lock "30213e67-6b1d-4d97-a971-1544335d02fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:26:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-87b9327a-e626-4a70-9cda-2b442f3c7590 req-2853b01d-ba65-403b-ac57-0a90a6625fa5 service nova] Lock "30213e67-6b1d-4d97-a971-1544335d02fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:26:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-87b9327a-e626-4a70-9cda-2b442f3c7590 req-2853b01d-ba65-403b-ac57-0a90a6625fa5 service nova] Lock "30213e67-6b1d-4d97-a971-1544335d02fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:26:11 user nova-compute[72362]: DEBUG nova.compute.manager [req-87b9327a-e626-4a70-9cda-2b442f3c7590 req-2853b01d-ba65-403b-ac57-0a90a6625fa5 service nova] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] No waiting events found dispatching network-vif-plugged-86a5b4ed-c891-4322-9ed4-4ddb3795148c {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:26:11 user nova-compute[72362]: WARNING nova.compute.manager [req-87b9327a-e626-4a70-9cda-2b442f3c7590 req-2853b01d-ba65-403b-ac57-0a90a6625fa5 service nova] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Received unexpected event network-vif-plugged-86a5b4ed-c891-4322-9ed4-4ddb3795148c for instance with vm_state rescued and task_state unrescuing.
Aug 09 10:26:11 user nova-compute[72362]: DEBUG nova.compute.manager [req-87b9327a-e626-4a70-9cda-2b442f3c7590 req-2853b01d-ba65-403b-ac57-0a90a6625fa5 service nova] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Received event network-changed-a722d26f-88e8-40a8-b13c-66ec2bc587cf {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:26:11 user nova-compute[72362]: DEBUG nova.compute.manager [req-87b9327a-e626-4a70-9cda-2b442f3c7590 req-2853b01d-ba65-403b-ac57-0a90a6625fa5 service nova] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Refreshing instance network info cache due to event network-changed-a722d26f-88e8-40a8-b13c-66ec2bc587cf. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:26:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-87b9327a-e626-4a70-9cda-2b442f3c7590 req-2853b01d-ba65-403b-ac57-0a90a6625fa5 service nova] Acquiring lock "refresh_cache-8d42f648-8616-4974-b416-0b6534b002cc" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:26:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-87b9327a-e626-4a70-9cda-2b442f3c7590 req-2853b01d-ba65-403b-ac57-0a90a6625fa5 service nova] Acquired lock "refresh_cache-8d42f648-8616-4974-b416-0b6534b002cc" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:26:11 user nova-compute[72362]: DEBUG nova.network.neutron [req-87b9327a-e626-4a70-9cda-2b442f3c7590 req-2853b01d-ba65-403b-ac57-0a90a6625fa5 service nova] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Refreshing network info cache for port a722d26f-88e8-40a8-b13c-66ec2bc587cf {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:26:11 user nova-compute[72362]: DEBUG nova.compute.manager [req-e8f657ff-5b6d-4210-8ef3-8ce36365a45e req-7aed8967-94d5-48fb-b8fb-251dc5bde68a service nova] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Received event network-vif-plugged-86a5b4ed-c891-4322-9ed4-4ddb3795148c {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:26:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e8f657ff-5b6d-4210-8ef3-8ce36365a45e req-7aed8967-94d5-48fb-b8fb-251dc5bde68a service nova] Acquiring lock "30213e67-6b1d-4d97-a971-1544335d02fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:26:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e8f657ff-5b6d-4210-8ef3-8ce36365a45e req-7aed8967-94d5-48fb-b8fb-251dc5bde68a service nova] Lock "30213e67-6b1d-4d97-a971-1544335d02fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:26:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e8f657ff-5b6d-4210-8ef3-8ce36365a45e req-7aed8967-94d5-48fb-b8fb-251dc5bde68a service nova] Lock "30213e67-6b1d-4d97-a971-1544335d02fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:26:11 user nova-compute[72362]: DEBUG nova.compute.manager [req-e8f657ff-5b6d-4210-8ef3-8ce36365a45e req-7aed8967-94d5-48fb-b8fb-251dc5bde68a service nova] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] No waiting events found dispatching network-vif-plugged-86a5b4ed-c891-4322-9ed4-4ddb3795148c {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:26:11 user nova-compute[72362]: WARNING nova.compute.manager [req-e8f657ff-5b6d-4210-8ef3-8ce36365a45e req-7aed8967-94d5-48fb-b8fb-251dc5bde68a service nova] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Received unexpected event network-vif-plugged-86a5b4ed-c891-4322-9ed4-4ddb3795148c for instance with vm_state rescued and task_state unrescuing.
Aug 09 10:26:11 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Removed pending event for 30213e67-6b1d-4d97-a971-1544335d02fb due to event {{(pid=72362) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 10:26:11 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576771.3685522, 30213e67-6b1d-4d97-a971-1544335d02fb => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:26:11 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] VM Resumed (Lifecycle Event)
Aug 09 10:26:11 user nova-compute[72362]: DEBUG nova.compute.manager [None req-79b87c1a-df22-4976-a411-4bfcf320636a tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:26:11 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:26:11 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:26:11 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=8008MB free_disk=25.344501495361328GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 10:26:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:26:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:26:11 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:26:11 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:26:11 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 09 10:26:11 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576771.369381, 30213e67-6b1d-4d97-a971-1544335d02fb => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:26:11 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] VM Started (Lifecycle Event)
Aug 09 10:26:11 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:26:11 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:26:11 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 8e055c58-a365-4f18-a6e3-377e32e2189d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:26:11 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:26:11 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 4746beb1-d313-4cea-bf7b-75b507ebbdd2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:26:11 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance a6000393-6044-4b54-ac0b-1d631e2ed0ae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:26:11 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 30213e67-6b1d-4d97-a971-1544335d02fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:26:11 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:26:11 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 8d42f648-8616-4974-b416-0b6534b002cc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:26:11 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 10:26:11 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 10:26:12 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:26:12 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:26:12 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 10:26:12 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.453s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:26:12 user nova-compute[72362]: DEBUG nova.network.neutron [req-87b9327a-e626-4a70-9cda-2b442f3c7590 req-2853b01d-ba65-403b-ac57-0a90a6625fa5 service nova] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Updated VIF entry in instance network info cache for port a722d26f-88e8-40a8-b13c-66ec2bc587cf. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:26:12 user nova-compute[72362]: DEBUG nova.network.neutron [req-87b9327a-e626-4a70-9cda-2b442f3c7590 req-2853b01d-ba65-403b-ac57-0a90a6625fa5 service nova] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Updating instance_info_cache with network_info: [{"id": "a722d26f-88e8-40a8-b13c-66ec2bc587cf", "address": "fa:16:3e:9d:b1:56", "network": {"id": "da288577-5a89-4a87-aa94-d70e8e98cf83", "bridge": "br-int", "label": "tempest-TestShelveInstance-2076187029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4b0b83578f14c84a8fadd12e66911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa722d26f-88", "ovs_interfaceid": "a722d26f-88e8-40a8-b13c-66ec2bc587cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:26:12 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-87b9327a-e626-4a70-9cda-2b442f3c7590 req-2853b01d-ba65-403b-ac57-0a90a6625fa5 service nova] Releasing lock "refresh_cache-8d42f648-8616-4974-b416-0b6534b002cc" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:26:12 user nova-compute[72362]: DEBUG nova.compute.manager [req-87b9327a-e626-4a70-9cda-2b442f3c7590 req-2853b01d-ba65-403b-ac57-0a90a6625fa5 service nova] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Received event network-vif-plugged-86a5b4ed-c891-4322-9ed4-4ddb3795148c {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:26:12 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-87b9327a-e626-4a70-9cda-2b442f3c7590 req-2853b01d-ba65-403b-ac57-0a90a6625fa5 service nova] Acquiring lock "30213e67-6b1d-4d97-a971-1544335d02fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:26:12 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-87b9327a-e626-4a70-9cda-2b442f3c7590 req-2853b01d-ba65-403b-ac57-0a90a6625fa5 service nova] Lock "30213e67-6b1d-4d97-a971-1544335d02fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:26:12 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-87b9327a-e626-4a70-9cda-2b442f3c7590 req-2853b01d-ba65-403b-ac57-0a90a6625fa5 service nova] Lock "30213e67-6b1d-4d97-a971-1544335d02fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:26:12 user nova-compute[72362]: DEBUG nova.compute.manager [req-87b9327a-e626-4a70-9cda-2b442f3c7590 req-2853b01d-ba65-403b-ac57-0a90a6625fa5 service nova] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] No waiting events found dispatching network-vif-plugged-86a5b4ed-c891-4322-9ed4-4ddb3795148c {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:26:12 user nova-compute[72362]: WARNING nova.compute.manager [req-87b9327a-e626-4a70-9cda-2b442f3c7590 req-2853b01d-ba65-403b-ac57-0a90a6625fa5 service nova] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Received unexpected event network-vif-plugged-86a5b4ed-c891-4322-9ed4-4ddb3795148c for instance with vm_state rescued and task_state unrescuing.
Aug 09 10:26:15 user nova-compute[72362]: DEBUG nova.compute.manager [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Start spawning the instance on the hypervisor. {{(pid=72362) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:26:15 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Creating image(s)
Aug 09 10:26:15 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Did not create local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Ensure instance console log exists: /opt/stack/data/nova/instances/4ebbb1fa-12d7-4ebf-b73d-52c452077ec8/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Start _get_guest_xml network_info=[{"id": "0a6057db-abb0-4777-9aab-d3a2ba3f95ec", "address": "fa:16:3e:48:68:7a", "network": {"id": "bea01ebc-53b7-4715-a159-6295257b1dd1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1313518742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6057db-ab", "ovs_interfaceid": "0a6057db-abb0-4777-9aab-d3a2ba3f95ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4c5ba9f1-7d79-4f8a-8273-1fcf85b6ea71", "address": "fa:16:3e:14:52:ad", "network": {"id": "6a6fcebc-f762-47d1-9213-265b323e18e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1150728202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c5ba9f1-7d", "ovs_interfaceid": "4c5ba9f1-7d79-4f8a-8273-1fcf85b6ea71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff7bc1ec-40b6-469c-8fec-e49752a917c6", "address": "fa:16:3e:1a:1f:d2", "network": {"id": "6a6fcebc-f762-47d1-9213-265b323e18e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1150728202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff7bc1ec-40", "ovs_interfaceid": "ff7bc1ec-40b6-469c-8fec-e49752a917c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "64f56105-6893-4ab5-86bf-380874d78f8c", "address": "fa:16:3e:df:37:39", "network": {"id": "6a6fcebc-f762-47d1-9213-265b323e18e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1150728202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64f56105-68", "ovs_interfaceid": "64f56105-6893-4ab5-86bf-380874d78f8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "31b0a33f-dad5-4ea1-8a20-d7c3fdedd352", "address": "fa:16:3e:4f:e5:8f", "network": {"id": "6a6fcebc-f762-47d1-9213-265b323e18e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1150728202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31b0a33f-da", "ovs_interfaceid": "31b0a33f-dad5-4ea1-8a20-d7c3fdedd352", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "71a96106-1d45-4b94-a7da-893e8b6d92bd", "address": "fa:16:3e:69:13:9b", "network": {"id": "355d69f9-75a6-4620-837c-cdc9269e990e", "bridge": "br-int", "label": "tempest-device-tagging-net2-969918414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71a96106-1d", "ovs_interfaceid": "71a96106-1d45-4b94-a7da-893e8b6d92bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "945c59da-d927-49a5-82e7-7c591943fcd1", "address": "fa:16:3e:11:1b:1b", "network": {"id": "355d69f9-75a6-4620-837c-cdc9269e990e", "bridge": "br-int", "label": "tempest-device-tagging-net2-969918414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap945c59da-d9", "ovs_interfaceid": "945c59da-d927-49a5-82e7-7c591943fcd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '619968d5-93dd-44e3-97b1-725920ac9b84', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gCpLEnQl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4ebbb1fa-12d7-4ebf-b73d-52c452077ec8', 'attached_at': '', 'detached_at': '', 'volume_id': 'fc8514c8-cef8-4746-80df-4ded7518bc1e', 'serial': 'fc8514c8-cef8-4746-80df-4ded7518bc1e'}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None}, {'attachment_id': '1a50f567-55c6-4a7d-98d0-679492fcd9ab', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QtnsNAac', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4ebbb1fa-12d7-4ebf-b73d-52c452077ec8', 'attached_at': '', 'detached_at': '', 'volume_id': '39ab95fc-aac0-4286-9f63-dcb1f84dc1a5', 'serial': '39ab95fc-aac0-4286-9f63-dcb1f84dc1a5'}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 1, 'volume_type': None}, {'attachment_id': 'c5968e23-b4f7-4d80-89b9-387cea56f97d', 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xZIEClgX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4ebbb1fa-12d7-4ebf-b73d-52c452077ec8', 'attached_at': '', 'detached_at': '', 'volume_id': '0ab739d8-a2a6-44f5-a553-89827f9c7ccb', 'serial': '0ab739d8-a2a6-44f5-a553-89827f9c7ccb'}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 2, 'volume_type': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:26:15 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:26:15 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:26:15 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gCpLEnQl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:26:15 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:26:15 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:26:15 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:26:15 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:26:15 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:26:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b546e86c-9224-46d5-a2f1-b713951395a5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:26:15 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c007f1e8-384d-4a3c-b905-ea4fd8e45c34]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e] added
Aug 09 10:26:15 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f408b3-e3d5-41ea-8924-8d02137fe9b6]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaafae84-2536-41eb-b9de-84f6a206fbbf]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gCpLEnQl {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gCpLEnQl" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[db371f29-487a-4a59-b0a0-ab23a01df131]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gCpLEnQl'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d754d860-aab1-43ad-b9dc-d0617e03f733]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[56140de7-1a05-4b15-a492-8c001397ff3a]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:26:15 user nova-compute[72362]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)
Aug 09 10:26:15 user nova-compute[72362]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:26:15 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:26:15 user nova-compute[72362]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)
Aug 09 10:26:15 user nova-compute[72362]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:26:15 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[591dbb76-f31f-4f42-be6f-6e7442c1d406]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e, portal: 172.16.0.220,3260]
Aug 09 10:26:15 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e, portal: 172.16.0.220,3260] successful.
Aug 09 10:26:15 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[268b9a93-bfb2-4913-9078-e5568564ccc1]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:26:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:16 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b16fb40-4ca5-47e2-926b-034f57854fc5]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:16 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:26:16 user nova-compute[72362]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)
Aug 09 10:26:16 user nova-compute[72362]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:26:16 user nova-compute[72362]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e (non-flash)
Aug 09 10:26:16 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:26:16 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:26:16 user nova-compute[72362]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)
Aug 09 10:26:16 user nova-compute[72362]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:26:16 user nova-compute[72362]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e (non-flash)
Aug 09 10:26:16 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:26:16 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:26:16 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:26:16 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] HCTL ('35', '-', '-', 0) found on session 29 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:26:16 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:26:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:16 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[16fefaa3-9191-4992-9d52-a0d4384e3e57]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:16 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:26:16 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gCpLEnQl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:26:16 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4993-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:26:16 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:26:16 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 10:26:16 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 10:26:16 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:16 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '26536633031336639', 'path': '/dev/sdd'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536633031336639', 'path': '/dev/sdd'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QtnsNAac', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:26:17 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:26:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:26:17 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:26:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:26:17 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:26:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a42a90-1b5b-4d99-80ba-4bce977459d7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:26:17 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[7102a5af-7e5e-4ca9-a48a-e73449900e7d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5] added
Aug 09 10:26:17 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5378e770-e8cb-49d5-a1ba-33a1c6c9aa0a]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21e4d94-4b7c-4aec-a4fc-43562e0ddaa1]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QtnsNAac {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QtnsNAac" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e926f6d-aee2-4eba-8bbd-f42d6af3576f]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QtnsNAac'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5148a6a9-1ba0-4aeb-bebb-deb3ea242c7e]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5513c336-8863-4765-a97d-0873f1f81261]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:26:17 user nova-compute[72362]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)
Aug 09 10:26:17 user nova-compute[72362]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:26:17 user nova-compute[72362]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e (non-flash)
Aug 09 10:26:17 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:26:17 user nova-compute[72362]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)
Aug 09 10:26:17 user nova-compute[72362]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:26:17 user nova-compute[72362]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e (non-flash)
Aug 09 10:26:17 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d687f826-1261-42d3-b4c3-2f74e6285483]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5, portal: 172.16.0.220,3260]
Aug 09 10:26:17 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5, portal: 172.16.0.220,3260] successful.
Aug 09 10:26:17 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.041s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[639add77-27f1-404a-bb6c-e2b4f98466f3]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ca6a18-e3b0-4b56-87ba-102374924c7a]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:26:17 user nova-compute[72362]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)
Aug 09 10:26:17 user nova-compute[72362]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:26:17 user nova-compute[72362]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e (non-flash)
Aug 09 10:26:17 user nova-compute[72362]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 (non-flash)
Aug 09 10:26:17 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:26:17 user nova-compute[72362]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)
Aug 09 10:26:17 user nova-compute[72362]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:26:17 user nova-compute[72362]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e (non-flash)
Aug 09 10:26:17 user nova-compute[72362]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 (non-flash)
Aug 09 10:26:17 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] HCTL ('36', '-', '-', 0) found on session 30 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd01407-0c11-41d9-b739-ca92f5e84e5f]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:26:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QtnsNAac', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:26:18 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:26:18 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '26563363235393465', 'path': '/dev/sde'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:26:18 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563363235393465', 'path': '/dev/sde'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:26:18 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:26:18 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xZIEClgX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:26:18 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:26:18 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:26:18 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:26:18 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:26:18 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:26:18 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:26:18 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:26:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:18 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa688b6-94e4-4dd0-b4ac-e588ca56a2d1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:18 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:26:18 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:26:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:18 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6375857f-f8fb-4c54-807f-128072d2519e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:18 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb] added
Aug 09 10:26:18 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:26:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:18 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[418ee3db-bdd1-4f12-9c3f-9fba0f4a3b14]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:18 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:26:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:18 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a25cd9d-5834-43c2-9a17-a4e023386d7c]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:18 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:26:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xZIEClgX {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xZIEClgX" returned: 0 in 0.025s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:18 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca950586-aafe-4cf0-8b52-ea5b7ff15e60]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:18 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xZIEClgX'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:26:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:18 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe672bc6-8e9e-457c-b544-12897710be9c]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:18 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:26:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:18 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bfd85e2-796d-44cf-98c9-6889923a7f62]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:18 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:26:18 user nova-compute[72362]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)
Aug 09 10:26:18 user nova-compute[72362]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:26:18 user nova-compute[72362]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e (non-flash)
Aug 09 10:26:18 user nova-compute[72362]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 (non-flash)
Aug 09 10:26:18 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:26:18 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:26:18 user nova-compute[72362]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)
Aug 09 10:26:18 user nova-compute[72362]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:26:18 user nova-compute[72362]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e (non-flash)
Aug 09 10:26:18 user nova-compute[72362]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 (non-flash)
Aug 09 10:26:18 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:26:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:18 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[48053953-9711-48a2-b648-b9da45575a03]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:18 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb, portal: 172.16.0.220,3260]
Aug 09 10:26:18 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb, portal: 172.16.0.220,3260] successful.
Aug 09 10:26:18 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:26:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:18 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6076a191-106d-4be5-83fe-27ba6cc66b0a]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:18 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:26:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:18 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5606f636-4c4c-4148-a405-42a3696cf248]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:18 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:26:18 user nova-compute[72362]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)
Aug 09 10:26:18 user nova-compute[72362]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:26:18 user nova-compute[72362]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e (non-flash)
Aug 09 10:26:18 user nova-compute[72362]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 (non-flash)
Aug 09 10:26:18 user nova-compute[72362]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb (non-flash)
Aug 09 10:26:18 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:26:18 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:26:18 user nova-compute[72362]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)
Aug 09 10:26:18 user nova-compute[72362]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:26:18 user nova-compute[72362]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e (non-flash)
Aug 09 10:26:18 user nova-compute[72362]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 (non-flash)
Aug 09 10:26:18 user nova-compute[72362]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb (non-flash)
Aug 09 10:26:18 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:26:18 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:26:18 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:26:18 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] HCTL ('37', '-', '-', 0) found on session 31 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:26:18 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:26:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:19 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[99351cfb-2ce0-4f8e-8ea7-af5231fe156a]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:19 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Searching for a device in session 31 and hctl ['37', '*', '*', 0] yield: None {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:26:19 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Start spawning the instance on the hypervisor. {{(pid=72362) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 10:26:19 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:26:19 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Creating image(s)
Aug 09 10:26:19 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Did not create local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 10:26:19 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Ensure instance console log exists: /opt/stack/data/nova/instances/8d42f648-8616-4974-b416-0b6534b002cc/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:26:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:26:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:26:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:26:19 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Start _get_guest_xml network_info=[{"id": "a722d26f-88e8-40a8-b13c-66ec2bc587cf", "address": "fa:16:3e:9d:b1:56", "network": {"id": "da288577-5a89-4a87-aa94-d70e8e98cf83", "bridge": "br-int", "label": "tempest-TestShelveInstance-2076187029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4b0b83578f14c84a8fadd12e66911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa722d26f-88", "ovs_interfaceid": "a722d26f-88e8-40a8-b13c-66ec2bc587cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'dcf95e87-1846-4f89-ad76-081dc21bd9ca', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Jkiypbdf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8d42f648-8616-4974-b416-0b6534b002cc', 'attached_at': '', 'detached_at': '', 'volume_id': 'df0efc51-3970-4983-a224-c79511fab3d9', 'serial': 'df0efc51-3970-4983-a224-c79511fab3d9'}, 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:26:19 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:26:19 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:26:19 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:26:19 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:26:19 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:26:19 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:26:19 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:26:19 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:26:19 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:26:19 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:26:19 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:26:19 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:26:19 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:26:19 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:26:19 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:26:19 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:26:19 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:26:19 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:26:19 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:26:19 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Jkiypbdf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:26:19 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:26:19 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Searching for a device in session 31 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xZIEClgX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '23465363964373639', 'path': '/dev/sdf'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23465363964373639', 'path': '/dev/sdf'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.765s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:26:20 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:26:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:26:20 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:26:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[435b3b25-b2ca-462e-a2f5-a4790ee64277]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:26:20 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:25:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2033498851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2033498851',id=22,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6yquiDWYxTGTfonZ8GsBdP+XG79KCKtKDMQwS55yvW3vn0LTtCoJbNKXKEI0bpiTqu/XZD7eQcIRfB+YHtKODgyWyZ+dqAh6nZ7MH08+scg5xWXswI5VFqtkEwNpGhsw==',key_name='tempest-keypair-1319859291',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c28082d2768043b197738d79c7fe9f34',ramdisk_id='',reservation_id='r-7rv9erom',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1074064696',owner_user_name='tempest-TaggedBootDevicesTest_v242-1074064696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:25:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db66f066669949739a5888f4fe24a6df',uuid=4ebbb1fa-12d7-4ebf-b73d-52c452077ec8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a6057db-abb0-4777-9aab-d3a2ba3f95ec", "address": "fa:16:3e:48:68:7a", "network": {"id": "bea01ebc-53b7-4715-a159-6295257b1dd1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1313518742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6057db-ab", "ovs_interfaceid": "0a6057db-abb0-4777-9aab-d3a2ba3f95ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Converting VIF {"id": "0a6057db-abb0-4777-9aab-d3a2ba3f95ec", "address": "fa:16:3e:48:68:7a", "network": {"id": "bea01ebc-53b7-4715-a159-6295257b1dd1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1313518742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6057db-ab", "ovs_interfaceid": "0a6057db-abb0-4777-9aab-d3a2ba3f95ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:68:7a,bridge_name='br-int',has_traffic_filtering=True,id=0a6057db-abb0-4777-9aab-d3a2ba3f95ec,network=Network(bea01ebc-53b7-4715-a159-6295257b1dd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a6057db-ab') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:25:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2033498851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2033498851',id=22,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6yquiDWYxTGTfonZ8GsBdP+XG79KCKtKDMQwS55yvW3vn0LTtCoJbNKXKEI0bpiTqu/XZD7eQcIRfB+YHtKODgyWyZ+dqAh6nZ7MH08+scg5xWXswI5VFqtkEwNpGhsw==',key_name='tempest-keypair-1319859291',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c28082d2768043b197738d79c7fe9f34',ramdisk_id='',reservation_id='r-7rv9erom',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1074064696',owner_user_name='tempest-TaggedBootDevicesTest_v242-1074064696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:25:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db66f066669949739a5888f4fe24a6df',uuid=4ebbb1fa-12d7-4ebf-b73d-52c452077ec8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c5ba9f1-7d79-4f8a-8273-1fcf85b6ea71", "address": "fa:16:3e:14:52:ad", "network": {"id": "6a6fcebc-f762-47d1-9213-265b323e18e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1150728202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c5ba9f1-7d", "ovs_interfaceid": "4c5ba9f1-7d79-4f8a-8273-1fcf85b6ea71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Converting VIF {"id": "4c5ba9f1-7d79-4f8a-8273-1fcf85b6ea71", "address": "fa:16:3e:14:52:ad", "network": {"id": "6a6fcebc-f762-47d1-9213-265b323e18e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1150728202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c5ba9f1-7d", "ovs_interfaceid": "4c5ba9f1-7d79-4f8a-8273-1fcf85b6ea71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:52:ad,bridge_name='br-int',has_traffic_filtering=True,id=4c5ba9f1-7d79-4f8a-8273-1fcf85b6ea71,network=Network(6a6fcebc-f762-47d1-9213-265b323e18e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4c5ba9f1-7d') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:25:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2033498851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2033498851',id=22,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6yquiDWYxTGTfonZ8GsBdP+XG79KCKtKDMQwS55yvW3vn0LTtCoJbNKXKEI0bpiTqu/XZD7eQcIRfB+YHtKODgyWyZ+dqAh6nZ7MH08+scg5xWXswI5VFqtkEwNpGhsw==',key_name='tempest-keypair-1319859291',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c28082d2768043b197738d79c7fe9f34',ramdisk_id='',reservation_id='r-7rv9erom',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1074064696',owner_user_name='tempest-TaggedBootDevicesTest_v242-1074064696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:25:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db66f066669949739a5888f4fe24a6df',uuid=4ebbb1fa-12d7-4ebf-b73d-52c452077ec8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff7bc1ec-40b6-469c-8fec-e49752a917c6", "address": "fa:16:3e:1a:1f:d2", "network": {"id": "6a6fcebc-f762-47d1-9213-265b323e18e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1150728202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff7bc1ec-40", "ovs_interfaceid": "ff7bc1ec-40b6-469c-8fec-e49752a917c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Converting VIF {"id": "ff7bc1ec-40b6-469c-8fec-e49752a917c6", "address": "fa:16:3e:1a:1f:d2", "network": {"id": "6a6fcebc-f762-47d1-9213-265b323e18e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1150728202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff7bc1ec-40", "ovs_interfaceid": "ff7bc1ec-40b6-469c-8fec-e49752a917c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:1f:d2,bridge_name='br-int',has_traffic_filtering=True,id=ff7bc1ec-40b6-469c-8fec-e49752a917c6,network=Network(6a6fcebc-f762-47d1-9213-265b323e18e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapff7bc1ec-40') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:25:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2033498851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2033498851',id=22,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6yquiDWYxTGTfonZ8GsBdP+XG79KCKtKDMQwS55yvW3vn0LTtCoJbNKXKEI0bpiTqu/XZD7eQcIRfB+YHtKODgyWyZ+dqAh6nZ7MH08+scg5xWXswI5VFqtkEwNpGhsw==',key_name='tempest-keypair-1319859291',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c28082d2768043b197738d79c7fe9f34',ramdisk_id='',reservation_id='r-7rv9erom',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1074064696',owner_user_name='tempest-TaggedBootDevicesTest_v242-1074064696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:25:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db66f066669949739a5888f4fe24a6df',uuid=4ebbb1fa-12d7-4ebf-b73d-52c452077ec8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64f56105-6893-4ab5-86bf-380874d78f8c", "address": "fa:16:3e:df:37:39", "network": {"id": "6a6fcebc-f762-47d1-9213-265b323e18e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1150728202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64f56105-68", "ovs_interfaceid": "64f56105-6893-4ab5-86bf-380874d78f8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Converting VIF {"id": "64f56105-6893-4ab5-86bf-380874d78f8c", "address": "fa:16:3e:df:37:39", "network": {"id": "6a6fcebc-f762-47d1-9213-265b323e18e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1150728202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64f56105-68", "ovs_interfaceid": "64f56105-6893-4ab5-86bf-380874d78f8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:37:39,bridge_name='br-int',has_traffic_filtering=True,id=64f56105-6893-4ab5-86bf-380874d78f8c,network=Network(6a6fcebc-f762-47d1-9213-265b323e18e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64f56105-68') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:25:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2033498851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2033498851',id=22,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6yquiDWYxTGTfonZ8GsBdP+XG79KCKtKDMQwS55yvW3vn0LTtCoJbNKXKEI0bpiTqu/XZD7eQcIRfB+YHtKODgyWyZ+dqAh6nZ7MH08+scg5xWXswI5VFqtkEwNpGhsw==',key_name='tempest-keypair-1319859291',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c28082d2768043b197738d79c7fe9f34',ramdisk_id='',reservation_id='r-7rv9erom',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1074064696',owner_user_name='tempest-TaggedBootDevicesTest_v242-1074064696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:25:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db66f066669949739a5888f4fe24a6df',uuid=4ebbb1fa-12d7-4ebf-b73d-52c452077ec8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31b0a33f-dad5-4ea1-8a20-d7c3fdedd352", "address": "fa:16:3e:4f:e5:8f", "network": {"id": "6a6fcebc-f762-47d1-9213-265b323e18e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1150728202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31b0a33f-da", "ovs_interfaceid": "31b0a33f-dad5-4ea1-8a20-d7c3fdedd352", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Converting VIF {"id": "31b0a33f-dad5-4ea1-8a20-d7c3fdedd352", "address": "fa:16:3e:4f:e5:8f", "network": {"id": "6a6fcebc-f762-47d1-9213-265b323e18e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1150728202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31b0a33f-da", "ovs_interfaceid": "31b0a33f-dad5-4ea1-8a20-d7c3fdedd352", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:e5:8f,bridge_name='br-int',has_traffic_filtering=True,id=31b0a33f-dad5-4ea1-8a20-d7c3fdedd352,network=Network(6a6fcebc-f762-47d1-9213-265b323e18e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31b0a33f-da') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:25:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2033498851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2033498851',id=22,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6yquiDWYxTGTfonZ8GsBdP+XG79KCKtKDMQwS55yvW3vn0LTtCoJbNKXKEI0bpiTqu/XZD7eQcIRfB+YHtKODgyWyZ+dqAh6nZ7MH08+scg5xWXswI5VFqtkEwNpGhsw==',key_name='tempest-keypair-1319859291',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c28082d2768043b197738d79c7fe9f34',ramdisk_id='',reservation_id='r-7rv9erom',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1074064696',owner_user_name='tempest-TaggedBootDevicesTest_v242-1074064696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:25:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db66f066669949739a5888f4fe24a6df',uuid=4ebbb1fa-12d7-4ebf-b73d-52c452077ec8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71a96106-1d45-4b94-a7da-893e8b6d92bd", "address": "fa:16:3e:69:13:9b", "network": {"id": "355d69f9-75a6-4620-837c-cdc9269e990e", "bridge": "br-int", "label": "tempest-device-tagging-net2-969918414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71a96106-1d", "ovs_interfaceid": "71a96106-1d45-4b94-a7da-893e8b6d92bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Converting VIF {"id": "71a96106-1d45-4b94-a7da-893e8b6d92bd", "address": "fa:16:3e:69:13:9b", "network": {"id": "355d69f9-75a6-4620-837c-cdc9269e990e", "bridge": "br-int", "label": "tempest-device-tagging-net2-969918414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71a96106-1d", "ovs_interfaceid": "71a96106-1d45-4b94-a7da-893e8b6d92bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:13:9b,bridge_name='br-int',has_traffic_filtering=True,id=71a96106-1d45-4b94-a7da-893e8b6d92bd,network=Network(355d69f9-75a6-4620-837c-cdc9269e990e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71a96106-1d') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:25:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2033498851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2033498851',id=22,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6yquiDWYxTGTfonZ8GsBdP+XG79KCKtKDMQwS55yvW3vn0LTtCoJbNKXKEI0bpiTqu/XZD7eQcIRfB+YHtKODgyWyZ+dqAh6nZ7MH08+scg5xWXswI5VFqtkEwNpGhsw==',key_name='tempest-keypair-1319859291',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c28082d2768043b197738d79c7fe9f34',ramdisk_id='',reservation_id='r-7rv9erom',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1074064696',owner_user_name='tempest-TaggedBootDevicesTest_v242-1074064696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:25:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db66f066669949739a5888f4fe24a6df',uuid=4ebbb1fa-12d7-4ebf-b73d-52c452077ec8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "945c59da-d927-49a5-82e7-7c591943fcd1", "address": "fa:16:3e:11:1b:1b", "network": {"id": "355d69f9-75a6-4620-837c-cdc9269e990e", "bridge": "br-int", "label": "tempest-device-tagging-net2-969918414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap945c59da-d9", "ovs_interfaceid": "945c59da-d927-49a5-82e7-7c591943fcd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Converting VIF {"id": "945c59da-d927-49a5-82e7-7c591943fcd1", "address": "fa:16:3e:11:1b:1b", "network": {"id": "355d69f9-75a6-4620-837c-cdc9269e990e", "bridge": "br-int", "label": "tempest-device-tagging-net2-969918414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap945c59da-d9", "ovs_interfaceid": "945c59da-d927-49a5-82e7-7c591943fcd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:1b:1b,bridge_name='br-int',has_traffic_filtering=True,id=945c59da-d927-49a5-82e7-7c591943fcd1,network=Network(355d69f9-75a6-4620-837c-cdc9269e990e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap945c59da-d9') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG nova.objects.instance [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Lazy-loading 'pci_devices' on Instance uuid 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[1593d32f-779a-46fb-b9b3-bbc7cc24166a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9] added
Aug 09 10:26:20 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c2bf8cd8-d913-4f2b-8bc7-27ea49d5e231 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Acquiring lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c2bf8cd8-d913-4f2b-8bc7-27ea49d5e231 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:26:20 user nova-compute[72362]:   <uuid>4ebbb1fa-12d7-4ebf-b73d-52c452077ec8</uuid>
Aug 09 10:26:20 user nova-compute[72362]:   <name>instance-00000016</name>
Aug 09 10:26:20 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:26:20 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:26:20 user nova-compute[72362]:   <metadata>
Aug 09 10:26:20 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:26:20 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:26:20 user nova-compute[72362]:       <nova:name>tempest-device-tagging-server-2033498851</nova:name>
Aug 09 10:26:20 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:26:15</nova:creationTime>
Aug 09 10:26:20 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:26:20 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:26:20 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:26:20 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:26:20 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:26:20 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:26:20 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:26:20 user nova-compute[72362]:       <nova:owner>
Aug 09 10:26:20 user nova-compute[72362]:         <nova:user uuid="db66f066669949739a5888f4fe24a6df">tempest-TaggedBootDevicesTest_v242-1074064696-project-member</nova:user>
Aug 09 10:26:20 user nova-compute[72362]:         <nova:project uuid="c28082d2768043b197738d79c7fe9f34">tempest-TaggedBootDevicesTest_v242-1074064696</nova:project>
Aug 09 10:26:20 user nova-compute[72362]:       </nova:owner>
Aug 09 10:26:20 user nova-compute[72362]:       <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:26:20 user nova-compute[72362]:       <nova:ports>
Aug 09 10:26:20 user nova-compute[72362]:         <nova:port uuid="0a6057db-abb0-4777-9aab-d3a2ba3f95ec">
Aug 09 10:26:20 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 10:26:20 user nova-compute[72362]:         </nova:port>
Aug 09 10:26:20 user nova-compute[72362]:         <nova:port uuid="4c5ba9f1-7d79-4f8a-8273-1fcf85b6ea71">
Aug 09 10:26:20 user nova-compute[72362]:           <nova:ip type="fixed" address="10.1.1.125" ipVersion="4"/>
Aug 09 10:26:20 user nova-compute[72362]:         </nova:port>
Aug 09 10:26:20 user nova-compute[72362]:         <nova:port uuid="ff7bc1ec-40b6-469c-8fec-e49752a917c6">
Aug 09 10:26:20 user nova-compute[72362]:           <nova:ip type="fixed" address="10.1.1.74" ipVersion="4"/>
Aug 09 10:26:20 user nova-compute[72362]:         </nova:port>
Aug 09 10:26:20 user nova-compute[72362]:         <nova:port uuid="64f56105-6893-4ab5-86bf-380874d78f8c">
Aug 09 10:26:20 user nova-compute[72362]:           <nova:ip type="fixed" address="10.1.1.97" ipVersion="4"/>
Aug 09 10:26:20 user nova-compute[72362]:         </nova:port>
Aug 09 10:26:20 user nova-compute[72362]:         <nova:port uuid="31b0a33f-dad5-4ea1-8a20-d7c3fdedd352">
Aug 09 10:26:20 user nova-compute[72362]:           <nova:ip type="fixed" address="10.1.1.73" ipVersion="4"/>
Aug 09 10:26:20 user nova-compute[72362]:         </nova:port>
Aug 09 10:26:20 user nova-compute[72362]:         <nova:port uuid="71a96106-1d45-4b94-a7da-893e8b6d92bd">
Aug 09 10:26:20 user nova-compute[72362]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 09 10:26:20 user nova-compute[72362]:         </nova:port>
Aug 09 10:26:20 user nova-compute[72362]:         <nova:port uuid="945c59da-d927-49a5-82e7-7c591943fcd1">
Aug 09 10:26:20 user nova-compute[72362]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 09 10:26:20 user nova-compute[72362]:         </nova:port>
Aug 09 10:26:20 user nova-compute[72362]:       </nova:ports>
Aug 09 10:26:20 user nova-compute[72362]:     </nova:instance>
Aug 09 10:26:20 user nova-compute[72362]:   </metadata>
Aug 09 10:26:20 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:26:20 user nova-compute[72362]:     <system>
Aug 09 10:26:20 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:26:20 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:26:20 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:26:20 user nova-compute[72362]:       <entry name="serial">4ebbb1fa-12d7-4ebf-b73d-52c452077ec8</entry>
Aug 09 10:26:20 user nova-compute[72362]:       <entry name="uuid">4ebbb1fa-12d7-4ebf-b73d-52c452077ec8</entry>
Aug 09 10:26:20 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:26:20 user nova-compute[72362]:     </system>
Aug 09 10:26:20 user nova-compute[72362]:   </sysinfo>
Aug 09 10:26:20 user nova-compute[72362]:   <os>
Aug 09 10:26:20 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:26:20 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:26:20 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:26:20 user nova-compute[72362]:   </os>
Aug 09 10:26:20 user nova-compute[72362]:   <features>
Aug 09 10:26:20 user nova-compute[72362]:     <acpi/>
Aug 09 10:26:20 user nova-compute[72362]:     <apic/>
Aug 09 10:26:20 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:26:20 user nova-compute[72362]:   </features>
Aug 09 10:26:20 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:26:20 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:26:20 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:26:20 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:26:20 user nova-compute[72362]:   </clock>
Aug 09 10:26:20 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:26:20 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:26:20 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:26:20 user nova-compute[72362]:   </cpu>
Aug 09 10:26:20 user nova-compute[72362]:   <devices>
Aug 09 10:26:20 user nova-compute[72362]:     <disk type="file" device="cdrom">
Aug 09 10:26:20 user nova-compute[72362]:       <driver name="qemu" type="raw" cache="none"/>
Aug 09 10:26:20 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/4ebbb1fa-12d7-4ebf-b73d-52c452077ec8/disk.config"/>
Aug 09 10:26:20 user nova-compute[72362]:       <target dev="hda" bus="ide"/>
Aug 09 10:26:20 user nova-compute[72362]:     </disk>
Aug 09 10:26:20 user nova-compute[72362]:     <disk type="block" device="disk">
Aug 09 10:26:20 user nova-compute[72362]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:26:20 user nova-compute[72362]:       <source dev="/dev/sdd"/>
Aug 09 10:26:20 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:26:20 user nova-compute[72362]:       <serial>fc8514c8-cef8-4746-80df-4ded7518bc1e</serial>
Aug 09 10:26:20 user nova-compute[72362]:     </disk>
Aug 09 10:26:20 user nova-compute[72362]:     <disk type="block" device="disk">
Aug 09 10:26:20 user nova-compute[72362]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:26:20 user nova-compute[72362]:       <source dev="/dev/sde"/>
Aug 09 10:26:20 user nova-compute[72362]:       <target dev="vdb" bus="virtio"/>
Aug 09 10:26:20 user nova-compute[72362]:       <serial>39ab95fc-aac0-4286-9f63-dcb1f84dc1a5</serial>
Aug 09 10:26:20 user nova-compute[72362]:     </disk>
Aug 09 10:26:20 user nova-compute[72362]:     <disk type="block" device="disk">
Aug 09 10:26:20 user nova-compute[72362]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:26:20 user nova-compute[72362]:       <source dev="/dev/sdf"/>
Aug 09 10:26:20 user nova-compute[72362]:       <target dev="vdc" bus="virtio"/>
Aug 09 10:26:20 user nova-compute[72362]:       <serial>0ab739d8-a2a6-44f5-a553-89827f9c7ccb</serial>
Aug 09 10:26:20 user nova-compute[72362]:     </disk>
Aug 09 10:26:20 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:26:20 user nova-compute[72362]:       <mac address="fa:16:3e:48:68:7a"/>
Aug 09 10:26:20 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:26:20 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:26:20 user nova-compute[72362]:       <target dev="tap0a6057db-ab"/>
Aug 09 10:26:20 user nova-compute[72362]:     </interface>
Aug 09 10:26:20 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:26:20 user nova-compute[72362]:       <mac address="fa:16:3e:14:52:ad"/>
Aug 09 10:26:20 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:26:20 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:26:20 user nova-compute[72362]:       <target dev="tap4c5ba9f1-7d"/>
Aug 09 10:26:20 user nova-compute[72362]:     </interface>
Aug 09 10:26:20 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:26:20 user nova-compute[72362]:       <mac address="fa:16:3e:1a:1f:d2"/>
Aug 09 10:26:20 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:26:20 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:26:20 user nova-compute[72362]:       <target dev="tapff7bc1ec-40"/>
Aug 09 10:26:20 user nova-compute[72362]:     </interface>
Aug 09 10:26:20 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:26:20 user nova-compute[72362]:       <mac address="fa:16:3e:df:37:39"/>
Aug 09 10:26:20 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:26:20 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:26:20 user nova-compute[72362]:       <target dev="tap64f56105-68"/>
Aug 09 10:26:20 user nova-compute[72362]:     </interface>
Aug 09 10:26:20 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:26:20 user nova-compute[72362]:       <mac address="fa:16:3e:4f:e5:8f"/>
Aug 09 10:26:20 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:26:20 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:26:20 user nova-compute[72362]:       <target dev="tap31b0a33f-da"/>
Aug 09 10:26:20 user nova-compute[72362]:     </interface>
Aug 09 10:26:20 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:26:20 user nova-compute[72362]:       <mac address="fa:16:3e:69:13:9b"/>
Aug 09 10:26:20 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:26:20 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:26:20 user nova-compute[72362]:       <target dev="tap71a96106-1d"/>
Aug 09 10:26:20 user nova-compute[72362]:     </interface>
Aug 09 10:26:20 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:26:20 user nova-compute[72362]:       <mac address="fa:16:3e:11:1b:1b"/>
Aug 09 10:26:20 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:26:20 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:26:20 user nova-compute[72362]:       <target dev="tap945c59da-d9"/>
Aug 09 10:26:20 user nova-compute[72362]:     </interface>
Aug 09 10:26:20 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:26:20 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/4ebbb1fa-12d7-4ebf-b73d-52c452077ec8/console.log" append="off"/>
Aug 09 10:26:20 user nova-compute[72362]:     </serial>
Aug 09 10:26:20 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:26:20 user nova-compute[72362]:     <video>
Aug 09 10:26:20 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:26:20 user nova-compute[72362]:     </video>
Aug 09 10:26:20 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:26:20 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:26:20 user nova-compute[72362]:     </rng>
Aug 09 10:26:20 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:26:20 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:26:20 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:26:20 user nova-compute[72362]:     </memballoon>
Aug 09 10:26:20 user nova-compute[72362]:   </devices>
Aug 09 10:26:20 user nova-compute[72362]: </domain>
Aug 09 10:26:20 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:25:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2033498851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2033498851',id=22,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6yquiDWYxTGTfonZ8GsBdP+XG79KCKtKDMQwS55yvW3vn0LTtCoJbNKXKEI0bpiTqu/XZD7eQcIRfB+YHtKODgyWyZ+dqAh6nZ7MH08+scg5xWXswI5VFqtkEwNpGhsw==',key_name='tempest-keypair-1319859291',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c28082d2768043b197738d79c7fe9f34',ramdisk_id='',reservation_id='r-7rv9erom',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1074064696',owner_user_name='tempest-TaggedBootDevicesTest_v242-1074064696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:25:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db66f066669949739a5888f4fe24a6df',uuid=4ebbb1fa-12d7-4ebf-b73d-52c452077ec8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a6057db-abb0-4777-9aab-d3a2ba3f95ec", "address": "fa:16:3e:48:68:7a", "network": {"id": "bea01ebc-53b7-4715-a159-6295257b1dd1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1313518742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6057db-ab", "ovs_interfaceid": "0a6057db-abb0-4777-9aab-d3a2ba3f95ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Converting VIF {"id": "0a6057db-abb0-4777-9aab-d3a2ba3f95ec", "address": "fa:16:3e:48:68:7a", "network": {"id": "bea01ebc-53b7-4715-a159-6295257b1dd1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1313518742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6057db-ab", "ovs_interfaceid": "0a6057db-abb0-4777-9aab-d3a2ba3f95ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:68:7a,bridge_name='br-int',has_traffic_filtering=True,id=0a6057db-abb0-4777-9aab-d3a2ba3f95ec,network=Network(bea01ebc-53b7-4715-a159-6295257b1dd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a6057db-ab') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG os_vif [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:68:7a,bridge_name='br-int',has_traffic_filtering=True,id=0a6057db-abb0-4777-9aab-d3a2ba3f95ec,network=Network(bea01ebc-53b7-4715-a159-6295257b1dd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a6057db-ab') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG nova.objects.instance [None req-c2bf8cd8-d913-4f2b-8bc7-27ea49d5e231 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lazy-loading 'flavor' on Instance uuid 4746beb1-d313-4cea-bf7b-75b507ebbdd2 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc58faf2-a1d7-46bc-b7cd-4b6d10813abf]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a6057db-ab, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0a6057db-ab, col_values=(('external_ids', {'iface-id': '0a6057db-abb0-4777-9aab-d3a2ba3f95ec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:68:7a', 'vm-uuid': '4ebbb1fa-12d7-4ebf-b73d-52c452077ec8'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:20 user nova-compute[72362]: INFO os_vif [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:68:7a,bridge_name='br-int',has_traffic_filtering=True,id=0a6057db-abb0-4777-9aab-d3a2ba3f95ec,network=Network(bea01ebc-53b7-4715-a159-6295257b1dd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a6057db-ab')
Aug 09 10:26:20 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:25:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2033498851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2033498851',id=22,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6yquiDWYxTGTfonZ8GsBdP+XG79KCKtKDMQwS55yvW3vn0LTtCoJbNKXKEI0bpiTqu/XZD7eQcIRfB+YHtKODgyWyZ+dqAh6nZ7MH08+scg5xWXswI5VFqtkEwNpGhsw==',key_name='tempest-keypair-1319859291',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c28082d2768043b197738d79c7fe9f34',ramdisk_id='',reservation_id='r-7rv9erom',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1074064696',owner_user_name='tempest-TaggedBootDevicesTest_v242-1074064696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:25:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db66f066669949739a5888f4fe24a6df',uuid=4ebbb1fa-12d7-4ebf-b73d-52c452077ec8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c5ba9f1-7d79-4f8a-8273-1fcf85b6ea71", "address": "fa:16:3e:14:52:ad", "network": {"id": "6a6fcebc-f762-47d1-9213-265b323e18e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1150728202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c5ba9f1-7d", "ovs_interfaceid": "4c5ba9f1-7d79-4f8a-8273-1fcf85b6ea71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Converting VIF {"id": "4c5ba9f1-7d79-4f8a-8273-1fcf85b6ea71", "address": "fa:16:3e:14:52:ad", "network": {"id": "6a6fcebc-f762-47d1-9213-265b323e18e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1150728202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c5ba9f1-7d", "ovs_interfaceid": "4c5ba9f1-7d79-4f8a-8273-1fcf85b6ea71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:52:ad,bridge_name='br-int',has_traffic_filtering=True,id=4c5ba9f1-7d79-4f8a-8273-1fcf85b6ea71,network=Network(6a6fcebc-f762-47d1-9213-265b323e18e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4c5ba9f1-7d') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG os_vif [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:52:ad,bridge_name='br-int',has_traffic_filtering=True,id=4c5ba9f1-7d79-4f8a-8273-1fcf85b6ea71,network=Network(6a6fcebc-f762-47d1-9213-265b323e18e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4c5ba9f1-7d') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[85de1f0f-4f0f-4c8f-82cf-deece3818e99]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Jkiypbdf {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c5ba9f1-7d, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4c5ba9f1-7d, col_values=(('external_ids', {'iface-id': '4c5ba9f1-7d79-4f8a-8273-1fcf85b6ea71', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:52:ad', 'vm-uuid': '4ebbb1fa-12d7-4ebf-b73d-52c452077ec8'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c2bf8cd8-d913-4f2b-8bc7-27ea49d5e231 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Jkiypbdf" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff00237-8d4f-4411-8583-5b82c2a338ab]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'Jkiypbdf'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:20 user nova-compute[72362]: INFO os_vif [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:52:ad,bridge_name='br-int',has_traffic_filtering=True,id=4c5ba9f1-7d79-4f8a-8273-1fcf85b6ea71,network=Network(6a6fcebc-f762-47d1-9213-265b323e18e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4c5ba9f1-7d')
Aug 09 10:26:20 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:25:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2033498851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2033498851',id=22,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6yquiDWYxTGTfonZ8GsBdP+XG79KCKtKDMQwS55yvW3vn0LTtCoJbNKXKEI0bpiTqu/XZD7eQcIRfB+YHtKODgyWyZ+dqAh6nZ7MH08+scg5xWXswI5VFqtkEwNpGhsw==',key_name='tempest-keypair-1319859291',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c28082d2768043b197738d79c7fe9f34',ramdisk_id='',reservation_id='r-7rv9erom',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1074064696',owner_user_name='tempest-TaggedBootDevicesTest_v242-1074064696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:25:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db66f066669949739a5888f4fe24a6df',uuid=4ebbb1fa-12d7-4ebf-b73d-52c452077ec8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff7bc1ec-40b6-469c-8fec-e49752a917c6", "address": "fa:16:3e:1a:1f:d2", "network": {"id": "6a6fcebc-f762-47d1-9213-265b323e18e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1150728202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff7bc1ec-40", "ovs_interfaceid": "ff7bc1ec-40b6-469c-8fec-e49752a917c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Converting VIF {"id": "ff7bc1ec-40b6-469c-8fec-e49752a917c6", "address": "fa:16:3e:1a:1f:d2", "network": {"id": "6a6fcebc-f762-47d1-9213-265b323e18e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1150728202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff7bc1ec-40", "ovs_interfaceid": "ff7bc1ec-40b6-469c-8fec-e49752a917c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:1f:d2,bridge_name='br-int',has_traffic_filtering=True,id=ff7bc1ec-40b6-469c-8fec-e49752a917c6,network=Network(6a6fcebc-f762-47d1-9213-265b323e18e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapff7bc1ec-40') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG os_vif [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:1f:d2,bridge_name='br-int',has_traffic_filtering=True,id=ff7bc1ec-40b6-469c-8fec-e49752a917c6,network=Network(6a6fcebc-f762-47d1-9213-265b323e18e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapff7bc1ec-40') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff7bc1ec-40, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapff7bc1ec-40, col_values=(('external_ids', {'iface-id': 'ff7bc1ec-40b6-469c-8fec-e49752a917c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:1f:d2', 'vm-uuid': '4ebbb1fa-12d7-4ebf-b73d-52c452077ec8'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4337f8-de6c-4f23-944d-b5796e19b270]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:20 user nova-compute[72362]: INFO os_vif [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:1f:d2,bridge_name='br-int',has_traffic_filtering=True,id=ff7bc1ec-40b6-469c-8fec-e49752a917c6,network=Network(6a6fcebc-f762-47d1-9213-265b323e18e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapff7bc1ec-40')
Aug 09 10:26:20 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:25:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2033498851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2033498851',id=22,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6yquiDWYxTGTfonZ8GsBdP+XG79KCKtKDMQwS55yvW3vn0LTtCoJbNKXKEI0bpiTqu/XZD7eQcIRfB+YHtKODgyWyZ+dqAh6nZ7MH08+scg5xWXswI5VFqtkEwNpGhsw==',key_name='tempest-keypair-1319859291',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c28082d2768043b197738d79c7fe9f34',ramdisk_id='',reservation_id='r-7rv9erom',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1074064696',owner_user_name='tempest-TaggedBootDevicesTest_v242-1074064696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:25:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db66f066669949739a5888f4fe24a6df',uuid=4ebbb1fa-12d7-4ebf-b73d-52c452077ec8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64f56105-6893-4ab5-86bf-380874d78f8c", "address": "fa:16:3e:df:37:39", "network": {"id": "6a6fcebc-f762-47d1-9213-265b323e18e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1150728202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64f56105-68", "ovs_interfaceid": "64f56105-6893-4ab5-86bf-380874d78f8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Converting VIF {"id": "64f56105-6893-4ab5-86bf-380874d78f8c", "address": "fa:16:3e:df:37:39", "network": {"id": "6a6fcebc-f762-47d1-9213-265b323e18e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1150728202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64f56105-68", "ovs_interfaceid": "64f56105-6893-4ab5-86bf-380874d78f8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:37:39,bridge_name='br-int',has_traffic_filtering=True,id=64f56105-6893-4ab5-86bf-380874d78f8c,network=Network(6a6fcebc-f762-47d1-9213-265b323e18e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64f56105-68') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG os_vif [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:37:39,bridge_name='br-int',has_traffic_filtering=True,id=64f56105-6893-4ab5-86bf-380874d78f8c,network=Network(6a6fcebc-f762-47d1-9213-265b323e18e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64f56105-68') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[485f5d3e-a045-4b88-9caf-a4c0d5cc45d9]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:26:20 user nova-compute[72362]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)
Aug 09 10:26:20 user nova-compute[72362]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:26:20 user nova-compute[72362]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e (non-flash)
Aug 09 10:26:20 user nova-compute[72362]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 (non-flash)
Aug 09 10:26:20 user nova-compute[72362]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb (non-flash)
Aug 09 10:26:20 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:26:20 user nova-compute[72362]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)
Aug 09 10:26:20 user nova-compute[72362]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:26:20 user nova-compute[72362]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e (non-flash)
Aug 09 10:26:20 user nova-compute[72362]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 (non-flash)
Aug 09 10:26:20 user nova-compute[72362]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb (non-flash)
Aug 09 10:26:20 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64f56105-68, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap64f56105-68, col_values=(('external_ids', {'iface-id': '64f56105-6893-4ab5-86bf-380874d78f8c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:37:39', 'vm-uuid': '4ebbb1fa-12d7-4ebf-b73d-52c452077ec8'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:20 user nova-compute[72362]: INFO os_vif [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:37:39,bridge_name='br-int',has_traffic_filtering=True,id=64f56105-6893-4ab5-86bf-380874d78f8c,network=Network(6a6fcebc-f762-47d1-9213-265b323e18e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64f56105-68')
Aug 09 10:26:20 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:25:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2033498851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2033498851',id=22,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6yquiDWYxTGTfonZ8GsBdP+XG79KCKtKDMQwS55yvW3vn0LTtCoJbNKXKEI0bpiTqu/XZD7eQcIRfB+YHtKODgyWyZ+dqAh6nZ7MH08+scg5xWXswI5VFqtkEwNpGhsw==',key_name='tempest-keypair-1319859291',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c28082d2768043b197738d79c7fe9f34',ramdisk_id='',reservation_id='r-7rv9erom',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1074064696',owner_user_name='tempest-TaggedBootDevicesTest_v242-1074064696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:25:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db66f066669949739a5888f4fe24a6df',uuid=4ebbb1fa-12d7-4ebf-b73d-52c452077ec8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31b0a33f-dad5-4ea1-8a20-d7c3fdedd352", "address": "fa:16:3e:4f:e5:8f", "network": {"id": "6a6fcebc-f762-47d1-9213-265b323e18e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1150728202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31b0a33f-da", "ovs_interfaceid": "31b0a33f-dad5-4ea1-8a20-d7c3fdedd352", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Converting VIF {"id": "31b0a33f-dad5-4ea1-8a20-d7c3fdedd352", "address": "fa:16:3e:4f:e5:8f", "network": {"id": "6a6fcebc-f762-47d1-9213-265b323e18e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1150728202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31b0a33f-da", "ovs_interfaceid": "31b0a33f-dad5-4ea1-8a20-d7c3fdedd352", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:e5:8f,bridge_name='br-int',has_traffic_filtering=True,id=31b0a33f-dad5-4ea1-8a20-d7c3fdedd352,network=Network(6a6fcebc-f762-47d1-9213-265b323e18e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31b0a33f-da') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG os_vif [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:e5:8f,bridge_name='br-int',has_traffic_filtering=True,id=31b0a33f-dad5-4ea1-8a20-d7c3fdedd352,network=Network(6a6fcebc-f762-47d1-9213-265b323e18e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31b0a33f-da') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap31b0a33f-da, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap31b0a33f-da, col_values=(('external_ids', {'iface-id': '31b0a33f-dad5-4ea1-8a20-d7c3fdedd352', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:e5:8f', 'vm-uuid': '4ebbb1fa-12d7-4ebf-b73d-52c452077ec8'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c2bf8cd8-d913-4f2b-8bc7-27ea49d5e231 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Acquiring lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c2bf8cd8-d913-4f2b-8bc7-27ea49d5e231 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:26:20 user nova-compute[72362]: INFO nova.compute.manager [None req-c2bf8cd8-d913-4f2b-8bc7-27ea49d5e231 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Attaching volume db538713-7228-48a1-b4aa-13f8234e070f to /dev/vdb
Aug 09 10:26:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[02974956-baf9-448f-8cc9-d51fd615820f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9, portal: 172.16.0.220,3260]
Aug 09 10:26:20 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9, portal: 172.16.0.220,3260] successful.
Aug 09 10:26:20 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:20 user nova-compute[72362]: INFO os_vif [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:e5:8f,bridge_name='br-int',has_traffic_filtering=True,id=31b0a33f-dad5-4ea1-8a20-d7c3fdedd352,network=Network(6a6fcebc-f762-47d1-9213-265b323e18e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31b0a33f-da')
Aug 09 10:26:20 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:25:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2033498851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2033498851',id=22,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6yquiDWYxTGTfonZ8GsBdP+XG79KCKtKDMQwS55yvW3vn0LTtCoJbNKXKEI0bpiTqu/XZD7eQcIRfB+YHtKODgyWyZ+dqAh6nZ7MH08+scg5xWXswI5VFqtkEwNpGhsw==',key_name='tempest-keypair-1319859291',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c28082d2768043b197738d79c7fe9f34',ramdisk_id='',reservation_id='r-7rv9erom',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1074064696',owner_user_name='tempest-TaggedBootDevicesTest_v242-1074064696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:25:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db66f066669949739a5888f4fe24a6df',uuid=4ebbb1fa-12d7-4ebf-b73d-52c452077ec8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71a96106-1d45-4b94-a7da-893e8b6d92bd", "address": "fa:16:3e:69:13:9b", "network": {"id": "355d69f9-75a6-4620-837c-cdc9269e990e", "bridge": "br-int", "label": "tempest-device-tagging-net2-969918414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71a96106-1d", "ovs_interfaceid": "71a96106-1d45-4b94-a7da-893e8b6d92bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Converting VIF {"id": "71a96106-1d45-4b94-a7da-893e8b6d92bd", "address": "fa:16:3e:69:13:9b", "network": {"id": "355d69f9-75a6-4620-837c-cdc9269e990e", "bridge": "br-int", "label": "tempest-device-tagging-net2-969918414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71a96106-1d", "ovs_interfaceid": "71a96106-1d45-4b94-a7da-893e8b6d92bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:13:9b,bridge_name='br-int',has_traffic_filtering=True,id=71a96106-1d45-4b94-a7da-893e8b6d92bd,network=Network(355d69f9-75a6-4620-837c-cdc9269e990e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71a96106-1d') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG os_vif [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:13:9b,bridge_name='br-int',has_traffic_filtering=True,id=71a96106-1d45-4b94-a7da-893e8b6d92bd,network=Network(355d69f9-75a6-4620-837c-cdc9269e990e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71a96106-1d') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1347ef-058e-4aff-8ce9-abfbe1ad5b9b]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71a96106-1d, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap71a96106-1d, col_values=(('external_ids', {'iface-id': '71a96106-1d45-4b94-a7da-893e8b6d92bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:13:9b', 'vm-uuid': '4ebbb1fa-12d7-4ebf-b73d-52c452077ec8'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a134bd-7b78-48ba-a06c-a58e45353ae7]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:26:20 user nova-compute[72362]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)
Aug 09 10:26:20 user nova-compute[72362]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:26:20 user nova-compute[72362]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e (non-flash)
Aug 09 10:26:20 user nova-compute[72362]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 (non-flash)
Aug 09 10:26:20 user nova-compute[72362]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb (non-flash)
Aug 09 10:26:20 user nova-compute[72362]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)
Aug 09 10:26:20 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:26:20 user nova-compute[72362]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)
Aug 09 10:26:20 user nova-compute[72362]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:26:20 user nova-compute[72362]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e (non-flash)
Aug 09 10:26:20 user nova-compute[72362]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 (non-flash)
Aug 09 10:26:20 user nova-compute[72362]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb (non-flash)
Aug 09 10:26:20 user nova-compute[72362]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)
Aug 09 10:26:20 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.384s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] HCTL ('38', '-', '-', 0) found on session 32 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG os_brick.utils [None req-c2bf8cd8-d913-4f2b-8bc7-27ea49d5e231 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.029s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4c871e-8b73-423c-8f49-0b580b0f1ecb]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Searching for a device in session 32 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Jkiypbdf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ff9cf9-8431-4cab-a739-f09e8bf9e9ba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:20 user nova-compute[72362]: INFO os_vif [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:13:9b,bridge_name='br-int',has_traffic_filtering=True,id=71a96106-1d45-4b94-a7da-893e8b6d92bd,network=Network(355d69f9-75a6-4620-837c-cdc9269e990e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71a96106-1d')
Aug 09 10:26:20 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:25:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2033498851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2033498851',id=22,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6yquiDWYxTGTfonZ8GsBdP+XG79KCKtKDMQwS55yvW3vn0LTtCoJbNKXKEI0bpiTqu/XZD7eQcIRfB+YHtKODgyWyZ+dqAh6nZ7MH08+scg5xWXswI5VFqtkEwNpGhsw==',key_name='tempest-keypair-1319859291',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c28082d2768043b197738d79c7fe9f34',ramdisk_id='',reservation_id='r-7rv9erom',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1074064696',owner_user_name='tempest-TaggedBootDevicesTest_v242-1074064696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:25:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db66f066669949739a5888f4fe24a6df',uuid=4ebbb1fa-12d7-4ebf-b73d-52c452077ec8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "945c59da-d927-49a5-82e7-7c591943fcd1", "address": "fa:16:3e:11:1b:1b", "network": {"id": "355d69f9-75a6-4620-837c-cdc9269e990e", "bridge": "br-int", "label": "tempest-device-tagging-net2-969918414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap945c59da-d9", "ovs_interfaceid": "945c59da-d927-49a5-82e7-7c591943fcd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Converting VIF {"id": "945c59da-d927-49a5-82e7-7c591943fcd1", "address": "fa:16:3e:11:1b:1b", "network": {"id": "355d69f9-75a6-4620-837c-cdc9269e990e", "bridge": "br-int", "label": "tempest-device-tagging-net2-969918414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap945c59da-d9", "ovs_interfaceid": "945c59da-d927-49a5-82e7-7c591943fcd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:1b:1b,bridge_name='br-int',has_traffic_filtering=True,id=945c59da-d927-49a5-82e7-7c591943fcd1,network=Network(355d69f9-75a6-4620-837c-cdc9269e990e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap945c59da-d9') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG os_vif [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:1b:1b,bridge_name='br-int',has_traffic_filtering=True,id=945c59da-d927-49a5-82e7-7c591943fcd1,network=Network(355d69f9-75a6-4620-837c-cdc9269e990e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap945c59da-d9') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap945c59da-d9, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap945c59da-d9, col_values=(('external_ids', {'iface-id': '945c59da-d927-49a5-82e7-7c591943fcd1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:1b:1b', 'vm-uuid': '4ebbb1fa-12d7-4ebf-b73d-52c452077ec8'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb872b43-265e-481d-8843-05469bdb7942]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25554b2-26bd-49a0-9d23-82626de724ae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4728498-9d97-4317-b4f1-ab4218ad4871]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-c2bf8cd8-d913-4f2b-8bc7-27ea49d5e231 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-c2bf8cd8-d913-4f2b-8bc7-27ea49d5e231 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c2bf8cd8-d913-4f2b-8bc7-27ea49d5e231 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:26:20 user nova-compute[72362]: INFO os_vif [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:1b:1b,bridge_name='br-int',has_traffic_filtering=True,id=945c59da-d927-49a5-82e7-7c591943fcd1,network=Network(355d69f9-75a6-4620-837c-cdc9269e990e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap945c59da-d9')
Aug 09 10:26:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:26:20 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:26:20 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0297bfc9-f288-4191-ad04-1f887aeadce2]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-c2bf8cd8-d913-4f2b-8bc7-27ea49d5e231 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-c2bf8cd8-d913-4f2b-8bc7-27ea49d5e231 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-c2bf8cd8-d913-4f2b-8bc7-27ea49d5e231 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG os_brick.utils [None req-c2bf8cd8-d913-4f2b-8bc7-27ea49d5e231 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-c2bf8cd8-d913-4f2b-8bc7-27ea49d5e231 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Updating existing volume attachment record: 9d0477a5-7263-4c58-9337-3950a9259c9d {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] No BDM found with device name hda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] No VIF found with MAC fa:16:3e:48:68:7a, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:26:20 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] No VIF found with MAC fa:16:3e:4f:e5:8f, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:26:20 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Using config drive
Aug 09 10:26:20 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Creating config drive at /opt/stack/data/nova/instances/4ebbb1fa-12d7-4ebf-b73d-52c452077ec8/disk.config
Aug 09 10:26:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4ebbb1fa-12d7-4ebf-b73d-52c452077ec8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp61mmm_2a {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4ebbb1fa-12d7-4ebf-b73d-52c452077ec8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp61mmm_2a" returned: 0 in 0.120s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:21 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:21 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.434s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:26:21 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] <== connect_volume: return (2200ms) {'type': 'block', 'scsi_wwn': '23561646531633231', 'path': '/dev/sdg'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:26:21 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23561646531633231', 'path': '/dev/sdg'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:26:21 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:26:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1217884661',display_name='tempest-TestShelveInstance-server-1217884661',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1217884661',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOmjYX+nb6oC43JrBd2BJzwvKVraDBLQFtiNrt1C0JH07OfZmS7euFshiJsgrHA9mKVxj6ykyCXOcr6o2Xd6tEVsv+X2yXun7E9pphr2j2+BP4TP+ZXevz40p5xbEPaYA==',key_name='tempest-TestShelveInstance-1415559284',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d4b0b83578f14c84a8fadd12e66911f7',ramdisk_id='',reservation_id='r-4qse1uup',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-307673701',owner_user_name='tempest-TestShelveInstance-307673701-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:26:05Z,user_data=None,user_id='0b0a0c2a13af4b34ab0dedfaaeae864a',uuid=8d42f648-8616-4974-b416-0b6534b002cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a722d26f-88e8-40a8-b13c-66ec2bc587cf", "address": "fa:16:3e:9d:b1:56", "network": {"id": "da288577-5a89-4a87-aa94-d70e8e98cf83", "bridge": "br-int", "label": "tempest-TestShelveInstance-2076187029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4b0b83578f14c84a8fadd12e66911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa722d26f-88", "ovs_interfaceid": "a722d26f-88e8-40a8-b13c-66ec2bc587cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:26:21 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Converting VIF {"id": "a722d26f-88e8-40a8-b13c-66ec2bc587cf", "address": "fa:16:3e:9d:b1:56", "network": {"id": "da288577-5a89-4a87-aa94-d70e8e98cf83", "bridge": "br-int", "label": "tempest-TestShelveInstance-2076187029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4b0b83578f14c84a8fadd12e66911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa722d26f-88", "ovs_interfaceid": "a722d26f-88e8-40a8-b13c-66ec2bc587cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:26:21 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:b1:56,bridge_name='br-int',has_traffic_filtering=True,id=a722d26f-88e8-40a8-b13c-66ec2bc587cf,network=Network(da288577-5a89-4a87-aa94-d70e8e98cf83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa722d26f-88') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:26:21 user nova-compute[72362]: DEBUG nova.objects.instance [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d42f648-8616-4974-b416-0b6534b002cc {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:26:21 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:26:21 user nova-compute[72362]:   <uuid>8d42f648-8616-4974-b416-0b6534b002cc</uuid>
Aug 09 10:26:21 user nova-compute[72362]:   <name>instance-00000017</name>
Aug 09 10:26:21 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:26:21 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:26:21 user nova-compute[72362]:   <metadata>
Aug 09 10:26:21 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:26:21 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:26:21 user nova-compute[72362]:       <nova:name>tempest-TestShelveInstance-server-1217884661</nova:name>
Aug 09 10:26:21 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:26:19</nova:creationTime>
Aug 09 10:26:21 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:26:21 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:26:21 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:26:21 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:26:21 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:26:21 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:26:21 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:26:21 user nova-compute[72362]:       <nova:owner>
Aug 09 10:26:21 user nova-compute[72362]:         <nova:user uuid="0b0a0c2a13af4b34ab0dedfaaeae864a">tempest-TestShelveInstance-307673701-project-member</nova:user>
Aug 09 10:26:21 user nova-compute[72362]:         <nova:project uuid="d4b0b83578f14c84a8fadd12e66911f7">tempest-TestShelveInstance-307673701</nova:project>
Aug 09 10:26:21 user nova-compute[72362]:       </nova:owner>
Aug 09 10:26:21 user nova-compute[72362]:       <nova:ports>
Aug 09 10:26:21 user nova-compute[72362]:         <nova:port uuid="a722d26f-88e8-40a8-b13c-66ec2bc587cf">
Aug 09 10:26:21 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 10:26:21 user nova-compute[72362]:         </nova:port>
Aug 09 10:26:21 user nova-compute[72362]:       </nova:ports>
Aug 09 10:26:21 user nova-compute[72362]:     </nova:instance>
Aug 09 10:26:21 user nova-compute[72362]:   </metadata>
Aug 09 10:26:21 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:26:21 user nova-compute[72362]:     <system>
Aug 09 10:26:21 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:26:21 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:26:21 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:26:21 user nova-compute[72362]:       <entry name="serial">8d42f648-8616-4974-b416-0b6534b002cc</entry>
Aug 09 10:26:21 user nova-compute[72362]:       <entry name="uuid">8d42f648-8616-4974-b416-0b6534b002cc</entry>
Aug 09 10:26:21 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:26:21 user nova-compute[72362]:     </system>
Aug 09 10:26:21 user nova-compute[72362]:   </sysinfo>
Aug 09 10:26:21 user nova-compute[72362]:   <os>
Aug 09 10:26:21 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:26:21 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:26:21 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:26:21 user nova-compute[72362]:   </os>
Aug 09 10:26:21 user nova-compute[72362]:   <features>
Aug 09 10:26:21 user nova-compute[72362]:     <acpi/>
Aug 09 10:26:21 user nova-compute[72362]:     <apic/>
Aug 09 10:26:21 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:26:21 user nova-compute[72362]:   </features>
Aug 09 10:26:21 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:26:21 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:26:21 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:26:21 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:26:21 user nova-compute[72362]:   </clock>
Aug 09 10:26:21 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:26:21 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:26:21 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:26:21 user nova-compute[72362]:   </cpu>
Aug 09 10:26:21 user nova-compute[72362]:   <devices>
Aug 09 10:26:21 user nova-compute[72362]:     <disk type="block" device="disk">
Aug 09 10:26:21 user nova-compute[72362]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:26:21 user nova-compute[72362]:       <source dev="/dev/sdg"/>
Aug 09 10:26:21 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:26:21 user nova-compute[72362]:       <serial>df0efc51-3970-4983-a224-c79511fab3d9</serial>
Aug 09 10:26:21 user nova-compute[72362]:     </disk>
Aug 09 10:26:21 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:26:21 user nova-compute[72362]:       <mac address="fa:16:3e:9d:b1:56"/>
Aug 09 10:26:21 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:26:21 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:26:21 user nova-compute[72362]:       <target dev="tapa722d26f-88"/>
Aug 09 10:26:21 user nova-compute[72362]:     </interface>
Aug 09 10:26:21 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:26:21 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/8d42f648-8616-4974-b416-0b6534b002cc/console.log" append="off"/>
Aug 09 10:26:21 user nova-compute[72362]:     </serial>
Aug 09 10:26:21 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:26:21 user nova-compute[72362]:     <video>
Aug 09 10:26:21 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:26:21 user nova-compute[72362]:     </video>
Aug 09 10:26:21 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:26:21 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:26:21 user nova-compute[72362]:     </rng>
Aug 09 10:26:21 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:26:21 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:26:21 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:26:21 user nova-compute[72362]:     </memballoon>
Aug 09 10:26:21 user nova-compute[72362]:   </devices>
Aug 09 10:26:21 user nova-compute[72362]: </domain>
Aug 09 10:26:21 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:26:21 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:26:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1217884661',display_name='tempest-TestShelveInstance-server-1217884661',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1217884661',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOmjYX+nb6oC43JrBd2BJzwvKVraDBLQFtiNrt1C0JH07OfZmS7euFshiJsgrHA9mKVxj6ykyCXOcr6o2Xd6tEVsv+X2yXun7E9pphr2j2+BP4TP+ZXevz40p5xbEPaYA==',key_name='tempest-TestShelveInstance-1415559284',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d4b0b83578f14c84a8fadd12e66911f7',ramdisk_id='',reservation_id='r-4qse1uup',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-307673701',owner_user_name='tempest-TestShelveInstance-307673701-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:26:05Z,user_data=None,user_id='0b0a0c2a13af4b34ab0dedfaaeae864a',uuid=8d42f648-8616-4974-b416-0b6534b002cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a722d26f-88e8-40a8-b13c-66ec2bc587cf", "address": "fa:16:3e:9d:b1:56", "network": {"id": "da288577-5a89-4a87-aa94-d70e8e98cf83", "bridge": "br-int", "label": "tempest-TestShelveInstance-2076187029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4b0b83578f14c84a8fadd12e66911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa722d26f-88", "ovs_interfaceid": "a722d26f-88e8-40a8-b13c-66ec2bc587cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:26:21 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Converting VIF {"id": "a722d26f-88e8-40a8-b13c-66ec2bc587cf", "address": "fa:16:3e:9d:b1:56", "network": {"id": "da288577-5a89-4a87-aa94-d70e8e98cf83", "bridge": "br-int", "label": "tempest-TestShelveInstance-2076187029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4b0b83578f14c84a8fadd12e66911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa722d26f-88", "ovs_interfaceid": "a722d26f-88e8-40a8-b13c-66ec2bc587cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:26:21 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:b1:56,bridge_name='br-int',has_traffic_filtering=True,id=a722d26f-88e8-40a8-b13c-66ec2bc587cf,network=Network(da288577-5a89-4a87-aa94-d70e8e98cf83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa722d26f-88') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:26:21 user nova-compute[72362]: DEBUG os_vif [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:b1:56,bridge_name='br-int',has_traffic_filtering=True,id=a722d26f-88e8-40a8-b13c-66ec2bc587cf,network=Network(da288577-5a89-4a87-aa94-d70e8e98cf83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa722d26f-88') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:26:21 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:21 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:26:21 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:26:21 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:21 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa722d26f-88, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:26:21 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa722d26f-88, col_values=(('external_ids', {'iface-id': 'a722d26f-88e8-40a8-b13c-66ec2bc587cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:b1:56', 'vm-uuid': '8d42f648-8616-4974-b416-0b6534b002cc'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:26:21 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:21 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:26:21 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:21 user nova-compute[72362]: INFO os_vif [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:b1:56,bridge_name='br-int',has_traffic_filtering=True,id=a722d26f-88e8-40a8-b13c-66ec2bc587cf,network=Network(da288577-5a89-4a87-aa94-d70e8e98cf83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa722d26f-88')
Aug 09 10:26:21 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:26:21 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] No VIF found with MAC fa:16:3e:9d:b1:56, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:26:23 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:23 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:23 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:23 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:23 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:24 user nova-compute[72362]: DEBUG nova.compute.manager [req-03a33a48-d49a-43ac-9b15-3b157b05d3f5 req-0bfa47a5-8496-4d4a-88f6-1bbb8af7a9be service nova] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Received event network-vif-plugged-a722d26f-88e8-40a8-b13c-66ec2bc587cf {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:26:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-03a33a48-d49a-43ac-9b15-3b157b05d3f5 req-0bfa47a5-8496-4d4a-88f6-1bbb8af7a9be service nova] Acquiring lock "8d42f648-8616-4974-b416-0b6534b002cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:26:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-03a33a48-d49a-43ac-9b15-3b157b05d3f5 req-0bfa47a5-8496-4d4a-88f6-1bbb8af7a9be service nova] Lock "8d42f648-8616-4974-b416-0b6534b002cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:26:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-03a33a48-d49a-43ac-9b15-3b157b05d3f5 req-0bfa47a5-8496-4d4a-88f6-1bbb8af7a9be service nova] Lock "8d42f648-8616-4974-b416-0b6534b002cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:26:24 user nova-compute[72362]: DEBUG nova.compute.manager [req-03a33a48-d49a-43ac-9b15-3b157b05d3f5 req-0bfa47a5-8496-4d4a-88f6-1bbb8af7a9be service nova] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] No waiting events found dispatching network-vif-plugged-a722d26f-88e8-40a8-b13c-66ec2bc587cf {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:26:24 user nova-compute[72362]: WARNING nova.compute.manager [req-03a33a48-d49a-43ac-9b15-3b157b05d3f5 req-0bfa47a5-8496-4d4a-88f6-1bbb8af7a9be service nova] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Received unexpected event network-vif-plugged-a722d26f-88e8-40a8-b13c-66ec2bc587cf for instance with vm_state building and task_state spawning.
Aug 09 10:26:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:24 user nova-compute[72362]: DEBUG nova.compute.manager [req-11c10c0e-db8e-41c6-98d9-19f18e11cb41 req-42287c52-d1c4-4467-8c6d-b9a8b25fec51 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received event network-vif-plugged-0a6057db-abb0-4777-9aab-d3a2ba3f95ec {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:26:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-11c10c0e-db8e-41c6-98d9-19f18e11cb41 req-42287c52-d1c4-4467-8c6d-b9a8b25fec51 service nova] Acquiring lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:26:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-11c10c0e-db8e-41c6-98d9-19f18e11cb41 req-42287c52-d1c4-4467-8c6d-b9a8b25fec51 service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:26:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-11c10c0e-db8e-41c6-98d9-19f18e11cb41 req-42287c52-d1c4-4467-8c6d-b9a8b25fec51 service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:26:24 user nova-compute[72362]: DEBUG nova.compute.manager [req-11c10c0e-db8e-41c6-98d9-19f18e11cb41 req-42287c52-d1c4-4467-8c6d-b9a8b25fec51 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] No waiting events found dispatching network-vif-plugged-0a6057db-abb0-4777-9aab-d3a2ba3f95ec {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:26:24 user nova-compute[72362]: WARNING nova.compute.manager [req-11c10c0e-db8e-41c6-98d9-19f18e11cb41 req-42287c52-d1c4-4467-8c6d-b9a8b25fec51 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received unexpected event network-vif-plugged-0a6057db-abb0-4777-9aab-d3a2ba3f95ec for instance with vm_state building and task_state spawning.
Aug 09 10:26:25 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:25 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:25 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:25 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:25 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:25 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:25 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:25 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:25 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:25 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:25 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:25 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:25 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:25 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:26 user nova-compute[72362]: DEBUG nova.compute.manager [req-25c1ec13-0732-4d74-83c1-9d30b35fde7a req-e325afd3-bec5-4e95-994b-d01c746bd6c4 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received event network-vif-plugged-31b0a33f-dad5-4ea1-8a20-d7c3fdedd352 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:26:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-25c1ec13-0732-4d74-83c1-9d30b35fde7a req-e325afd3-bec5-4e95-994b-d01c746bd6c4 service nova] Acquiring lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:26:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-25c1ec13-0732-4d74-83c1-9d30b35fde7a req-e325afd3-bec5-4e95-994b-d01c746bd6c4 service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:26:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-25c1ec13-0732-4d74-83c1-9d30b35fde7a req-e325afd3-bec5-4e95-994b-d01c746bd6c4 service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:26:26 user nova-compute[72362]: DEBUG nova.compute.manager [req-25c1ec13-0732-4d74-83c1-9d30b35fde7a req-e325afd3-bec5-4e95-994b-d01c746bd6c4 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] No waiting events found dispatching network-vif-plugged-31b0a33f-dad5-4ea1-8a20-d7c3fdedd352 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:26:26 user nova-compute[72362]: WARNING nova.compute.manager [req-25c1ec13-0732-4d74-83c1-9d30b35fde7a req-e325afd3-bec5-4e95-994b-d01c746bd6c4 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received unexpected event network-vif-plugged-31b0a33f-dad5-4ea1-8a20-d7c3fdedd352 for instance with vm_state building and task_state spawning.
Aug 09 10:26:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:26 user nova-compute[72362]: DEBUG nova.compute.manager [req-7e09e7c5-0c05-480b-8503-8ee7f92ae397 req-bb451e52-4191-448c-bfee-a8f6e5914616 service nova] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Received event network-vif-plugged-a722d26f-88e8-40a8-b13c-66ec2bc587cf {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:26:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-7e09e7c5-0c05-480b-8503-8ee7f92ae397 req-bb451e52-4191-448c-bfee-a8f6e5914616 service nova] Acquiring lock "8d42f648-8616-4974-b416-0b6534b002cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:26:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-7e09e7c5-0c05-480b-8503-8ee7f92ae397 req-bb451e52-4191-448c-bfee-a8f6e5914616 service nova] Lock "8d42f648-8616-4974-b416-0b6534b002cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:26:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-7e09e7c5-0c05-480b-8503-8ee7f92ae397 req-bb451e52-4191-448c-bfee-a8f6e5914616 service nova] Lock "8d42f648-8616-4974-b416-0b6534b002cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:26:26 user nova-compute[72362]: DEBUG nova.compute.manager [req-7e09e7c5-0c05-480b-8503-8ee7f92ae397 req-bb451e52-4191-448c-bfee-a8f6e5914616 service nova] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] No waiting events found dispatching network-vif-plugged-a722d26f-88e8-40a8-b13c-66ec2bc587cf {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:26:26 user nova-compute[72362]: WARNING nova.compute.manager [req-7e09e7c5-0c05-480b-8503-8ee7f92ae397 req-bb451e52-4191-448c-bfee-a8f6e5914616 service nova] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Received unexpected event network-vif-plugged-a722d26f-88e8-40a8-b13c-66ec2bc587cf for instance with vm_state building and task_state spawning.
Aug 09 10:26:26 user nova-compute[72362]: DEBUG nova.compute.manager [req-7e09e7c5-0c05-480b-8503-8ee7f92ae397 req-bb451e52-4191-448c-bfee-a8f6e5914616 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received event network-vif-plugged-4c5ba9f1-7d79-4f8a-8273-1fcf85b6ea71 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:26:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-7e09e7c5-0c05-480b-8503-8ee7f92ae397 req-bb451e52-4191-448c-bfee-a8f6e5914616 service nova] Acquiring lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:26:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-7e09e7c5-0c05-480b-8503-8ee7f92ae397 req-bb451e52-4191-448c-bfee-a8f6e5914616 service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:26:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-7e09e7c5-0c05-480b-8503-8ee7f92ae397 req-bb451e52-4191-448c-bfee-a8f6e5914616 service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:26:26 user nova-compute[72362]: DEBUG nova.compute.manager [req-7e09e7c5-0c05-480b-8503-8ee7f92ae397 req-bb451e52-4191-448c-bfee-a8f6e5914616 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] No waiting events found dispatching network-vif-plugged-4c5ba9f1-7d79-4f8a-8273-1fcf85b6ea71 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:26:26 user nova-compute[72362]: WARNING nova.compute.manager [req-7e09e7c5-0c05-480b-8503-8ee7f92ae397 req-bb451e52-4191-448c-bfee-a8f6e5914616 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received unexpected event network-vif-plugged-4c5ba9f1-7d79-4f8a-8273-1fcf85b6ea71 for instance with vm_state building and task_state spawning.
Aug 09 10:26:26 user nova-compute[72362]: DEBUG nova.compute.manager [req-7e09e7c5-0c05-480b-8503-8ee7f92ae397 req-bb451e52-4191-448c-bfee-a8f6e5914616 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received event network-vif-plugged-4c5ba9f1-7d79-4f8a-8273-1fcf85b6ea71 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:26:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-7e09e7c5-0c05-480b-8503-8ee7f92ae397 req-bb451e52-4191-448c-bfee-a8f6e5914616 service nova] Acquiring lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:26:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-7e09e7c5-0c05-480b-8503-8ee7f92ae397 req-bb451e52-4191-448c-bfee-a8f6e5914616 service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:26:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-7e09e7c5-0c05-480b-8503-8ee7f92ae397 req-bb451e52-4191-448c-bfee-a8f6e5914616 service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:26:26 user nova-compute[72362]: DEBUG nova.compute.manager [req-7e09e7c5-0c05-480b-8503-8ee7f92ae397 req-bb451e52-4191-448c-bfee-a8f6e5914616 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] No waiting events found dispatching network-vif-plugged-4c5ba9f1-7d79-4f8a-8273-1fcf85b6ea71 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:26:26 user nova-compute[72362]: WARNING nova.compute.manager [req-7e09e7c5-0c05-480b-8503-8ee7f92ae397 req-bb451e52-4191-448c-bfee-a8f6e5914616 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received unexpected event network-vif-plugged-4c5ba9f1-7d79-4f8a-8273-1fcf85b6ea71 for instance with vm_state building and task_state spawning.
Aug 09 10:26:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:26 user nova-compute[72362]: DEBUG nova.compute.manager [req-3e5ac6c7-0875-4117-93d9-0aeb1b73382d req-26af6a27-fc0c-42cd-b45e-942734f710b7 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received event network-vif-plugged-0a6057db-abb0-4777-9aab-d3a2ba3f95ec {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:26:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3e5ac6c7-0875-4117-93d9-0aeb1b73382d req-26af6a27-fc0c-42cd-b45e-942734f710b7 service nova] Acquiring lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:26:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3e5ac6c7-0875-4117-93d9-0aeb1b73382d req-26af6a27-fc0c-42cd-b45e-942734f710b7 service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:26:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3e5ac6c7-0875-4117-93d9-0aeb1b73382d req-26af6a27-fc0c-42cd-b45e-942734f710b7 service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:26:26 user nova-compute[72362]: DEBUG nova.compute.manager [req-3e5ac6c7-0875-4117-93d9-0aeb1b73382d req-26af6a27-fc0c-42cd-b45e-942734f710b7 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] No waiting events found dispatching network-vif-plugged-0a6057db-abb0-4777-9aab-d3a2ba3f95ec {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:26:26 user nova-compute[72362]: WARNING nova.compute.manager [req-3e5ac6c7-0875-4117-93d9-0aeb1b73382d req-26af6a27-fc0c-42cd-b45e-942734f710b7 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received unexpected event network-vif-plugged-0a6057db-abb0-4777-9aab-d3a2ba3f95ec for instance with vm_state building and task_state spawning.
Aug 09 10:26:26 user nova-compute[72362]: DEBUG nova.compute.manager [req-3e5ac6c7-0875-4117-93d9-0aeb1b73382d req-26af6a27-fc0c-42cd-b45e-942734f710b7 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received event network-vif-plugged-ff7bc1ec-40b6-469c-8fec-e49752a917c6 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:26:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3e5ac6c7-0875-4117-93d9-0aeb1b73382d req-26af6a27-fc0c-42cd-b45e-942734f710b7 service nova] Acquiring lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:26:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3e5ac6c7-0875-4117-93d9-0aeb1b73382d req-26af6a27-fc0c-42cd-b45e-942734f710b7 service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:26:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3e5ac6c7-0875-4117-93d9-0aeb1b73382d req-26af6a27-fc0c-42cd-b45e-942734f710b7 service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:26:26 user nova-compute[72362]: DEBUG nova.compute.manager [req-3e5ac6c7-0875-4117-93d9-0aeb1b73382d req-26af6a27-fc0c-42cd-b45e-942734f710b7 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] No waiting events found dispatching network-vif-plugged-ff7bc1ec-40b6-469c-8fec-e49752a917c6 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:26:26 user nova-compute[72362]: WARNING nova.compute.manager [req-3e5ac6c7-0875-4117-93d9-0aeb1b73382d req-26af6a27-fc0c-42cd-b45e-942734f710b7 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received unexpected event network-vif-plugged-ff7bc1ec-40b6-469c-8fec-e49752a917c6 for instance with vm_state building and task_state spawning.
Aug 09 10:26:26 user nova-compute[72362]: DEBUG nova.compute.manager [req-3e5ac6c7-0875-4117-93d9-0aeb1b73382d req-26af6a27-fc0c-42cd-b45e-942734f710b7 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received event network-vif-plugged-ff7bc1ec-40b6-469c-8fec-e49752a917c6 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:26:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3e5ac6c7-0875-4117-93d9-0aeb1b73382d req-26af6a27-fc0c-42cd-b45e-942734f710b7 service nova] Acquiring lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:26:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3e5ac6c7-0875-4117-93d9-0aeb1b73382d req-26af6a27-fc0c-42cd-b45e-942734f710b7 service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:26:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3e5ac6c7-0875-4117-93d9-0aeb1b73382d req-26af6a27-fc0c-42cd-b45e-942734f710b7 service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:26:26 user nova-compute[72362]: DEBUG nova.compute.manager [req-3e5ac6c7-0875-4117-93d9-0aeb1b73382d req-26af6a27-fc0c-42cd-b45e-942734f710b7 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] No waiting events found dispatching network-vif-plugged-ff7bc1ec-40b6-469c-8fec-e49752a917c6 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:26:26 user nova-compute[72362]: WARNING nova.compute.manager [req-3e5ac6c7-0875-4117-93d9-0aeb1b73382d req-26af6a27-fc0c-42cd-b45e-942734f710b7 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received unexpected event network-vif-plugged-ff7bc1ec-40b6-469c-8fec-e49752a917c6 for instance with vm_state building and task_state spawning.
Aug 09 10:26:26 user nova-compute[72362]: DEBUG nova.compute.manager [req-3e5ac6c7-0875-4117-93d9-0aeb1b73382d req-26af6a27-fc0c-42cd-b45e-942734f710b7 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received event network-vif-plugged-64f56105-6893-4ab5-86bf-380874d78f8c {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:26:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3e5ac6c7-0875-4117-93d9-0aeb1b73382d req-26af6a27-fc0c-42cd-b45e-942734f710b7 service nova] Acquiring lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:26:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3e5ac6c7-0875-4117-93d9-0aeb1b73382d req-26af6a27-fc0c-42cd-b45e-942734f710b7 service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:26:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3e5ac6c7-0875-4117-93d9-0aeb1b73382d req-26af6a27-fc0c-42cd-b45e-942734f710b7 service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:26:26 user nova-compute[72362]: DEBUG nova.compute.manager [req-3e5ac6c7-0875-4117-93d9-0aeb1b73382d req-26af6a27-fc0c-42cd-b45e-942734f710b7 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] No waiting events found dispatching network-vif-plugged-64f56105-6893-4ab5-86bf-380874d78f8c {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:26:26 user nova-compute[72362]: WARNING nova.compute.manager [req-3e5ac6c7-0875-4117-93d9-0aeb1b73382d req-26af6a27-fc0c-42cd-b45e-942734f710b7 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received unexpected event network-vif-plugged-64f56105-6893-4ab5-86bf-380874d78f8c for instance with vm_state building and task_state spawning.
Aug 09 10:26:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:27 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576787.5624444, 8d42f648-8616-4974-b416-0b6534b002cc => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:26:27 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] VM Resumed (Lifecycle Event)
Aug 09 10:26:27 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:26:27 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:26:27 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:26:27 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Instance spawned successfully.
Aug 09 10:26:27 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 10:26:27 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:26:27 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Found default for hw_cdrom_bus of ide {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:26:27 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Found default for hw_disk_bus of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:26:27 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:26:27 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:26:27 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Found default for hw_video_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:26:27 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Found default for hw_vif_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:26:27 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:26:27 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576787.5717068, 8d42f648-8616-4974-b416-0b6534b002cc => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:26:27 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] VM Started (Lifecycle Event)
Aug 09 10:26:27 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:26:27 user nova-compute[72362]: INFO nova.compute.manager [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Took 8.61 seconds to spawn the instance on the hypervisor.
Aug 09 10:26:27 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:26:27 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:26:27 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:26:27 user nova-compute[72362]: INFO nova.compute.manager [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Took 23.19 seconds to build instance.
Aug 09 10:26:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1b8098ec-e672-4795-b13b-9889868c5139 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Lock "8d42f648-8616-4974-b416-0b6534b002cc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.300s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:26:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:28 user nova-compute[72362]: DEBUG nova.compute.manager [req-658c9864-9c93-4b44-a36e-b968961a1a5b req-aa2bf038-c1bc-4b0a-93bf-2b4e2bec282c service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received event network-vif-plugged-31b0a33f-dad5-4ea1-8a20-d7c3fdedd352 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:26:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-658c9864-9c93-4b44-a36e-b968961a1a5b req-aa2bf038-c1bc-4b0a-93bf-2b4e2bec282c service nova] Acquiring lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:26:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-658c9864-9c93-4b44-a36e-b968961a1a5b req-aa2bf038-c1bc-4b0a-93bf-2b4e2bec282c service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:26:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-658c9864-9c93-4b44-a36e-b968961a1a5b req-aa2bf038-c1bc-4b0a-93bf-2b4e2bec282c service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:26:28 user nova-compute[72362]: DEBUG nova.compute.manager [req-658c9864-9c93-4b44-a36e-b968961a1a5b req-aa2bf038-c1bc-4b0a-93bf-2b4e2bec282c service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] No waiting events found dispatching network-vif-plugged-31b0a33f-dad5-4ea1-8a20-d7c3fdedd352 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:26:28 user nova-compute[72362]: WARNING nova.compute.manager [req-658c9864-9c93-4b44-a36e-b968961a1a5b req-aa2bf038-c1bc-4b0a-93bf-2b4e2bec282c service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received unexpected event network-vif-plugged-31b0a33f-dad5-4ea1-8a20-d7c3fdedd352 for instance with vm_state building and task_state spawning.
Aug 09 10:26:28 user nova-compute[72362]: DEBUG nova.compute.manager [req-658c9864-9c93-4b44-a36e-b968961a1a5b req-aa2bf038-c1bc-4b0a-93bf-2b4e2bec282c service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received event network-vif-plugged-945c59da-d927-49a5-82e7-7c591943fcd1 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:26:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-658c9864-9c93-4b44-a36e-b968961a1a5b req-aa2bf038-c1bc-4b0a-93bf-2b4e2bec282c service nova] Acquiring lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:26:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-658c9864-9c93-4b44-a36e-b968961a1a5b req-aa2bf038-c1bc-4b0a-93bf-2b4e2bec282c service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:26:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-658c9864-9c93-4b44-a36e-b968961a1a5b req-aa2bf038-c1bc-4b0a-93bf-2b4e2bec282c service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:26:28 user nova-compute[72362]: DEBUG nova.compute.manager [req-658c9864-9c93-4b44-a36e-b968961a1a5b req-aa2bf038-c1bc-4b0a-93bf-2b4e2bec282c service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] No waiting events found dispatching network-vif-plugged-945c59da-d927-49a5-82e7-7c591943fcd1 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:26:28 user nova-compute[72362]: WARNING nova.compute.manager [req-658c9864-9c93-4b44-a36e-b968961a1a5b req-aa2bf038-c1bc-4b0a-93bf-2b4e2bec282c service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received unexpected event network-vif-plugged-945c59da-d927-49a5-82e7-7c591943fcd1 for instance with vm_state building and task_state spawning.
Aug 09 10:26:28 user nova-compute[72362]: DEBUG nova.compute.manager [req-658c9864-9c93-4b44-a36e-b968961a1a5b req-aa2bf038-c1bc-4b0a-93bf-2b4e2bec282c service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received event network-vif-plugged-945c59da-d927-49a5-82e7-7c591943fcd1 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:26:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-658c9864-9c93-4b44-a36e-b968961a1a5b req-aa2bf038-c1bc-4b0a-93bf-2b4e2bec282c service nova] Acquiring lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:26:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-658c9864-9c93-4b44-a36e-b968961a1a5b req-aa2bf038-c1bc-4b0a-93bf-2b4e2bec282c service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.009s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:26:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-658c9864-9c93-4b44-a36e-b968961a1a5b req-aa2bf038-c1bc-4b0a-93bf-2b4e2bec282c service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:26:28 user nova-compute[72362]: DEBUG nova.compute.manager [req-658c9864-9c93-4b44-a36e-b968961a1a5b req-aa2bf038-c1bc-4b0a-93bf-2b4e2bec282c service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] No waiting events found dispatching network-vif-plugged-945c59da-d927-49a5-82e7-7c591943fcd1 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:26:28 user nova-compute[72362]: WARNING nova.compute.manager [req-658c9864-9c93-4b44-a36e-b968961a1a5b req-aa2bf038-c1bc-4b0a-93bf-2b4e2bec282c service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received unexpected event network-vif-plugged-945c59da-d927-49a5-82e7-7c591943fcd1 for instance with vm_state building and task_state spawning.
Aug 09 10:26:28 user nova-compute[72362]: DEBUG nova.compute.manager [req-221162cb-d213-4ea9-a3da-20060363846c req-7b0fc02a-262b-49fc-a6dd-c09b4f82aa42 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received event network-vif-plugged-71a96106-1d45-4b94-a7da-893e8b6d92bd {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:26:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-221162cb-d213-4ea9-a3da-20060363846c req-7b0fc02a-262b-49fc-a6dd-c09b4f82aa42 service nova] Acquiring lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:26:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-221162cb-d213-4ea9-a3da-20060363846c req-7b0fc02a-262b-49fc-a6dd-c09b4f82aa42 service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:26:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-221162cb-d213-4ea9-a3da-20060363846c req-7b0fc02a-262b-49fc-a6dd-c09b4f82aa42 service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:26:28 user nova-compute[72362]: DEBUG nova.compute.manager [req-221162cb-d213-4ea9-a3da-20060363846c req-7b0fc02a-262b-49fc-a6dd-c09b4f82aa42 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] No waiting events found dispatching network-vif-plugged-71a96106-1d45-4b94-a7da-893e8b6d92bd {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:26:28 user nova-compute[72362]: WARNING nova.compute.manager [req-221162cb-d213-4ea9-a3da-20060363846c req-7b0fc02a-262b-49fc-a6dd-c09b4f82aa42 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received unexpected event network-vif-plugged-71a96106-1d45-4b94-a7da-893e8b6d92bd for instance with vm_state building and task_state spawning.
Aug 09 10:26:28 user nova-compute[72362]: DEBUG nova.compute.manager [req-221162cb-d213-4ea9-a3da-20060363846c req-7b0fc02a-262b-49fc-a6dd-c09b4f82aa42 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received event network-vif-plugged-71a96106-1d45-4b94-a7da-893e8b6d92bd {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:26:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-221162cb-d213-4ea9-a3da-20060363846c req-7b0fc02a-262b-49fc-a6dd-c09b4f82aa42 service nova] Acquiring lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:26:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-221162cb-d213-4ea9-a3da-20060363846c req-7b0fc02a-262b-49fc-a6dd-c09b4f82aa42 service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:26:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-221162cb-d213-4ea9-a3da-20060363846c req-7b0fc02a-262b-49fc-a6dd-c09b4f82aa42 service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:26:28 user nova-compute[72362]: DEBUG nova.compute.manager [req-221162cb-d213-4ea9-a3da-20060363846c req-7b0fc02a-262b-49fc-a6dd-c09b4f82aa42 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] No waiting events found dispatching network-vif-plugged-71a96106-1d45-4b94-a7da-893e8b6d92bd {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:26:28 user nova-compute[72362]: WARNING nova.compute.manager [req-221162cb-d213-4ea9-a3da-20060363846c req-7b0fc02a-262b-49fc-a6dd-c09b4f82aa42 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received unexpected event network-vif-plugged-71a96106-1d45-4b94-a7da-893e8b6d92bd for instance with vm_state building and task_state spawning.
Aug 09 10:26:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:28 user nova-compute[72362]: DEBUG nova.compute.manager [req-6dd9b781-a5e6-448b-b05e-21e7adce4f7f req-290ab561-abd7-40f4-8540-8afd1da574d7 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received event network-vif-plugged-64f56105-6893-4ab5-86bf-380874d78f8c {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:26:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-6dd9b781-a5e6-448b-b05e-21e7adce4f7f req-290ab561-abd7-40f4-8540-8afd1da574d7 service nova] Acquiring lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:26:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-6dd9b781-a5e6-448b-b05e-21e7adce4f7f req-290ab561-abd7-40f4-8540-8afd1da574d7 service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:26:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-6dd9b781-a5e6-448b-b05e-21e7adce4f7f req-290ab561-abd7-40f4-8540-8afd1da574d7 service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:26:28 user nova-compute[72362]: DEBUG nova.compute.manager [req-6dd9b781-a5e6-448b-b05e-21e7adce4f7f req-290ab561-abd7-40f4-8540-8afd1da574d7 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] No waiting events found dispatching network-vif-plugged-64f56105-6893-4ab5-86bf-380874d78f8c {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:26:28 user nova-compute[72362]: WARNING nova.compute.manager [req-6dd9b781-a5e6-448b-b05e-21e7adce4f7f req-290ab561-abd7-40f4-8540-8afd1da574d7 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received unexpected event network-vif-plugged-64f56105-6893-4ab5-86bf-380874d78f8c for instance with vm_state building and task_state spawning.
Aug 09 10:26:29 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576789.0916154, 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:26:29 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] VM Resumed (Lifecycle Event)
Aug 09 10:26:29 user nova-compute[72362]: DEBUG nova.compute.manager [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:26:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:26:29 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Instance spawned successfully.
Aug 09 10:26:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 10:26:29 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:26:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Found default for hw_cdrom_bus of ide {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:26:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Found default for hw_disk_bus of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:26:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:26:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:26:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Found default for hw_video_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:26:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Found default for hw_vif_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:26:29 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:26:29 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:26:29 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576789.095604, 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:26:29 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] VM Started (Lifecycle Event)
Aug 09 10:26:29 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:26:29 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:26:29 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:26:29 user nova-compute[72362]: INFO nova.compute.manager [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Took 13.75 seconds to spawn the instance on the hypervisor.
Aug 09 10:26:29 user nova-compute[72362]: DEBUG nova.compute.manager [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:26:29 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:29 user nova-compute[72362]: INFO nova.compute.manager [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Took 45.44 seconds to build instance.
Aug 09 10:26:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5ea2b1b6-67d6-434a-8e54-df4684ba77eb tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 45.650s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:26:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:41 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2bf8cd8-d913-4f2b-8bc7-27ea49d5e231 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:26:41 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bf8cd8-d913-4f2b-8bc7-27ea49d5e231 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:db538713-7228-48a1-b4aa-13f8234e070f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fHBTLamw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:26:41 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-c2bf8cd8-d913-4f2b-8bc7-27ea49d5e231 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:26:41 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-c2bf8cd8-d913-4f2b-8bc7-27ea49d5e231 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:26:41 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-c2bf8cd8-d913-4f2b-8bc7-27ea49d5e231 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:26:41 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-c2bf8cd8-d913-4f2b-8bc7-27ea49d5e231 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:26:41 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-c2bf8cd8-d913-4f2b-8bc7-27ea49d5e231 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db538713-7228-48a1-b4aa-13f8234e070f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:26:41 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-c2bf8cd8-d913-4f2b-8bc7-27ea49d5e231 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db538713-7228-48a1-b4aa-13f8234e070f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:26:41 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-c2bf8cd8-d913-4f2b-8bc7-27ea49d5e231 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:26:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db538713-7228-48a1-b4aa-13f8234e070f -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db538713-7228-48a1-b4aa-13f8234e070f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:41 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f35e2f-d752-4c3d-88bb-78e3e22b63a2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:41 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bf8cd8-d913-4f2b-8bc7-27ea49d5e231 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:26:41 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:26:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db538713-7228-48a1-b4aa-13f8234e070f -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db538713-7228-48a1-b4aa-13f8234e070f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:42 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0446088-431d-402f-923d-ba24658c9c9f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db538713-7228-48a1-b4aa-13f8234e070f] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bf8cd8-d913-4f2b-8bc7-27ea49d5e231 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db538713-7228-48a1-b4aa-13f8234e070f] added
Aug 09 10:26:42 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:26:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db538713-7228-48a1-b4aa-13f8234e070f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db538713-7228-48a1-b4aa-13f8234e070f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:42 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[785de73e-54de-4265-a223-e301377838a7]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bf8cd8-d913-4f2b-8bc7-27ea49d5e231 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:26:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db538713-7228-48a1-b4aa-13f8234e070f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db538713-7228-48a1-b4aa-13f8234e070f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:42 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[434c8b47-56c5-49fd-926d-a2c3fc55a4a9]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bf8cd8-d913-4f2b-8bc7-27ea49d5e231 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:26:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db538713-7228-48a1-b4aa-13f8234e070f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fHBTLamw {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db538713-7228-48a1-b4aa-13f8234e070f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fHBTLamw" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:42 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc808a5-40f4-42c2-b58b-c56b756239f9]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bf8cd8-d913-4f2b-8bc7-27ea49d5e231 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fHBTLamw'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:26:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db538713-7228-48a1-b4aa-13f8234e070f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db538713-7228-48a1-b4aa-13f8234e070f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:42 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afe61e3-0f9d-4afb-a56d-be723871a1a9]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bf8cd8-d913-4f2b-8bc7-27ea49d5e231 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:26:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:42 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[258e136f-fbec-459e-a849-8904e607d1df]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bf8cd8-d913-4f2b-8bc7-27ea49d5e231 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:26:42 user nova-compute[72362]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)
Aug 09 10:26:42 user nova-compute[72362]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:26:42 user nova-compute[72362]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e (non-flash)
Aug 09 10:26:42 user nova-compute[72362]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 (non-flash)
Aug 09 10:26:42 user nova-compute[72362]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb (non-flash)
Aug 09 10:26:42 user nova-compute[72362]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)
Aug 09 10:26:42 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:26:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bf8cd8-d913-4f2b-8bc7-27ea49d5e231 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:26:42 user nova-compute[72362]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)
Aug 09 10:26:42 user nova-compute[72362]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:26:42 user nova-compute[72362]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e (non-flash)
Aug 09 10:26:42 user nova-compute[72362]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 (non-flash)
Aug 09 10:26:42 user nova-compute[72362]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb (non-flash)
Aug 09 10:26:42 user nova-compute[72362]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)
Aug 09 10:26:42 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:26:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db538713-7228-48a1-b4aa-13f8234e070f -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db538713-7228-48a1-b4aa-13f8234e070f -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:42 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8f448e-11c8-4e75-a7be-d20b1a7c2dd8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:db538713-7228-48a1-b4aa-13f8234e070f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:db538713-7228-48a1-b4aa-13f8234e070f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bf8cd8-d913-4f2b-8bc7-27ea49d5e231 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:db538713-7228-48a1-b4aa-13f8234e070f, portal: 172.16.0.220,3260]
Aug 09 10:26:42 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:db538713-7228-48a1-b4aa-13f8234e070f, portal: 172.16.0.220,3260] successful.
Aug 09 10:26:42 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:26:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db538713-7228-48a1-b4aa-13f8234e070f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db538713-7228-48a1-b4aa-13f8234e070f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:42 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d46628-6caf-4bf4-8166-183ea8abb00a]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bf8cd8-d913-4f2b-8bc7-27ea49d5e231 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:26:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:42 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3650c21d-54d0-4546-a565-f52f70ae48d4]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db538713-7228-48a1-b4aa-13f8234e070f (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bf8cd8-d913-4f2b-8bc7-27ea49d5e231 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:26:42 user nova-compute[72362]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)
Aug 09 10:26:42 user nova-compute[72362]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:26:42 user nova-compute[72362]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e (non-flash)
Aug 09 10:26:42 user nova-compute[72362]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 (non-flash)
Aug 09 10:26:42 user nova-compute[72362]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb (non-flash)
Aug 09 10:26:42 user nova-compute[72362]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)
Aug 09 10:26:42 user nova-compute[72362]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db538713-7228-48a1-b4aa-13f8234e070f (non-flash)
Aug 09 10:26:42 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:26:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bf8cd8-d913-4f2b-8bc7-27ea49d5e231 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:26:42 user nova-compute[72362]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)
Aug 09 10:26:42 user nova-compute[72362]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:26:42 user nova-compute[72362]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e (non-flash)
Aug 09 10:26:42 user nova-compute[72362]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 (non-flash)
Aug 09 10:26:42 user nova-compute[72362]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb (non-flash)
Aug 09 10:26:42 user nova-compute[72362]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)
Aug 09 10:26:42 user nova-compute[72362]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db538713-7228-48a1-b4aa-13f8234e070f (non-flash)
Aug 09 10:26:42 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:26:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-c2bf8cd8-d913-4f2b-8bc7-27ea49d5e231 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db538713-7228-48a1-b4aa-13f8234e070f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.477s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:26:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bf8cd8-d913-4f2b-8bc7-27ea49d5e231 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:26:42 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-c2bf8cd8-d913-4f2b-8bc7-27ea49d5e231 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] HCTL ('40', '-', '-', 0) found on session 33 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:26:42 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-c2bf8cd8-d913-4f2b-8bc7-27ea49d5e231 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:26:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:42 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5c5005-5eba-4e80-94cb-229205ba18fc]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:42 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-c2bf8cd8-d913-4f2b-8bc7-27ea49d5e231 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Searching for a device in session 33 and hctl ['40', '*', '*', 0] yield: None {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:26:43 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-c2bf8cd8-d913-4f2b-8bc7-27ea49d5e231 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Searching for a device in session 33 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:26:43 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bf8cd8-d913-4f2b-8bc7-27ea49d5e231 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fHBTLamw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:26:43 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-c2bf8cd8-d913-4f2b-8bc7-27ea49d5e231 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.517s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:26:43 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bf8cd8-d913-4f2b-8bc7-27ea49d5e231 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] <== connect_volume: return (1519ms) {'type': 'block', 'scsi_wwn': '23662326330313934', 'path': '/dev/sdi'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:26:43 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2bf8cd8-d913-4f2b-8bc7-27ea49d5e231 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662326330313934', 'path': '/dev/sdi'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:26:43 user nova-compute[72362]: DEBUG nova.objects.instance [None req-c2bf8cd8-d913-4f2b-8bc7-27ea49d5e231 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lazy-loading 'flavor' on Instance uuid 4746beb1-d313-4cea-bf7b-75b507ebbdd2 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:26:43 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-c2bf8cd8-d913-4f2b-8bc7-27ea49d5e231 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 10:26:43 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:26:43 user nova-compute[72362]:   <source dev="/dev/sdi"/>
Aug 09 10:26:43 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:26:43 user nova-compute[72362]:   <serial>db538713-7228-48a1-b4aa-13f8234e070f</serial>
Aug 09 10:26:43 user nova-compute[72362]: </disk>
Aug 09 10:26:43 user nova-compute[72362]:  {{(pid=72362) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 10:26:43 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-c2bf8cd8-d913-4f2b-8bc7-27ea49d5e231 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:26:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-c2bf8cd8-d913-4f2b-8bc7-27ea49d5e231 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:26:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-c2bf8cd8-d913-4f2b-8bc7-27ea49d5e231 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] No VIF found with MAC fa:16:3e:03:05:4e, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:26:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c2bf8cd8-d913-4f2b-8bc7-27ea49d5e231 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.199s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:26:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:46 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:26:46 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Cleaning up deleted instances {{(pid=72362) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 10:26:46 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] There are 0 instances to clean {{(pid=72362) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 10:26:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Acquiring lock "09fcf27a-c6dc-4c4a-b73c-555ea2339967" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:26:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "09fcf27a-c6dc-4c4a-b73c-555ea2339967" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:26:47 user nova-compute[72362]: DEBUG nova.compute.manager [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Starting instance... {{(pid=72362) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 10:26:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:26:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:26:47 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:26:47 user nova-compute[72362]: INFO nova.compute.claims [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Claim successful on node user
Aug 09 10:26:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2542e2bd-481f-4481-a8ef-7734175587a2 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Acquiring lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:26:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2542e2bd-481f-4481-a8ef-7734175587a2 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:26:48 user nova-compute[72362]: INFO nova.compute.manager [None req-2542e2bd-481f-4481-a8ef-7734175587a2 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Detaching volume db538713-7228-48a1-b4aa-13f8234e070f
Aug 09 10:26:48 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:26:48 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:26:48 user nova-compute[72362]: INFO nova.virt.block_device [None req-2542e2bd-481f-4481-a8ef-7734175587a2 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Attempting to driver detach volume db538713-7228-48a1-b4aa-13f8234e070f from mountpoint /dev/vdb
Aug 09 10:26:48 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-2542e2bd-481f-4481-a8ef-7734175587a2 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Attempting to detach device vdb from instance 4746beb1-d313-4cea-bf7b-75b507ebbdd2 from the persistent domain config. {{(pid=72362) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 10:26:48 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-2542e2bd-481f-4481-a8ef-7734175587a2 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 10:26:48 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:26:48 user nova-compute[72362]:   <source dev="/dev/sdi"/>
Aug 09 10:26:48 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:26:48 user nova-compute[72362]:   <serial>db538713-7228-48a1-b4aa-13f8234e070f</serial>
Aug 09 10:26:48 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 10:26:48 user nova-compute[72362]: </disk>
Aug 09 10:26:48 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:26:48 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-2542e2bd-481f-4481-a8ef-7734175587a2 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Successfully detached device vdb from instance 4746beb1-d313-4cea-bf7b-75b507ebbdd2 from the persistent domain config.
Aug 09 10:26:48 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-2542e2bd-481f-4481-a8ef-7734175587a2 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4746beb1-d313-4cea-bf7b-75b507ebbdd2 from the live domain config. {{(pid=72362) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 10:26:48 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-2542e2bd-481f-4481-a8ef-7734175587a2 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 10:26:48 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:26:48 user nova-compute[72362]:   <source dev="/dev/sdi"/>
Aug 09 10:26:48 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:26:48 user nova-compute[72362]:   <serial>db538713-7228-48a1-b4aa-13f8234e070f</serial>
Aug 09 10:26:48 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 10:26:48 user nova-compute[72362]: </disk>
Aug 09 10:26:48 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:26:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.934s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:26:48 user nova-compute[72362]: DEBUG nova.compute.manager [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Start building networks asynchronously for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 10:26:48 user nova-compute[72362]: DEBUG nova.compute.manager [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Allocating IP information in the background. {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 10:26:48 user nova-compute[72362]: DEBUG nova.network.neutron [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] allocate_for_instance() {{(pid=72362) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 10:26:48 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 10:26:48 user nova-compute[72362]: DEBUG nova.compute.manager [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Start building block device mappings for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG nova.policy [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8bd184d9dcf64c6fa81bf0b7fa68a9b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb5a3be50242059591c9cbf8cc0f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72362) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG nova.compute.manager [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Start spawning the instance on the hypervisor. {{(pid=72362) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:26:49 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Creating image(s)
Aug 09 10:26:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Acquiring lock "/opt/stack/data/nova/instances/09fcf27a-c6dc-4c4a-b73c-555ea2339967/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "/opt/stack/data/nova/instances/09fcf27a-c6dc-4c4a-b73c-555ea2339967/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "/opt/stack/data/nova/instances/09fcf27a-c6dc-4c4a-b73c-555ea2339967/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Received event <DeviceRemovedEvent: 1691576809.261466, 4746beb1-d313-4cea-bf7b-75b507ebbdd2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72362) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-2542e2bd-481f-4481-a8ef-7734175587a2 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4746beb1-d313-4cea-bf7b-75b507ebbdd2 {{(pid=72362) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 10:26:49 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-2542e2bd-481f-4481-a8ef-7734175587a2 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Successfully detached device vdb from instance 4746beb1-d313-4cea-bf7b-75b507ebbdd2 from the live domain config.
Aug 09 10:26:49 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2542e2bd-481f-4481-a8ef-7734175587a2 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2542e2bd-481f-4481-a8ef-7734175587a2 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:db538713-7228-48a1-b4aa-13f8234e070f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fHBTLamw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:26:49 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-2542e2bd-481f-4481-a8ef-7734175587a2 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:26:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-2542e2bd-481f-4481-a8ef-7734175587a2 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-2542e2bd-481f-4481-a8ef-7734175587a2 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2542e2bd-481f-4481-a8ef-7734175587a2 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db538713-7228-48a1-b4aa-13f8234e070f', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fd2eb8-86f0-4ba6-9cd1-efbf106ca0c2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db538713-7228-48a1-b4aa-13f8234e070f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b1c5f6-05a0-4ce7-9950-045b11d3d557]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db538713-7228-48a1-b4aa-13f8234e070f (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2542e2bd-481f-4481-a8ef-7734175587a2 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:26:49 user nova-compute[72362]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)
Aug 09 10:26:49 user nova-compute[72362]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:26:49 user nova-compute[72362]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e (non-flash)
Aug 09 10:26:49 user nova-compute[72362]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 (non-flash)
Aug 09 10:26:49 user nova-compute[72362]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb (non-flash)
Aug 09 10:26:49 user nova-compute[72362]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)
Aug 09 10:26:49 user nova-compute[72362]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db538713-7228-48a1-b4aa-13f8234e070f (non-flash)
Aug 09 10:26:49 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2542e2bd-481f-4481-a8ef-7734175587a2 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:26:49 user nova-compute[72362]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)
Aug 09 10:26:49 user nova-compute[72362]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:26:49 user nova-compute[72362]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e (non-flash)
Aug 09 10:26:49 user nova-compute[72362]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 (non-flash)
Aug 09 10:26:49 user nova-compute[72362]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb (non-flash)
Aug 09 10:26:49 user nova-compute[72362]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)
Aug 09 10:26:49 user nova-compute[72362]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db538713-7228-48a1-b4aa-13f8234e070f (non-flash)
Aug 09 10:26:49 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2542e2bd-481f-4481-a8ef-7734175587a2 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e41bd000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db538713-7228-48a1-b4aa-13f8234e070f'): ({'sdi'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-2542e2bd-481f-4481-a8ef-7734175587a2 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Removing single pathed devices sdi {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.160s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Acquiring lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3df27a-015e-492a-97a8-e35014e25b00]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[65bb38dc-a455-4299-9d0b-a8b333da8999]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-2542e2bd-481f-4481-a8ef-7734175587a2 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Flushing IO for device /dev/sdi {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b154d632-6ee4-4a66-97f0-18cc48fdefd4]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-2542e2bd-481f-4481-a8ef-7734175587a2 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.051s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11dc4ea-c9aa-4d92-a542-91b99e45f74b]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-2542e2bd-481f-4481-a8ef-7734175587a2 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-2542e2bd-481f-4481-a8ef-7734175587a2 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] SCSI volumes sdi have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2542e2bd-481f-4481-a8ef-7734175587a2 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db538713-7228-48a1-b4aa-13f8234e070f')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.177s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/09fcf27a-c6dc-4c4a-b73c-555ea2339967/disk 1073741824 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db538713-7228-48a1-b4aa-13f8234e070f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db538713-7228-48a1-b4aa-13f8234e070f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4b3083-a27e-4ee2-8bf5-073f87b4e106]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2542e2bd-481f-4481-a8ef-7734175587a2 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db538713-7228-48a1-b4aa-13f8234e070f -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/09fcf27a-c6dc-4c4a-b73c-555ea2339967/disk 1073741824" returned: 0 in 0.064s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db538713-7228-48a1-b4aa-13f8234e070f -p 172.16.0.220:3260 --logout" returned: 0 in 0.099s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d83b98-89c8-4d34-90ef-e91d4ff1f748]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:db538713-7228-48a1-b4aa-13f8234e070f, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:db538713-7228-48a1-b4aa-13f8234e070f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2542e2bd-481f-4481-a8ef-7734175587a2 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:db538713-7228-48a1-b4aa-13f8234e070f, portal: 172.16.0.220,3260]
Aug 09 10:26:49 user nova-compute[72362]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:db538713-7228-48a1-b4aa-13f8234e070f, portal: 172.16.0.220,3260] successful.
Aug 09 10:26:49 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db538713-7228-48a1-b4aa-13f8234e070f -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db538713-7228-48a1-b4aa-13f8234e070f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94fed75-8a64-46a1-bac8-0c27ed2c344a]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2542e2bd-481f-4481-a8ef-7734175587a2 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-2542e2bd-481f-4481-a8ef-7734175587a2 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.477s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2542e2bd-481f-4481-a8ef-7734175587a2 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] <== disconnect_volume: return (479ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2542e2bd-481f-4481-a8ef-7734175587a2 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.155s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Checking if we can resize image /opt/stack/data/nova/instances/09fcf27a-c6dc-4c4a-b73c-555ea2339967/disk. size=1073741824 {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09fcf27a-c6dc-4c4a-b73c-555ea2339967/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09fcf27a-c6dc-4c4a-b73c-555ea2339967/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Cannot resize image /opt/stack/data/nova/instances/09fcf27a-c6dc-4c4a-b73c-555ea2339967/disk to a smaller size. {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 10:26:49 user nova-compute[72362]: DEBUG nova.objects.instance [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lazy-loading 'migration_context' on Instance uuid 09fcf27a-c6dc-4c4a-b73c-555ea2339967 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:26:50 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Created local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 10:26:50 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Ensure instance console log exists: /opt/stack/data/nova/instances/09fcf27a-c6dc-4c4a-b73c-555ea2339967/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:26:50 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:26:50 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:26:50 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:26:50 user nova-compute[72362]: DEBUG nova.network.neutron [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Successfully created port: f99044c7-fa30-4e74-b2f3-0e937c17b02e {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:26:50 user nova-compute[72362]: DEBUG nova.objects.instance [None req-2542e2bd-481f-4481-a8ef-7734175587a2 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lazy-loading 'flavor' on Instance uuid 4746beb1-d313-4cea-bf7b-75b507ebbdd2 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:26:50 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2542e2bd-481f-4481-a8ef-7734175587a2 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.190s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:26:51 user nova-compute[72362]: DEBUG nova.network.neutron [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Successfully updated port: f99044c7-fa30-4e74-b2f3-0e937c17b02e {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:26:51 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Acquiring lock "refresh_cache-09fcf27a-c6dc-4c4a-b73c-555ea2339967" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:26:51 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Acquired lock "refresh_cache-09fcf27a-c6dc-4c4a-b73c-555ea2339967" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:26:51 user nova-compute[72362]: DEBUG nova.network.neutron [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:26:51 user nova-compute[72362]: DEBUG nova.compute.manager [req-7f2e7f08-0cf9-47db-bf87-13a0f5216a32 req-f17af3b3-5378-40c3-a32a-ae8293c5f764 service nova] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Received event network-changed-f99044c7-fa30-4e74-b2f3-0e937c17b02e {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:26:51 user nova-compute[72362]: DEBUG nova.compute.manager [req-7f2e7f08-0cf9-47db-bf87-13a0f5216a32 req-f17af3b3-5378-40c3-a32a-ae8293c5f764 service nova] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Refreshing instance network info cache due to event network-changed-f99044c7-fa30-4e74-b2f3-0e937c17b02e. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:26:51 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-7f2e7f08-0cf9-47db-bf87-13a0f5216a32 req-f17af3b3-5378-40c3-a32a-ae8293c5f764 service nova] Acquiring lock "refresh_cache-09fcf27a-c6dc-4c4a-b73c-555ea2339967" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:26:51 user nova-compute[72362]: DEBUG nova.network.neutron [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:26:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:51 user nova-compute[72362]: DEBUG nova.network.neutron [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Updating instance_info_cache with network_info: [{"id": "f99044c7-fa30-4e74-b2f3-0e937c17b02e", "address": "fa:16:3e:40:57:6c", "network": {"id": "5fe3b8dc-aa50-4e53-bb4d-2dcb773e501e", "bridge": "br-int", "label": "tempest-TestStampPattern-205380618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bb5a3be50242059591c9cbf8cc0f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf99044c7-fa", "ovs_interfaceid": "f99044c7-fa30-4e74-b2f3-0e937c17b02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:26:51 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Releasing lock "refresh_cache-09fcf27a-c6dc-4c4a-b73c-555ea2339967" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:26:51 user nova-compute[72362]: DEBUG nova.compute.manager [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Instance network_info: |[{"id": "f99044c7-fa30-4e74-b2f3-0e937c17b02e", "address": "fa:16:3e:40:57:6c", "network": {"id": "5fe3b8dc-aa50-4e53-bb4d-2dcb773e501e", "bridge": "br-int", "label": "tempest-TestStampPattern-205380618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bb5a3be50242059591c9cbf8cc0f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf99044c7-fa", "ovs_interfaceid": "f99044c7-fa30-4e74-b2f3-0e937c17b02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 10:26:51 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-7f2e7f08-0cf9-47db-bf87-13a0f5216a32 req-f17af3b3-5378-40c3-a32a-ae8293c5f764 service nova] Acquired lock "refresh_cache-09fcf27a-c6dc-4c4a-b73c-555ea2339967" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:26:51 user nova-compute[72362]: DEBUG nova.network.neutron [req-7f2e7f08-0cf9-47db-bf87-13a0f5216a32 req-f17af3b3-5378-40c3-a32a-ae8293c5f764 service nova] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Refreshing network info cache for port f99044c7-fa30-4e74-b2f3-0e937c17b02e {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:26:51 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Start _get_guest_xml network_info=[{"id": "f99044c7-fa30-4e74-b2f3-0e937c17b02e", "address": "fa:16:3e:40:57:6c", "network": {"id": "5fe3b8dc-aa50-4e53-bb4d-2dcb773e501e", "bridge": "br-int", "label": "tempest-TestStampPattern-205380618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bb5a3be50242059591c9cbf8cc0f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf99044c7-fa", "ovs_interfaceid": "f99044c7-fa30-4e74-b2f3-0e937c17b02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': 'a08d1a11-49eb-4212-a351-e11ee9553b95'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:26:51 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:26:51 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:26:51 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:26:51 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:26:51 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:26:51 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:26:51 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:26:51 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:26:51 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:26:51 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:26:51 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:26:51 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:26:51 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:26:51 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:26:51 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:26:51 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:26:51 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:26:51 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:26:51 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:26:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-317416098',display_name='tempest-TestStampPattern-server-317416098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-317416098',id=24,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKLVu2dFvNs/80YFheQzFf8fh5quQ6+XNPPKMAWty1o9Sg/SwStPSnUjW/MsHeKbh1Vmc8aVVjHIMDgyHJuEjaJiur5QU2xWgYQwqf957GAtOQZW38FZ3ltyAQ4vCaq5g==',key_name='tempest-TestStampPattern-2134506676',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7bb5a3be50242059591c9cbf8cc0f9d',ramdisk_id='',reservation_id='r-ax8392lz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1731024477',owner_user_name='tempest-TestStampPattern-1731024477-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:26:49Z,user_data=None,user_id='8bd184d9dcf64c6fa81bf0b7fa68a9b3',uuid=09fcf27a-c6dc-4c4a-b73c-555ea2339967,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f99044c7-fa30-4e74-b2f3-0e937c17b02e", "address": "fa:16:3e:40:57:6c", "network": {"id": "5fe3b8dc-aa50-4e53-bb4d-2dcb773e501e", "bridge": "br-int", "label": "tempest-TestStampPattern-205380618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bb5a3be50242059591c9cbf8cc0f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf99044c7-fa", "ovs_interfaceid": "f99044c7-fa30-4e74-b2f3-0e937c17b02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:26:51 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Converting VIF {"id": "f99044c7-fa30-4e74-b2f3-0e937c17b02e", "address": "fa:16:3e:40:57:6c", "network": {"id": "5fe3b8dc-aa50-4e53-bb4d-2dcb773e501e", "bridge": "br-int", "label": "tempest-TestStampPattern-205380618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bb5a3be50242059591c9cbf8cc0f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf99044c7-fa", "ovs_interfaceid": "f99044c7-fa30-4e74-b2f3-0e937c17b02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:26:51 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:57:6c,bridge_name='br-int',has_traffic_filtering=True,id=f99044c7-fa30-4e74-b2f3-0e937c17b02e,network=Network(5fe3b8dc-aa50-4e53-bb4d-2dcb773e501e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf99044c7-fa') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:26:51 user nova-compute[72362]: DEBUG nova.objects.instance [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lazy-loading 'pci_devices' on Instance uuid 09fcf27a-c6dc-4c4a-b73c-555ea2339967 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:26:51 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:26:51 user nova-compute[72362]:   <uuid>09fcf27a-c6dc-4c4a-b73c-555ea2339967</uuid>
Aug 09 10:26:51 user nova-compute[72362]:   <name>instance-00000018</name>
Aug 09 10:26:51 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:26:51 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:26:51 user nova-compute[72362]:   <metadata>
Aug 09 10:26:51 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:26:51 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:26:51 user nova-compute[72362]:       <nova:name>tempest-TestStampPattern-server-317416098</nova:name>
Aug 09 10:26:51 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:26:51</nova:creationTime>
Aug 09 10:26:51 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:26:51 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:26:51 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:26:51 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:26:51 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:26:51 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:26:51 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:26:51 user nova-compute[72362]:       <nova:owner>
Aug 09 10:26:51 user nova-compute[72362]:         <nova:user uuid="8bd184d9dcf64c6fa81bf0b7fa68a9b3">tempest-TestStampPattern-1731024477-project-member</nova:user>
Aug 09 10:26:51 user nova-compute[72362]:         <nova:project uuid="d7bb5a3be50242059591c9cbf8cc0f9d">tempest-TestStampPattern-1731024477</nova:project>
Aug 09 10:26:51 user nova-compute[72362]:       </nova:owner>
Aug 09 10:26:51 user nova-compute[72362]:       <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:26:51 user nova-compute[72362]:       <nova:ports>
Aug 09 10:26:51 user nova-compute[72362]:         <nova:port uuid="f99044c7-fa30-4e74-b2f3-0e937c17b02e">
Aug 09 10:26:51 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 09 10:26:51 user nova-compute[72362]:         </nova:port>
Aug 09 10:26:51 user nova-compute[72362]:       </nova:ports>
Aug 09 10:26:51 user nova-compute[72362]:     </nova:instance>
Aug 09 10:26:51 user nova-compute[72362]:   </metadata>
Aug 09 10:26:51 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:26:51 user nova-compute[72362]:     <system>
Aug 09 10:26:51 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:26:51 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:26:51 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:26:51 user nova-compute[72362]:       <entry name="serial">09fcf27a-c6dc-4c4a-b73c-555ea2339967</entry>
Aug 09 10:26:51 user nova-compute[72362]:       <entry name="uuid">09fcf27a-c6dc-4c4a-b73c-555ea2339967</entry>
Aug 09 10:26:51 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:26:51 user nova-compute[72362]:     </system>
Aug 09 10:26:51 user nova-compute[72362]:   </sysinfo>
Aug 09 10:26:51 user nova-compute[72362]:   <os>
Aug 09 10:26:51 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:26:51 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:26:51 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:26:51 user nova-compute[72362]:   </os>
Aug 09 10:26:51 user nova-compute[72362]:   <features>
Aug 09 10:26:51 user nova-compute[72362]:     <acpi/>
Aug 09 10:26:51 user nova-compute[72362]:     <apic/>
Aug 09 10:26:51 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:26:51 user nova-compute[72362]:   </features>
Aug 09 10:26:51 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:26:51 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:26:51 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:26:51 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:26:51 user nova-compute[72362]:   </clock>
Aug 09 10:26:51 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:26:51 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:26:51 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:26:51 user nova-compute[72362]:   </cpu>
Aug 09 10:26:51 user nova-compute[72362]:   <devices>
Aug 09 10:26:51 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:26:51 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:26:51 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/09fcf27a-c6dc-4c4a-b73c-555ea2339967/disk"/>
Aug 09 10:26:51 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:26:51 user nova-compute[72362]:     </disk>
Aug 09 10:26:51 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:26:51 user nova-compute[72362]:       <mac address="fa:16:3e:40:57:6c"/>
Aug 09 10:26:51 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:26:51 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:26:51 user nova-compute[72362]:       <target dev="tapf99044c7-fa"/>
Aug 09 10:26:51 user nova-compute[72362]:     </interface>
Aug 09 10:26:51 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:26:51 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/09fcf27a-c6dc-4c4a-b73c-555ea2339967/console.log" append="off"/>
Aug 09 10:26:51 user nova-compute[72362]:     </serial>
Aug 09 10:26:51 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:26:51 user nova-compute[72362]:     <video>
Aug 09 10:26:51 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:26:51 user nova-compute[72362]:     </video>
Aug 09 10:26:51 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:26:51 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:26:51 user nova-compute[72362]:     </rng>
Aug 09 10:26:51 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:26:51 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:26:51 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:26:51 user nova-compute[72362]:     </memballoon>
Aug 09 10:26:51 user nova-compute[72362]:   </devices>
Aug 09 10:26:51 user nova-compute[72362]: </domain>
Aug 09 10:26:51 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:26:51 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:26:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-317416098',display_name='tempest-TestStampPattern-server-317416098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-317416098',id=24,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKLVu2dFvNs/80YFheQzFf8fh5quQ6+XNPPKMAWty1o9Sg/SwStPSnUjW/MsHeKbh1Vmc8aVVjHIMDgyHJuEjaJiur5QU2xWgYQwqf957GAtOQZW38FZ3ltyAQ4vCaq5g==',key_name='tempest-TestStampPattern-2134506676',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7bb5a3be50242059591c9cbf8cc0f9d',ramdisk_id='',reservation_id='r-ax8392lz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1731024477',owner_user_name='tempest-TestStampPattern-1731024477-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:26:49Z,user_data=None,user_id='8bd184d9dcf64c6fa81bf0b7fa68a9b3',uuid=09fcf27a-c6dc-4c4a-b73c-555ea2339967,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f99044c7-fa30-4e74-b2f3-0e937c17b02e", "address": "fa:16:3e:40:57:6c", "network": {"id": "5fe3b8dc-aa50-4e53-bb4d-2dcb773e501e", "bridge": "br-int", "label": "tempest-TestStampPattern-205380618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bb5a3be50242059591c9cbf8cc0f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf99044c7-fa", "ovs_interfaceid": "f99044c7-fa30-4e74-b2f3-0e937c17b02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:26:51 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Converting VIF {"id": "f99044c7-fa30-4e74-b2f3-0e937c17b02e", "address": "fa:16:3e:40:57:6c", "network": {"id": "5fe3b8dc-aa50-4e53-bb4d-2dcb773e501e", "bridge": "br-int", "label": "tempest-TestStampPattern-205380618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bb5a3be50242059591c9cbf8cc0f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf99044c7-fa", "ovs_interfaceid": "f99044c7-fa30-4e74-b2f3-0e937c17b02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:26:51 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:57:6c,bridge_name='br-int',has_traffic_filtering=True,id=f99044c7-fa30-4e74-b2f3-0e937c17b02e,network=Network(5fe3b8dc-aa50-4e53-bb4d-2dcb773e501e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf99044c7-fa') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:26:51 user nova-compute[72362]: DEBUG os_vif [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:57:6c,bridge_name='br-int',has_traffic_filtering=True,id=f99044c7-fa30-4e74-b2f3-0e937c17b02e,network=Network(5fe3b8dc-aa50-4e53-bb4d-2dcb773e501e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf99044c7-fa') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:26:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:26:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:26:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf99044c7-fa, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:26:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf99044c7-fa, col_values=(('external_ids', {'iface-id': 'f99044c7-fa30-4e74-b2f3-0e937c17b02e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:57:6c', 'vm-uuid': '09fcf27a-c6dc-4c4a-b73c-555ea2339967'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:26:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:26:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:51 user nova-compute[72362]: INFO os_vif [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:57:6c,bridge_name='br-int',has_traffic_filtering=True,id=f99044c7-fa30-4e74-b2f3-0e937c17b02e,network=Network(5fe3b8dc-aa50-4e53-bb4d-2dcb773e501e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf99044c7-fa')
Aug 09 10:26:52 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:26:52 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] No VIF found with MAC fa:16:3e:40:57:6c, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:26:52 user nova-compute[72362]: DEBUG nova.network.neutron [req-7f2e7f08-0cf9-47db-bf87-13a0f5216a32 req-f17af3b3-5378-40c3-a32a-ae8293c5f764 service nova] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Updated VIF entry in instance network info cache for port f99044c7-fa30-4e74-b2f3-0e937c17b02e. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:26:52 user nova-compute[72362]: DEBUG nova.network.neutron [req-7f2e7f08-0cf9-47db-bf87-13a0f5216a32 req-f17af3b3-5378-40c3-a32a-ae8293c5f764 service nova] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Updating instance_info_cache with network_info: [{"id": "f99044c7-fa30-4e74-b2f3-0e937c17b02e", "address": "fa:16:3e:40:57:6c", "network": {"id": "5fe3b8dc-aa50-4e53-bb4d-2dcb773e501e", "bridge": "br-int", "label": "tempest-TestStampPattern-205380618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bb5a3be50242059591c9cbf8cc0f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf99044c7-fa", "ovs_interfaceid": "f99044c7-fa30-4e74-b2f3-0e937c17b02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:26:52 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-7f2e7f08-0cf9-47db-bf87-13a0f5216a32 req-f17af3b3-5378-40c3-a32a-ae8293c5f764 service nova] Releasing lock "refresh_cache-09fcf27a-c6dc-4c4a-b73c-555ea2339967" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:26:52 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:26:53 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:53 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:53 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:53 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:54 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:54 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:54 user nova-compute[72362]: DEBUG nova.compute.manager [req-abc529e0-c108-4486-8f57-92735259bed8 req-b08b9289-a829-4ad5-893f-b79be222ca39 service nova] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Received event network-vif-plugged-f99044c7-fa30-4e74-b2f3-0e937c17b02e {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:26:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-abc529e0-c108-4486-8f57-92735259bed8 req-b08b9289-a829-4ad5-893f-b79be222ca39 service nova] Acquiring lock "09fcf27a-c6dc-4c4a-b73c-555ea2339967-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:26:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-abc529e0-c108-4486-8f57-92735259bed8 req-b08b9289-a829-4ad5-893f-b79be222ca39 service nova] Lock "09fcf27a-c6dc-4c4a-b73c-555ea2339967-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:26:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-abc529e0-c108-4486-8f57-92735259bed8 req-b08b9289-a829-4ad5-893f-b79be222ca39 service nova] Lock "09fcf27a-c6dc-4c4a-b73c-555ea2339967-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:26:54 user nova-compute[72362]: DEBUG nova.compute.manager [req-abc529e0-c108-4486-8f57-92735259bed8 req-b08b9289-a829-4ad5-893f-b79be222ca39 service nova] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] No waiting events found dispatching network-vif-plugged-f99044c7-fa30-4e74-b2f3-0e937c17b02e {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:26:54 user nova-compute[72362]: WARNING nova.compute.manager [req-abc529e0-c108-4486-8f57-92735259bed8 req-b08b9289-a829-4ad5-893f-b79be222ca39 service nova] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Received unexpected event network-vif-plugged-f99044c7-fa30-4e74-b2f3-0e937c17b02e for instance with vm_state building and task_state spawning.
Aug 09 10:26:55 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:55 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576815.7120821, 09fcf27a-c6dc-4c4a-b73c-555ea2339967 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:26:55 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] VM Resumed (Lifecycle Event)
Aug 09 10:26:55 user nova-compute[72362]: DEBUG nova.compute.manager [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:26:55 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:26:55 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Instance spawned successfully.
Aug 09 10:26:55 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 10:26:55 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:26:55 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:26:55 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Found default for hw_cdrom_bus of ide {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:26:55 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Found default for hw_disk_bus of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:26:55 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:26:55 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:26:55 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Found default for hw_video_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:26:55 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Found default for hw_vif_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:26:55 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:26:55 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576815.7138023, 09fcf27a-c6dc-4c4a-b73c-555ea2339967 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:26:55 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] VM Started (Lifecycle Event)
Aug 09 10:26:55 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:26:55 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:26:55 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:26:55 user nova-compute[72362]: INFO nova.compute.manager [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Took 6.65 seconds to spawn the instance on the hypervisor.
Aug 09 10:26:55 user nova-compute[72362]: DEBUG nova.compute.manager [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:26:55 user nova-compute[72362]: INFO nova.compute.manager [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Took 8.09 seconds to build instance.
Aug 09 10:26:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b89d9ff9-f1ac-4e73-8135-bdd82c07f190 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "09fcf27a-c6dc-4c4a-b73c-555ea2339967" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.192s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:26:55 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:26:56 user nova-compute[72362]: DEBUG nova.compute.manager [req-c124fc9d-893b-48ee-93ae-6449bf71cfd1 req-f11900ae-7b0d-4792-9df9-50dd0d587bda service nova] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Received event network-vif-plugged-f99044c7-fa30-4e74-b2f3-0e937c17b02e {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:26:56 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c124fc9d-893b-48ee-93ae-6449bf71cfd1 req-f11900ae-7b0d-4792-9df9-50dd0d587bda service nova] Acquiring lock "09fcf27a-c6dc-4c4a-b73c-555ea2339967-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:26:56 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c124fc9d-893b-48ee-93ae-6449bf71cfd1 req-f11900ae-7b0d-4792-9df9-50dd0d587bda service nova] Lock "09fcf27a-c6dc-4c4a-b73c-555ea2339967-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:26:56 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c124fc9d-893b-48ee-93ae-6449bf71cfd1 req-f11900ae-7b0d-4792-9df9-50dd0d587bda service nova] Lock "09fcf27a-c6dc-4c4a-b73c-555ea2339967-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:26:56 user nova-compute[72362]: DEBUG nova.compute.manager [req-c124fc9d-893b-48ee-93ae-6449bf71cfd1 req-f11900ae-7b0d-4792-9df9-50dd0d587bda service nova] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] No waiting events found dispatching network-vif-plugged-f99044c7-fa30-4e74-b2f3-0e937c17b02e {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:26:56 user nova-compute[72362]: WARNING nova.compute.manager [req-c124fc9d-893b-48ee-93ae-6449bf71cfd1 req-f11900ae-7b0d-4792-9df9-50dd0d587bda service nova] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Received unexpected event network-vif-plugged-f99044c7-fa30-4e74-b2f3-0e937c17b02e for instance with vm_state active and task_state None.
Aug 09 10:26:56 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:56 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:26:57 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:26:57 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:26:57 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 10:26:58 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:26:58 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 10:26:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "refresh_cache-a6000393-6044-4b54-ac0b-1d631e2ed0ae" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:26:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquired lock "refresh_cache-a6000393-6044-4b54-ac0b-1d631e2ed0ae" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:26:59 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Forcefully refreshing network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 10:26:59 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Updating instance_info_cache with network_info: [{"id": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "address": "fa:16:3e:6e:b0:73", "network": {"id": "7358b925-3211-4419-84eb-df6967f5ea8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1360753488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dac04663e2f45378cc0e466740342d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c0230bc-c7", "ovs_interfaceid": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:26:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Releasing lock "refresh_cache-a6000393-6044-4b54-ac0b-1d631e2ed0ae" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:26:59 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Updated the network info_cache for instance {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 10:26:59 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:26:59 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:27:00 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:01 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:27:03 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:27:03 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:07 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:27:08 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:27:08 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:27:08 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:27:08 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 10:27:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09fcf27a-c6dc-4c4a-b73c-555ea2339967/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09fcf27a-c6dc-4c4a-b73c-555ea2339967/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09fcf27a-c6dc-4c4a-b73c-555ea2339967/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09fcf27a-c6dc-4c4a-b73c-555ea2339967/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:08 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:27:08 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:27:08 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:27:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:09 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:09 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:09 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:09 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:09 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:27:09 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:27:09 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4746beb1-d313-4cea-bf7b-75b507ebbdd2/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:09 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4746beb1-d313-4cea-bf7b-75b507ebbdd2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:09 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4746beb1-d313-4cea-bf7b-75b507ebbdd2/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:09 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4746beb1-d313-4cea-bf7b-75b507ebbdd2/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:09 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:27:09 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:09 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:09 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:09 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:09 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:27:10 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:27:10 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:27:10 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=7588MB free_disk=25.318775177001953GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 10:27:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:27:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:27:10 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 8e055c58-a365-4f18-a6e3-377e32e2189d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:27:10 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:27:10 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 4746beb1-d313-4cea-bf7b-75b507ebbdd2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:27:10 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance a6000393-6044-4b54-ac0b-1d631e2ed0ae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:27:10 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 30213e67-6b1d-4d97-a971-1544335d02fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:27:10 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:27:10 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 8d42f648-8616-4974-b416-0b6534b002cc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:27:10 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 09fcf27a-c6dc-4c4a-b73c-555ea2339967 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:27:10 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 10:27:10 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 10:27:10 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Refreshing inventories for resource provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 10:27:10 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Updating ProviderTree inventory for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 10:27:10 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Updating inventory in ProviderTree for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 10:27:10 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Refreshing aggregate associations for resource provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d, aggregates: None {{(pid=72362) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 10:27:10 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Refreshing trait associations for resource provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE41,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=72362) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 10:27:11 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:27:11 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:27:11 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 10:27:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.751s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:27:11 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:27:11 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72362) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 10:27:11 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:11 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:12 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Acquiring lock "f4087716-c913-48db-886e-2f21d1238c66" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:27:12 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Lock "f4087716-c913-48db-886e-2f21d1238c66" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:27:12 user nova-compute[72362]: DEBUG nova.compute.manager [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] [instance: f4087716-c913-48db-886e-2f21d1238c66] Starting instance... {{(pid=72362) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 10:27:12 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:27:12 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:27:12 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:27:12 user nova-compute[72362]: INFO nova.compute.claims [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] [instance: f4087716-c913-48db-886e-2f21d1238c66] Claim successful on node user
Aug 09 10:27:13 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:27:13 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:27:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.397s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:27:13 user nova-compute[72362]: DEBUG nova.compute.manager [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] [instance: f4087716-c913-48db-886e-2f21d1238c66] Start building networks asynchronously for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 10:27:13 user nova-compute[72362]: DEBUG nova.compute.manager [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] [instance: f4087716-c913-48db-886e-2f21d1238c66] Allocating IP information in the background. {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 10:27:13 user nova-compute[72362]: DEBUG nova.network.neutron [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] [instance: f4087716-c913-48db-886e-2f21d1238c66] allocate_for_instance() {{(pid=72362) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 10:27:13 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] [instance: f4087716-c913-48db-886e-2f21d1238c66] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 10:27:13 user nova-compute[72362]: DEBUG nova.compute.manager [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] [instance: f4087716-c913-48db-886e-2f21d1238c66] Start building block device mappings for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 10:27:13 user nova-compute[72362]: DEBUG nova.policy [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '30a526d59c834b44b4eea04eb4141559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66f472891e4aa18010200536e8f4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72362) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 10:27:13 user nova-compute[72362]: DEBUG nova.compute.manager [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] [instance: f4087716-c913-48db-886e-2f21d1238c66] Start spawning the instance on the hypervisor. {{(pid=72362) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 10:27:13 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] [instance: f4087716-c913-48db-886e-2f21d1238c66] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:27:13 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] [instance: f4087716-c913-48db-886e-2f21d1238c66] Creating image(s)
Aug 09 10:27:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Acquiring lock "/opt/stack/data/nova/instances/f4087716-c913-48db-886e-2f21d1238c66/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:27:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Lock "/opt/stack/data/nova/instances/f4087716-c913-48db-886e-2f21d1238c66/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:27:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Lock "/opt/stack/data/nova/instances/f4087716-c913-48db-886e-2f21d1238c66/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:27:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.141s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Acquiring lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:27:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:27:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.131s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/f4087716-c913-48db-886e-2f21d1238c66/disk 1073741824 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/f4087716-c913-48db-886e-2f21d1238c66/disk 1073741824" returned: 0 in 0.050s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:27:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.144s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:14 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f4087716-c913-48db-886e-2f21d1238c66/disk. size=1073741824 {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 10:27:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4087716-c913-48db-886e-2f21d1238c66/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:14 user nova-compute[72362]: DEBUG nova.network.neutron [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] [instance: f4087716-c913-48db-886e-2f21d1238c66] Successfully created port: 357779ea-2646-4d4b-926d-b069e0ae2aa2 {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:27:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4087716-c913-48db-886e-2f21d1238c66/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:14 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Cannot resize image /opt/stack/data/nova/instances/f4087716-c913-48db-886e-2f21d1238c66/disk to a smaller size. {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 10:27:14 user nova-compute[72362]: DEBUG nova.objects.instance [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Lazy-loading 'migration_context' on Instance uuid f4087716-c913-48db-886e-2f21d1238c66 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:27:14 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] [instance: f4087716-c913-48db-886e-2f21d1238c66] Created local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 10:27:14 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] [instance: f4087716-c913-48db-886e-2f21d1238c66] Ensure instance console log exists: /opt/stack/data/nova/instances/f4087716-c913-48db-886e-2f21d1238c66/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:27:14 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:27:14 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:27:14 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:27:15 user nova-compute[72362]: DEBUG nova.network.neutron [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] [instance: f4087716-c913-48db-886e-2f21d1238c66] Successfully updated port: 357779ea-2646-4d4b-926d-b069e0ae2aa2 {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:27:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Acquiring lock "refresh_cache-f4087716-c913-48db-886e-2f21d1238c66" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:27:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Acquired lock "refresh_cache-f4087716-c913-48db-886e-2f21d1238c66" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:27:15 user nova-compute[72362]: DEBUG nova.network.neutron [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] [instance: f4087716-c913-48db-886e-2f21d1238c66] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:27:15 user nova-compute[72362]: DEBUG nova.compute.manager [req-86df359f-5998-437e-a543-1e3103b1ce6a req-5d0df0eb-0206-4abf-8296-688dd30c01bb service nova] [instance: f4087716-c913-48db-886e-2f21d1238c66] Received event network-changed-357779ea-2646-4d4b-926d-b069e0ae2aa2 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:27:15 user nova-compute[72362]: DEBUG nova.compute.manager [req-86df359f-5998-437e-a543-1e3103b1ce6a req-5d0df0eb-0206-4abf-8296-688dd30c01bb service nova] [instance: f4087716-c913-48db-886e-2f21d1238c66] Refreshing instance network info cache due to event network-changed-357779ea-2646-4d4b-926d-b069e0ae2aa2. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:27:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-86df359f-5998-437e-a543-1e3103b1ce6a req-5d0df0eb-0206-4abf-8296-688dd30c01bb service nova] Acquiring lock "refresh_cache-f4087716-c913-48db-886e-2f21d1238c66" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:27:15 user nova-compute[72362]: DEBUG nova.network.neutron [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] [instance: f4087716-c913-48db-886e-2f21d1238c66] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:27:15 user nova-compute[72362]: DEBUG nova.network.neutron [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] [instance: f4087716-c913-48db-886e-2f21d1238c66] Updating instance_info_cache with network_info: [{"id": "357779ea-2646-4d4b-926d-b069e0ae2aa2", "address": "fa:16:3e:d9:6f:46", "network": {"id": "5b9407cc-c008-48b3-b93d-ed1ba23bcd90", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-399083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a66f472891e4aa18010200536e8f4f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap357779ea-26", "ovs_interfaceid": "357779ea-2646-4d4b-926d-b069e0ae2aa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:27:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Releasing lock "refresh_cache-f4087716-c913-48db-886e-2f21d1238c66" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:27:15 user nova-compute[72362]: DEBUG nova.compute.manager [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] [instance: f4087716-c913-48db-886e-2f21d1238c66] Instance network_info: |[{"id": "357779ea-2646-4d4b-926d-b069e0ae2aa2", "address": "fa:16:3e:d9:6f:46", "network": {"id": "5b9407cc-c008-48b3-b93d-ed1ba23bcd90", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-399083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a66f472891e4aa18010200536e8f4f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap357779ea-26", "ovs_interfaceid": "357779ea-2646-4d4b-926d-b069e0ae2aa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 10:27:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-86df359f-5998-437e-a543-1e3103b1ce6a req-5d0df0eb-0206-4abf-8296-688dd30c01bb service nova] Acquired lock "refresh_cache-f4087716-c913-48db-886e-2f21d1238c66" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:27:15 user nova-compute[72362]: DEBUG nova.network.neutron [req-86df359f-5998-437e-a543-1e3103b1ce6a req-5d0df0eb-0206-4abf-8296-688dd30c01bb service nova] [instance: f4087716-c913-48db-886e-2f21d1238c66] Refreshing network info cache for port 357779ea-2646-4d4b-926d-b069e0ae2aa2 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:27:15 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] [instance: f4087716-c913-48db-886e-2f21d1238c66] Start _get_guest_xml network_info=[{"id": "357779ea-2646-4d4b-926d-b069e0ae2aa2", "address": "fa:16:3e:d9:6f:46", "network": {"id": "5b9407cc-c008-48b3-b93d-ed1ba23bcd90", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-399083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a66f472891e4aa18010200536e8f4f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap357779ea-26", "ovs_interfaceid": "357779ea-2646-4d4b-926d-b069e0ae2aa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': 'a08d1a11-49eb-4212-a351-e11ee9553b95'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:27:15 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:27:15 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:27:15 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:27:15 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:27:15 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:27:15 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:27:15 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:27:15 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:27:15 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:27:15 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:27:15 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:27:15 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:27:15 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:27:15 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:27:15 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:27:15 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:27:15 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:27:15 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:27:15 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:27:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-758890688',display_name='tempest-TestServerVolumeAttachmentScenario-server-758890688',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-758890688',id=25,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDg4F13idmURqiWtNU+qBvKofHOBiyrWkUEpu5CygWpmgvhhgcdsZiUXe11Me9S5M51qSnDe7eFBU62NU8km2DW3eb2LAFIK5qAztxD23xiypjEvyaFKNDVOIndnRc2kRg==',key_name='tempest-keypair-5128969',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a66f472891e4aa18010200536e8f4f1',ramdisk_id='',reservation_id='r-7cu4q6wu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1243199391',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1243199391-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:27:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30a526d59c834b44b4eea04eb4141559',uuid=f4087716-c913-48db-886e-2f21d1238c66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "357779ea-2646-4d4b-926d-b069e0ae2aa2", "address": "fa:16:3e:d9:6f:46", "network": {"id": "5b9407cc-c008-48b3-b93d-ed1ba23bcd90", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-399083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a66f472891e4aa18010200536e8f4f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap357779ea-26", "ovs_interfaceid": "357779ea-2646-4d4b-926d-b069e0ae2aa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:27:15 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Converting VIF {"id": "357779ea-2646-4d4b-926d-b069e0ae2aa2", "address": "fa:16:3e:d9:6f:46", "network": {"id": "5b9407cc-c008-48b3-b93d-ed1ba23bcd90", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-399083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a66f472891e4aa18010200536e8f4f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap357779ea-26", "ovs_interfaceid": "357779ea-2646-4d4b-926d-b069e0ae2aa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:27:15 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:6f:46,bridge_name='br-int',has_traffic_filtering=True,id=357779ea-2646-4d4b-926d-b069e0ae2aa2,network=Network(5b9407cc-c008-48b3-b93d-ed1ba23bcd90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap357779ea-26') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:27:15 user nova-compute[72362]: DEBUG nova.objects.instance [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Lazy-loading 'pci_devices' on Instance uuid f4087716-c913-48db-886e-2f21d1238c66 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:27:15 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] [instance: f4087716-c913-48db-886e-2f21d1238c66] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:27:15 user nova-compute[72362]:   <uuid>f4087716-c913-48db-886e-2f21d1238c66</uuid>
Aug 09 10:27:15 user nova-compute[72362]:   <name>instance-00000019</name>
Aug 09 10:27:15 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:27:15 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:27:15 user nova-compute[72362]:   <metadata>
Aug 09 10:27:15 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:27:15 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:27:15 user nova-compute[72362]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-758890688</nova:name>
Aug 09 10:27:15 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:27:15</nova:creationTime>
Aug 09 10:27:15 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:27:15 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:27:15 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:27:15 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:27:15 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:27:15 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:27:15 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:27:15 user nova-compute[72362]:       <nova:owner>
Aug 09 10:27:15 user nova-compute[72362]:         <nova:user uuid="30a526d59c834b44b4eea04eb4141559">tempest-TestServerVolumeAttachmentScenario-1243199391-project-member</nova:user>
Aug 09 10:27:15 user nova-compute[72362]:         <nova:project uuid="2a66f472891e4aa18010200536e8f4f1">tempest-TestServerVolumeAttachmentScenario-1243199391</nova:project>
Aug 09 10:27:15 user nova-compute[72362]:       </nova:owner>
Aug 09 10:27:15 user nova-compute[72362]:       <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:27:15 user nova-compute[72362]:       <nova:ports>
Aug 09 10:27:15 user nova-compute[72362]:         <nova:port uuid="357779ea-2646-4d4b-926d-b069e0ae2aa2">
Aug 09 10:27:15 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 09 10:27:15 user nova-compute[72362]:         </nova:port>
Aug 09 10:27:15 user nova-compute[72362]:       </nova:ports>
Aug 09 10:27:15 user nova-compute[72362]:     </nova:instance>
Aug 09 10:27:15 user nova-compute[72362]:   </metadata>
Aug 09 10:27:15 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:27:15 user nova-compute[72362]:     <system>
Aug 09 10:27:15 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:27:15 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:27:15 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:27:15 user nova-compute[72362]:       <entry name="serial">f4087716-c913-48db-886e-2f21d1238c66</entry>
Aug 09 10:27:15 user nova-compute[72362]:       <entry name="uuid">f4087716-c913-48db-886e-2f21d1238c66</entry>
Aug 09 10:27:15 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:27:15 user nova-compute[72362]:     </system>
Aug 09 10:27:15 user nova-compute[72362]:   </sysinfo>
Aug 09 10:27:15 user nova-compute[72362]:   <os>
Aug 09 10:27:15 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:27:15 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:27:15 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:27:15 user nova-compute[72362]:   </os>
Aug 09 10:27:15 user nova-compute[72362]:   <features>
Aug 09 10:27:15 user nova-compute[72362]:     <acpi/>
Aug 09 10:27:15 user nova-compute[72362]:     <apic/>
Aug 09 10:27:15 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:27:15 user nova-compute[72362]:   </features>
Aug 09 10:27:15 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:27:15 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:27:15 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:27:15 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:27:15 user nova-compute[72362]:   </clock>
Aug 09 10:27:15 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:27:15 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:27:15 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:27:15 user nova-compute[72362]:   </cpu>
Aug 09 10:27:15 user nova-compute[72362]:   <devices>
Aug 09 10:27:15 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:27:15 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:27:15 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/f4087716-c913-48db-886e-2f21d1238c66/disk"/>
Aug 09 10:27:15 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:27:15 user nova-compute[72362]:     </disk>
Aug 09 10:27:15 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:27:15 user nova-compute[72362]:       <mac address="fa:16:3e:d9:6f:46"/>
Aug 09 10:27:15 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:27:15 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:27:15 user nova-compute[72362]:       <target dev="tap357779ea-26"/>
Aug 09 10:27:15 user nova-compute[72362]:     </interface>
Aug 09 10:27:15 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:27:15 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/f4087716-c913-48db-886e-2f21d1238c66/console.log" append="off"/>
Aug 09 10:27:15 user nova-compute[72362]:     </serial>
Aug 09 10:27:15 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:27:15 user nova-compute[72362]:     <video>
Aug 09 10:27:15 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:27:15 user nova-compute[72362]:     </video>
Aug 09 10:27:15 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:27:15 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:27:15 user nova-compute[72362]:     </rng>
Aug 09 10:27:15 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:27:15 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:27:15 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:27:15 user nova-compute[72362]:     </memballoon>
Aug 09 10:27:15 user nova-compute[72362]:   </devices>
Aug 09 10:27:15 user nova-compute[72362]: </domain>
Aug 09 10:27:15 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:27:15 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:27:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-758890688',display_name='tempest-TestServerVolumeAttachmentScenario-server-758890688',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-758890688',id=25,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDg4F13idmURqiWtNU+qBvKofHOBiyrWkUEpu5CygWpmgvhhgcdsZiUXe11Me9S5M51qSnDe7eFBU62NU8km2DW3eb2LAFIK5qAztxD23xiypjEvyaFKNDVOIndnRc2kRg==',key_name='tempest-keypair-5128969',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a66f472891e4aa18010200536e8f4f1',ramdisk_id='',reservation_id='r-7cu4q6wu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1243199391',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1243199391-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:27:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30a526d59c834b44b4eea04eb4141559',uuid=f4087716-c913-48db-886e-2f21d1238c66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "357779ea-2646-4d4b-926d-b069e0ae2aa2", "address": "fa:16:3e:d9:6f:46", "network": {"id": "5b9407cc-c008-48b3-b93d-ed1ba23bcd90", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-399083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a66f472891e4aa18010200536e8f4f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap357779ea-26", "ovs_interfaceid": "357779ea-2646-4d4b-926d-b069e0ae2aa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:27:15 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Converting VIF {"id": "357779ea-2646-4d4b-926d-b069e0ae2aa2", "address": "fa:16:3e:d9:6f:46", "network": {"id": "5b9407cc-c008-48b3-b93d-ed1ba23bcd90", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-399083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a66f472891e4aa18010200536e8f4f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap357779ea-26", "ovs_interfaceid": "357779ea-2646-4d4b-926d-b069e0ae2aa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:27:15 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:6f:46,bridge_name='br-int',has_traffic_filtering=True,id=357779ea-2646-4d4b-926d-b069e0ae2aa2,network=Network(5b9407cc-c008-48b3-b93d-ed1ba23bcd90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap357779ea-26') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:27:15 user nova-compute[72362]: DEBUG os_vif [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:6f:46,bridge_name='br-int',has_traffic_filtering=True,id=357779ea-2646-4d4b-926d-b069e0ae2aa2,network=Network(5b9407cc-c008-48b3-b93d-ed1ba23bcd90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap357779ea-26') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:27:15 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:15 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:27:15 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:27:15 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:15 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap357779ea-26, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:27:15 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap357779ea-26, col_values=(('external_ids', {'iface-id': '357779ea-2646-4d4b-926d-b069e0ae2aa2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:6f:46', 'vm-uuid': 'f4087716-c913-48db-886e-2f21d1238c66'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:27:15 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:15 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:27:15 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:15 user nova-compute[72362]: INFO os_vif [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:6f:46,bridge_name='br-int',has_traffic_filtering=True,id=357779ea-2646-4d4b-926d-b069e0ae2aa2,network=Network(5b9407cc-c008-48b3-b93d-ed1ba23bcd90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap357779ea-26')
Aug 09 10:27:15 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:27:15 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] No VIF found with MAC fa:16:3e:d9:6f:46, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:27:16 user nova-compute[72362]: DEBUG nova.network.neutron [req-86df359f-5998-437e-a543-1e3103b1ce6a req-5d0df0eb-0206-4abf-8296-688dd30c01bb service nova] [instance: f4087716-c913-48db-886e-2f21d1238c66] Updated VIF entry in instance network info cache for port 357779ea-2646-4d4b-926d-b069e0ae2aa2. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:27:16 user nova-compute[72362]: DEBUG nova.network.neutron [req-86df359f-5998-437e-a543-1e3103b1ce6a req-5d0df0eb-0206-4abf-8296-688dd30c01bb service nova] [instance: f4087716-c913-48db-886e-2f21d1238c66] Updating instance_info_cache with network_info: [{"id": "357779ea-2646-4d4b-926d-b069e0ae2aa2", "address": "fa:16:3e:d9:6f:46", "network": {"id": "5b9407cc-c008-48b3-b93d-ed1ba23bcd90", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-399083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a66f472891e4aa18010200536e8f4f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap357779ea-26", "ovs_interfaceid": "357779ea-2646-4d4b-926d-b069e0ae2aa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:27:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-86df359f-5998-437e-a543-1e3103b1ce6a req-5d0df0eb-0206-4abf-8296-688dd30c01bb service nova] Releasing lock "refresh_cache-f4087716-c913-48db-886e-2f21d1238c66" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:27:16 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:17 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:17 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:17 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:17 user nova-compute[72362]: DEBUG nova.compute.manager [req-8c257d57-ad2d-4476-873d-64ba653688c7 req-0309b604-aa06-40ac-a977-fee8a0b1e627 service nova] [instance: f4087716-c913-48db-886e-2f21d1238c66] Received event network-vif-plugged-357779ea-2646-4d4b-926d-b069e0ae2aa2 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:27:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8c257d57-ad2d-4476-873d-64ba653688c7 req-0309b604-aa06-40ac-a977-fee8a0b1e627 service nova] Acquiring lock "f4087716-c913-48db-886e-2f21d1238c66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:27:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8c257d57-ad2d-4476-873d-64ba653688c7 req-0309b604-aa06-40ac-a977-fee8a0b1e627 service nova] Lock "f4087716-c913-48db-886e-2f21d1238c66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:27:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8c257d57-ad2d-4476-873d-64ba653688c7 req-0309b604-aa06-40ac-a977-fee8a0b1e627 service nova] Lock "f4087716-c913-48db-886e-2f21d1238c66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:27:17 user nova-compute[72362]: DEBUG nova.compute.manager [req-8c257d57-ad2d-4476-873d-64ba653688c7 req-0309b604-aa06-40ac-a977-fee8a0b1e627 service nova] [instance: f4087716-c913-48db-886e-2f21d1238c66] No waiting events found dispatching network-vif-plugged-357779ea-2646-4d4b-926d-b069e0ae2aa2 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:27:17 user nova-compute[72362]: WARNING nova.compute.manager [req-8c257d57-ad2d-4476-873d-64ba653688c7 req-0309b604-aa06-40ac-a977-fee8a0b1e627 service nova] [instance: f4087716-c913-48db-886e-2f21d1238c66] Received unexpected event network-vif-plugged-357779ea-2646-4d4b-926d-b069e0ae2aa2 for instance with vm_state building and task_state spawning.
Aug 09 10:27:17 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:17 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:17 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:17 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:19 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576839.4503057, f4087716-c913-48db-886e-2f21d1238c66 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:27:19 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: f4087716-c913-48db-886e-2f21d1238c66] VM Resumed (Lifecycle Event)
Aug 09 10:27:19 user nova-compute[72362]: DEBUG nova.compute.manager [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] [instance: f4087716-c913-48db-886e-2f21d1238c66] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:27:19 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] [instance: f4087716-c913-48db-886e-2f21d1238c66] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:27:19 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: f4087716-c913-48db-886e-2f21d1238c66] Instance spawned successfully.
Aug 09 10:27:19 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] [instance: f4087716-c913-48db-886e-2f21d1238c66] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 10:27:19 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: f4087716-c913-48db-886e-2f21d1238c66] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:27:19 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] [instance: f4087716-c913-48db-886e-2f21d1238c66] Found default for hw_cdrom_bus of ide {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:27:19 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] [instance: f4087716-c913-48db-886e-2f21d1238c66] Found default for hw_disk_bus of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:27:19 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] [instance: f4087716-c913-48db-886e-2f21d1238c66] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:27:19 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] [instance: f4087716-c913-48db-886e-2f21d1238c66] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:27:19 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] [instance: f4087716-c913-48db-886e-2f21d1238c66] Found default for hw_video_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:27:19 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] [instance: f4087716-c913-48db-886e-2f21d1238c66] Found default for hw_vif_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:27:19 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: f4087716-c913-48db-886e-2f21d1238c66] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:27:19 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: f4087716-c913-48db-886e-2f21d1238c66] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:27:19 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576839.4533968, f4087716-c913-48db-886e-2f21d1238c66 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:27:19 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: f4087716-c913-48db-886e-2f21d1238c66] VM Started (Lifecycle Event)
Aug 09 10:27:19 user nova-compute[72362]: DEBUG nova.compute.manager [req-b8131565-bc6d-42fa-b676-d3b2d2128c26 req-0a9f940a-d9bb-4b24-beeb-1999be6cf270 service nova] [instance: f4087716-c913-48db-886e-2f21d1238c66] Received event network-vif-plugged-357779ea-2646-4d4b-926d-b069e0ae2aa2 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:27:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b8131565-bc6d-42fa-b676-d3b2d2128c26 req-0a9f940a-d9bb-4b24-beeb-1999be6cf270 service nova] Acquiring lock "f4087716-c913-48db-886e-2f21d1238c66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:27:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b8131565-bc6d-42fa-b676-d3b2d2128c26 req-0a9f940a-d9bb-4b24-beeb-1999be6cf270 service nova] Lock "f4087716-c913-48db-886e-2f21d1238c66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:27:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b8131565-bc6d-42fa-b676-d3b2d2128c26 req-0a9f940a-d9bb-4b24-beeb-1999be6cf270 service nova] Lock "f4087716-c913-48db-886e-2f21d1238c66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:27:19 user nova-compute[72362]: DEBUG nova.compute.manager [req-b8131565-bc6d-42fa-b676-d3b2d2128c26 req-0a9f940a-d9bb-4b24-beeb-1999be6cf270 service nova] [instance: f4087716-c913-48db-886e-2f21d1238c66] No waiting events found dispatching network-vif-plugged-357779ea-2646-4d4b-926d-b069e0ae2aa2 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:27:19 user nova-compute[72362]: WARNING nova.compute.manager [req-b8131565-bc6d-42fa-b676-d3b2d2128c26 req-0a9f940a-d9bb-4b24-beeb-1999be6cf270 service nova] [instance: f4087716-c913-48db-886e-2f21d1238c66] Received unexpected event network-vif-plugged-357779ea-2646-4d4b-926d-b069e0ae2aa2 for instance with vm_state building and task_state spawning.
Aug 09 10:27:19 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: f4087716-c913-48db-886e-2f21d1238c66] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:27:19 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: f4087716-c913-48db-886e-2f21d1238c66] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:27:19 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: f4087716-c913-48db-886e-2f21d1238c66] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:27:19 user nova-compute[72362]: INFO nova.compute.manager [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] [instance: f4087716-c913-48db-886e-2f21d1238c66] Took 6.08 seconds to spawn the instance on the hypervisor.
Aug 09 10:27:19 user nova-compute[72362]: DEBUG nova.compute.manager [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] [instance: f4087716-c913-48db-886e-2f21d1238c66] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:27:19 user nova-compute[72362]: INFO nova.compute.manager [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] [instance: f4087716-c913-48db-886e-2f21d1238c66] Took 6.83 seconds to build instance.
Aug 09 10:27:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-9a0804e2-464a-435e-8656-61c40fbf5885 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Lock "f4087716-c913-48db-886e-2f21d1238c66" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.924s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:27:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:21 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:21 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Acquiring lock "1a5a9ab8-ca97-454e-b850-c119ea2cd1bf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:27:21 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "1a5a9ab8-ca97-454e-b850-c119ea2cd1bf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:27:21 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Starting instance... {{(pid=72362) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 10:27:21 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:27:21 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:27:21 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:27:21 user nova-compute[72362]: INFO nova.compute.claims [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Claim successful on node user
Aug 09 10:27:22 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:27:22 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:27:22 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.442s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:27:22 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Start building networks asynchronously for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 10:27:22 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Allocating IP information in the background. {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 10:27:22 user nova-compute[72362]: DEBUG nova.network.neutron [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] allocate_for_instance() {{(pid=72362) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 10:27:22 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 10:27:22 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Start building block device mappings for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 10:27:22 user nova-compute[72362]: DEBUG nova.policy [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '755ef9806a264f15bb80d2cd5db55d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc046adc7984378983895400e2b5e04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72362) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 10:27:22 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Start spawning the instance on the hypervisor. {{(pid=72362) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 10:27:22 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:27:22 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Creating image(s)
Aug 09 10:27:22 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Acquiring lock "/opt/stack/data/nova/instances/1a5a9ab8-ca97-454e-b850-c119ea2cd1bf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:27:22 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "/opt/stack/data/nova/instances/1a5a9ab8-ca97-454e-b850-c119ea2cd1bf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:27:22 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "/opt/stack/data/nova/instances/1a5a9ab8-ca97-454e-b850-c119ea2cd1bf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:27:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.144s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:22 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Acquiring lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:27:22 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:27:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.157s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/1a5a9ab8-ca97-454e-b850-c119ea2cd1bf/disk 1073741824 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/1a5a9ab8-ca97-454e-b850-c119ea2cd1bf/disk 1073741824" returned: 0 in 0.088s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:27:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.180s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:23 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1a5a9ab8-ca97-454e-b850-c119ea2cd1bf/disk. size=1073741824 {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 10:27:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a5a9ab8-ca97-454e-b850-c119ea2cd1bf/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:23 user nova-compute[72362]: DEBUG nova.network.neutron [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Successfully created port: 012d406b-af0d-4583-b641-45775d43dfb3 {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:27:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a5a9ab8-ca97-454e-b850-c119ea2cd1bf/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:23 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Cannot resize image /opt/stack/data/nova/instances/1a5a9ab8-ca97-454e-b850-c119ea2cd1bf/disk to a smaller size. {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 10:27:23 user nova-compute[72362]: DEBUG nova.objects.instance [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lazy-loading 'migration_context' on Instance uuid 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:27:23 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Created local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 10:27:23 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Ensure instance console log exists: /opt/stack/data/nova/instances/1a5a9ab8-ca97-454e-b850-c119ea2cd1bf/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:27:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:27:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:27:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:27:24 user nova-compute[72362]: DEBUG nova.network.neutron [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Successfully updated port: 012d406b-af0d-4583-b641-45775d43dfb3 {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:27:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Acquiring lock "refresh_cache-1a5a9ab8-ca97-454e-b850-c119ea2cd1bf" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:27:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Acquired lock "refresh_cache-1a5a9ab8-ca97-454e-b850-c119ea2cd1bf" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:27:24 user nova-compute[72362]: DEBUG nova.network.neutron [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:27:24 user nova-compute[72362]: DEBUG nova.compute.manager [req-56a9a563-345a-4fd8-9b01-d3a77f42d4cf req-4b2674ed-0aa1-4f15-851f-876b39a8f4c8 service nova] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Received event network-changed-012d406b-af0d-4583-b641-45775d43dfb3 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:27:24 user nova-compute[72362]: DEBUG nova.compute.manager [req-56a9a563-345a-4fd8-9b01-d3a77f42d4cf req-4b2674ed-0aa1-4f15-851f-876b39a8f4c8 service nova] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Refreshing instance network info cache due to event network-changed-012d406b-af0d-4583-b641-45775d43dfb3. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:27:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-56a9a563-345a-4fd8-9b01-d3a77f42d4cf req-4b2674ed-0aa1-4f15-851f-876b39a8f4c8 service nova] Acquiring lock "refresh_cache-1a5a9ab8-ca97-454e-b850-c119ea2cd1bf" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:27:24 user nova-compute[72362]: DEBUG nova.network.neutron [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:27:24 user nova-compute[72362]: DEBUG nova.network.neutron [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Updating instance_info_cache with network_info: [{"id": "012d406b-af0d-4583-b641-45775d43dfb3", "address": "fa:16:3e:14:7b:dc", "network": {"id": "f9878e3c-f52a-4f3a-933d-b9c534dd3a59", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-797945070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc046adc7984378983895400e2b5e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap012d406b-af", "ovs_interfaceid": "012d406b-af0d-4583-b641-45775d43dfb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:27:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Releasing lock "refresh_cache-1a5a9ab8-ca97-454e-b850-c119ea2cd1bf" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:27:24 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Instance network_info: |[{"id": "012d406b-af0d-4583-b641-45775d43dfb3", "address": "fa:16:3e:14:7b:dc", "network": {"id": "f9878e3c-f52a-4f3a-933d-b9c534dd3a59", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-797945070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc046adc7984378983895400e2b5e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap012d406b-af", "ovs_interfaceid": "012d406b-af0d-4583-b641-45775d43dfb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 10:27:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-56a9a563-345a-4fd8-9b01-d3a77f42d4cf req-4b2674ed-0aa1-4f15-851f-876b39a8f4c8 service nova] Acquired lock "refresh_cache-1a5a9ab8-ca97-454e-b850-c119ea2cd1bf" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:27:24 user nova-compute[72362]: DEBUG nova.network.neutron [req-56a9a563-345a-4fd8-9b01-d3a77f42d4cf req-4b2674ed-0aa1-4f15-851f-876b39a8f4c8 service nova] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Refreshing network info cache for port 012d406b-af0d-4583-b641-45775d43dfb3 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:27:24 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Start _get_guest_xml network_info=[{"id": "012d406b-af0d-4583-b641-45775d43dfb3", "address": "fa:16:3e:14:7b:dc", "network": {"id": "f9878e3c-f52a-4f3a-933d-b9c534dd3a59", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-797945070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc046adc7984378983895400e2b5e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap012d406b-af", "ovs_interfaceid": "012d406b-af0d-4583-b641-45775d43dfb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': 'a08d1a11-49eb-4212-a351-e11ee9553b95'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:27:24 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:27:24 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:27:24 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:27:24 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:27:24 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:27:24 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:27:24 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:27:24 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:27:24 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:27:24 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:27:24 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:27:24 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:27:24 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:27:24 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:27:24 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:27:24 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:27:24 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:27:24 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:27:24 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:27:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2056024681',display_name='tempest-VolumesSnapshotTestJSON-instance-2056024681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2056024681',id=26,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSomeTFU43ejGb86sHV4XUf29Dr00Hfdm1XyoWkhUXexJTrJi2ZyMPAvHN1Q5HimB2PMvrfn3OEk8eFrPIA9j0mDQ3VmXC/NxHW0IkScFJ8yYrJkt+ZxqXihoEiDJc3Jw==',key_name='tempest-keypair-255463968',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fc046adc7984378983895400e2b5e04',ramdisk_id='',reservation_id='r-yeu6wzt6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1214114448',owner_user_name='tempest-VolumesSnapshotTestJSON-1214114448-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:27:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='755ef9806a264f15bb80d2cd5db55d9b',uuid=1a5a9ab8-ca97-454e-b850-c119ea2cd1bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "012d406b-af0d-4583-b641-45775d43dfb3", "address": "fa:16:3e:14:7b:dc", "network": {"id": "f9878e3c-f52a-4f3a-933d-b9c534dd3a59", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-797945070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc046adc7984378983895400e2b5e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap012d406b-af", "ovs_interfaceid": "012d406b-af0d-4583-b641-45775d43dfb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:27:24 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Converting VIF {"id": "012d406b-af0d-4583-b641-45775d43dfb3", "address": "fa:16:3e:14:7b:dc", "network": {"id": "f9878e3c-f52a-4f3a-933d-b9c534dd3a59", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-797945070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc046adc7984378983895400e2b5e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap012d406b-af", "ovs_interfaceid": "012d406b-af0d-4583-b641-45775d43dfb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:27:24 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:7b:dc,bridge_name='br-int',has_traffic_filtering=True,id=012d406b-af0d-4583-b641-45775d43dfb3,network=Network(f9878e3c-f52a-4f3a-933d-b9c534dd3a59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap012d406b-af') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:27:24 user nova-compute[72362]: DEBUG nova.objects.instance [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lazy-loading 'pci_devices' on Instance uuid 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:27:24 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:27:24 user nova-compute[72362]:   <uuid>1a5a9ab8-ca97-454e-b850-c119ea2cd1bf</uuid>
Aug 09 10:27:24 user nova-compute[72362]:   <name>instance-0000001a</name>
Aug 09 10:27:24 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:27:24 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:27:24 user nova-compute[72362]:   <metadata>
Aug 09 10:27:24 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:27:24 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:27:24 user nova-compute[72362]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-2056024681</nova:name>
Aug 09 10:27:24 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:27:24</nova:creationTime>
Aug 09 10:27:24 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:27:24 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:27:24 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:27:24 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:27:24 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:27:24 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:27:24 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:27:24 user nova-compute[72362]:       <nova:owner>
Aug 09 10:27:24 user nova-compute[72362]:         <nova:user uuid="755ef9806a264f15bb80d2cd5db55d9b">tempest-VolumesSnapshotTestJSON-1214114448-project-member</nova:user>
Aug 09 10:27:24 user nova-compute[72362]:         <nova:project uuid="4fc046adc7984378983895400e2b5e04">tempest-VolumesSnapshotTestJSON-1214114448</nova:project>
Aug 09 10:27:24 user nova-compute[72362]:       </nova:owner>
Aug 09 10:27:24 user nova-compute[72362]:       <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:27:24 user nova-compute[72362]:       <nova:ports>
Aug 09 10:27:24 user nova-compute[72362]:         <nova:port uuid="012d406b-af0d-4583-b641-45775d43dfb3">
Aug 09 10:27:24 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 09 10:27:24 user nova-compute[72362]:         </nova:port>
Aug 09 10:27:24 user nova-compute[72362]:       </nova:ports>
Aug 09 10:27:24 user nova-compute[72362]:     </nova:instance>
Aug 09 10:27:24 user nova-compute[72362]:   </metadata>
Aug 09 10:27:24 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:27:24 user nova-compute[72362]:     <system>
Aug 09 10:27:24 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:27:24 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:27:24 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:27:24 user nova-compute[72362]:       <entry name="serial">1a5a9ab8-ca97-454e-b850-c119ea2cd1bf</entry>
Aug 09 10:27:24 user nova-compute[72362]:       <entry name="uuid">1a5a9ab8-ca97-454e-b850-c119ea2cd1bf</entry>
Aug 09 10:27:24 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:27:24 user nova-compute[72362]:     </system>
Aug 09 10:27:24 user nova-compute[72362]:   </sysinfo>
Aug 09 10:27:24 user nova-compute[72362]:   <os>
Aug 09 10:27:24 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:27:24 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:27:24 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:27:24 user nova-compute[72362]:   </os>
Aug 09 10:27:24 user nova-compute[72362]:   <features>
Aug 09 10:27:24 user nova-compute[72362]:     <acpi/>
Aug 09 10:27:24 user nova-compute[72362]:     <apic/>
Aug 09 10:27:24 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:27:24 user nova-compute[72362]:   </features>
Aug 09 10:27:24 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:27:24 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:27:24 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:27:24 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:27:24 user nova-compute[72362]:   </clock>
Aug 09 10:27:24 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:27:24 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:27:24 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:27:24 user nova-compute[72362]:   </cpu>
Aug 09 10:27:24 user nova-compute[72362]:   <devices>
Aug 09 10:27:24 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:27:24 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:27:24 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/1a5a9ab8-ca97-454e-b850-c119ea2cd1bf/disk"/>
Aug 09 10:27:24 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:27:24 user nova-compute[72362]:     </disk>
Aug 09 10:27:24 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:27:24 user nova-compute[72362]:       <mac address="fa:16:3e:14:7b:dc"/>
Aug 09 10:27:24 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:27:24 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:27:24 user nova-compute[72362]:       <target dev="tap012d406b-af"/>
Aug 09 10:27:24 user nova-compute[72362]:     </interface>
Aug 09 10:27:24 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:27:24 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/1a5a9ab8-ca97-454e-b850-c119ea2cd1bf/console.log" append="off"/>
Aug 09 10:27:24 user nova-compute[72362]:     </serial>
Aug 09 10:27:24 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:27:24 user nova-compute[72362]:     <video>
Aug 09 10:27:24 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:27:24 user nova-compute[72362]:     </video>
Aug 09 10:27:24 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:27:24 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:27:24 user nova-compute[72362]:     </rng>
Aug 09 10:27:24 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:27:24 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:27:24 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:27:24 user nova-compute[72362]:     </memballoon>
Aug 09 10:27:24 user nova-compute[72362]:   </devices>
Aug 09 10:27:24 user nova-compute[72362]: </domain>
Aug 09 10:27:24 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:27:24 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:27:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2056024681',display_name='tempest-VolumesSnapshotTestJSON-instance-2056024681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2056024681',id=26,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSomeTFU43ejGb86sHV4XUf29Dr00Hfdm1XyoWkhUXexJTrJi2ZyMPAvHN1Q5HimB2PMvrfn3OEk8eFrPIA9j0mDQ3VmXC/NxHW0IkScFJ8yYrJkt+ZxqXihoEiDJc3Jw==',key_name='tempest-keypair-255463968',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fc046adc7984378983895400e2b5e04',ramdisk_id='',reservation_id='r-yeu6wzt6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1214114448',owner_user_name='tempest-VolumesSnapshotTestJSON-1214114448-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:27:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='755ef9806a264f15bb80d2cd5db55d9b',uuid=1a5a9ab8-ca97-454e-b850-c119ea2cd1bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "012d406b-af0d-4583-b641-45775d43dfb3", "address": "fa:16:3e:14:7b:dc", "network": {"id": "f9878e3c-f52a-4f3a-933d-b9c534dd3a59", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-797945070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc046adc7984378983895400e2b5e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap012d406b-af", "ovs_interfaceid": "012d406b-af0d-4583-b641-45775d43dfb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:27:24 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Converting VIF {"id": "012d406b-af0d-4583-b641-45775d43dfb3", "address": "fa:16:3e:14:7b:dc", "network": {"id": "f9878e3c-f52a-4f3a-933d-b9c534dd3a59", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-797945070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc046adc7984378983895400e2b5e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap012d406b-af", "ovs_interfaceid": "012d406b-af0d-4583-b641-45775d43dfb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:27:24 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:7b:dc,bridge_name='br-int',has_traffic_filtering=True,id=012d406b-af0d-4583-b641-45775d43dfb3,network=Network(f9878e3c-f52a-4f3a-933d-b9c534dd3a59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap012d406b-af') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:27:24 user nova-compute[72362]: DEBUG os_vif [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:7b:dc,bridge_name='br-int',has_traffic_filtering=True,id=012d406b-af0d-4583-b641-45775d43dfb3,network=Network(f9878e3c-f52a-4f3a-933d-b9c534dd3a59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap012d406b-af') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:27:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:27:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:27:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap012d406b-af, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:27:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap012d406b-af, col_values=(('external_ids', {'iface-id': '012d406b-af0d-4583-b641-45775d43dfb3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:7b:dc', 'vm-uuid': '1a5a9ab8-ca97-454e-b850-c119ea2cd1bf'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:27:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:27:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:24 user nova-compute[72362]: INFO os_vif [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:7b:dc,bridge_name='br-int',has_traffic_filtering=True,id=012d406b-af0d-4583-b641-45775d43dfb3,network=Network(f9878e3c-f52a-4f3a-933d-b9c534dd3a59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap012d406b-af')
Aug 09 10:27:24 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:27:24 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] No VIF found with MAC fa:16:3e:14:7b:dc, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:27:25 user nova-compute[72362]: DEBUG nova.network.neutron [req-56a9a563-345a-4fd8-9b01-d3a77f42d4cf req-4b2674ed-0aa1-4f15-851f-876b39a8f4c8 service nova] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Updated VIF entry in instance network info cache for port 012d406b-af0d-4583-b641-45775d43dfb3. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:27:25 user nova-compute[72362]: DEBUG nova.network.neutron [req-56a9a563-345a-4fd8-9b01-d3a77f42d4cf req-4b2674ed-0aa1-4f15-851f-876b39a8f4c8 service nova] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Updating instance_info_cache with network_info: [{"id": "012d406b-af0d-4583-b641-45775d43dfb3", "address": "fa:16:3e:14:7b:dc", "network": {"id": "f9878e3c-f52a-4f3a-933d-b9c534dd3a59", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-797945070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc046adc7984378983895400e2b5e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap012d406b-af", "ovs_interfaceid": "012d406b-af0d-4583-b641-45775d43dfb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:27:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-56a9a563-345a-4fd8-9b01-d3a77f42d4cf req-4b2674ed-0aa1-4f15-851f-876b39a8f4c8 service nova] Releasing lock "refresh_cache-1a5a9ab8-ca97-454e-b850-c119ea2cd1bf" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:27:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-aad83cc2-c400-4f60-a5d3-bef0c8b624d8 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Acquiring lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:27:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-aad83cc2-c400-4f60-a5d3-bef0c8b624d8 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:27:25 user nova-compute[72362]: INFO nova.compute.manager [None req-aad83cc2-c400-4f60-a5d3-bef0c8b624d8 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Detaching volume cb2be0ee-763d-488d-b7e6-65e39d26b53b
Aug 09 10:27:25 user nova-compute[72362]: INFO nova.virt.block_device [None req-aad83cc2-c400-4f60-a5d3-bef0c8b624d8 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Attempting to driver detach volume cb2be0ee-763d-488d-b7e6-65e39d26b53b from mountpoint /dev/vdb
Aug 09 10:27:25 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-aad83cc2-c400-4f60-a5d3-bef0c8b624d8 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Attempting to detach device vdb from instance a6000393-6044-4b54-ac0b-1d631e2ed0ae from the persistent domain config. {{(pid=72362) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 10:27:25 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-aad83cc2-c400-4f60-a5d3-bef0c8b624d8 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 10:27:25 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:27:25 user nova-compute[72362]:   <source dev="/dev/sdc"/>
Aug 09 10:27:25 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:27:25 user nova-compute[72362]:   <serial>cb2be0ee-763d-488d-b7e6-65e39d26b53b</serial>
Aug 09 10:27:25 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 10:27:25 user nova-compute[72362]: </disk>
Aug 09 10:27:25 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:27:25 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-aad83cc2-c400-4f60-a5d3-bef0c8b624d8 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Successfully detached device vdb from instance a6000393-6044-4b54-ac0b-1d631e2ed0ae from the persistent domain config.
Aug 09 10:27:25 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-aad83cc2-c400-4f60-a5d3-bef0c8b624d8 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a6000393-6044-4b54-ac0b-1d631e2ed0ae from the live domain config. {{(pid=72362) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 10:27:25 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-aad83cc2-c400-4f60-a5d3-bef0c8b624d8 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 10:27:25 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:27:25 user nova-compute[72362]:   <source dev="/dev/sdc"/>
Aug 09 10:27:25 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:27:25 user nova-compute[72362]:   <serial>cb2be0ee-763d-488d-b7e6-65e39d26b53b</serial>
Aug 09 10:27:25 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 10:27:25 user nova-compute[72362]: </disk>
Aug 09 10:27:25 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Received event <DeviceRemovedEvent: 1691576846.1888905, a6000393-6044-4b54-ac0b-1d631e2ed0ae => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72362) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-aad83cc2-c400-4f60-a5d3-bef0c8b624d8 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a6000393-6044-4b54-ac0b-1d631e2ed0ae {{(pid=72362) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 10:27:26 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-aad83cc2-c400-4f60-a5d3-bef0c8b624d8 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Successfully detached device vdb from instance a6000393-6044-4b54-ac0b-1d631e2ed0ae from the live domain config.
Aug 09 10:27:26 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aad83cc2-c400-4f60-a5d3-bef0c8b624d8 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad83cc2-c400-4f60-a5d3-bef0c8b624d8 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXfyDmWR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:27:26 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-aad83cc2-c400-4f60-a5d3-bef0c8b624d8 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:27:26 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-aad83cc2-c400-4f60-a5d3-bef0c8b624d8 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-aad83cc2-c400-4f60-a5d3-bef0c8b624d8 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad83cc2-c400-4f60-a5d3-bef0c8b624d8 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa305b0e-ceab-4205-a8e6-03e8315b3183]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f3f52c-bf06-4406-b314-eedce2c0cba2]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad83cc2-c400-4f60-a5d3-bef0c8b624d8 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:27:26 user nova-compute[72362]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)
Aug 09 10:27:26 user nova-compute[72362]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:27:26 user nova-compute[72362]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e (non-flash)
Aug 09 10:27:26 user nova-compute[72362]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 (non-flash)
Aug 09 10:27:26 user nova-compute[72362]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb (non-flash)
Aug 09 10:27:26 user nova-compute[72362]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)
Aug 09 10:27:26 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad83cc2-c400-4f60-a5d3-bef0c8b624d8 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:27:26 user nova-compute[72362]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)
Aug 09 10:27:26 user nova-compute[72362]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b (non-flash)
Aug 09 10:27:26 user nova-compute[72362]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e (non-flash)
Aug 09 10:27:26 user nova-compute[72362]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 (non-flash)
Aug 09 10:27:26 user nova-compute[72362]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb (non-flash)
Aug 09 10:27:26 user nova-compute[72362]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)
Aug 09 10:27:26 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad83cc2-c400-4f60-a5d3-bef0c8b624d8 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e4258280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b'): ({'sdc'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-aad83cc2-c400-4f60-a5d3-bef0c8b624d8 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Removing single pathed devices sdc {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff6ebed-5f65-4f42-84a2-8364594fa95c]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[871e8997-cf8d-417f-8dff-2a7825699495]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-aad83cc2-c400-4f60-a5d3-bef0c8b624d8 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Flushing IO for device /dev/sdc {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a2ac13-93e4-4649-b73b-53482e2e3e65]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-aad83cc2-c400-4f60-a5d3-bef0c8b624d8 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[354dd118-9afd-4d65-908d-fffd88e5bbd9]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-aad83cc2-c400-4f60-a5d3-bef0c8b624d8 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-aad83cc2-c400-4f60-a5d3-bef0c8b624d8 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] SCSI volumes sdc have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad83cc2-c400-4f60-a5d3-bef0c8b624d8 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[900b2cf5-e154-4896-8697-285543f0d9fa]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad83cc2-c400-4f60-a5d3-bef0c8b624d8 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[98251cc5-f537-4a54-afb6-c17047a63408]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad83cc2-c400-4f60-a5d3-bef0c8b624d8 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b, portal: 172.16.0.220,3260]
Aug 09 10:27:26 user nova-compute[72362]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b, portal: 172.16.0.220,3260] successful.
Aug 09 10:27:26 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb2be0ee-763d-488d-b7e6-65e39d26b53b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78399bc-ceb6-4210-bc66-c08f2ca12fae]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad83cc2-c400-4f60-a5d3-bef0c8b624d8 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-aad83cc2-c400-4f60-a5d3-bef0c8b624d8 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad83cc2-c400-4f60-a5d3-bef0c8b624d8 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] <== disconnect_volume: return (326ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aad83cc2-c400-4f60-a5d3-bef0c8b624d8 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG nova.compute.manager [req-17a65083-62d9-4ed1-bfc2-f0dfa8b498ad req-3cda210f-206f-4b05-a527-9e1598460cc4 service nova] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Received event network-vif-plugged-012d406b-af0d-4583-b641-45775d43dfb3 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-17a65083-62d9-4ed1-bfc2-f0dfa8b498ad req-3cda210f-206f-4b05-a527-9e1598460cc4 service nova] Acquiring lock "1a5a9ab8-ca97-454e-b850-c119ea2cd1bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-17a65083-62d9-4ed1-bfc2-f0dfa8b498ad req-3cda210f-206f-4b05-a527-9e1598460cc4 service nova] Lock "1a5a9ab8-ca97-454e-b850-c119ea2cd1bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-17a65083-62d9-4ed1-bfc2-f0dfa8b498ad req-3cda210f-206f-4b05-a527-9e1598460cc4 service nova] Lock "1a5a9ab8-ca97-454e-b850-c119ea2cd1bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:27:26 user nova-compute[72362]: DEBUG nova.compute.manager [req-17a65083-62d9-4ed1-bfc2-f0dfa8b498ad req-3cda210f-206f-4b05-a527-9e1598460cc4 service nova] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] No waiting events found dispatching network-vif-plugged-012d406b-af0d-4583-b641-45775d43dfb3 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:27:26 user nova-compute[72362]: WARNING nova.compute.manager [req-17a65083-62d9-4ed1-bfc2-f0dfa8b498ad req-3cda210f-206f-4b05-a527-9e1598460cc4 service nova] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Received unexpected event network-vif-plugged-012d406b-af0d-4583-b641-45775d43dfb3 for instance with vm_state building and task_state spawning.
Aug 09 10:27:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:28 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576848.807468, 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:27:28 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] VM Resumed (Lifecycle Event)
Aug 09 10:27:28 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:27:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:27:28 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Instance spawned successfully.
Aug 09 10:27:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 10:27:28 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:27:28 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:27:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Found default for hw_cdrom_bus of ide {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:27:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Found default for hw_disk_bus of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:27:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:27:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:27:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Found default for hw_video_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:27:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Found default for hw_vif_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:27:28 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:27:28 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576848.8115425, 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:27:28 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] VM Started (Lifecycle Event)
Aug 09 10:27:28 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:27:28 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:27:28 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:27:28 user nova-compute[72362]: DEBUG nova.compute.manager [req-64cfa6ac-5655-4b60-95ec-dfc547e84844 req-0d745209-7083-4fde-b0e3-bb79e44d5910 service nova] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Received event network-vif-plugged-012d406b-af0d-4583-b641-45775d43dfb3 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:27:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-64cfa6ac-5655-4b60-95ec-dfc547e84844 req-0d745209-7083-4fde-b0e3-bb79e44d5910 service nova] Acquiring lock "1a5a9ab8-ca97-454e-b850-c119ea2cd1bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:27:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-64cfa6ac-5655-4b60-95ec-dfc547e84844 req-0d745209-7083-4fde-b0e3-bb79e44d5910 service nova] Lock "1a5a9ab8-ca97-454e-b850-c119ea2cd1bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:27:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-64cfa6ac-5655-4b60-95ec-dfc547e84844 req-0d745209-7083-4fde-b0e3-bb79e44d5910 service nova] Lock "1a5a9ab8-ca97-454e-b850-c119ea2cd1bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:27:28 user nova-compute[72362]: DEBUG nova.compute.manager [req-64cfa6ac-5655-4b60-95ec-dfc547e84844 req-0d745209-7083-4fde-b0e3-bb79e44d5910 service nova] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] No waiting events found dispatching network-vif-plugged-012d406b-af0d-4583-b641-45775d43dfb3 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:27:28 user nova-compute[72362]: WARNING nova.compute.manager [req-64cfa6ac-5655-4b60-95ec-dfc547e84844 req-0d745209-7083-4fde-b0e3-bb79e44d5910 service nova] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Received unexpected event network-vif-plugged-012d406b-af0d-4583-b641-45775d43dfb3 for instance with vm_state building and task_state spawning.
Aug 09 10:27:28 user nova-compute[72362]: INFO nova.compute.manager [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Took 6.27 seconds to spawn the instance on the hypervisor.
Aug 09 10:27:28 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:27:29 user nova-compute[72362]: INFO nova.compute.manager [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Took 7.06 seconds to build instance.
Aug 09 10:27:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7a69aec8-1a3b-486a-9723-cb59f099b383 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "1a5a9ab8-ca97-454e-b850-c119ea2cd1bf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.177s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:27:29 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:31 user nova-compute[72362]: DEBUG nova.objects.instance [None req-aad83cc2-c400-4f60-a5d3-bef0c8b624d8 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lazy-loading 'flavor' on Instance uuid a6000393-6044-4b54-ac0b-1d631e2ed0ae {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:27:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-aad83cc2-c400-4f60-a5d3-bef0c8b624d8 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.646s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:27:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a8efe3fd-96b8-46a8-86fc-6a1db4a4c11b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Acquiring lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:27:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a8efe3fd-96b8-46a8-86fc-6a1db4a4c11b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:27:32 user nova-compute[72362]: DEBUG nova.compute.manager [None req-a8efe3fd-96b8-46a8-86fc-6a1db4a4c11b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:27:32 user nova-compute[72362]: DEBUG nova.compute.manager [None req-a8efe3fd-96b8-46a8-86fc-6a1db4a4c11b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72362) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 09 10:27:32 user nova-compute[72362]: DEBUG nova.objects.instance [None req-a8efe3fd-96b8-46a8-86fc-6a1db4a4c11b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lazy-loading 'flavor' on Instance uuid a6000393-6044-4b54-ac0b-1d631e2ed0ae {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:27:33 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:33 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:33 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:33 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:33 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:33 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Instance destroyed successfully.
Aug 09 10:27:33 user nova-compute[72362]: DEBUG nova.compute.manager [None req-a8efe3fd-96b8-46a8-86fc-6a1db4a4c11b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:27:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a8efe3fd-96b8-46a8-86fc-6a1db4a4c11b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.877s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:27:34 user nova-compute[72362]: DEBUG nova.compute.manager [req-14d86b3b-8f69-424a-83b2-b6df9400fd68 req-ef3aefc6-9304-4a66-8c8a-8cdec7b516db service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Received event network-vif-unplugged-8c0230bc-c7a7-4497-af9a-2fafb259605c {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:27:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-14d86b3b-8f69-424a-83b2-b6df9400fd68 req-ef3aefc6-9304-4a66-8c8a-8cdec7b516db service nova] Acquiring lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:27:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-14d86b3b-8f69-424a-83b2-b6df9400fd68 req-ef3aefc6-9304-4a66-8c8a-8cdec7b516db service nova] Lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:27:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-14d86b3b-8f69-424a-83b2-b6df9400fd68 req-ef3aefc6-9304-4a66-8c8a-8cdec7b516db service nova] Lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:27:34 user nova-compute[72362]: DEBUG nova.compute.manager [req-14d86b3b-8f69-424a-83b2-b6df9400fd68 req-ef3aefc6-9304-4a66-8c8a-8cdec7b516db service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] No waiting events found dispatching network-vif-unplugged-8c0230bc-c7a7-4497-af9a-2fafb259605c {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:27:34 user nova-compute[72362]: WARNING nova.compute.manager [req-14d86b3b-8f69-424a-83b2-b6df9400fd68 req-ef3aefc6-9304-4a66-8c8a-8cdec7b516db service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Received unexpected event network-vif-unplugged-8c0230bc-c7a7-4497-af9a-2fafb259605c for instance with vm_state stopped and task_state None.
Aug 09 10:27:34 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:35 user nova-compute[72362]: DEBUG nova.compute.manager [req-cec08e1f-0068-4d16-9f4a-8f9860370192 req-f2c726af-dfa3-40cf-af06-1778448dc360 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received event network-changed-0a6057db-abb0-4777-9aab-d3a2ba3f95ec {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:27:35 user nova-compute[72362]: DEBUG nova.compute.manager [req-cec08e1f-0068-4d16-9f4a-8f9860370192 req-f2c726af-dfa3-40cf-af06-1778448dc360 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Refreshing instance network info cache due to event network-changed-0a6057db-abb0-4777-9aab-d3a2ba3f95ec. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:27:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-cec08e1f-0068-4d16-9f4a-8f9860370192 req-f2c726af-dfa3-40cf-af06-1778448dc360 service nova] Acquiring lock "refresh_cache-4ebbb1fa-12d7-4ebf-b73d-52c452077ec8" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:27:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-cec08e1f-0068-4d16-9f4a-8f9860370192 req-f2c726af-dfa3-40cf-af06-1778448dc360 service nova] Acquired lock "refresh_cache-4ebbb1fa-12d7-4ebf-b73d-52c452077ec8" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:27:35 user nova-compute[72362]: DEBUG nova.network.neutron [req-cec08e1f-0068-4d16-9f4a-8f9860370192 req-f2c726af-dfa3-40cf-af06-1778448dc360 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Refreshing network info cache for port 0a6057db-abb0-4777-9aab-d3a2ba3f95ec {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:27:35 user nova-compute[72362]: DEBUG nova.network.neutron [req-cec08e1f-0068-4d16-9f4a-8f9860370192 req-f2c726af-dfa3-40cf-af06-1778448dc360 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Updated VIF entry in instance network info cache for port 0a6057db-abb0-4777-9aab-d3a2ba3f95ec. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:27:35 user nova-compute[72362]: DEBUG nova.network.neutron [req-cec08e1f-0068-4d16-9f4a-8f9860370192 req-f2c726af-dfa3-40cf-af06-1778448dc360 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Updating instance_info_cache with network_info: [{"id": "0a6057db-abb0-4777-9aab-d3a2ba3f95ec", "address": "fa:16:3e:48:68:7a", "network": {"id": "bea01ebc-53b7-4715-a159-6295257b1dd1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1313518742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6057db-ab", "ovs_interfaceid": "0a6057db-abb0-4777-9aab-d3a2ba3f95ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4c5ba9f1-7d79-4f8a-8273-1fcf85b6ea71", "address": "fa:16:3e:14:52:ad", "network": {"id": "6a6fcebc-f762-47d1-9213-265b323e18e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1150728202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c5ba9f1-7d", "ovs_interfaceid": "4c5ba9f1-7d79-4f8a-8273-1fcf85b6ea71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff7bc1ec-40b6-469c-8fec-e49752a917c6", "address": "fa:16:3e:1a:1f:d2", "network": {"id": "6a6fcebc-f762-47d1-9213-265b323e18e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1150728202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff7bc1ec-40", "ovs_interfaceid": "ff7bc1ec-40b6-469c-8fec-e49752a917c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "64f56105-6893-4ab5-86bf-380874d78f8c", "address": "fa:16:3e:df:37:39", "network": {"id": "6a6fcebc-f762-47d1-9213-265b323e18e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1150728202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64f56105-68", "ovs_interfaceid": "64f56105-6893-4ab5-86bf-380874d78f8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "31b0a33f-dad5-4ea1-8a20-d7c3fdedd352", "address": "fa:16:3e:4f:e5:8f", "network": {"id": "6a6fcebc-f762-47d1-9213-265b323e18e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1150728202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31b0a33f-da", "ovs_interfaceid": "31b0a33f-dad5-4ea1-8a20-d7c3fdedd352", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "71a96106-1d45-4b94-a7da-893e8b6d92bd", "address": "fa:16:3e:69:13:9b", "network": {"id": "355d69f9-75a6-4620-837c-cdc9269e990e", "bridge": "br-int", "label": "tempest-device-tagging-net2-969918414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71a96106-1d", "ovs_interfaceid": "71a96106-1d45-4b94-a7da-893e8b6d92bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "945c59da-d927-49a5-82e7-7c591943fcd1", "address": "fa:16:3e:11:1b:1b", "network": {"id": "355d69f9-75a6-4620-837c-cdc9269e990e", "bridge": "br-int", "label": "tempest-device-tagging-net2-969918414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap945c59da-d9", "ovs_interfaceid": "945c59da-d927-49a5-82e7-7c591943fcd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:27:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-cec08e1f-0068-4d16-9f4a-8f9860370192 req-f2c726af-dfa3-40cf-af06-1778448dc360 service nova] Releasing lock "refresh_cache-4ebbb1fa-12d7-4ebf-b73d-52c452077ec8" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:27:36 user nova-compute[72362]: DEBUG nova.compute.manager [req-adabc2a7-b5e4-4577-b0f2-c7db639d8091 req-20266622-0944-430d-8017-af29d67e2ffd service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Received event network-vif-plugged-8c0230bc-c7a7-4497-af9a-2fafb259605c {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:27:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-adabc2a7-b5e4-4577-b0f2-c7db639d8091 req-20266622-0944-430d-8017-af29d67e2ffd service nova] Acquiring lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:27:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-adabc2a7-b5e4-4577-b0f2-c7db639d8091 req-20266622-0944-430d-8017-af29d67e2ffd service nova] Lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:27:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-adabc2a7-b5e4-4577-b0f2-c7db639d8091 req-20266622-0944-430d-8017-af29d67e2ffd service nova] Lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:27:36 user nova-compute[72362]: DEBUG nova.compute.manager [req-adabc2a7-b5e4-4577-b0f2-c7db639d8091 req-20266622-0944-430d-8017-af29d67e2ffd service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] No waiting events found dispatching network-vif-plugged-8c0230bc-c7a7-4497-af9a-2fafb259605c {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:27:36 user nova-compute[72362]: WARNING nova.compute.manager [req-adabc2a7-b5e4-4577-b0f2-c7db639d8091 req-20266622-0944-430d-8017-af29d67e2ffd service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Received unexpected event network-vif-plugged-8c0230bc-c7a7-4497-af9a-2fafb259605c for instance with vm_state stopped and task_state None.
Aug 09 10:27:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e282ca16-8b9e-4f57-9d0e-3b111a4f584d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Acquiring lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:27:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e282ca16-8b9e-4f57-9d0e-3b111a4f584d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:27:36 user nova-compute[72362]: INFO nova.compute.manager [None req-e282ca16-8b9e-4f57-9d0e-3b111a4f584d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Detaching volume 9fd78518-fb6e-47ac-a671-2b5e62efe4ec
Aug 09 10:27:36 user nova-compute[72362]: INFO nova.virt.block_device [None req-e282ca16-8b9e-4f57-9d0e-3b111a4f584d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Attempting to driver detach volume 9fd78518-fb6e-47ac-a671-2b5e62efe4ec from mountpoint /dev/vdb
Aug 09 10:27:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-e282ca16-8b9e-4f57-9d0e-3b111a4f584d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Attempting to detach device vdb from instance 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f from the persistent domain config. {{(pid=72362) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 10:27:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-e282ca16-8b9e-4f57-9d0e-3b111a4f584d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 10:27:36 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:27:36 user nova-compute[72362]:   <source dev="/dev/sdb"/>
Aug 09 10:27:36 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:27:36 user nova-compute[72362]:   <serial>9fd78518-fb6e-47ac-a671-2b5e62efe4ec</serial>
Aug 09 10:27:36 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 10:27:36 user nova-compute[72362]: </disk>
Aug 09 10:27:36 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:27:36 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-e282ca16-8b9e-4f57-9d0e-3b111a4f584d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Successfully detached device vdb from instance 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f from the persistent domain config.
Aug 09 10:27:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-e282ca16-8b9e-4f57-9d0e-3b111a4f584d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f from the live domain config. {{(pid=72362) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 10:27:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-e282ca16-8b9e-4f57-9d0e-3b111a4f584d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 10:27:36 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:27:36 user nova-compute[72362]:   <source dev="/dev/sdb"/>
Aug 09 10:27:36 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:27:36 user nova-compute[72362]:   <serial>9fd78518-fb6e-47ac-a671-2b5e62efe4ec</serial>
Aug 09 10:27:36 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 10:27:36 user nova-compute[72362]: </disk>
Aug 09 10:27:36 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Received event <DeviceRemovedEvent: 1691576857.0452707, 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72362) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-e282ca16-8b9e-4f57-9d0e-3b111a4f584d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f {{(pid=72362) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 10:27:37 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-e282ca16-8b9e-4f57-9d0e-3b111a4f584d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Successfully detached device vdb from instance 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f from the live domain config.
Aug 09 10:27:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e282ca16-8b9e-4f57-9d0e-3b111a4f584d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-e282ca16-8b9e-4f57-9d0e-3b111a4f584d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yMmUbTGO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:27:37 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-e282ca16-8b9e-4f57-9d0e-3b111a4f584d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:27:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-e282ca16-8b9e-4f57-9d0e-3b111a4f584d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-e282ca16-8b9e-4f57-9d0e-3b111a4f584d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-e282ca16-8b9e-4f57-9d0e-3b111a4f584d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eca0aaa-9a30-42a8-9c6a-c77ecc8cd2d0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e147ca-d962-49cb-99dc-547401ba3e00]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-e282ca16-8b9e-4f57-9d0e-3b111a4f584d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:27:37 user nova-compute[72362]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)
Aug 09 10:27:37 user nova-compute[72362]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e (non-flash)
Aug 09 10:27:37 user nova-compute[72362]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 (non-flash)
Aug 09 10:27:37 user nova-compute[72362]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb (non-flash)
Aug 09 10:27:37 user nova-compute[72362]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)
Aug 09 10:27:37 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-e282ca16-8b9e-4f57-9d0e-3b111a4f584d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:27:37 user nova-compute[72362]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec (non-flash)
Aug 09 10:27:37 user nova-compute[72362]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e (non-flash)
Aug 09 10:27:37 user nova-compute[72362]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 (non-flash)
Aug 09 10:27:37 user nova-compute[72362]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb (non-flash)
Aug 09 10:27:37 user nova-compute[72362]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)
Aug 09 10:27:37 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-e282ca16-8b9e-4f57-9d0e-3b111a4f584d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34dc245e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec'): ({'sdb'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-e282ca16-8b9e-4f57-9d0e-3b111a4f584d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Removing single pathed devices sdb {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e284eaa-1a45-4a77-87e5-2ba31d212c74]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35dce58-b51b-4a2e-ae6f-9d06ad21b5e2]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-e282ca16-8b9e-4f57-9d0e-3b111a4f584d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Flushing IO for device /dev/sdb {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[891eaa2f-0552-4c7b-bce9-261b5f2d85bf]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-e282ca16-8b9e-4f57-9d0e-3b111a4f584d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f9586f-c207-45f5-b329-aac837e94da1]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-e282ca16-8b9e-4f57-9d0e-3b111a4f584d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-e282ca16-8b9e-4f57-9d0e-3b111a4f584d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] SCSI volumes sdb have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-e282ca16-8b9e-4f57-9d0e-3b111a4f584d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f788f99-7e1b-4957-ae74-21d1d368debc]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-e282ca16-8b9e-4f57-9d0e-3b111a4f584d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4133d8-715e-42fb-9561-1cdef466b727]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-e282ca16-8b9e-4f57-9d0e-3b111a4f584d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec, portal: 172.16.0.220,3260]
Aug 09 10:27:37 user nova-compute[72362]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec, portal: 172.16.0.220,3260] successful.
Aug 09 10:27:37 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd78518-fb6e-47ac-a671-2b5e62efe4ec -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a426664-6f2c-441a-86b3-8361741a4f76]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-e282ca16-8b9e-4f57-9d0e-3b111a4f584d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-e282ca16-8b9e-4f57-9d0e-3b111a4f584d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-e282ca16-8b9e-4f57-9d0e-3b111a4f584d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] <== disconnect_volume: return (297ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e282ca16-8b9e-4f57-9d0e-3b111a4f584d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Acquiring lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Acquiring lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:27:37 user nova-compute[72362]: INFO nova.compute.manager [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Terminating instance
Aug 09 10:27:37 user nova-compute[72362]: DEBUG nova.compute.manager [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Start destroying the instance on the hypervisor. {{(pid=72362) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:38 user nova-compute[72362]: DEBUG nova.objects.instance [None req-e282ca16-8b9e-4f57-9d0e-3b111a4f584d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lazy-loading 'flavor' on Instance uuid 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:27:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:38 user nova-compute[72362]: DEBUG nova.compute.manager [req-98d760d2-733d-4ae2-a457-ac6ee917be2d req-2ca9e71b-a9d4-4cdd-b152-563d2c2db787 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received event network-vif-unplugged-4c5ba9f1-7d79-4f8a-8273-1fcf85b6ea71 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:27:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-98d760d2-733d-4ae2-a457-ac6ee917be2d req-2ca9e71b-a9d4-4cdd-b152-563d2c2db787 service nova] Acquiring lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:27:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-98d760d2-733d-4ae2-a457-ac6ee917be2d req-2ca9e71b-a9d4-4cdd-b152-563d2c2db787 service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:27:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-98d760d2-733d-4ae2-a457-ac6ee917be2d req-2ca9e71b-a9d4-4cdd-b152-563d2c2db787 service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:27:38 user nova-compute[72362]: DEBUG nova.compute.manager [req-98d760d2-733d-4ae2-a457-ac6ee917be2d req-2ca9e71b-a9d4-4cdd-b152-563d2c2db787 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] No waiting events found dispatching network-vif-unplugged-4c5ba9f1-7d79-4f8a-8273-1fcf85b6ea71 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:27:38 user nova-compute[72362]: DEBUG nova.compute.manager [req-98d760d2-733d-4ae2-a457-ac6ee917be2d req-2ca9e71b-a9d4-4cdd-b152-563d2c2db787 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received event network-vif-unplugged-4c5ba9f1-7d79-4f8a-8273-1fcf85b6ea71 for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:27:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e282ca16-8b9e-4f57-9d0e-3b111a4f584d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.803s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:27:38 user nova-compute[72362]: DEBUG nova.compute.manager [req-56a26a82-89fd-4dd0-937d-b2e87d9e3b37 req-c2057a6e-1ddd-4b85-9df6-ee5f6f8fb7fd service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received event network-vif-unplugged-0a6057db-abb0-4777-9aab-d3a2ba3f95ec {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:27:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-56a26a82-89fd-4dd0-937d-b2e87d9e3b37 req-c2057a6e-1ddd-4b85-9df6-ee5f6f8fb7fd service nova] Acquiring lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:27:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-56a26a82-89fd-4dd0-937d-b2e87d9e3b37 req-c2057a6e-1ddd-4b85-9df6-ee5f6f8fb7fd service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:27:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-56a26a82-89fd-4dd0-937d-b2e87d9e3b37 req-c2057a6e-1ddd-4b85-9df6-ee5f6f8fb7fd service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:27:38 user nova-compute[72362]: DEBUG nova.compute.manager [req-56a26a82-89fd-4dd0-937d-b2e87d9e3b37 req-c2057a6e-1ddd-4b85-9df6-ee5f6f8fb7fd service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] No waiting events found dispatching network-vif-unplugged-0a6057db-abb0-4777-9aab-d3a2ba3f95ec {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:27:38 user nova-compute[72362]: DEBUG nova.compute.manager [req-56a26a82-89fd-4dd0-937d-b2e87d9e3b37 req-c2057a6e-1ddd-4b85-9df6-ee5f6f8fb7fd service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received event network-vif-unplugged-0a6057db-abb0-4777-9aab-d3a2ba3f95ec for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:27:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:38 user nova-compute[72362]: DEBUG nova.compute.manager [req-fefbc824-d281-4c69-a9d2-3891af8110c4 req-e9704243-e5ec-47b2-af6a-bf207f03a3b4 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received event network-vif-unplugged-31b0a33f-dad5-4ea1-8a20-d7c3fdedd352 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:27:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-fefbc824-d281-4c69-a9d2-3891af8110c4 req-e9704243-e5ec-47b2-af6a-bf207f03a3b4 service nova] Acquiring lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:27:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-fefbc824-d281-4c69-a9d2-3891af8110c4 req-e9704243-e5ec-47b2-af6a-bf207f03a3b4 service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:27:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-fefbc824-d281-4c69-a9d2-3891af8110c4 req-e9704243-e5ec-47b2-af6a-bf207f03a3b4 service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:27:38 user nova-compute[72362]: DEBUG nova.compute.manager [req-fefbc824-d281-4c69-a9d2-3891af8110c4 req-e9704243-e5ec-47b2-af6a-bf207f03a3b4 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] No waiting events found dispatching network-vif-unplugged-31b0a33f-dad5-4ea1-8a20-d7c3fdedd352 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:27:38 user nova-compute[72362]: DEBUG nova.compute.manager [req-fefbc824-d281-4c69-a9d2-3891af8110c4 req-e9704243-e5ec-47b2-af6a-bf207f03a3b4 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received event network-vif-unplugged-31b0a33f-dad5-4ea1-8a20-d7c3fdedd352 for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:27:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:39 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Instance destroyed successfully.
Aug 09 10:27:39 user nova-compute[72362]: DEBUG nova.objects.instance [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Lazy-loading 'resources' on Instance uuid 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:27:39 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:25:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2033498851',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2033498851',id=22,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6yquiDWYxTGTfonZ8GsBdP+XG79KCKtKDMQwS55yvW3vn0LTtCoJbNKXKEI0bpiTqu/XZD7eQcIRfB+YHtKODgyWyZ+dqAh6nZ7MH08+scg5xWXswI5VFqtkEwNpGhsw==',key_name='tempest-keypair-1319859291',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:26:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c28082d2768043b197738d79c7fe9f34',ramdisk_id='',reservation_id='r-7rv9erom',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1074064696',owner_user_name='tempest-TaggedBootDevicesTest_v242-1074064696-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:26:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db66f066669949739a5888f4fe24a6df',uuid=4ebbb1fa-12d7-4ebf-b73d-52c452077ec8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a6057db-abb0-4777-9aab-d3a2ba3f95ec", "address": "fa:16:3e:48:68:7a", "network": {"id": "bea01ebc-53b7-4715-a159-6295257b1dd1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1313518742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6057db-ab", "ovs_interfaceid": "0a6057db-abb0-4777-9aab-d3a2ba3f95ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:27:39 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Converting VIF {"id": "0a6057db-abb0-4777-9aab-d3a2ba3f95ec", "address": "fa:16:3e:48:68:7a", "network": {"id": "bea01ebc-53b7-4715-a159-6295257b1dd1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1313518742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6057db-ab", "ovs_interfaceid": "0a6057db-abb0-4777-9aab-d3a2ba3f95ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:27:39 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:68:7a,bridge_name='br-int',has_traffic_filtering=True,id=0a6057db-abb0-4777-9aab-d3a2ba3f95ec,network=Network(bea01ebc-53b7-4715-a159-6295257b1dd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a6057db-ab') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:27:39 user nova-compute[72362]: DEBUG os_vif [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:68:7a,bridge_name='br-int',has_traffic_filtering=True,id=0a6057db-abb0-4777-9aab-d3a2ba3f95ec,network=Network(bea01ebc-53b7-4715-a159-6295257b1dd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a6057db-ab') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:27:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a6057db-ab, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:27:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:27:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:39 user nova-compute[72362]: INFO os_vif [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:68:7a,bridge_name='br-int',has_traffic_filtering=True,id=0a6057db-abb0-4777-9aab-d3a2ba3f95ec,network=Network(bea01ebc-53b7-4715-a159-6295257b1dd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a6057db-ab')
Aug 09 10:27:39 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:25:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2033498851',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2033498851',id=22,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6yquiDWYxTGTfonZ8GsBdP+XG79KCKtKDMQwS55yvW3vn0LTtCoJbNKXKEI0bpiTqu/XZD7eQcIRfB+YHtKODgyWyZ+dqAh6nZ7MH08+scg5xWXswI5VFqtkEwNpGhsw==',key_name='tempest-keypair-1319859291',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:26:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c28082d2768043b197738d79c7fe9f34',ramdisk_id='',reservation_id='r-7rv9erom',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1074064696',owner_user_name='tempest-TaggedBootDevicesTest_v242-1074064696-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:26:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db66f066669949739a5888f4fe24a6df',uuid=4ebbb1fa-12d7-4ebf-b73d-52c452077ec8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c5ba9f1-7d79-4f8a-8273-1fcf85b6ea71", "address": "fa:16:3e:14:52:ad", "network": {"id": "6a6fcebc-f762-47d1-9213-265b323e18e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1150728202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c5ba9f1-7d", "ovs_interfaceid": "4c5ba9f1-7d79-4f8a-8273-1fcf85b6ea71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:27:39 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Converting VIF {"id": "4c5ba9f1-7d79-4f8a-8273-1fcf85b6ea71", "address": "fa:16:3e:14:52:ad", "network": {"id": "6a6fcebc-f762-47d1-9213-265b323e18e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1150728202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c5ba9f1-7d", "ovs_interfaceid": "4c5ba9f1-7d79-4f8a-8273-1fcf85b6ea71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:27:39 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:52:ad,bridge_name='br-int',has_traffic_filtering=True,id=4c5ba9f1-7d79-4f8a-8273-1fcf85b6ea71,network=Network(6a6fcebc-f762-47d1-9213-265b323e18e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4c5ba9f1-7d') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:27:39 user nova-compute[72362]: DEBUG os_vif [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:52:ad,bridge_name='br-int',has_traffic_filtering=True,id=4c5ba9f1-7d79-4f8a-8273-1fcf85b6ea71,network=Network(6a6fcebc-f762-47d1-9213-265b323e18e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4c5ba9f1-7d') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:27:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c5ba9f1-7d, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:27:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:40 user nova-compute[72362]: INFO os_vif [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:52:ad,bridge_name='br-int',has_traffic_filtering=True,id=4c5ba9f1-7d79-4f8a-8273-1fcf85b6ea71,network=Network(6a6fcebc-f762-47d1-9213-265b323e18e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4c5ba9f1-7d')
Aug 09 10:27:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:25:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2033498851',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2033498851',id=22,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6yquiDWYxTGTfonZ8GsBdP+XG79KCKtKDMQwS55yvW3vn0LTtCoJbNKXKEI0bpiTqu/XZD7eQcIRfB+YHtKODgyWyZ+dqAh6nZ7MH08+scg5xWXswI5VFqtkEwNpGhsw==',key_name='tempest-keypair-1319859291',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:26:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c28082d2768043b197738d79c7fe9f34',ramdisk_id='',reservation_id='r-7rv9erom',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1074064696',owner_user_name='tempest-TaggedBootDevicesTest_v242-1074064696-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:26:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db66f066669949739a5888f4fe24a6df',uuid=4ebbb1fa-12d7-4ebf-b73d-52c452077ec8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff7bc1ec-40b6-469c-8fec-e49752a917c6", "address": "fa:16:3e:1a:1f:d2", "network": {"id": "6a6fcebc-f762-47d1-9213-265b323e18e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1150728202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff7bc1ec-40", "ovs_interfaceid": "ff7bc1ec-40b6-469c-8fec-e49752a917c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Converting VIF {"id": "ff7bc1ec-40b6-469c-8fec-e49752a917c6", "address": "fa:16:3e:1a:1f:d2", "network": {"id": "6a6fcebc-f762-47d1-9213-265b323e18e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1150728202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff7bc1ec-40", "ovs_interfaceid": "ff7bc1ec-40b6-469c-8fec-e49752a917c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:1f:d2,bridge_name='br-int',has_traffic_filtering=True,id=ff7bc1ec-40b6-469c-8fec-e49752a917c6,network=Network(6a6fcebc-f762-47d1-9213-265b323e18e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapff7bc1ec-40') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG os_vif [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:1f:d2,bridge_name='br-int',has_traffic_filtering=True,id=ff7bc1ec-40b6-469c-8fec-e49752a917c6,network=Network(6a6fcebc-f762-47d1-9213-265b323e18e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapff7bc1ec-40') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff7bc1ec-40, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:40 user nova-compute[72362]: INFO os_vif [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:1f:d2,bridge_name='br-int',has_traffic_filtering=True,id=ff7bc1ec-40b6-469c-8fec-e49752a917c6,network=Network(6a6fcebc-f762-47d1-9213-265b323e18e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapff7bc1ec-40')
Aug 09 10:27:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:25:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2033498851',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2033498851',id=22,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6yquiDWYxTGTfonZ8GsBdP+XG79KCKtKDMQwS55yvW3vn0LTtCoJbNKXKEI0bpiTqu/XZD7eQcIRfB+YHtKODgyWyZ+dqAh6nZ7MH08+scg5xWXswI5VFqtkEwNpGhsw==',key_name='tempest-keypair-1319859291',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:26:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c28082d2768043b197738d79c7fe9f34',ramdisk_id='',reservation_id='r-7rv9erom',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1074064696',owner_user_name='tempest-TaggedBootDevicesTest_v242-1074064696-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:26:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db66f066669949739a5888f4fe24a6df',uuid=4ebbb1fa-12d7-4ebf-b73d-52c452077ec8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64f56105-6893-4ab5-86bf-380874d78f8c", "address": "fa:16:3e:df:37:39", "network": {"id": "6a6fcebc-f762-47d1-9213-265b323e18e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1150728202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64f56105-68", "ovs_interfaceid": "64f56105-6893-4ab5-86bf-380874d78f8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Converting VIF {"id": "64f56105-6893-4ab5-86bf-380874d78f8c", "address": "fa:16:3e:df:37:39", "network": {"id": "6a6fcebc-f762-47d1-9213-265b323e18e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1150728202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64f56105-68", "ovs_interfaceid": "64f56105-6893-4ab5-86bf-380874d78f8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:37:39,bridge_name='br-int',has_traffic_filtering=True,id=64f56105-6893-4ab5-86bf-380874d78f8c,network=Network(6a6fcebc-f762-47d1-9213-265b323e18e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64f56105-68') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG os_vif [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:37:39,bridge_name='br-int',has_traffic_filtering=True,id=64f56105-6893-4ab5-86bf-380874d78f8c,network=Network(6a6fcebc-f762-47d1-9213-265b323e18e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64f56105-68') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64f56105-68, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:40 user nova-compute[72362]: INFO os_vif [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:37:39,bridge_name='br-int',has_traffic_filtering=True,id=64f56105-6893-4ab5-86bf-380874d78f8c,network=Network(6a6fcebc-f762-47d1-9213-265b323e18e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64f56105-68')
Aug 09 10:27:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:25:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2033498851',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2033498851',id=22,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6yquiDWYxTGTfonZ8GsBdP+XG79KCKtKDMQwS55yvW3vn0LTtCoJbNKXKEI0bpiTqu/XZD7eQcIRfB+YHtKODgyWyZ+dqAh6nZ7MH08+scg5xWXswI5VFqtkEwNpGhsw==',key_name='tempest-keypair-1319859291',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:26:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c28082d2768043b197738d79c7fe9f34',ramdisk_id='',reservation_id='r-7rv9erom',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1074064696',owner_user_name='tempest-TaggedBootDevicesTest_v242-1074064696-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:26:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db66f066669949739a5888f4fe24a6df',uuid=4ebbb1fa-12d7-4ebf-b73d-52c452077ec8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31b0a33f-dad5-4ea1-8a20-d7c3fdedd352", "address": "fa:16:3e:4f:e5:8f", "network": {"id": "6a6fcebc-f762-47d1-9213-265b323e18e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1150728202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31b0a33f-da", "ovs_interfaceid": "31b0a33f-dad5-4ea1-8a20-d7c3fdedd352", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Converting VIF {"id": "31b0a33f-dad5-4ea1-8a20-d7c3fdedd352", "address": "fa:16:3e:4f:e5:8f", "network": {"id": "6a6fcebc-f762-47d1-9213-265b323e18e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1150728202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31b0a33f-da", "ovs_interfaceid": "31b0a33f-dad5-4ea1-8a20-d7c3fdedd352", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:e5:8f,bridge_name='br-int',has_traffic_filtering=True,id=31b0a33f-dad5-4ea1-8a20-d7c3fdedd352,network=Network(6a6fcebc-f762-47d1-9213-265b323e18e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31b0a33f-da') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG os_vif [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:e5:8f,bridge_name='br-int',has_traffic_filtering=True,id=31b0a33f-dad5-4ea1-8a20-d7c3fdedd352,network=Network(6a6fcebc-f762-47d1-9213-265b323e18e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31b0a33f-da') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap31b0a33f-da, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:40 user nova-compute[72362]: INFO os_vif [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:e5:8f,bridge_name='br-int',has_traffic_filtering=True,id=31b0a33f-dad5-4ea1-8a20-d7c3fdedd352,network=Network(6a6fcebc-f762-47d1-9213-265b323e18e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31b0a33f-da')
Aug 09 10:27:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:25:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2033498851',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2033498851',id=22,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6yquiDWYxTGTfonZ8GsBdP+XG79KCKtKDMQwS55yvW3vn0LTtCoJbNKXKEI0bpiTqu/XZD7eQcIRfB+YHtKODgyWyZ+dqAh6nZ7MH08+scg5xWXswI5VFqtkEwNpGhsw==',key_name='tempest-keypair-1319859291',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:26:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c28082d2768043b197738d79c7fe9f34',ramdisk_id='',reservation_id='r-7rv9erom',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1074064696',owner_user_name='tempest-TaggedBootDevicesTest_v242-1074064696-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:26:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db66f066669949739a5888f4fe24a6df',uuid=4ebbb1fa-12d7-4ebf-b73d-52c452077ec8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71a96106-1d45-4b94-a7da-893e8b6d92bd", "address": "fa:16:3e:69:13:9b", "network": {"id": "355d69f9-75a6-4620-837c-cdc9269e990e", "bridge": "br-int", "label": "tempest-device-tagging-net2-969918414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71a96106-1d", "ovs_interfaceid": "71a96106-1d45-4b94-a7da-893e8b6d92bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Converting VIF {"id": "71a96106-1d45-4b94-a7da-893e8b6d92bd", "address": "fa:16:3e:69:13:9b", "network": {"id": "355d69f9-75a6-4620-837c-cdc9269e990e", "bridge": "br-int", "label": "tempest-device-tagging-net2-969918414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71a96106-1d", "ovs_interfaceid": "71a96106-1d45-4b94-a7da-893e8b6d92bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:13:9b,bridge_name='br-int',has_traffic_filtering=True,id=71a96106-1d45-4b94-a7da-893e8b6d92bd,network=Network(355d69f9-75a6-4620-837c-cdc9269e990e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71a96106-1d') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG os_vif [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:13:9b,bridge_name='br-int',has_traffic_filtering=True,id=71a96106-1d45-4b94-a7da-893e8b6d92bd,network=Network(355d69f9-75a6-4620-837c-cdc9269e990e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71a96106-1d') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71a96106-1d, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:40 user nova-compute[72362]: INFO os_vif [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:13:9b,bridge_name='br-int',has_traffic_filtering=True,id=71a96106-1d45-4b94-a7da-893e8b6d92bd,network=Network(355d69f9-75a6-4620-837c-cdc9269e990e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71a96106-1d')
Aug 09 10:27:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T10:25:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2033498851',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2033498851',id=22,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6yquiDWYxTGTfonZ8GsBdP+XG79KCKtKDMQwS55yvW3vn0LTtCoJbNKXKEI0bpiTqu/XZD7eQcIRfB+YHtKODgyWyZ+dqAh6nZ7MH08+scg5xWXswI5VFqtkEwNpGhsw==',key_name='tempest-keypair-1319859291',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:26:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c28082d2768043b197738d79c7fe9f34',ramdisk_id='',reservation_id='r-7rv9erom',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1074064696',owner_user_name='tempest-TaggedBootDevicesTest_v242-1074064696-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:26:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db66f066669949739a5888f4fe24a6df',uuid=4ebbb1fa-12d7-4ebf-b73d-52c452077ec8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "945c59da-d927-49a5-82e7-7c591943fcd1", "address": "fa:16:3e:11:1b:1b", "network": {"id": "355d69f9-75a6-4620-837c-cdc9269e990e", "bridge": "br-int", "label": "tempest-device-tagging-net2-969918414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap945c59da-d9", "ovs_interfaceid": "945c59da-d927-49a5-82e7-7c591943fcd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Converting VIF {"id": "945c59da-d927-49a5-82e7-7c591943fcd1", "address": "fa:16:3e:11:1b:1b", "network": {"id": "355d69f9-75a6-4620-837c-cdc9269e990e", "bridge": "br-int", "label": "tempest-device-tagging-net2-969918414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap945c59da-d9", "ovs_interfaceid": "945c59da-d927-49a5-82e7-7c591943fcd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:1b:1b,bridge_name='br-int',has_traffic_filtering=True,id=945c59da-d927-49a5-82e7-7c591943fcd1,network=Network(355d69f9-75a6-4620-837c-cdc9269e990e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap945c59da-d9') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG os_vif [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:1b:1b,bridge_name='br-int',has_traffic_filtering=True,id=945c59da-d927-49a5-82e7-7c591943fcd1,network=Network(355d69f9-75a6-4620-837c-cdc9269e990e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap945c59da-d9') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap945c59da-d9, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:40 user nova-compute[72362]: INFO os_vif [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:1b:1b,bridge_name='br-int',has_traffic_filtering=True,id=945c59da-d927-49a5-82e7-7c591943fcd1,network=Network(355d69f9-75a6-4620-837c-cdc9269e990e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap945c59da-d9')
Aug 09 10:27:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gCpLEnQl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:27:40 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:27:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG nova.compute.manager [req-7415bfd4-8417-4aee-ba4a-ae03113aa1cb req-e99af621-1389-41a0-a0c7-11c9e523a010 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received event network-vif-plugged-4c5ba9f1-7d79-4f8a-8273-1fcf85b6ea71 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-7415bfd4-8417-4aee-ba4a-ae03113aa1cb req-e99af621-1389-41a0-a0c7-11c9e523a010 service nova] Acquiring lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-7415bfd4-8417-4aee-ba4a-ae03113aa1cb req-e99af621-1389-41a0-a0c7-11c9e523a010 service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-7415bfd4-8417-4aee-ba4a-ae03113aa1cb req-e99af621-1389-41a0-a0c7-11c9e523a010 service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG nova.compute.manager [req-7415bfd4-8417-4aee-ba4a-ae03113aa1cb req-e99af621-1389-41a0-a0c7-11c9e523a010 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] No waiting events found dispatching network-vif-plugged-4c5ba9f1-7d79-4f8a-8273-1fcf85b6ea71 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:27:40 user nova-compute[72362]: WARNING nova.compute.manager [req-7415bfd4-8417-4aee-ba4a-ae03113aa1cb req-e99af621-1389-41a0-a0c7-11c9e523a010 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received unexpected event network-vif-plugged-4c5ba9f1-7d79-4f8a-8273-1fcf85b6ea71 for instance with vm_state active and task_state deleting.
Aug 09 10:27:40 user nova-compute[72362]: DEBUG nova.compute.manager [req-7415bfd4-8417-4aee-ba4a-ae03113aa1cb req-e99af621-1389-41a0-a0c7-11c9e523a010 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received event network-vif-unplugged-71a96106-1d45-4b94-a7da-893e8b6d92bd {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-7415bfd4-8417-4aee-ba4a-ae03113aa1cb req-e99af621-1389-41a0-a0c7-11c9e523a010 service nova] Acquiring lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-7415bfd4-8417-4aee-ba4a-ae03113aa1cb req-e99af621-1389-41a0-a0c7-11c9e523a010 service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-7415bfd4-8417-4aee-ba4a-ae03113aa1cb req-e99af621-1389-41a0-a0c7-11c9e523a010 service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG nova.compute.manager [req-7415bfd4-8417-4aee-ba4a-ae03113aa1cb req-e99af621-1389-41a0-a0c7-11c9e523a010 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] No waiting events found dispatching network-vif-unplugged-71a96106-1d45-4b94-a7da-893e8b6d92bd {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG nova.compute.manager [req-7415bfd4-8417-4aee-ba4a-ae03113aa1cb req-e99af621-1389-41a0-a0c7-11c9e523a010 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received event network-vif-unplugged-71a96106-1d45-4b94-a7da-893e8b6d92bd for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG nova.compute.manager [req-7415bfd4-8417-4aee-ba4a-ae03113aa1cb req-e99af621-1389-41a0-a0c7-11c9e523a010 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received event network-vif-plugged-71a96106-1d45-4b94-a7da-893e8b6d92bd {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-7415bfd4-8417-4aee-ba4a-ae03113aa1cb req-e99af621-1389-41a0-a0c7-11c9e523a010 service nova] Acquiring lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-7415bfd4-8417-4aee-ba4a-ae03113aa1cb req-e99af621-1389-41a0-a0c7-11c9e523a010 service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-7415bfd4-8417-4aee-ba4a-ae03113aa1cb req-e99af621-1389-41a0-a0c7-11c9e523a010 service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG nova.compute.manager [req-7415bfd4-8417-4aee-ba4a-ae03113aa1cb req-e99af621-1389-41a0-a0c7-11c9e523a010 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] No waiting events found dispatching network-vif-plugged-71a96106-1d45-4b94-a7da-893e8b6d92bd {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:27:40 user nova-compute[72362]: WARNING nova.compute.manager [req-7415bfd4-8417-4aee-ba4a-ae03113aa1cb req-e99af621-1389-41a0-a0c7-11c9e523a010 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received unexpected event network-vif-plugged-71a96106-1d45-4b94-a7da-893e8b6d92bd for instance with vm_state active and task_state deleting.
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f580caec-da46-4b47-8113-6c6f3c0b9e22]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG nova.compute.manager [req-863108eb-093c-43c3-b143-43fdfdece62e req-86bd72f3-b937-4cba-9ef9-75b9cd7c89c3 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received event network-vif-plugged-0a6057db-abb0-4777-9aab-d3a2ba3f95ec {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-863108eb-093c-43c3-b143-43fdfdece62e req-86bd72f3-b937-4cba-9ef9-75b9cd7c89c3 service nova] Acquiring lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-863108eb-093c-43c3-b143-43fdfdece62e req-86bd72f3-b937-4cba-9ef9-75b9cd7c89c3 service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-863108eb-093c-43c3-b143-43fdfdece62e req-86bd72f3-b937-4cba-9ef9-75b9cd7c89c3 service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG nova.compute.manager [req-863108eb-093c-43c3-b143-43fdfdece62e req-86bd72f3-b937-4cba-9ef9-75b9cd7c89c3 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] No waiting events found dispatching network-vif-plugged-0a6057db-abb0-4777-9aab-d3a2ba3f95ec {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:27:40 user nova-compute[72362]: WARNING nova.compute.manager [req-863108eb-093c-43c3-b143-43fdfdece62e req-86bd72f3-b937-4cba-9ef9-75b9cd7c89c3 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received unexpected event network-vif-plugged-0a6057db-abb0-4777-9aab-d3a2ba3f95ec for instance with vm_state active and task_state deleting.
Aug 09 10:27:40 user nova-compute[72362]: DEBUG nova.compute.manager [req-863108eb-093c-43c3-b143-43fdfdece62e req-86bd72f3-b937-4cba-9ef9-75b9cd7c89c3 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received event network-vif-unplugged-ff7bc1ec-40b6-469c-8fec-e49752a917c6 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-863108eb-093c-43c3-b143-43fdfdece62e req-86bd72f3-b937-4cba-9ef9-75b9cd7c89c3 service nova] Acquiring lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-863108eb-093c-43c3-b143-43fdfdece62e req-86bd72f3-b937-4cba-9ef9-75b9cd7c89c3 service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-863108eb-093c-43c3-b143-43fdfdece62e req-86bd72f3-b937-4cba-9ef9-75b9cd7c89c3 service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG nova.compute.manager [req-863108eb-093c-43c3-b143-43fdfdece62e req-86bd72f3-b937-4cba-9ef9-75b9cd7c89c3 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] No waiting events found dispatching network-vif-unplugged-ff7bc1ec-40b6-469c-8fec-e49752a917c6 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG nova.compute.manager [req-863108eb-093c-43c3-b143-43fdfdece62e req-86bd72f3-b937-4cba-9ef9-75b9cd7c89c3 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received event network-vif-unplugged-ff7bc1ec-40b6-469c-8fec-e49752a917c6 for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG nova.compute.manager [req-863108eb-093c-43c3-b143-43fdfdece62e req-86bd72f3-b937-4cba-9ef9-75b9cd7c89c3 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received event network-vif-plugged-ff7bc1ec-40b6-469c-8fec-e49752a917c6 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-863108eb-093c-43c3-b143-43fdfdece62e req-86bd72f3-b937-4cba-9ef9-75b9cd7c89c3 service nova] Acquiring lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-863108eb-093c-43c3-b143-43fdfdece62e req-86bd72f3-b937-4cba-9ef9-75b9cd7c89c3 service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-863108eb-093c-43c3-b143-43fdfdece62e req-86bd72f3-b937-4cba-9ef9-75b9cd7c89c3 service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG nova.compute.manager [req-863108eb-093c-43c3-b143-43fdfdece62e req-86bd72f3-b937-4cba-9ef9-75b9cd7c89c3 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] No waiting events found dispatching network-vif-plugged-ff7bc1ec-40b6-469c-8fec-e49752a917c6 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:27:40 user nova-compute[72362]: WARNING nova.compute.manager [req-863108eb-093c-43c3-b143-43fdfdece62e req-86bd72f3-b937-4cba-9ef9-75b9cd7c89c3 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received unexpected event network-vif-plugged-ff7bc1ec-40b6-469c-8fec-e49752a917c6 for instance with vm_state active and task_state deleting.
Aug 09 10:27:40 user nova-compute[72362]: DEBUG nova.compute.manager [req-863108eb-093c-43c3-b143-43fdfdece62e req-86bd72f3-b937-4cba-9ef9-75b9cd7c89c3 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received event network-vif-unplugged-64f56105-6893-4ab5-86bf-380874d78f8c {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-863108eb-093c-43c3-b143-43fdfdece62e req-86bd72f3-b937-4cba-9ef9-75b9cd7c89c3 service nova] Acquiring lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-863108eb-093c-43c3-b143-43fdfdece62e req-86bd72f3-b937-4cba-9ef9-75b9cd7c89c3 service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-863108eb-093c-43c3-b143-43fdfdece62e req-86bd72f3-b937-4cba-9ef9-75b9cd7c89c3 service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG nova.compute.manager [req-863108eb-093c-43c3-b143-43fdfdece62e req-86bd72f3-b937-4cba-9ef9-75b9cd7c89c3 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] No waiting events found dispatching network-vif-unplugged-64f56105-6893-4ab5-86bf-380874d78f8c {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG nova.compute.manager [req-863108eb-093c-43c3-b143-43fdfdece62e req-86bd72f3-b937-4cba-9ef9-75b9cd7c89c3 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received event network-vif-unplugged-64f56105-6893-4ab5-86bf-380874d78f8c for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG nova.compute.manager [req-863108eb-093c-43c3-b143-43fdfdece62e req-86bd72f3-b937-4cba-9ef9-75b9cd7c89c3 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received event network-vif-plugged-64f56105-6893-4ab5-86bf-380874d78f8c {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-863108eb-093c-43c3-b143-43fdfdece62e req-86bd72f3-b937-4cba-9ef9-75b9cd7c89c3 service nova] Acquiring lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-863108eb-093c-43c3-b143-43fdfdece62e req-86bd72f3-b937-4cba-9ef9-75b9cd7c89c3 service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-863108eb-093c-43c3-b143-43fdfdece62e req-86bd72f3-b937-4cba-9ef9-75b9cd7c89c3 service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG nova.compute.manager [req-863108eb-093c-43c3-b143-43fdfdece62e req-86bd72f3-b937-4cba-9ef9-75b9cd7c89c3 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] No waiting events found dispatching network-vif-plugged-64f56105-6893-4ab5-86bf-380874d78f8c {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:27:40 user nova-compute[72362]: WARNING nova.compute.manager [req-863108eb-093c-43c3-b143-43fdfdece62e req-86bd72f3-b937-4cba-9ef9-75b9cd7c89c3 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received unexpected event network-vif-plugged-64f56105-6893-4ab5-86bf-380874d78f8c for instance with vm_state active and task_state deleting.
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43a9fd7-c147-4d02-b4aa-7c7b5f9813bc]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:27:40 user nova-compute[72362]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e (non-flash)
Aug 09 10:27:40 user nova-compute[72362]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 (non-flash)
Aug 09 10:27:40 user nova-compute[72362]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb (non-flash)
Aug 09 10:27:40 user nova-compute[72362]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)
Aug 09 10:27:40 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:27:40 user nova-compute[72362]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e (non-flash)
Aug 09 10:27:40 user nova-compute[72362]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 (non-flash)
Aug 09 10:27:40 user nova-compute[72362]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb (non-flash)
Aug 09 10:27:40 user nova-compute[72362]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)
Aug 09 10:27:40 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e45de290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e'): ({'sdd'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Removing single pathed devices sdd {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9780c0-06e2-4ef3-83d7-505ed971cd26]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.027s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e867156-3e19-4555-9a2c-29eb9eeec60d]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Flushing IO for device /dev/sdd {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc014971-1958-48be-8e01-d136155ef9f4]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78ec29e-4ce0-44c1-9819-5dc402505030]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] SCSI volumes sdd have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4082d7e9-e137-4e5b-b488-54982e4e2b90]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c038ef5e-d939-48ca-93fb-d372024bdbc4]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e, portal: 172.16.0.220,3260]
Aug 09 10:27:40 user nova-compute[72362]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e, portal: 172.16.0.220,3260] successful.
Aug 09 10:27:40 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc8514c8-cef8-4746-80df-4ded7518bc1e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f25025c-80c2-4857-b166-4aedffd9e3ab]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] <== disconnect_volume: return (340ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QtnsNAac', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:27:40 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:27:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[26741507-acb4-4e74-b2db-2d9fd8dcceb0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[704cf76f-c45d-41ab-ad6b-3273ee0ecc8f]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:27:40 user nova-compute[72362]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 (non-flash)
Aug 09 10:27:40 user nova-compute[72362]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb (non-flash)
Aug 09 10:27:40 user nova-compute[72362]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)
Aug 09 10:27:40 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:27:40 user nova-compute[72362]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 (non-flash)
Aug 09 10:27:40 user nova-compute[72362]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb (non-flash)
Aug 09 10:27:40 user nova-compute[72362]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)
Aug 09 10:27:40 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e4149750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5'): ({'sde'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Removing single pathed devices sde {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.113s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4becc0a4-11fa-4700-85bb-f16df2ee8de6]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.106s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fb499c-578b-4579-aac0-505e5f8f9430]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Flushing IO for device /dev/sde {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.168s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef16a3b-69ec-410d-9ffd-77f587573177]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG nova.compute.manager [req-b596a7a5-61f6-4b09-8627-384421768bfd req-a08b8c7b-7114-4cb0-950b-74224b692f62 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received event network-vif-plugged-31b0a33f-dad5-4ea1-8a20-d7c3fdedd352 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b596a7a5-61f6-4b09-8627-384421768bfd req-a08b8c7b-7114-4cb0-950b-74224b692f62 service nova] Acquiring lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b596a7a5-61f6-4b09-8627-384421768bfd req-a08b8c7b-7114-4cb0-950b-74224b692f62 service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b596a7a5-61f6-4b09-8627-384421768bfd req-a08b8c7b-7114-4cb0-950b-74224b692f62 service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG nova.compute.manager [req-b596a7a5-61f6-4b09-8627-384421768bfd req-a08b8c7b-7114-4cb0-950b-74224b692f62 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] No waiting events found dispatching network-vif-plugged-31b0a33f-dad5-4ea1-8a20-d7c3fdedd352 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:27:41 user nova-compute[72362]: WARNING nova.compute.manager [req-b596a7a5-61f6-4b09-8627-384421768bfd req-a08b8c7b-7114-4cb0-950b-74224b692f62 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received unexpected event network-vif-plugged-31b0a33f-dad5-4ea1-8a20-d7c3fdedd352 for instance with vm_state active and task_state deleting.
Aug 09 10:27:41 user nova-compute[72362]: DEBUG nova.compute.manager [req-b596a7a5-61f6-4b09-8627-384421768bfd req-a08b8c7b-7114-4cb0-950b-74224b692f62 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received event network-vif-unplugged-945c59da-d927-49a5-82e7-7c591943fcd1 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b596a7a5-61f6-4b09-8627-384421768bfd req-a08b8c7b-7114-4cb0-950b-74224b692f62 service nova] Acquiring lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b596a7a5-61f6-4b09-8627-384421768bfd req-a08b8c7b-7114-4cb0-950b-74224b692f62 service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b596a7a5-61f6-4b09-8627-384421768bfd req-a08b8c7b-7114-4cb0-950b-74224b692f62 service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG nova.compute.manager [req-b596a7a5-61f6-4b09-8627-384421768bfd req-a08b8c7b-7114-4cb0-950b-74224b692f62 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] No waiting events found dispatching network-vif-unplugged-945c59da-d927-49a5-82e7-7c591943fcd1 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG nova.compute.manager [req-b596a7a5-61f6-4b09-8627-384421768bfd req-a08b8c7b-7114-4cb0-950b-74224b692f62 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received event network-vif-unplugged-945c59da-d927-49a5-82e7-7c591943fcd1 for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG nova.compute.manager [req-b596a7a5-61f6-4b09-8627-384421768bfd req-a08b8c7b-7114-4cb0-950b-74224b692f62 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received event network-vif-plugged-945c59da-d927-49a5-82e7-7c591943fcd1 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b596a7a5-61f6-4b09-8627-384421768bfd req-a08b8c7b-7114-4cb0-950b-74224b692f62 service nova] Acquiring lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b596a7a5-61f6-4b09-8627-384421768bfd req-a08b8c7b-7114-4cb0-950b-74224b692f62 service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b596a7a5-61f6-4b09-8627-384421768bfd req-a08b8c7b-7114-4cb0-950b-74224b692f62 service nova] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG nova.compute.manager [req-b596a7a5-61f6-4b09-8627-384421768bfd req-a08b8c7b-7114-4cb0-950b-74224b692f62 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] No waiting events found dispatching network-vif-plugged-945c59da-d927-49a5-82e7-7c591943fcd1 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:27:41 user nova-compute[72362]: WARNING nova.compute.manager [req-b596a7a5-61f6-4b09-8627-384421768bfd req-a08b8c7b-7114-4cb0-950b-74224b692f62 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received unexpected event network-vif-plugged-945c59da-d927-49a5-82e7-7c591943fcd1 for instance with vm_state active and task_state deleting.
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.108s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7bb8878-ea78-4bba-bf5c-e6848fdfd7eb]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] SCSI volumes sde have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[1048250e-002f-4a1b-955b-9f97ad58e914]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3703204f-8561-48f8-b864-9bf1cbcf9c47]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5, portal: 172.16.0.220,3260]
Aug 09 10:27:41 user nova-compute[72362]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5, portal: 172.16.0.220,3260] successful.
Aug 09 10:27:41 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39ab95fc-aac0-4286-9f63-dcb1f84dc1a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c991cf6-47f5-4aba-97d7-108bbd573d37]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.728s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] <== disconnect_volume: return (729ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xZIEClgX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:27:41 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:27:41 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e70c056-4c15-43b4-ab29-f55f522b8d07]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af4eeaa-b6cb-47f4-b3e4-65e49245ae2c]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:27:41 user nova-compute[72362]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb (non-flash)
Aug 09 10:27:41 user nova-compute[72362]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)
Aug 09 10:27:41 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:27:41 user nova-compute[72362]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb (non-flash)
Aug 09 10:27:41 user nova-compute[72362]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)
Aug 09 10:27:41 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e4306440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb'): ({'sdf'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Removing single pathed devices sdf {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[df27a864-50d9-4058-a0f4-f9223d4f40aa]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b4d584-5aa2-49c2-9125-894e1b9ab3bd]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Flushing IO for device /dev/sdf {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d748b4-5710-4dff-bcc0-5c82d2e2f712]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c30620-0794-4919-a667-930514763714]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] SCSI volumes sdf have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3162286-ba5d-40e7-8559-76580be09e4d]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[712f342d-7f3a-4e5f-9bc9-e21d674d17d8]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb, portal: 172.16.0.220,3260]
Aug 09 10:27:41 user nova-compute[72362]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb, portal: 172.16.0.220,3260] successful.
Aug 09 10:27:41 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab739d8-a2a6-44f5-a553-89827f9c7ccb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50ac960-35cf-4ea1-836f-c7daa926030e]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] <== disconnect_volume: return (279ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:27:41 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Deleting instance files /opt/stack/data/nova/instances/4ebbb1fa-12d7-4ebf-b73d-52c452077ec8_del
Aug 09 10:27:41 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Deletion of /opt/stack/data/nova/instances/4ebbb1fa-12d7-4ebf-b73d-52c452077ec8_del complete
Aug 09 10:27:41 user nova-compute[72362]: INFO nova.compute.manager [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Took 4.00 seconds to destroy the instance on the hypervisor.
Aug 09 10:27:41 user nova-compute[72362]: DEBUG oslo.service.loopingcall [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72362) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG nova.compute.manager [-] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Deallocating network for instance {{(pid=72362) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 10:27:41 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] deallocate_for_instance() {{(pid=72362) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 10:27:44 user nova-compute[72362]: DEBUG nova.compute.manager [req-89eef729-f957-47ea-962c-a453724a7217 req-1391c8f2-16d8-4ac6-b260-69190d094440 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received event network-vif-deleted-31b0a33f-dad5-4ea1-8a20-d7c3fdedd352 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:27:44 user nova-compute[72362]: INFO nova.compute.manager [req-89eef729-f957-47ea-962c-a453724a7217 req-1391c8f2-16d8-4ac6-b260-69190d094440 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Neutron deleted interface 31b0a33f-dad5-4ea1-8a20-d7c3fdedd352; detaching it from the instance and deleting it from the info cache
Aug 09 10:27:44 user nova-compute[72362]: DEBUG nova.network.neutron [req-89eef729-f957-47ea-962c-a453724a7217 req-1391c8f2-16d8-4ac6-b260-69190d094440 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Updating instance_info_cache with network_info: [{"id": "0a6057db-abb0-4777-9aab-d3a2ba3f95ec", "address": "fa:16:3e:48:68:7a", "network": {"id": "bea01ebc-53b7-4715-a159-6295257b1dd1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1313518742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6057db-ab", "ovs_interfaceid": "0a6057db-abb0-4777-9aab-d3a2ba3f95ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4c5ba9f1-7d79-4f8a-8273-1fcf85b6ea71", "address": "fa:16:3e:14:52:ad", "network": {"id": "6a6fcebc-f762-47d1-9213-265b323e18e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1150728202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c5ba9f1-7d", "ovs_interfaceid": "4c5ba9f1-7d79-4f8a-8273-1fcf85b6ea71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff7bc1ec-40b6-469c-8fec-e49752a917c6", "address": "fa:16:3e:1a:1f:d2", "network": {"id": "6a6fcebc-f762-47d1-9213-265b323e18e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1150728202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff7bc1ec-40", "ovs_interfaceid": "ff7bc1ec-40b6-469c-8fec-e49752a917c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "64f56105-6893-4ab5-86bf-380874d78f8c", "address": "fa:16:3e:df:37:39", "network": {"id": "6a6fcebc-f762-47d1-9213-265b323e18e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1150728202", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64f56105-68", "ovs_interfaceid": "64f56105-6893-4ab5-86bf-380874d78f8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "71a96106-1d45-4b94-a7da-893e8b6d92bd", "address": "fa:16:3e:69:13:9b", "network": {"id": "355d69f9-75a6-4620-837c-cdc9269e990e", "bridge": "br-int", "label": "tempest-device-tagging-net2-969918414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71a96106-1d", "ovs_interfaceid": "71a96106-1d45-4b94-a7da-893e8b6d92bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "945c59da-d927-49a5-82e7-7c591943fcd1", "address": "fa:16:3e:11:1b:1b", "network": {"id": "355d69f9-75a6-4620-837c-cdc9269e990e", "bridge": "br-int", "label": "tempest-device-tagging-net2-969918414", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c28082d2768043b197738d79c7fe9f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap945c59da-d9", "ovs_interfaceid": "945c59da-d927-49a5-82e7-7c591943fcd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:27:44 user nova-compute[72362]: DEBUG nova.compute.manager [req-89eef729-f957-47ea-962c-a453724a7217 req-1391c8f2-16d8-4ac6-b260-69190d094440 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Detach interface failed, port_id=31b0a33f-dad5-4ea1-8a20-d7c3fdedd352, reason: Instance 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8 could not be found. {{(pid=72362) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 10:27:45 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:45 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:27:45 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Took 3.96 seconds to deallocate network for instance.
Aug 09 10:27:46 user nova-compute[72362]: DEBUG nova.compute.manager [req-bd63e563-1fa5-4cea-b36f-83dd6e001113 req-d106cb7a-b28a-4c7b-b686-61a7f70742c2 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received event network-vif-deleted-71a96106-1d45-4b94-a7da-893e8b6d92bd {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:27:46 user nova-compute[72362]: DEBUG nova.compute.manager [req-bd63e563-1fa5-4cea-b36f-83dd6e001113 req-d106cb7a-b28a-4c7b-b686-61a7f70742c2 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received event network-vif-deleted-0a6057db-abb0-4777-9aab-d3a2ba3f95ec {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:27:46 user nova-compute[72362]: DEBUG nova.compute.manager [req-bd63e563-1fa5-4cea-b36f-83dd6e001113 req-d106cb7a-b28a-4c7b-b686-61a7f70742c2 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received event network-vif-deleted-945c59da-d927-49a5-82e7-7c591943fcd1 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:27:46 user nova-compute[72362]: DEBUG nova.compute.manager [req-bd63e563-1fa5-4cea-b36f-83dd6e001113 req-d106cb7a-b28a-4c7b-b686-61a7f70742c2 service nova] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Received event network-vif-deleted-64f56105-6893-4ab5-86bf-380874d78f8c {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:27:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f4c437f8-54f9-4733-a988-7807b6bcf4db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Acquiring lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:27:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f4c437f8-54f9-4733-a988-7807b6bcf4db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:27:47 user nova-compute[72362]: DEBUG nova.objects.instance [None req-f4c437f8-54f9-4733-a988-7807b6bcf4db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lazy-loading 'flavor' on Instance uuid 4746beb1-d313-4cea-bf7b-75b507ebbdd2 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:27:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f4c437f8-54f9-4733-a988-7807b6bcf4db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:27:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f4c437f8-54f9-4733-a988-7807b6bcf4db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Acquiring lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:27:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f4c437f8-54f9-4733-a988-7807b6bcf4db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:27:47 user nova-compute[72362]: INFO nova.compute.manager [None req-f4c437f8-54f9-4733-a988-7807b6bcf4db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Attaching volume a51c8054-114a-4a19-a1a6-9b896c446ed1 to /dev/vdb
Aug 09 10:27:47 user nova-compute[72362]: DEBUG os_brick.utils [None req-f4c437f8-54f9-4733-a988-7807b6bcf4db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:27:47 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:47 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:47 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b6de08-0efc-40e5-bd47-ead929e9ae2b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:47 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:47 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:47 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[8071b709-f5de-4ec2-bd0c-5601ad46024f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:47 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:47 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:47 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ff227a-d9a6-400d-a9bf-1e0684e2a2d7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:47 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c6b770-6a85-4bbb-96ff-5589eaf8acdc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:47 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-f4c437f8-54f9-4733-a988-7807b6bcf4db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:47 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-f4c437f8-54f9-4733-a988-7807b6bcf4db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:27:47 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f4c437f8-54f9-4733-a988-7807b6bcf4db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:27:47 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:47 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:27:47 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:27:47 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5e08eb-c48a-4655-bc14-46ab89c352a0]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:47 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-f4c437f8-54f9-4733-a988-7807b6bcf4db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:27:47 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-f4c437f8-54f9-4733-a988-7807b6bcf4db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:27:47 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-f4c437f8-54f9-4733-a988-7807b6bcf4db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:27:47 user nova-compute[72362]: DEBUG os_brick.utils [None req-f4c437f8-54f9-4733-a988-7807b6bcf4db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:27:47 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-f4c437f8-54f9-4733-a988-7807b6bcf4db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Updating existing volume attachment record: 5e299e2a-b9eb-49bc-98e0-b52cedcc6a53 {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 10:27:48 user nova-compute[72362]: INFO nova.compute.manager [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Took 2.40 seconds to detach 3 volumes for instance.
Aug 09 10:27:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:27:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:27:48 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:27:48 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:27:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.345s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:27:48 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Deleted allocations for instance 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8
Aug 09 10:27:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f9647aab-f815-4f3a-9179-a88fcb6471db tempest-TaggedBootDevicesTest_v242-1074064696 tempest-TaggedBootDevicesTest_v242-1074064696-project-member] Lock "4ebbb1fa-12d7-4ebf-b73d-52c452077ec8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.956s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:27:48 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691576853.747908, a6000393-6044-4b54-ac0b-1d631e2ed0ae => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:27:48 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] VM Stopped (Lifecycle Event)
Aug 09 10:27:48 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1a65c4dc-19b2-4560-bc92-37d5b30eb09c None None] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:27:48 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1a65c4dc-19b2-4560-bc92-37d5b30eb09c None None] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:27:50 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:54 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691576859.7772014, 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8 => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:27:54 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] VM Stopped (Lifecycle Event)
Aug 09 10:27:54 user nova-compute[72362]: DEBUG nova.compute.manager [None req-2f7b5661-d810-4bb7-93d8-f5b324dec7da None None] [instance: 4ebbb1fa-12d7-4ebf-b73d-52c452077ec8] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:27:55 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:55 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4c437f8-54f9-4733-a988-7807b6bcf4db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:27:55 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c437f8-54f9-4733-a988-7807b6bcf4db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a51c8054-114a-4a19-a1a6-9b896c446ed1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gXyaSRKM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:27:55 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-f4c437f8-54f9-4733-a988-7807b6bcf4db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:27:55 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-f4c437f8-54f9-4733-a988-7807b6bcf4db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:27:55 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-f4c437f8-54f9-4733-a988-7807b6bcf4db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:27:55 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-f4c437f8-54f9-4733-a988-7807b6bcf4db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:27:55 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-f4c437f8-54f9-4733-a988-7807b6bcf4db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a51c8054-114a-4a19-a1a6-9b896c446ed1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:27:55 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-f4c437f8-54f9-4733-a988-7807b6bcf4db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a51c8054-114a-4a19-a1a6-9b896c446ed1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:27:55 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-f4c437f8-54f9-4733-a988-7807b6bcf4db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:27:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a51c8054-114a-4a19-a1a6-9b896c446ed1 -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a51c8054-114a-4a19-a1a6-9b896c446ed1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:56 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[baaa6d1d-af5d-44b8-8f48-a9cef534f542]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c437f8-54f9-4733-a988-7807b6bcf4db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:27:56 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:27:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a51c8054-114a-4a19-a1a6-9b896c446ed1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a51c8054-114a-4a19-a1a6-9b896c446ed1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:56 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b562a443-4b08-47d3-a0d7-d5ff585585e1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a51c8054-114a-4a19-a1a6-9b896c446ed1] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c437f8-54f9-4733-a988-7807b6bcf4db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a51c8054-114a-4a19-a1a6-9b896c446ed1] added
Aug 09 10:27:56 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:27:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a51c8054-114a-4a19-a1a6-9b896c446ed1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a51c8054-114a-4a19-a1a6-9b896c446ed1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:56 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f573da31-24ef-4e39-bfac-4864a2a6fd32]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c437f8-54f9-4733-a988-7807b6bcf4db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:27:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a51c8054-114a-4a19-a1a6-9b896c446ed1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a51c8054-114a-4a19-a1a6-9b896c446ed1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:56 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1887b05-fb3e-4158-ac84-7455fb579031]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c437f8-54f9-4733-a988-7807b6bcf4db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:27:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a51c8054-114a-4a19-a1a6-9b896c446ed1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gXyaSRKM {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a51c8054-114a-4a19-a1a6-9b896c446ed1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gXyaSRKM" returned: 0 in 0.035s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:56 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b56a30-6a16-4520-8814-5d8132f082ba]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c437f8-54f9-4733-a988-7807b6bcf4db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gXyaSRKM'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:27:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a51c8054-114a-4a19-a1a6-9b896c446ed1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a51c8054-114a-4a19-a1a6-9b896c446ed1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:56 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44027eb-5cbe-4569-a2fd-93817a4bb20e]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c437f8-54f9-4733-a988-7807b6bcf4db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:27:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:56 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ede076-af96-43c5-b871-84697fbba3d0]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c437f8-54f9-4733-a988-7807b6bcf4db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:27:56 user nova-compute[72362]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)
Aug 09 10:27:56 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:27:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c437f8-54f9-4733-a988-7807b6bcf4db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:27:56 user nova-compute[72362]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)
Aug 09 10:27:56 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:27:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a51c8054-114a-4a19-a1a6-9b896c446ed1 -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a51c8054-114a-4a19-a1a6-9b896c446ed1 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:56 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[966a2c36-4723-4e2f-812b-5fc0662c3a81]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a51c8054-114a-4a19-a1a6-9b896c446ed1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a51c8054-114a-4a19-a1a6-9b896c446ed1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c437f8-54f9-4733-a988-7807b6bcf4db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a51c8054-114a-4a19-a1a6-9b896c446ed1, portal: 172.16.0.220,3260]
Aug 09 10:27:56 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:a51c8054-114a-4a19-a1a6-9b896c446ed1, portal: 172.16.0.220,3260] successful.
Aug 09 10:27:56 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:27:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a51c8054-114a-4a19-a1a6-9b896c446ed1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a51c8054-114a-4a19-a1a6-9b896c446ed1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:56 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d432848a-9b63-4fc4-8088-2b360bfe14f9]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c437f8-54f9-4733-a988-7807b6bcf4db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:27:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:56 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c42300-9438-445b-b752-f55f98c84058]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c8054-114a-4a19-a1a6-9b896c446ed1 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c437f8-54f9-4733-a988-7807b6bcf4db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:27:56 user nova-compute[72362]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)
Aug 09 10:27:56 user nova-compute[72362]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c8054-114a-4a19-a1a6-9b896c446ed1 (non-flash)
Aug 09 10:27:56 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:27:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c437f8-54f9-4733-a988-7807b6bcf4db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:27:56 user nova-compute[72362]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)
Aug 09 10:27:56 user nova-compute[72362]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c8054-114a-4a19-a1a6-9b896c446ed1 (non-flash)
Aug 09 10:27:56 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:27:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-f4c437f8-54f9-4733-a988-7807b6bcf4db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a51c8054-114a-4a19-a1a6-9b896c446ed1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:27:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c437f8-54f9-4733-a988-7807b6bcf4db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:27:56 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-f4c437f8-54f9-4733-a988-7807b6bcf4db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] HCTL ('33', '-', '-', 0) found on session 34 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:27:56 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-f4c437f8-54f9-4733-a988-7807b6bcf4db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:27:56 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:27:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:56 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[2206b3ab-cfd8-4d48-ba12-d7379751b9ce]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:27:56 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-f4c437f8-54f9-4733-a988-7807b6bcf4db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:27:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c437f8-54f9-4733-a988-7807b6bcf4db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gXyaSRKM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:27:56 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:57 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-f4c437f8-54f9-4733-a988-7807b6bcf4db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:27:57 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c437f8-54f9-4733-a988-7807b6bcf4db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '26331616631646664', 'path': '/dev/sdb'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:27:57 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4c437f8-54f9-4733-a988-7807b6bcf4db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331616631646664', 'path': '/dev/sdb'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:27:57 user nova-compute[72362]: DEBUG nova.objects.instance [None req-f4c437f8-54f9-4733-a988-7807b6bcf4db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lazy-loading 'flavor' on Instance uuid 4746beb1-d313-4cea-bf7b-75b507ebbdd2 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:27:57 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-f4c437f8-54f9-4733-a988-7807b6bcf4db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 10:27:57 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:27:57 user nova-compute[72362]:   <source dev="/dev/sdb"/>
Aug 09 10:27:57 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:27:57 user nova-compute[72362]:   <serial>a51c8054-114a-4a19-a1a6-9b896c446ed1</serial>
Aug 09 10:27:57 user nova-compute[72362]: </disk>
Aug 09 10:27:57 user nova-compute[72362]:  {{(pid=72362) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 10:27:57 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-f4c437f8-54f9-4733-a988-7807b6bcf4db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:27:57 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-f4c437f8-54f9-4733-a988-7807b6bcf4db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:27:57 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-f4c437f8-54f9-4733-a988-7807b6bcf4db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] No VIF found with MAC fa:16:3e:03:05:4e, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:27:57 user nova-compute[72362]: DEBUG nova.compute.manager [req-9ae6bc8a-076d-4c6e-bd3f-a76dbb932fc7 req-5ece2a2b-00fd-4078-9f3b-e525ccc7115e service nova] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Received event network-changed-a722d26f-88e8-40a8-b13c-66ec2bc587cf {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:27:57 user nova-compute[72362]: DEBUG nova.compute.manager [req-9ae6bc8a-076d-4c6e-bd3f-a76dbb932fc7 req-5ece2a2b-00fd-4078-9f3b-e525ccc7115e service nova] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Refreshing instance network info cache due to event network-changed-a722d26f-88e8-40a8-b13c-66ec2bc587cf. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:27:57 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-9ae6bc8a-076d-4c6e-bd3f-a76dbb932fc7 req-5ece2a2b-00fd-4078-9f3b-e525ccc7115e service nova] Acquiring lock "refresh_cache-8d42f648-8616-4974-b416-0b6534b002cc" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:27:57 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-9ae6bc8a-076d-4c6e-bd3f-a76dbb932fc7 req-5ece2a2b-00fd-4078-9f3b-e525ccc7115e service nova] Acquired lock "refresh_cache-8d42f648-8616-4974-b416-0b6534b002cc" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:27:57 user nova-compute[72362]: DEBUG nova.network.neutron [req-9ae6bc8a-076d-4c6e-bd3f-a76dbb932fc7 req-5ece2a2b-00fd-4078-9f3b-e525ccc7115e service nova] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Refreshing network info cache for port a722d26f-88e8-40a8-b13c-66ec2bc587cf {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:27:57 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f4c437f8-54f9-4733-a988-7807b6bcf4db tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.520s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:27:57 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:27:57 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:27:57 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 10:27:58 user nova-compute[72362]: DEBUG nova.network.neutron [req-9ae6bc8a-076d-4c6e-bd3f-a76dbb932fc7 req-5ece2a2b-00fd-4078-9f3b-e525ccc7115e service nova] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Updated VIF entry in instance network info cache for port a722d26f-88e8-40a8-b13c-66ec2bc587cf. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:27:58 user nova-compute[72362]: DEBUG nova.network.neutron [req-9ae6bc8a-076d-4c6e-bd3f-a76dbb932fc7 req-5ece2a2b-00fd-4078-9f3b-e525ccc7115e service nova] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Updating instance_info_cache with network_info: [{"id": "a722d26f-88e8-40a8-b13c-66ec2bc587cf", "address": "fa:16:3e:9d:b1:56", "network": {"id": "da288577-5a89-4a87-aa94-d70e8e98cf83", "bridge": "br-int", "label": "tempest-TestShelveInstance-2076187029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4b0b83578f14c84a8fadd12e66911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa722d26f-88", "ovs_interfaceid": "a722d26f-88e8-40a8-b13c-66ec2bc587cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:27:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-9ae6bc8a-076d-4c6e-bd3f-a76dbb932fc7 req-5ece2a2b-00fd-4078-9f3b-e525ccc7115e service nova] Releasing lock "refresh_cache-8d42f648-8616-4974-b416-0b6534b002cc" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:27:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b07de4a5-7823-462a-a361-c7996dabf491 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Acquiring lock "8d42f648-8616-4974-b416-0b6534b002cc" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:27:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b07de4a5-7823-462a-a361-c7996dabf491 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Lock "8d42f648-8616-4974-b416-0b6534b002cc" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:27:58 user nova-compute[72362]: INFO nova.compute.manager [None req-b07de4a5-7823-462a-a361-c7996dabf491 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Shelve offloading
Aug 09 10:27:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquiring lock "f8abc99c-b87b-4586-b9d4-7f5bcda60683" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:27:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "f8abc99c-b87b-4586-b9d4-7f5bcda60683" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:27:58 user nova-compute[72362]: DEBUG nova.compute.manager [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Starting instance... {{(pid=72362) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 10:27:58 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:58 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:58 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:27:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:27:58 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:27:58 user nova-compute[72362]: INFO nova.compute.claims [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Claim successful on node user
Aug 09 10:27:58 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:27:58 user nova-compute[72362]: DEBUG nova.compute.manager [req-46956928-576b-4f3e-a159-8f8c98c4ecde req-c5468d65-f6c0-4946-a510-8261304fd97f service nova] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Received event network-vif-unplugged-a722d26f-88e8-40a8-b13c-66ec2bc587cf {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:27:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-46956928-576b-4f3e-a159-8f8c98c4ecde req-c5468d65-f6c0-4946-a510-8261304fd97f service nova] Acquiring lock "8d42f648-8616-4974-b416-0b6534b002cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:27:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-46956928-576b-4f3e-a159-8f8c98c4ecde req-c5468d65-f6c0-4946-a510-8261304fd97f service nova] Lock "8d42f648-8616-4974-b416-0b6534b002cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:27:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-46956928-576b-4f3e-a159-8f8c98c4ecde req-c5468d65-f6c0-4946-a510-8261304fd97f service nova] Lock "8d42f648-8616-4974-b416-0b6534b002cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:27:58 user nova-compute[72362]: DEBUG nova.compute.manager [req-46956928-576b-4f3e-a159-8f8c98c4ecde req-c5468d65-f6c0-4946-a510-8261304fd97f service nova] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] No waiting events found dispatching network-vif-unplugged-a722d26f-88e8-40a8-b13c-66ec2bc587cf {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:27:58 user nova-compute[72362]: WARNING nova.compute.manager [req-46956928-576b-4f3e-a159-8f8c98c4ecde req-c5468d65-f6c0-4946-a510-8261304fd97f service nova] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Received unexpected event network-vif-unplugged-a722d26f-88e8-40a8-b13c-66ec2bc587cf for instance with vm_state active and task_state shelving.
Aug 09 10:27:58 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:27:59 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:27:59 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:27:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.528s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:27:59 user nova-compute[72362]: DEBUG nova.compute.manager [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Start building networks asynchronously for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 10:27:59 user nova-compute[72362]: DEBUG nova.compute.manager [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Allocating IP information in the background. {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 10:27:59 user nova-compute[72362]: DEBUG nova.network.neutron [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] allocate_for_instance() {{(pid=72362) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 10:27:59 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 10:27:59 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Instance destroyed successfully.
Aug 09 10:27:59 user nova-compute[72362]: DEBUG nova.compute.manager [None req-b07de4a5-7823-462a-a361-c7996dabf491 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:27:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b07de4a5-7823-462a-a361-c7996dabf491 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Acquiring lock "refresh_cache-8d42f648-8616-4974-b416-0b6534b002cc" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:27:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b07de4a5-7823-462a-a361-c7996dabf491 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Acquired lock "refresh_cache-8d42f648-8616-4974-b416-0b6534b002cc" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:27:59 user nova-compute[72362]: DEBUG nova.network.neutron [None req-b07de4a5-7823-462a-a361-c7996dabf491 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:27:59 user nova-compute[72362]: DEBUG nova.compute.manager [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Start building block device mappings for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 10:27:59 user nova-compute[72362]: DEBUG nova.policy [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4a1904ffd10b4e8b959971b5e2383113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f206cedc59df46deb91e7ec2167c1f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72362) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 10:27:59 user nova-compute[72362]: DEBUG nova.compute.manager [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Start spawning the instance on the hypervisor. {{(pid=72362) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 10:27:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:27:59 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Creating image(s)
Aug 09 10:27:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquiring lock "/opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:27:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "/opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:27:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "/opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:27:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.177s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquiring lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:27:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:27:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.138s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk 1073741824 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-63d2b80d-3bf8-496f-80a8-60fcf41e9d39 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Acquiring lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:27:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-63d2b80d-3bf8-496f-80a8-60fcf41e9d39 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:27:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk 1073741824" returned: 0 in 0.067s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:27:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:27:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:27:59 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:27:59 user nova-compute[72362]: INFO nova.compute.manager [None req-63d2b80d-3bf8-496f-80a8-60fcf41e9d39 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Detaching volume a51c8054-114a-4a19-a1a6-9b896c446ed1
Aug 09 10:27:59 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:28:00 user nova-compute[72362]: INFO nova.virt.block_device [None req-63d2b80d-3bf8-496f-80a8-60fcf41e9d39 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Attempting to driver detach volume a51c8054-114a-4a19-a1a6-9b896c446ed1 from mountpoint /dev/vdb
Aug 09 10:28:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.160s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk. size=1073741824 {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG nova.network.neutron [None req-b07de4a5-7823-462a-a361-c7996dabf491 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Updating instance_info_cache with network_info: [{"id": "a722d26f-88e8-40a8-b13c-66ec2bc587cf", "address": "fa:16:3e:9d:b1:56", "network": {"id": "da288577-5a89-4a87-aa94-d70e8e98cf83", "bridge": "br-int", "label": "tempest-TestShelveInstance-2076187029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4b0b83578f14c84a8fadd12e66911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa722d26f-88", "ovs_interfaceid": "a722d26f-88e8-40a8-b13c-66ec2bc587cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-63d2b80d-3bf8-496f-80a8-60fcf41e9d39 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Attempting to detach device vdb from instance 4746beb1-d313-4cea-bf7b-75b507ebbdd2 from the persistent domain config. {{(pid=72362) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-63d2b80d-3bf8-496f-80a8-60fcf41e9d39 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 10:28:00 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:28:00 user nova-compute[72362]:   <source dev="/dev/sdb"/>
Aug 09 10:28:00 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:28:00 user nova-compute[72362]:   <serial>a51c8054-114a-4a19-a1a6-9b896c446ed1</serial>
Aug 09 10:28:00 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 10:28:00 user nova-compute[72362]: </disk>
Aug 09 10:28:00 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b07de4a5-7823-462a-a361-c7996dabf491 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Releasing lock "refresh_cache-8d42f648-8616-4974-b416-0b6534b002cc" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:28:00 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-63d2b80d-3bf8-496f-80a8-60fcf41e9d39 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Successfully detached device vdb from instance 4746beb1-d313-4cea-bf7b-75b507ebbdd2 from the persistent domain config.
Aug 09 10:28:00 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-63d2b80d-3bf8-496f-80a8-60fcf41e9d39 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4746beb1-d313-4cea-bf7b-75b507ebbdd2 from the live domain config. {{(pid=72362) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-63d2b80d-3bf8-496f-80a8-60fcf41e9d39 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 10:28:00 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:28:00 user nova-compute[72362]:   <source dev="/dev/sdb"/>
Aug 09 10:28:00 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:28:00 user nova-compute[72362]:   <serial>a51c8054-114a-4a19-a1a6-9b896c446ed1</serial>
Aug 09 10:28:00 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 10:28:00 user nova-compute[72362]: </disk>
Aug 09 10:28:00 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Cannot resize image /opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk to a smaller size. {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG nova.objects.instance [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lazy-loading 'migration_context' on Instance uuid f8abc99c-b87b-4586-b9d4-7f5bcda60683 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Created local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Ensure instance console log exists: /opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG nova.network.neutron [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Successfully created port: 1415f63e-af2e-4e87-aca2-8b360176adb7 {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Received event <DeviceRemovedEvent: 1691576880.6471303, 4746beb1-d313-4cea-bf7b-75b507ebbdd2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72362) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-63d2b80d-3bf8-496f-80a8-60fcf41e9d39 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4746beb1-d313-4cea-bf7b-75b507ebbdd2 {{(pid=72362) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 10:28:00 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-63d2b80d-3bf8-496f-80a8-60fcf41e9d39 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Successfully detached device vdb from instance 4746beb1-d313-4cea-bf7b-75b507ebbdd2 from the live domain config.
Aug 09 10:28:00 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63d2b80d-3bf8-496f-80a8-60fcf41e9d39 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d2b80d-3bf8-496f-80a8-60fcf41e9d39 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:a51c8054-114a-4a19-a1a6-9b896c446ed1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gXyaSRKM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:28:00 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-63d2b80d-3bf8-496f-80a8-60fcf41e9d39 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:28:00 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-63d2b80d-3bf8-496f-80a8-60fcf41e9d39 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-63d2b80d-3bf8-496f-80a8-60fcf41e9d39 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d2b80d-3bf8-496f-80a8-60fcf41e9d39 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a51c8054-114a-4a19-a1a6-9b896c446ed1', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[1992dffd-357d-4361-b31a-d89c3af92aee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a51c8054-114a-4a19-a1a6-9b896c446ed1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc2628f-2f91-48cc-8910-bbf73a0d3671]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c8054-114a-4a19-a1a6-9b896c446ed1 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d2b80d-3bf8-496f-80a8-60fcf41e9d39 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:28:00 user nova-compute[72362]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)
Aug 09 10:28:00 user nova-compute[72362]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c8054-114a-4a19-a1a6-9b896c446ed1 (non-flash)
Aug 09 10:28:00 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d2b80d-3bf8-496f-80a8-60fcf41e9d39 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:28:00 user nova-compute[72362]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)
Aug 09 10:28:00 user nova-compute[72362]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c8054-114a-4a19-a1a6-9b896c446ed1 (non-flash)
Aug 09 10:28:00 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d2b80d-3bf8-496f-80a8-60fcf41e9d39 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34dc26bd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a51c8054-114a-4a19-a1a6-9b896c446ed1'): ({'sdb'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-63d2b80d-3bf8-496f-80a8-60fcf41e9d39 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Removing single pathed devices sdb {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[98220aa6-770f-4f9e-8e77-58d8fe544282]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9364b7-c086-4348-bb8f-8ad462de8ec1]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-63d2b80d-3bf8-496f-80a8-60fcf41e9d39 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Flushing IO for device /dev/sdb {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fdc083-099a-4326-8274-6cea1b27c210]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-63d2b80d-3bf8-496f-80a8-60fcf41e9d39 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[519f1043-548e-4fc9-8792-eef4becad750]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-63d2b80d-3bf8-496f-80a8-60fcf41e9d39 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-63d2b80d-3bf8-496f-80a8-60fcf41e9d39 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] SCSI volumes sdb have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d2b80d-3bf8-496f-80a8-60fcf41e9d39 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a51c8054-114a-4a19-a1a6-9b896c446ed1')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a51c8054-114a-4a19-a1a6-9b896c446ed1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a51c8054-114a-4a19-a1a6-9b896c446ed1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53c5df8-1618-486e-97f2-eb6aafaede42]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d2b80d-3bf8-496f-80a8-60fcf41e9d39 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a51c8054-114a-4a19-a1a6-9b896c446ed1 -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG nova.compute.manager [req-46fa97aa-1a99-43b7-8c4e-142eb03e52f7 req-acaef82f-153a-4c98-a2cf-c4c6588a0180 service nova] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Received event network-vif-plugged-a722d26f-88e8-40a8-b13c-66ec2bc587cf {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-46fa97aa-1a99-43b7-8c4e-142eb03e52f7 req-acaef82f-153a-4c98-a2cf-c4c6588a0180 service nova] Acquiring lock "8d42f648-8616-4974-b416-0b6534b002cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-46fa97aa-1a99-43b7-8c4e-142eb03e52f7 req-acaef82f-153a-4c98-a2cf-c4c6588a0180 service nova] Lock "8d42f648-8616-4974-b416-0b6534b002cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-46fa97aa-1a99-43b7-8c4e-142eb03e52f7 req-acaef82f-153a-4c98-a2cf-c4c6588a0180 service nova] Lock "8d42f648-8616-4974-b416-0b6534b002cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG nova.compute.manager [req-46fa97aa-1a99-43b7-8c4e-142eb03e52f7 req-acaef82f-153a-4c98-a2cf-c4c6588a0180 service nova] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] No waiting events found dispatching network-vif-plugged-a722d26f-88e8-40a8-b13c-66ec2bc587cf {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:28:00 user nova-compute[72362]: WARNING nova.compute.manager [req-46fa97aa-1a99-43b7-8c4e-142eb03e52f7 req-acaef82f-153a-4c98-a2cf-c4c6588a0180 service nova] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Received unexpected event network-vif-plugged-a722d26f-88e8-40a8-b13c-66ec2bc587cf for instance with vm_state active and task_state shelving.
Aug 09 10:28:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a51c8054-114a-4a19-a1a6-9b896c446ed1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[499219b7-45b3-4388-b7a5-f1b0c93dae74]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:a51c8054-114a-4a19-a1a6-9b896c446ed1, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:a51c8054-114a-4a19-a1a6-9b896c446ed1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d2b80d-3bf8-496f-80a8-60fcf41e9d39 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:a51c8054-114a-4a19-a1a6-9b896c446ed1, portal: 172.16.0.220,3260]
Aug 09 10:28:00 user nova-compute[72362]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:a51c8054-114a-4a19-a1a6-9b896c446ed1, portal: 172.16.0.220,3260] successful.
Aug 09 10:28:00 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a51c8054-114a-4a19-a1a6-9b896c446ed1 -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Rebuilding the list of instances to heal {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a51c8054-114a-4a19-a1a6-9b896c446ed1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa6aa9a-482a-4529-8dc8-848188f50ea0]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d2b80d-3bf8-496f-80a8-60fcf41e9d39 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-63d2b80d-3bf8-496f-80a8-60fcf41e9d39 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d2b80d-3bf8-496f-80a8-60fcf41e9d39 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] <== disconnect_volume: return (326ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:28:00 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63d2b80d-3bf8-496f-80a8-60fcf41e9d39 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Skipping network cache update for instance because it is Building. {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 09 10:28:01 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Instance destroyed successfully.
Aug 09 10:28:01 user nova-compute[72362]: DEBUG nova.objects.instance [None req-b07de4a5-7823-462a-a361-c7996dabf491 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Lazy-loading 'resources' on Instance uuid 8d42f648-8616-4974-b416-0b6534b002cc {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-b07de4a5-7823-462a-a361-c7996dabf491 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:26:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1217884661',display_name='tempest-TestShelveInstance-server-1217884661',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1217884661',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOmjYX+nb6oC43JrBd2BJzwvKVraDBLQFtiNrt1C0JH07OfZmS7euFshiJsgrHA9mKVxj6ykyCXOcr6o2Xd6tEVsv+X2yXun7E9pphr2j2+BP4TP+ZXevz40p5xbEPaYA==',key_name='tempest-TestShelveInstance-1415559284',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:26:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d4b0b83578f14c84a8fadd12e66911f7',ramdisk_id='',reservation_id='r-4qse1uup',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-307673701',owner_user_name='tempest-TestShelveInstance-307673701-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:26:28Z,user_data=None,user_id='0b0a0c2a13af4b34ab0dedfaaeae864a',uuid=8d42f648-8616-4974-b416-0b6534b002cc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a722d26f-88e8-40a8-b13c-66ec2bc587cf", "address": "fa:16:3e:9d:b1:56", "network": {"id": "da288577-5a89-4a87-aa94-d70e8e98cf83", "bridge": "br-int", "label": "tempest-TestShelveInstance-2076187029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4b0b83578f14c84a8fadd12e66911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa722d26f-88", "ovs_interfaceid": "a722d26f-88e8-40a8-b13c-66ec2bc587cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-b07de4a5-7823-462a-a361-c7996dabf491 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Converting VIF {"id": "a722d26f-88e8-40a8-b13c-66ec2bc587cf", "address": "fa:16:3e:9d:b1:56", "network": {"id": "da288577-5a89-4a87-aa94-d70e8e98cf83", "bridge": "br-int", "label": "tempest-TestShelveInstance-2076187029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4b0b83578f14c84a8fadd12e66911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa722d26f-88", "ovs_interfaceid": "a722d26f-88e8-40a8-b13c-66ec2bc587cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-b07de4a5-7823-462a-a361-c7996dabf491 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:b1:56,bridge_name='br-int',has_traffic_filtering=True,id=a722d26f-88e8-40a8-b13c-66ec2bc587cf,network=Network(da288577-5a89-4a87-aa94-d70e8e98cf83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa722d26f-88') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG os_vif [None req-b07de4a5-7823-462a-a361-c7996dabf491 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:b1:56,bridge_name='br-int',has_traffic_filtering=True,id=a722d26f-88e8-40a8-b13c-66ec2bc587cf,network=Network(da288577-5a89-4a87-aa94-d70e8e98cf83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa722d26f-88') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa722d26f-88, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG nova.compute.manager [req-95c2223f-7a9e-4293-a144-b6d1cf851589 req-66fc9a1e-7076-4a40-8717-73006e633873 service nova] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Received event network-changed-a722d26f-88e8-40a8-b13c-66ec2bc587cf {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG nova.compute.manager [req-95c2223f-7a9e-4293-a144-b6d1cf851589 req-66fc9a1e-7076-4a40-8717-73006e633873 service nova] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Refreshing instance network info cache due to event network-changed-a722d26f-88e8-40a8-b13c-66ec2bc587cf. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-95c2223f-7a9e-4293-a144-b6d1cf851589 req-66fc9a1e-7076-4a40-8717-73006e633873 service nova] Acquiring lock "refresh_cache-8d42f648-8616-4974-b416-0b6534b002cc" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-95c2223f-7a9e-4293-a144-b6d1cf851589 req-66fc9a1e-7076-4a40-8717-73006e633873 service nova] Acquired lock "refresh_cache-8d42f648-8616-4974-b416-0b6534b002cc" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG nova.network.neutron [req-95c2223f-7a9e-4293-a144-b6d1cf851589 req-66fc9a1e-7076-4a40-8717-73006e633873 service nova] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Refreshing network info cache for port a722d26f-88e8-40a8-b13c-66ec2bc587cf {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:28:01 user nova-compute[72362]: INFO os_vif [None req-b07de4a5-7823-462a-a361-c7996dabf491 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:b1:56,bridge_name='br-int',has_traffic_filtering=True,id=a722d26f-88e8-40a8-b13c-66ec2bc587cf,network=Network(da288577-5a89-4a87-aa94-d70e8e98cf83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa722d26f-88')
Aug 09 10:28:01 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b07de4a5-7823-462a-a361-c7996dabf491 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-b07de4a5-7823-462a-a361-c7996dabf491 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Jkiypbdf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:28:01 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-b07de4a5-7823-462a-a361-c7996dabf491 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:28:01 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-b07de4a5-7823-462a-a361-c7996dabf491 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-b07de4a5-7823-462a-a361-c7996dabf491 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-b07de4a5-7823-462a-a361-c7996dabf491 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee72e429-091f-4811-9bbb-846e4b4e74a1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "refresh_cache-8e055c58-a365-4f18-a6e3-377e32e2189d" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquired lock "refresh_cache-8e055c58-a365-4f18-a6e3-377e32e2189d" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Forcefully refreshing network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG nova.objects.instance [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lazy-loading 'info_cache' on Instance uuid 8e055c58-a365-4f18-a6e3-377e32e2189d {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55cc591-5990-49de-833a-841b072739ef]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-b07de4a5-7823-462a-a361-c7996dabf491 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:28:01 user nova-compute[72362]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)
Aug 09 10:28:01 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-b07de4a5-7823-462a-a361-c7996dabf491 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:28:01 user nova-compute[72362]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)
Aug 09 10:28:01 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-b07de4a5-7823-462a-a361-c7996dabf491 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e5cbd750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9'): ({'sdg'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-b07de4a5-7823-462a-a361-c7996dabf491 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Removing single pathed devices sdg {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cad9427-bc4f-4a76-9acb-30432b65eeb5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.026s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[86fc39d0-4100-4d0d-b7c1-c9d2ff2b64ca]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-b07de4a5-7823-462a-a361-c7996dabf491 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Flushing IO for device /dev/sdg {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[006c32ca-2c79-47ba-87d4-83026b260214]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-b07de4a5-7823-462a-a361-c7996dabf491 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.060s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[26039110-11bb-400b-92b2-da2dba391a21]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-b07de4a5-7823-462a-a361-c7996dabf491 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-b07de4a5-7823-462a-a361-c7996dabf491 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] SCSI volumes sdg have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-b07de4a5-7823-462a-a361-c7996dabf491 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[978ad592-58b2-46d4-b50e-66d289a1d43e]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-b07de4a5-7823-462a-a361-c7996dabf491 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f6a951-8fb6-4e11-b269-77f494f91736]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-b07de4a5-7823-462a-a361-c7996dabf491 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9, portal: 172.16.0.220,3260]
Aug 09 10:28:01 user nova-compute[72362]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9, portal: 172.16.0.220,3260] successful.
Aug 09 10:28:01 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddaf266b-6fa7-4206-8bcb-2d94c1811d82]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-b07de4a5-7823-462a-a361-c7996dabf491 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-b07de4a5-7823-462a-a361-c7996dabf491 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-b07de4a5-7823-462a-a361-c7996dabf491 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] <== disconnect_volume: return (332ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b07de4a5-7823-462a-a361-c7996dabf491 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:28:01 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-b07de4a5-7823-462a-a361-c7996dabf491 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Deleting instance files /opt/stack/data/nova/instances/8d42f648-8616-4974-b416-0b6534b002cc_del
Aug 09 10:28:01 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-b07de4a5-7823-462a-a361-c7996dabf491 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Deletion of /opt/stack/data/nova/instances/8d42f648-8616-4974-b416-0b6534b002cc_del complete
Aug 09 10:28:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG nova.network.neutron [req-95c2223f-7a9e-4293-a144-b6d1cf851589 req-66fc9a1e-7076-4a40-8717-73006e633873 service nova] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Updated VIF entry in instance network info cache for port a722d26f-88e8-40a8-b13c-66ec2bc587cf. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG nova.network.neutron [req-95c2223f-7a9e-4293-a144-b6d1cf851589 req-66fc9a1e-7076-4a40-8717-73006e633873 service nova] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Updating instance_info_cache with network_info: [{"id": "a722d26f-88e8-40a8-b13c-66ec2bc587cf", "address": "fa:16:3e:9d:b1:56", "network": {"id": "da288577-5a89-4a87-aa94-d70e8e98cf83", "bridge": null, "label": "tempest-TestShelveInstance-2076187029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4b0b83578f14c84a8fadd12e66911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapa722d26f-88", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-95c2223f-7a9e-4293-a144-b6d1cf851589 req-66fc9a1e-7076-4a40-8717-73006e633873 service nova] Releasing lock "refresh_cache-8d42f648-8616-4974-b416-0b6534b002cc" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG nova.network.neutron [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Successfully updated port: 1415f63e-af2e-4e87-aca2-8b360176adb7 {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquiring lock "refresh_cache-f8abc99c-b87b-4586-b9d4-7f5bcda60683" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquired lock "refresh_cache-f8abc99c-b87b-4586-b9d4-7f5bcda60683" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG nova.network.neutron [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG nova.compute.manager [req-28232dd0-1760-4236-b592-2e0123eb8ee9 req-1c2e0085-c10e-4e69-98c9-a4d64ea1b906 service nova] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Received event network-changed-1415f63e-af2e-4e87-aca2-8b360176adb7 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG nova.compute.manager [req-28232dd0-1760-4236-b592-2e0123eb8ee9 req-1c2e0085-c10e-4e69-98c9-a4d64ea1b906 service nova] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Refreshing instance network info cache due to event network-changed-1415f63e-af2e-4e87-aca2-8b360176adb7. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-28232dd0-1760-4236-b592-2e0123eb8ee9 req-1c2e0085-c10e-4e69-98c9-a4d64ea1b906 service nova] Acquiring lock "refresh_cache-f8abc99c-b87b-4586-b9d4-7f5bcda60683" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG nova.objects.instance [None req-63d2b80d-3bf8-496f-80a8-60fcf41e9d39 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lazy-loading 'flavor' on Instance uuid 4746beb1-d313-4cea-bf7b-75b507ebbdd2 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG nova.network.neutron [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Updating instance_info_cache with network_info: [{"id": "f1a870b6-1d3b-4567-b165-8f2571edf9bd", "address": "fa:16:3e:d7:84:09", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a870b6-1d", "ovs_interfaceid": "f1a870b6-1d3b-4567-b165-8f2571edf9bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Releasing lock "refresh_cache-8e055c58-a365-4f18-a6e3-377e32e2189d" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Updated the network info_cache for instance {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-63d2b80d-3bf8-496f-80a8-60fcf41e9d39 tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.982s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:28:01 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:28:02 user nova-compute[72362]: DEBUG nova.network.neutron [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Updating instance_info_cache with network_info: [{"id": "1415f63e-af2e-4e87-aca2-8b360176adb7", "address": "fa:16:3e:c9:ab:0b", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1415f63e-af", "ovs_interfaceid": "1415f63e-af2e-4e87-aca2-8b360176adb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:28:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Releasing lock "refresh_cache-f8abc99c-b87b-4586-b9d4-7f5bcda60683" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:28:02 user nova-compute[72362]: DEBUG nova.compute.manager [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Instance network_info: |[{"id": "1415f63e-af2e-4e87-aca2-8b360176adb7", "address": "fa:16:3e:c9:ab:0b", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1415f63e-af", "ovs_interfaceid": "1415f63e-af2e-4e87-aca2-8b360176adb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 10:28:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-28232dd0-1760-4236-b592-2e0123eb8ee9 req-1c2e0085-c10e-4e69-98c9-a4d64ea1b906 service nova] Acquired lock "refresh_cache-f8abc99c-b87b-4586-b9d4-7f5bcda60683" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:28:02 user nova-compute[72362]: DEBUG nova.network.neutron [req-28232dd0-1760-4236-b592-2e0123eb8ee9 req-1c2e0085-c10e-4e69-98c9-a4d64ea1b906 service nova] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Refreshing network info cache for port 1415f63e-af2e-4e87-aca2-8b360176adb7 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:28:02 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Start _get_guest_xml network_info=[{"id": "1415f63e-af2e-4e87-aca2-8b360176adb7", "address": "fa:16:3e:c9:ab:0b", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1415f63e-af", "ovs_interfaceid": "1415f63e-af2e-4e87-aca2-8b360176adb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': 'a08d1a11-49eb-4212-a351-e11ee9553b95'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:28:02 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:28:02 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:28:02 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:28:02 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:28:02 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:28:02 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:28:02 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:28:02 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:28:02 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:28:02 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:28:02 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:28:02 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:28:02 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:28:02 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:28:02 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:28:02 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:28:02 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:28:02 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:28:02 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:27:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1593462953',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1593462953',id=27,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f206cedc59df46deb91e7ec2167c1f2b',ramdisk_id='',reservation_id='r-xyl8w71h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1706340435',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:27:59Z,user_data=None,user_id='4a1904ffd10b4e8b959971b5e2383113',uuid=f8abc99c-b87b-4586-b9d4-7f5bcda60683,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1415f63e-af2e-4e87-aca2-8b360176adb7", "address": "fa:16:3e:c9:ab:0b", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1415f63e-af", "ovs_interfaceid": "1415f63e-af2e-4e87-aca2-8b360176adb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:28:02 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Converting VIF {"id": "1415f63e-af2e-4e87-aca2-8b360176adb7", "address": "fa:16:3e:c9:ab:0b", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1415f63e-af", "ovs_interfaceid": "1415f63e-af2e-4e87-aca2-8b360176adb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:28:02 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:ab:0b,bridge_name='br-int',has_traffic_filtering=True,id=1415f63e-af2e-4e87-aca2-8b360176adb7,network=Network(bb852331-57aa-4911-b8ff-30f5411f65b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1415f63e-af') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:28:02 user nova-compute[72362]: DEBUG nova.objects.instance [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lazy-loading 'pci_devices' on Instance uuid f8abc99c-b87b-4586-b9d4-7f5bcda60683 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:28:02 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:28:02 user nova-compute[72362]:   <uuid>f8abc99c-b87b-4586-b9d4-7f5bcda60683</uuid>
Aug 09 10:28:02 user nova-compute[72362]:   <name>instance-0000001b</name>
Aug 09 10:28:02 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:28:02 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:28:02 user nova-compute[72362]:   <metadata>
Aug 09 10:28:02 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:28:02 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:28:02 user nova-compute[72362]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1593462953</nova:name>
Aug 09 10:28:02 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:28:02</nova:creationTime>
Aug 09 10:28:02 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:28:02 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:28:02 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:28:02 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:28:02 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:28:02 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:28:02 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:28:02 user nova-compute[72362]:       <nova:owner>
Aug 09 10:28:02 user nova-compute[72362]:         <nova:user uuid="4a1904ffd10b4e8b959971b5e2383113">tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member</nova:user>
Aug 09 10:28:02 user nova-compute[72362]:         <nova:project uuid="f206cedc59df46deb91e7ec2167c1f2b">tempest-ServerBootFromVolumeStableRescueTest-1706340435</nova:project>
Aug 09 10:28:02 user nova-compute[72362]:       </nova:owner>
Aug 09 10:28:02 user nova-compute[72362]:       <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:28:02 user nova-compute[72362]:       <nova:ports>
Aug 09 10:28:02 user nova-compute[72362]:         <nova:port uuid="1415f63e-af2e-4e87-aca2-8b360176adb7">
Aug 09 10:28:02 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 10:28:02 user nova-compute[72362]:         </nova:port>
Aug 09 10:28:02 user nova-compute[72362]:       </nova:ports>
Aug 09 10:28:02 user nova-compute[72362]:     </nova:instance>
Aug 09 10:28:02 user nova-compute[72362]:   </metadata>
Aug 09 10:28:02 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:28:02 user nova-compute[72362]:     <system>
Aug 09 10:28:02 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:28:02 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:28:02 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:28:02 user nova-compute[72362]:       <entry name="serial">f8abc99c-b87b-4586-b9d4-7f5bcda60683</entry>
Aug 09 10:28:02 user nova-compute[72362]:       <entry name="uuid">f8abc99c-b87b-4586-b9d4-7f5bcda60683</entry>
Aug 09 10:28:02 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:28:02 user nova-compute[72362]:     </system>
Aug 09 10:28:02 user nova-compute[72362]:   </sysinfo>
Aug 09 10:28:02 user nova-compute[72362]:   <os>
Aug 09 10:28:02 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:28:02 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:28:02 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:28:02 user nova-compute[72362]:   </os>
Aug 09 10:28:02 user nova-compute[72362]:   <features>
Aug 09 10:28:02 user nova-compute[72362]:     <acpi/>
Aug 09 10:28:02 user nova-compute[72362]:     <apic/>
Aug 09 10:28:02 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:28:02 user nova-compute[72362]:   </features>
Aug 09 10:28:02 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:28:02 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:28:02 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:28:02 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:28:02 user nova-compute[72362]:   </clock>
Aug 09 10:28:02 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:28:02 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:28:02 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:28:02 user nova-compute[72362]:   </cpu>
Aug 09 10:28:02 user nova-compute[72362]:   <devices>
Aug 09 10:28:02 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:28:02 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:28:02 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk"/>
Aug 09 10:28:02 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:28:02 user nova-compute[72362]:     </disk>
Aug 09 10:28:02 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:28:02 user nova-compute[72362]:       <mac address="fa:16:3e:c9:ab:0b"/>
Aug 09 10:28:02 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:28:02 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:28:02 user nova-compute[72362]:       <target dev="tap1415f63e-af"/>
Aug 09 10:28:02 user nova-compute[72362]:     </interface>
Aug 09 10:28:02 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:28:02 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/console.log" append="off"/>
Aug 09 10:28:02 user nova-compute[72362]:     </serial>
Aug 09 10:28:02 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:28:02 user nova-compute[72362]:     <video>
Aug 09 10:28:02 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:28:02 user nova-compute[72362]:     </video>
Aug 09 10:28:02 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:28:02 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:28:02 user nova-compute[72362]:     </rng>
Aug 09 10:28:02 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:28:02 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:28:02 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:28:02 user nova-compute[72362]:     </memballoon>
Aug 09 10:28:02 user nova-compute[72362]:   </devices>
Aug 09 10:28:02 user nova-compute[72362]: </domain>
Aug 09 10:28:02 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:28:02 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:27:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1593462953',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1593462953',id=27,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f206cedc59df46deb91e7ec2167c1f2b',ramdisk_id='',reservation_id='r-xyl8w71h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1706340435',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:27:59Z,user_data=None,user_id='4a1904ffd10b4e8b959971b5e2383113',uuid=f8abc99c-b87b-4586-b9d4-7f5bcda60683,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1415f63e-af2e-4e87-aca2-8b360176adb7", "address": "fa:16:3e:c9:ab:0b", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1415f63e-af", "ovs_interfaceid": "1415f63e-af2e-4e87-aca2-8b360176adb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:28:02 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Converting VIF {"id": "1415f63e-af2e-4e87-aca2-8b360176adb7", "address": "fa:16:3e:c9:ab:0b", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1415f63e-af", "ovs_interfaceid": "1415f63e-af2e-4e87-aca2-8b360176adb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:28:02 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:ab:0b,bridge_name='br-int',has_traffic_filtering=True,id=1415f63e-af2e-4e87-aca2-8b360176adb7,network=Network(bb852331-57aa-4911-b8ff-30f5411f65b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1415f63e-af') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:28:02 user nova-compute[72362]: DEBUG os_vif [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:ab:0b,bridge_name='br-int',has_traffic_filtering=True,id=1415f63e-af2e-4e87-aca2-8b360176adb7,network=Network(bb852331-57aa-4911-b8ff-30f5411f65b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1415f63e-af') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:28:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:28:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:28:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:28:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:28:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1415f63e-af, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:28:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1415f63e-af, col_values=(('external_ids', {'iface-id': '1415f63e-af2e-4e87-aca2-8b360176adb7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:ab:0b', 'vm-uuid': 'f8abc99c-b87b-4586-b9d4-7f5bcda60683'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:28:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:28:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:28:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:28:02 user nova-compute[72362]: INFO os_vif [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:ab:0b,bridge_name='br-int',has_traffic_filtering=True,id=1415f63e-af2e-4e87-aca2-8b360176adb7,network=Network(bb852331-57aa-4911-b8ff-30f5411f65b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1415f63e-af')
Aug 09 10:28:02 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:28:02 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] No VIF found with MAC fa:16:3e:c9:ab:0b, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:28:02 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-b07de4a5-7823-462a-a361-c7996dabf491 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Deleted allocations for instance 8d42f648-8616-4974-b416-0b6534b002cc
Aug 09 10:28:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b07de4a5-7823-462a-a361-c7996dabf491 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:28:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b07de4a5-7823-462a-a361-c7996dabf491 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:28:02 user nova-compute[72362]: DEBUG nova.objects.instance [None req-b07de4a5-7823-462a-a361-c7996dabf491 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Lazy-loading 'numa_topology' on Instance uuid 8d42f648-8616-4974-b416-0b6534b002cc {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:28:02 user nova-compute[72362]: DEBUG nova.network.neutron [req-28232dd0-1760-4236-b592-2e0123eb8ee9 req-1c2e0085-c10e-4e69-98c9-a4d64ea1b906 service nova] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Updated VIF entry in instance network info cache for port 1415f63e-af2e-4e87-aca2-8b360176adb7. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:28:02 user nova-compute[72362]: DEBUG nova.network.neutron [req-28232dd0-1760-4236-b592-2e0123eb8ee9 req-1c2e0085-c10e-4e69-98c9-a4d64ea1b906 service nova] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Updating instance_info_cache with network_info: [{"id": "1415f63e-af2e-4e87-aca2-8b360176adb7", "address": "fa:16:3e:c9:ab:0b", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1415f63e-af", "ovs_interfaceid": "1415f63e-af2e-4e87-aca2-8b360176adb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:28:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-28232dd0-1760-4236-b592-2e0123eb8ee9 req-1c2e0085-c10e-4e69-98c9-a4d64ea1b906 service nova] Releasing lock "refresh_cache-f8abc99c-b87b-4586-b9d4-7f5bcda60683" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:28:02 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-b07de4a5-7823-462a-a361-c7996dabf491 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:28:02 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-b07de4a5-7823-462a-a361-c7996dabf491 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:28:02 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:28:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b07de4a5-7823-462a-a361-c7996dabf491 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.326s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:28:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b07de4a5-7823-462a-a361-c7996dabf491 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Lock "8d42f648-8616-4974-b416-0b6534b002cc" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.509s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:28:03 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:28:03 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:28:03 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:28:03 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:28:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:28:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:28:04 user nova-compute[72362]: DEBUG nova.compute.manager [req-c12d6fb4-f04f-4e7c-94a0-d8c6ec88d168 req-7c88c1b2-3869-45b8-9e7e-7e23370f6e96 service nova] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Received event network-vif-plugged-1415f63e-af2e-4e87-aca2-8b360176adb7 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:28:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c12d6fb4-f04f-4e7c-94a0-d8c6ec88d168 req-7c88c1b2-3869-45b8-9e7e-7e23370f6e96 service nova] Acquiring lock "f8abc99c-b87b-4586-b9d4-7f5bcda60683-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:28:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c12d6fb4-f04f-4e7c-94a0-d8c6ec88d168 req-7c88c1b2-3869-45b8-9e7e-7e23370f6e96 service nova] Lock "f8abc99c-b87b-4586-b9d4-7f5bcda60683-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:28:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c12d6fb4-f04f-4e7c-94a0-d8c6ec88d168 req-7c88c1b2-3869-45b8-9e7e-7e23370f6e96 service nova] Lock "f8abc99c-b87b-4586-b9d4-7f5bcda60683-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:28:04 user nova-compute[72362]: DEBUG nova.compute.manager [req-c12d6fb4-f04f-4e7c-94a0-d8c6ec88d168 req-7c88c1b2-3869-45b8-9e7e-7e23370f6e96 service nova] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] No waiting events found dispatching network-vif-plugged-1415f63e-af2e-4e87-aca2-8b360176adb7 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:28:04 user nova-compute[72362]: WARNING nova.compute.manager [req-c12d6fb4-f04f-4e7c-94a0-d8c6ec88d168 req-7c88c1b2-3869-45b8-9e7e-7e23370f6e96 service nova] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Received unexpected event network-vif-plugged-1415f63e-af2e-4e87-aca2-8b360176adb7 for instance with vm_state building and task_state spawning.
Aug 09 10:28:05 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576885.8971372, f8abc99c-b87b-4586-b9d4-7f5bcda60683 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:28:05 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] VM Resumed (Lifecycle Event)
Aug 09 10:28:05 user nova-compute[72362]: DEBUG nova.compute.manager [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:28:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:28:05 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Instance spawned successfully.
Aug 09 10:28:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 10:28:05 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:28:05 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:28:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Found default for hw_cdrom_bus of ide {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:28:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Found default for hw_disk_bus of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:28:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:28:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:28:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Found default for hw_video_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:28:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Found default for hw_vif_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:28:05 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:28:05 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576885.899146, f8abc99c-b87b-4586-b9d4-7f5bcda60683 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:28:05 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] VM Started (Lifecycle Event)
Aug 09 10:28:05 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:28:05 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:28:06 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:28:06 user nova-compute[72362]: INFO nova.compute.manager [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Took 6.49 seconds to spawn the instance on the hypervisor.
Aug 09 10:28:06 user nova-compute[72362]: DEBUG nova.compute.manager [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:28:06 user nova-compute[72362]: INFO nova.compute.manager [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Took 7.41 seconds to build instance.
Aug 09 10:28:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-00dd7922-32b4-4f22-8c95-aee53a6b6c3d tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "f8abc99c-b87b-4586-b9d4-7f5bcda60683" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.527s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:28:06 user nova-compute[72362]: DEBUG nova.compute.manager [req-428bd8b2-7902-4428-805f-692bb1bd5f63 req-1ef21e5e-150d-456b-a689-89b8713beb9a service nova] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Received event network-vif-plugged-1415f63e-af2e-4e87-aca2-8b360176adb7 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:28:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-428bd8b2-7902-4428-805f-692bb1bd5f63 req-1ef21e5e-150d-456b-a689-89b8713beb9a service nova] Acquiring lock "f8abc99c-b87b-4586-b9d4-7f5bcda60683-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:28:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-428bd8b2-7902-4428-805f-692bb1bd5f63 req-1ef21e5e-150d-456b-a689-89b8713beb9a service nova] Lock "f8abc99c-b87b-4586-b9d4-7f5bcda60683-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:28:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-428bd8b2-7902-4428-805f-692bb1bd5f63 req-1ef21e5e-150d-456b-a689-89b8713beb9a service nova] Lock "f8abc99c-b87b-4586-b9d4-7f5bcda60683-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:28:06 user nova-compute[72362]: DEBUG nova.compute.manager [req-428bd8b2-7902-4428-805f-692bb1bd5f63 req-1ef21e5e-150d-456b-a689-89b8713beb9a service nova] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] No waiting events found dispatching network-vif-plugged-1415f63e-af2e-4e87-aca2-8b360176adb7 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:28:06 user nova-compute[72362]: WARNING nova.compute.manager [req-428bd8b2-7902-4428-805f-692bb1bd5f63 req-1ef21e5e-150d-456b-a689-89b8713beb9a service nova] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Received unexpected event network-vif-plugged-1415f63e-af2e-4e87-aca2-8b360176adb7 for instance with vm_state active and task_state None.
Aug 09 10:28:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:28:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:28:09 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:28:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:28:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:28:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:28:10 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 10:28:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09fcf27a-c6dc-4c4a-b73c-555ea2339967/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09fcf27a-c6dc-4c4a-b73c-555ea2339967/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09fcf27a-c6dc-4c4a-b73c-555ea2339967/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09fcf27a-c6dc-4c4a-b73c-555ea2339967/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:11 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:28:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a5a9ab8-ca97-454e-b850-c119ea2cd1bf/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a5a9ab8-ca97-454e-b850-c119ea2cd1bf/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a5a9ab8-ca97-454e-b850-c119ea2cd1bf/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a5a9ab8-ca97-454e-b850-c119ea2cd1bf/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4746beb1-d313-4cea-bf7b-75b507ebbdd2/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4746beb1-d313-4cea-bf7b-75b507ebbdd2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4746beb1-d313-4cea-bf7b-75b507ebbdd2/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4746beb1-d313-4cea-bf7b-75b507ebbdd2/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4087716-c913-48db-886e-2f21d1238c66/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4087716-c913-48db-886e-2f21d1238c66/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4087716-c913-48db-886e-2f21d1238c66/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4087716-c913-48db-886e-2f21d1238c66/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:28:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:13 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:28:13 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:28:13 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=7666MB free_disk=25.219730377197266GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 10:28:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:28:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:28:13 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 8e055c58-a365-4f18-a6e3-377e32e2189d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:28:13 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:28:13 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 4746beb1-d313-4cea-bf7b-75b507ebbdd2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:28:13 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance a6000393-6044-4b54-ac0b-1d631e2ed0ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:28:13 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 30213e67-6b1d-4d97-a971-1544335d02fb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:28:13 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 09fcf27a-c6dc-4c4a-b73c-555ea2339967 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:28:13 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance f4087716-c913-48db-886e-2f21d1238c66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:28:13 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:28:13 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance f8abc99c-b87b-4586-b9d4-7f5bcda60683 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:28:13 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 10:28:13 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 10:28:13 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:28:13 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:28:13 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 10:28:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.424s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:28:14 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691576879.3676841, 8d42f648-8616-4974-b416-0b6534b002cc => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:28:14 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] VM Stopped (Lifecycle Event)
Aug 09 10:28:14 user nova-compute[72362]: DEBUG nova.compute.manager [None req-0227b4f1-ad9f-4342-b1ae-3a7aadf3e528 None None] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:28:14 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:28:16 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:28:17 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:28:17 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:28:21 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:28:21 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:28:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:28:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:28:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:28:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Acquiring lock "94353851-e6a8-404b-b295-d539b2469d47" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:28:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Lock "94353851-e6a8-404b-b295-d539b2469d47" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:28:26 user nova-compute[72362]: DEBUG nova.compute.manager [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Starting instance... {{(pid=72362) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 10:28:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:28:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:28:26 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:28:26 user nova-compute[72362]: INFO nova.compute.claims [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Claim successful on node user
Aug 09 10:28:27 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:28:27 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:28:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.459s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:28:27 user nova-compute[72362]: DEBUG nova.compute.manager [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Start building networks asynchronously for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 10:28:27 user nova-compute[72362]: DEBUG nova.compute.manager [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Allocating IP information in the background. {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 10:28:27 user nova-compute[72362]: DEBUG nova.network.neutron [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] [instance: 94353851-e6a8-404b-b295-d539b2469d47] allocate_for_instance() {{(pid=72362) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 10:28:27 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 10:28:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:28:27 user nova-compute[72362]: DEBUG nova.compute.manager [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Start building block device mappings for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 10:28:27 user nova-compute[72362]: DEBUG nova.policy [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6299d4ac974c477e92914e677654f0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc168485d7424eb68b10725588022a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72362) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 10:28:27 user nova-compute[72362]: DEBUG nova.compute.manager [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Start spawning the instance on the hypervisor. {{(pid=72362) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 10:28:27 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:28:27 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Creating image(s)
Aug 09 10:28:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Acquiring lock "/opt/stack/data/nova/instances/94353851-e6a8-404b-b295-d539b2469d47/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:28:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Lock "/opt/stack/data/nova/instances/94353851-e6a8-404b-b295-d539b2469d47/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:28:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Lock "/opt/stack/data/nova/instances/94353851-e6a8-404b-b295-d539b2469d47/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:28:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.132s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Acquiring lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:28:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:28:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.136s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/94353851-e6a8-404b-b295-d539b2469d47/disk 1073741824 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/94353851-e6a8-404b-b295-d539b2469d47/disk 1073741824" returned: 0 in 0.049s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:28:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.137s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:28 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Checking if we can resize image /opt/stack/data/nova/instances/94353851-e6a8-404b-b295-d539b2469d47/disk. size=1073741824 {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 10:28:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94353851-e6a8-404b-b295-d539b2469d47/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94353851-e6a8-404b-b295-d539b2469d47/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:28 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Cannot resize image /opt/stack/data/nova/instances/94353851-e6a8-404b-b295-d539b2469d47/disk to a smaller size. {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 10:28:28 user nova-compute[72362]: DEBUG nova.objects.instance [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Lazy-loading 'migration_context' on Instance uuid 94353851-e6a8-404b-b295-d539b2469d47 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:28:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Created local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 10:28:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Ensure instance console log exists: /opt/stack/data/nova/instances/94353851-e6a8-404b-b295-d539b2469d47/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:28:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:28:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:28:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:28:28 user nova-compute[72362]: DEBUG nova.network.neutron [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Successfully created port: 63863234-78a1-41d7-8bd0-ee5d0657d86b {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:28:28 user nova-compute[72362]: DEBUG nova.network.neutron [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Successfully updated port: 63863234-78a1-41d7-8bd0-ee5d0657d86b {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:28:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Acquiring lock "refresh_cache-94353851-e6a8-404b-b295-d539b2469d47" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:28:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Acquired lock "refresh_cache-94353851-e6a8-404b-b295-d539b2469d47" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:28:28 user nova-compute[72362]: DEBUG nova.network.neutron [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:28:29 user nova-compute[72362]: DEBUG nova.compute.manager [req-0f404455-8de5-4d73-b53e-2cd178475e40 req-a8179b9a-5aad-435f-814d-a63e61d32c3c service nova] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Received event network-changed-63863234-78a1-41d7-8bd0-ee5d0657d86b {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:28:29 user nova-compute[72362]: DEBUG nova.compute.manager [req-0f404455-8de5-4d73-b53e-2cd178475e40 req-a8179b9a-5aad-435f-814d-a63e61d32c3c service nova] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Refreshing instance network info cache due to event network-changed-63863234-78a1-41d7-8bd0-ee5d0657d86b. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:28:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-0f404455-8de5-4d73-b53e-2cd178475e40 req-a8179b9a-5aad-435f-814d-a63e61d32c3c service nova] Acquiring lock "refresh_cache-94353851-e6a8-404b-b295-d539b2469d47" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:28:29 user nova-compute[72362]: DEBUG nova.network.neutron [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:28:29 user nova-compute[72362]: DEBUG nova.network.neutron [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Updating instance_info_cache with network_info: [{"id": "63863234-78a1-41d7-8bd0-ee5d0657d86b", "address": "fa:16:3e:d8:02:57", "network": {"id": "a5d87bf9-d44f-41f5-982b-a65355683bed", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1108251458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc168485d7424eb68b10725588022a8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63863234-78", "ovs_interfaceid": "63863234-78a1-41d7-8bd0-ee5d0657d86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:28:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Releasing lock "refresh_cache-94353851-e6a8-404b-b295-d539b2469d47" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:28:29 user nova-compute[72362]: DEBUG nova.compute.manager [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Instance network_info: |[{"id": "63863234-78a1-41d7-8bd0-ee5d0657d86b", "address": "fa:16:3e:d8:02:57", "network": {"id": "a5d87bf9-d44f-41f5-982b-a65355683bed", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1108251458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc168485d7424eb68b10725588022a8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63863234-78", "ovs_interfaceid": "63863234-78a1-41d7-8bd0-ee5d0657d86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 10:28:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-0f404455-8de5-4d73-b53e-2cd178475e40 req-a8179b9a-5aad-435f-814d-a63e61d32c3c service nova] Acquired lock "refresh_cache-94353851-e6a8-404b-b295-d539b2469d47" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:28:29 user nova-compute[72362]: DEBUG nova.network.neutron [req-0f404455-8de5-4d73-b53e-2cd178475e40 req-a8179b9a-5aad-435f-814d-a63e61d32c3c service nova] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Refreshing network info cache for port 63863234-78a1-41d7-8bd0-ee5d0657d86b {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:28:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Start _get_guest_xml network_info=[{"id": "63863234-78a1-41d7-8bd0-ee5d0657d86b", "address": "fa:16:3e:d8:02:57", "network": {"id": "a5d87bf9-d44f-41f5-982b-a65355683bed", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1108251458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc168485d7424eb68b10725588022a8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63863234-78", "ovs_interfaceid": "63863234-78a1-41d7-8bd0-ee5d0657d86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': 'a08d1a11-49eb-4212-a351-e11ee9553b95'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:28:29 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:28:29 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:28:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:28:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:28:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:28:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:28:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:28:29 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:28:29 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:28:29 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:28:29 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:28:29 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:28:29 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:28:29 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:28:29 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:28:29 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:28:29 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:28:29 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:28:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:28:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1699619469',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1699619469',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1699619',id=28,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJpiSLpbiQYD1SfunFU/GBvTdT5AnjKSLVNUh2l5Y4pV+NviHkBRzWru0VxImeKx4nFnEbdHyi96oSQe2CsXetCO1u0wHje0JeQyfXV1iOq5Tevaa3yDHYQMHnzbwWsLw==',key_name='tempest-keypair-634249765',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc168485d7424eb68b10725588022a8d',ramdisk_id='',reservation_id='r-kczemg2x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1177254404',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:28:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6299d4ac974c477e92914e677654f0f9',uuid=94353851-e6a8-404b-b295-d539b2469d47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63863234-78a1-41d7-8bd0-ee5d0657d86b", "address": "fa:16:3e:d8:02:57", "network": {"id": "a5d87bf9-d44f-41f5-982b-a65355683bed", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1108251458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc168485d7424eb68b10725588022a8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63863234-78", "ovs_interfaceid": "63863234-78a1-41d7-8bd0-ee5d0657d86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:28:29 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Converting VIF {"id": "63863234-78a1-41d7-8bd0-ee5d0657d86b", "address": "fa:16:3e:d8:02:57", "network": {"id": "a5d87bf9-d44f-41f5-982b-a65355683bed", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1108251458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc168485d7424eb68b10725588022a8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63863234-78", "ovs_interfaceid": "63863234-78a1-41d7-8bd0-ee5d0657d86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:28:29 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:02:57,bridge_name='br-int',has_traffic_filtering=True,id=63863234-78a1-41d7-8bd0-ee5d0657d86b,network=Network(a5d87bf9-d44f-41f5-982b-a65355683bed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63863234-78') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:28:29 user nova-compute[72362]: DEBUG nova.objects.instance [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Lazy-loading 'pci_devices' on Instance uuid 94353851-e6a8-404b-b295-d539b2469d47 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:28:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] [instance: 94353851-e6a8-404b-b295-d539b2469d47] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:28:29 user nova-compute[72362]:   <uuid>94353851-e6a8-404b-b295-d539b2469d47</uuid>
Aug 09 10:28:29 user nova-compute[72362]:   <name>instance-0000001c</name>
Aug 09 10:28:29 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:28:29 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:28:29 user nova-compute[72362]:   <metadata>
Aug 09 10:28:29 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:28:29 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:28:29 user nova-compute[72362]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1699619469</nova:name>
Aug 09 10:28:29 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:28:29</nova:creationTime>
Aug 09 10:28:29 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:28:29 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:28:29 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:28:29 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:28:29 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:28:29 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:28:29 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:28:29 user nova-compute[72362]:       <nova:owner>
Aug 09 10:28:29 user nova-compute[72362]:         <nova:user uuid="6299d4ac974c477e92914e677654f0f9">tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member</nova:user>
Aug 09 10:28:29 user nova-compute[72362]:         <nova:project uuid="bc168485d7424eb68b10725588022a8d">tempest-TestServerVolumeAttachScenarioOldVersion-1177254404</nova:project>
Aug 09 10:28:29 user nova-compute[72362]:       </nova:owner>
Aug 09 10:28:29 user nova-compute[72362]:       <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:28:29 user nova-compute[72362]:       <nova:ports>
Aug 09 10:28:29 user nova-compute[72362]:         <nova:port uuid="63863234-78a1-41d7-8bd0-ee5d0657d86b">
Aug 09 10:28:29 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 10:28:29 user nova-compute[72362]:         </nova:port>
Aug 09 10:28:29 user nova-compute[72362]:       </nova:ports>
Aug 09 10:28:29 user nova-compute[72362]:     </nova:instance>
Aug 09 10:28:29 user nova-compute[72362]:   </metadata>
Aug 09 10:28:29 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:28:29 user nova-compute[72362]:     <system>
Aug 09 10:28:29 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:28:29 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:28:29 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:28:29 user nova-compute[72362]:       <entry name="serial">94353851-e6a8-404b-b295-d539b2469d47</entry>
Aug 09 10:28:29 user nova-compute[72362]:       <entry name="uuid">94353851-e6a8-404b-b295-d539b2469d47</entry>
Aug 09 10:28:29 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:28:29 user nova-compute[72362]:     </system>
Aug 09 10:28:29 user nova-compute[72362]:   </sysinfo>
Aug 09 10:28:29 user nova-compute[72362]:   <os>
Aug 09 10:28:29 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:28:29 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:28:29 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:28:29 user nova-compute[72362]:   </os>
Aug 09 10:28:29 user nova-compute[72362]:   <features>
Aug 09 10:28:29 user nova-compute[72362]:     <acpi/>
Aug 09 10:28:29 user nova-compute[72362]:     <apic/>
Aug 09 10:28:29 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:28:29 user nova-compute[72362]:   </features>
Aug 09 10:28:29 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:28:29 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:28:29 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:28:29 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:28:29 user nova-compute[72362]:   </clock>
Aug 09 10:28:29 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:28:29 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:28:29 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:28:29 user nova-compute[72362]:   </cpu>
Aug 09 10:28:29 user nova-compute[72362]:   <devices>
Aug 09 10:28:29 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:28:29 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:28:29 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/94353851-e6a8-404b-b295-d539b2469d47/disk"/>
Aug 09 10:28:29 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:28:29 user nova-compute[72362]:     </disk>
Aug 09 10:28:29 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:28:29 user nova-compute[72362]:       <mac address="fa:16:3e:d8:02:57"/>
Aug 09 10:28:29 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:28:29 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:28:29 user nova-compute[72362]:       <target dev="tap63863234-78"/>
Aug 09 10:28:29 user nova-compute[72362]:     </interface>
Aug 09 10:28:29 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:28:29 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/94353851-e6a8-404b-b295-d539b2469d47/console.log" append="off"/>
Aug 09 10:28:29 user nova-compute[72362]:     </serial>
Aug 09 10:28:29 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:28:29 user nova-compute[72362]:     <video>
Aug 09 10:28:29 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:28:29 user nova-compute[72362]:     </video>
Aug 09 10:28:29 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:28:29 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:28:29 user nova-compute[72362]:     </rng>
Aug 09 10:28:29 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:28:29 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:28:29 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:28:29 user nova-compute[72362]:     </memballoon>
Aug 09 10:28:29 user nova-compute[72362]:   </devices>
Aug 09 10:28:29 user nova-compute[72362]: </domain>
Aug 09 10:28:29 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:28:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:28:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1699619469',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1699619469',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1699619',id=28,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJpiSLpbiQYD1SfunFU/GBvTdT5AnjKSLVNUh2l5Y4pV+NviHkBRzWru0VxImeKx4nFnEbdHyi96oSQe2CsXetCO1u0wHje0JeQyfXV1iOq5Tevaa3yDHYQMHnzbwWsLw==',key_name='tempest-keypair-634249765',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc168485d7424eb68b10725588022a8d',ramdisk_id='',reservation_id='r-kczemg2x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1177254404',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:28:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6299d4ac974c477e92914e677654f0f9',uuid=94353851-e6a8-404b-b295-d539b2469d47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63863234-78a1-41d7-8bd0-ee5d0657d86b", "address": "fa:16:3e:d8:02:57", "network": {"id": "a5d87bf9-d44f-41f5-982b-a65355683bed", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1108251458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc168485d7424eb68b10725588022a8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63863234-78", "ovs_interfaceid": "63863234-78a1-41d7-8bd0-ee5d0657d86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:28:29 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Converting VIF {"id": "63863234-78a1-41d7-8bd0-ee5d0657d86b", "address": "fa:16:3e:d8:02:57", "network": {"id": "a5d87bf9-d44f-41f5-982b-a65355683bed", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1108251458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc168485d7424eb68b10725588022a8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63863234-78", "ovs_interfaceid": "63863234-78a1-41d7-8bd0-ee5d0657d86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:28:29 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:02:57,bridge_name='br-int',has_traffic_filtering=True,id=63863234-78a1-41d7-8bd0-ee5d0657d86b,network=Network(a5d87bf9-d44f-41f5-982b-a65355683bed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63863234-78') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:28:29 user nova-compute[72362]: DEBUG os_vif [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:02:57,bridge_name='br-int',has_traffic_filtering=True,id=63863234-78a1-41d7-8bd0-ee5d0657d86b,network=Network(a5d87bf9-d44f-41f5-982b-a65355683bed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63863234-78') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:28:29 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:28:29 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:28:29 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:28:29 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:28:29 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap63863234-78, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:28:29 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap63863234-78, col_values=(('external_ids', {'iface-id': '63863234-78a1-41d7-8bd0-ee5d0657d86b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:02:57', 'vm-uuid': '94353851-e6a8-404b-b295-d539b2469d47'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:28:29 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:28:29 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:28:29 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:28:29 user nova-compute[72362]: INFO os_vif [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:02:57,bridge_name='br-int',has_traffic_filtering=True,id=63863234-78a1-41d7-8bd0-ee5d0657d86b,network=Network(a5d87bf9-d44f-41f5-982b-a65355683bed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63863234-78')
Aug 09 10:28:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:28:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] No VIF found with MAC fa:16:3e:d8:02:57, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:28:29 user nova-compute[72362]: DEBUG nova.network.neutron [req-0f404455-8de5-4d73-b53e-2cd178475e40 req-a8179b9a-5aad-435f-814d-a63e61d32c3c service nova] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Updated VIF entry in instance network info cache for port 63863234-78a1-41d7-8bd0-ee5d0657d86b. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:28:29 user nova-compute[72362]: DEBUG nova.network.neutron [req-0f404455-8de5-4d73-b53e-2cd178475e40 req-a8179b9a-5aad-435f-814d-a63e61d32c3c service nova] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Updating instance_info_cache with network_info: [{"id": "63863234-78a1-41d7-8bd0-ee5d0657d86b", "address": "fa:16:3e:d8:02:57", "network": {"id": "a5d87bf9-d44f-41f5-982b-a65355683bed", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1108251458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc168485d7424eb68b10725588022a8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63863234-78", "ovs_interfaceid": "63863234-78a1-41d7-8bd0-ee5d0657d86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:28:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-0f404455-8de5-4d73-b53e-2cd178475e40 req-a8179b9a-5aad-435f-814d-a63e61d32c3c service nova] Releasing lock "refresh_cache-94353851-e6a8-404b-b295-d539b2469d47" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:28:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:28:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:28:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:28:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:28:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:28:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:28:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:28:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:28:31 user nova-compute[72362]: DEBUG nova.compute.manager [req-39d7290e-ce8d-4bf9-baee-892b8331fdd1 req-47a67153-cda4-446b-a5db-abfeb8287f46 service nova] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Received event network-vif-plugged-63863234-78a1-41d7-8bd0-ee5d0657d86b {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:28:31 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-39d7290e-ce8d-4bf9-baee-892b8331fdd1 req-47a67153-cda4-446b-a5db-abfeb8287f46 service nova] Acquiring lock "94353851-e6a8-404b-b295-d539b2469d47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:28:31 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-39d7290e-ce8d-4bf9-baee-892b8331fdd1 req-47a67153-cda4-446b-a5db-abfeb8287f46 service nova] Lock "94353851-e6a8-404b-b295-d539b2469d47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:28:31 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-39d7290e-ce8d-4bf9-baee-892b8331fdd1 req-47a67153-cda4-446b-a5db-abfeb8287f46 service nova] Lock "94353851-e6a8-404b-b295-d539b2469d47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:28:31 user nova-compute[72362]: DEBUG nova.compute.manager [req-39d7290e-ce8d-4bf9-baee-892b8331fdd1 req-47a67153-cda4-446b-a5db-abfeb8287f46 service nova] [instance: 94353851-e6a8-404b-b295-d539b2469d47] No waiting events found dispatching network-vif-plugged-63863234-78a1-41d7-8bd0-ee5d0657d86b {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:28:31 user nova-compute[72362]: WARNING nova.compute.manager [req-39d7290e-ce8d-4bf9-baee-892b8331fdd1 req-47a67153-cda4-446b-a5db-abfeb8287f46 service nova] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Received unexpected event network-vif-plugged-63863234-78a1-41d7-8bd0-ee5d0657d86b for instance with vm_state building and task_state spawning.
Aug 09 10:28:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:28:32 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576912.9296443, 94353851-e6a8-404b-b295-d539b2469d47 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:28:32 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 94353851-e6a8-404b-b295-d539b2469d47] VM Resumed (Lifecycle Event)
Aug 09 10:28:32 user nova-compute[72362]: DEBUG nova.compute.manager [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:28:32 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:28:32 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Instance spawned successfully.
Aug 09 10:28:32 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 10:28:32 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:28:32 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:28:32 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Found default for hw_cdrom_bus of ide {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:28:32 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Found default for hw_disk_bus of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:28:32 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:28:32 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:28:32 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Found default for hw_video_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:28:32 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Found default for hw_vif_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:28:32 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 94353851-e6a8-404b-b295-d539b2469d47] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:28:32 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576912.9329424, 94353851-e6a8-404b-b295-d539b2469d47 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:28:32 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 94353851-e6a8-404b-b295-d539b2469d47] VM Started (Lifecycle Event)
Aug 09 10:28:33 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:28:33 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:28:33 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 94353851-e6a8-404b-b295-d539b2469d47] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:28:33 user nova-compute[72362]: INFO nova.compute.manager [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Took 5.57 seconds to spawn the instance on the hypervisor.
Aug 09 10:28:33 user nova-compute[72362]: DEBUG nova.compute.manager [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:28:33 user nova-compute[72362]: INFO nova.compute.manager [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Took 6.35 seconds to build instance.
Aug 09 10:28:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ee40bcab-c9f7-4949-9607-15ec4760c768 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Lock "94353851-e6a8-404b-b295-d539b2469d47" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.445s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:28:33 user nova-compute[72362]: DEBUG nova.compute.manager [req-699b0f2d-dcea-4549-bacc-63a0f81f7fce req-ba6fb6cb-a3bf-41a2-985e-69ccee9bb8b6 service nova] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Received event network-vif-plugged-63863234-78a1-41d7-8bd0-ee5d0657d86b {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:28:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-699b0f2d-dcea-4549-bacc-63a0f81f7fce req-ba6fb6cb-a3bf-41a2-985e-69ccee9bb8b6 service nova] Acquiring lock "94353851-e6a8-404b-b295-d539b2469d47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:28:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-699b0f2d-dcea-4549-bacc-63a0f81f7fce req-ba6fb6cb-a3bf-41a2-985e-69ccee9bb8b6 service nova] Lock "94353851-e6a8-404b-b295-d539b2469d47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:28:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-699b0f2d-dcea-4549-bacc-63a0f81f7fce req-ba6fb6cb-a3bf-41a2-985e-69ccee9bb8b6 service nova] Lock "94353851-e6a8-404b-b295-d539b2469d47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:28:33 user nova-compute[72362]: DEBUG nova.compute.manager [req-699b0f2d-dcea-4549-bacc-63a0f81f7fce req-ba6fb6cb-a3bf-41a2-985e-69ccee9bb8b6 service nova] [instance: 94353851-e6a8-404b-b295-d539b2469d47] No waiting events found dispatching network-vif-plugged-63863234-78a1-41d7-8bd0-ee5d0657d86b {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:28:33 user nova-compute[72362]: WARNING nova.compute.manager [req-699b0f2d-dcea-4549-bacc-63a0f81f7fce req-ba6fb6cb-a3bf-41a2-985e-69ccee9bb8b6 service nova] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Received unexpected event network-vif-plugged-63863234-78a1-41d7-8bd0-ee5d0657d86b for instance with vm_state active and task_state None.
Aug 09 10:28:34 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:28:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:28:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:28:39 user nova-compute[72362]: DEBUG nova.compute.manager [req-a795b6a0-54d2-42b1-8798-5c0355dc7521 req-352b0dc7-cc92-41ab-bb2f-15eeb021d375 service nova] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Received event network-changed-f99044c7-fa30-4e74-b2f3-0e937c17b02e {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:28:39 user nova-compute[72362]: DEBUG nova.compute.manager [req-a795b6a0-54d2-42b1-8798-5c0355dc7521 req-352b0dc7-cc92-41ab-bb2f-15eeb021d375 service nova] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Refreshing instance network info cache due to event network-changed-f99044c7-fa30-4e74-b2f3-0e937c17b02e. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:28:39 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-a795b6a0-54d2-42b1-8798-5c0355dc7521 req-352b0dc7-cc92-41ab-bb2f-15eeb021d375 service nova] Acquiring lock "refresh_cache-09fcf27a-c6dc-4c4a-b73c-555ea2339967" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:28:39 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-a795b6a0-54d2-42b1-8798-5c0355dc7521 req-352b0dc7-cc92-41ab-bb2f-15eeb021d375 service nova] Acquired lock "refresh_cache-09fcf27a-c6dc-4c4a-b73c-555ea2339967" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:28:39 user nova-compute[72362]: DEBUG nova.network.neutron [req-a795b6a0-54d2-42b1-8798-5c0355dc7521 req-352b0dc7-cc92-41ab-bb2f-15eeb021d375 service nova] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Refreshing network info cache for port f99044c7-fa30-4e74-b2f3-0e937c17b02e {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:28:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2889e546-17a1-44da-b666-07348009a1b6 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Acquiring lock "09fcf27a-c6dc-4c4a-b73c-555ea2339967" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:28:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2889e546-17a1-44da-b666-07348009a1b6 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "09fcf27a-c6dc-4c4a-b73c-555ea2339967" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:28:40 user nova-compute[72362]: DEBUG nova.objects.instance [None req-2889e546-17a1-44da-b666-07348009a1b6 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lazy-loading 'flavor' on Instance uuid 09fcf27a-c6dc-4c4a-b73c-555ea2339967 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:28:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2889e546-17a1-44da-b666-07348009a1b6 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "09fcf27a-c6dc-4c4a-b73c-555ea2339967" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.103s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:28:40 user nova-compute[72362]: DEBUG nova.network.neutron [req-a795b6a0-54d2-42b1-8798-5c0355dc7521 req-352b0dc7-cc92-41ab-bb2f-15eeb021d375 service nova] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Updated VIF entry in instance network info cache for port f99044c7-fa30-4e74-b2f3-0e937c17b02e. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:28:40 user nova-compute[72362]: DEBUG nova.network.neutron [req-a795b6a0-54d2-42b1-8798-5c0355dc7521 req-352b0dc7-cc92-41ab-bb2f-15eeb021d375 service nova] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Updating instance_info_cache with network_info: [{"id": "f99044c7-fa30-4e74-b2f3-0e937c17b02e", "address": "fa:16:3e:40:57:6c", "network": {"id": "5fe3b8dc-aa50-4e53-bb4d-2dcb773e501e", "bridge": "br-int", "label": "tempest-TestStampPattern-205380618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bb5a3be50242059591c9cbf8cc0f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf99044c7-fa", "ovs_interfaceid": "f99044c7-fa30-4e74-b2f3-0e937c17b02e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:28:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-a795b6a0-54d2-42b1-8798-5c0355dc7521 req-352b0dc7-cc92-41ab-bb2f-15eeb021d375 service nova] Releasing lock "refresh_cache-09fcf27a-c6dc-4c4a-b73c-555ea2339967" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:28:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2889e546-17a1-44da-b666-07348009a1b6 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Acquiring lock "09fcf27a-c6dc-4c4a-b73c-555ea2339967" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:28:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2889e546-17a1-44da-b666-07348009a1b6 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "09fcf27a-c6dc-4c4a-b73c-555ea2339967" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:28:40 user nova-compute[72362]: INFO nova.compute.manager [None req-2889e546-17a1-44da-b666-07348009a1b6 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Attaching volume 53f317f8-e6ea-43f6-89f6-aa1019801f27 to /dev/vdb
Aug 09 10:28:40 user nova-compute[72362]: DEBUG os_brick.utils [None req-2889e546-17a1-44da-b666-07348009a1b6 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:28:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:40 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[495dd05b-4455-4c96-93d8-ecc0d98c25fb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:28:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:40 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3abe8c17-5a0d-4547-96a0-99da2bb84fd9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:28:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:40 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a528ad97-2e23-486d-9995-bf8ffc5191fe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:28:40 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[275b8dd2-6175-4e0f-a3c6-12b7b1410e42]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:28:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-2889e546-17a1-44da-b666-07348009a1b6 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-2889e546-17a1-44da-b666-07348009a1b6 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:28:41 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2889e546-17a1-44da-b666-07348009a1b6 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:28:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:41 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:28:41 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:28:41 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2c8f48-c9ae-48d0-b7ce-66e8478d6fde]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:28:41 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-2889e546-17a1-44da-b666-07348009a1b6 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:28:41 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-2889e546-17a1-44da-b666-07348009a1b6 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:28:41 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-2889e546-17a1-44da-b666-07348009a1b6 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:28:41 user nova-compute[72362]: DEBUG os_brick.utils [None req-2889e546-17a1-44da-b666-07348009a1b6 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:28:41 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-2889e546-17a1-44da-b666-07348009a1b6 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Updating existing volume attachment record: 7ba041ea-7503-4abe-8fc6-e9bcc67b28d8 {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 10:28:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:28:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:28:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2889e546-17a1-44da-b666-07348009a1b6 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2889e546-17a1-44da-b666-07348009a1b6 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:53f317f8-e6ea-43f6-89f6-aa1019801f27'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PgfwlvIZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:28:49 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-2889e546-17a1-44da-b666-07348009a1b6 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:28:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-2889e546-17a1-44da-b666-07348009a1b6 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-2889e546-17a1-44da-b666-07348009a1b6 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:28:49 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-2889e546-17a1-44da-b666-07348009a1b6 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:28:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-2889e546-17a1-44da-b666-07348009a1b6 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53f317f8-e6ea-43f6-89f6-aa1019801f27" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-2889e546-17a1-44da-b666-07348009a1b6 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53f317f8-e6ea-43f6-89f6-aa1019801f27" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:28:49 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-2889e546-17a1-44da-b666-07348009a1b6 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:28:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53f317f8-e6ea-43f6-89f6-aa1019801f27 -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53f317f8-e6ea-43f6-89f6-aa1019801f27 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ce2c64-c99f-4dfb-9ebf-e0f79dbb9474]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2889e546-17a1-44da-b666-07348009a1b6 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:28:49 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53f317f8-e6ea-43f6-89f6-aa1019801f27 -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53f317f8-e6ea-43f6-89f6-aa1019801f27 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[930e761b-ab58-408f-92fb-f01367c62880]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53f317f8-e6ea-43f6-89f6-aa1019801f27] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2889e546-17a1-44da-b666-07348009a1b6 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53f317f8-e6ea-43f6-89f6-aa1019801f27] added
Aug 09 10:28:49 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53f317f8-e6ea-43f6-89f6-aa1019801f27 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53f317f8-e6ea-43f6-89f6-aa1019801f27 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[2723a13e-bb6d-4404-93f4-52c5980678d0]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2889e546-17a1-44da-b666-07348009a1b6 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53f317f8-e6ea-43f6-89f6-aa1019801f27 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53f317f8-e6ea-43f6-89f6-aa1019801f27 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9f7371-d80e-406e-8b40-34dcacec94ac]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2889e546-17a1-44da-b666-07348009a1b6 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53f317f8-e6ea-43f6-89f6-aa1019801f27 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PgfwlvIZ {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53f317f8-e6ea-43f6-89f6-aa1019801f27 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PgfwlvIZ" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8f09be-b55f-4473-bb17-39b96b6a530c]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2889e546-17a1-44da-b666-07348009a1b6 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PgfwlvIZ'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53f317f8-e6ea-43f6-89f6-aa1019801f27 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53f317f8-e6ea-43f6-89f6-aa1019801f27 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[199fa6d1-5ca0-4884-8995-7e67506e638a]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2889e546-17a1-44da-b666-07348009a1b6 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0ee631-60f7-43d2-a61d-22499fbf1d5d]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2889e546-17a1-44da-b666-07348009a1b6 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:28:49 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2889e546-17a1-44da-b666-07348009a1b6 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:28:49 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53f317f8-e6ea-43f6-89f6-aa1019801f27 -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53f317f8-e6ea-43f6-89f6-aa1019801f27 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[9333c335-eb8b-4835-8526-ddcc82e81a1a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:53f317f8-e6ea-43f6-89f6-aa1019801f27, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:53f317f8-e6ea-43f6-89f6-aa1019801f27, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2889e546-17a1-44da-b666-07348009a1b6 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:53f317f8-e6ea-43f6-89f6-aa1019801f27, portal: 172.16.0.220,3260]
Aug 09 10:28:49 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:53f317f8-e6ea-43f6-89f6-aa1019801f27, portal: 172.16.0.220,3260] successful.
Aug 09 10:28:49 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53f317f8-e6ea-43f6-89f6-aa1019801f27 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53f317f8-e6ea-43f6-89f6-aa1019801f27 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92a3634-1dfa-41cf-8918-3d774b28069d]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2889e546-17a1-44da-b666-07348009a1b6 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e32bbfe-ede1-4ddb-9f62-8558c3dbdda5]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f317f8-e6ea-43f6-89f6-aa1019801f27 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2889e546-17a1-44da-b666-07348009a1b6 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:28:49 user nova-compute[72362]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f317f8-e6ea-43f6-89f6-aa1019801f27 (non-flash)
Aug 09 10:28:49 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2889e546-17a1-44da-b666-07348009a1b6 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:28:49 user nova-compute[72362]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f317f8-e6ea-43f6-89f6-aa1019801f27 (non-flash)
Aug 09 10:28:49 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-2889e546-17a1-44da-b666-07348009a1b6 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53f317f8-e6ea-43f6-89f6-aa1019801f27" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2889e546-17a1-44da-b666-07348009a1b6 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-2889e546-17a1-44da-b666-07348009a1b6 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-2889e546-17a1-44da-b666-07348009a1b6 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b8fa5c-093c-4641-ad66-2631df5c1ac4]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-2889e546-17a1-44da-b666-07348009a1b6 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: None {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:28:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:28:50 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-2889e546-17a1-44da-b666-07348009a1b6 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:28:50 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2889e546-17a1-44da-b666-07348009a1b6 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PgfwlvIZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:28:50 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-2889e546-17a1-44da-b666-07348009a1b6 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:28:50 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2889e546-17a1-44da-b666-07348009a1b6 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '26138396237393532', 'path': '/dev/sdb'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:28:50 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2889e546-17a1-44da-b666-07348009a1b6 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138396237393532', 'path': '/dev/sdb'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:28:50 user nova-compute[72362]: DEBUG nova.objects.instance [None req-2889e546-17a1-44da-b666-07348009a1b6 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lazy-loading 'flavor' on Instance uuid 09fcf27a-c6dc-4c4a-b73c-555ea2339967 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:28:50 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-2889e546-17a1-44da-b666-07348009a1b6 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 10:28:50 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:28:50 user nova-compute[72362]:   <source dev="/dev/sdb"/>
Aug 09 10:28:50 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:28:50 user nova-compute[72362]:   <serial>53f317f8-e6ea-43f6-89f6-aa1019801f27</serial>
Aug 09 10:28:50 user nova-compute[72362]: </disk>
Aug 09 10:28:50 user nova-compute[72362]:  {{(pid=72362) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 10:28:50 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-2889e546-17a1-44da-b666-07348009a1b6 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:28:50 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-2889e546-17a1-44da-b666-07348009a1b6 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:28:50 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-2889e546-17a1-44da-b666-07348009a1b6 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] No VIF found with MAC fa:16:3e:40:57:6c, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:28:51 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2889e546-17a1-44da-b666-07348009a1b6 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "09fcf27a-c6dc-4c4a-b73c-555ea2339967" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.164s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:28:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:28:53 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-83c71d2f-7626-4ecf-91a4-20e0bcd41267 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Acquiring lock "09fcf27a-c6dc-4c4a-b73c-555ea2339967" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:28:53 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-83c71d2f-7626-4ecf-91a4-20e0bcd41267 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "09fcf27a-c6dc-4c4a-b73c-555ea2339967" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:28:53 user nova-compute[72362]: INFO nova.compute.manager [None req-83c71d2f-7626-4ecf-91a4-20e0bcd41267 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Detaching volume 53f317f8-e6ea-43f6-89f6-aa1019801f27
Aug 09 10:28:53 user nova-compute[72362]: INFO nova.virt.block_device [None req-83c71d2f-7626-4ecf-91a4-20e0bcd41267 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Attempting to driver detach volume 53f317f8-e6ea-43f6-89f6-aa1019801f27 from mountpoint /dev/vdb
Aug 09 10:28:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-83c71d2f-7626-4ecf-91a4-20e0bcd41267 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Attempting to detach device vdb from instance 09fcf27a-c6dc-4c4a-b73c-555ea2339967 from the persistent domain config. {{(pid=72362) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 10:28:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-83c71d2f-7626-4ecf-91a4-20e0bcd41267 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 10:28:53 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:28:53 user nova-compute[72362]:   <source dev="/dev/sdb"/>
Aug 09 10:28:53 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:28:53 user nova-compute[72362]:   <serial>53f317f8-e6ea-43f6-89f6-aa1019801f27</serial>
Aug 09 10:28:53 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 10:28:53 user nova-compute[72362]: </disk>
Aug 09 10:28:53 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:28:53 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-83c71d2f-7626-4ecf-91a4-20e0bcd41267 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Successfully detached device vdb from instance 09fcf27a-c6dc-4c4a-b73c-555ea2339967 from the persistent domain config.
Aug 09 10:28:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-83c71d2f-7626-4ecf-91a4-20e0bcd41267 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 09fcf27a-c6dc-4c4a-b73c-555ea2339967 from the live domain config. {{(pid=72362) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 10:28:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-83c71d2f-7626-4ecf-91a4-20e0bcd41267 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 10:28:53 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:28:53 user nova-compute[72362]:   <source dev="/dev/sdb"/>
Aug 09 10:28:53 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:28:53 user nova-compute[72362]:   <serial>53f317f8-e6ea-43f6-89f6-aa1019801f27</serial>
Aug 09 10:28:53 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 10:28:53 user nova-compute[72362]: </disk>
Aug 09 10:28:53 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:28:54 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Received event <DeviceRemovedEvent: 1691576934.4047089, 09fcf27a-c6dc-4c4a-b73c-555ea2339967 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72362) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 10:28:54 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-83c71d2f-7626-4ecf-91a4-20e0bcd41267 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 09fcf27a-c6dc-4c4a-b73c-555ea2339967 {{(pid=72362) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 10:28:54 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-83c71d2f-7626-4ecf-91a4-20e0bcd41267 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Successfully detached device vdb from instance 09fcf27a-c6dc-4c4a-b73c-555ea2339967 from the live domain config.
Aug 09 10:28:54 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83c71d2f-7626-4ecf-91a4-20e0bcd41267 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:28:54 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c71d2f-7626-4ecf-91a4-20e0bcd41267 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:53f317f8-e6ea-43f6-89f6-aa1019801f27'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PgfwlvIZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:28:54 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-83c71d2f-7626-4ecf-91a4-20e0bcd41267 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:28:54 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-83c71d2f-7626-4ecf-91a4-20e0bcd41267 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:28:54 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-83c71d2f-7626-4ecf-91a4-20e0bcd41267 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:28:54 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c71d2f-7626-4ecf-91a4-20e0bcd41267 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53f317f8-e6ea-43f6-89f6-aa1019801f27', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:28:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:54 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[003500f6-c7b2-4904-84d5-abe5c65c9f99]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53f317f8-e6ea-43f6-89f6-aa1019801f27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:28:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:54 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4508dd5-4785-4f51-a262-b1bc0fcd424c]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f317f8-e6ea-43f6-89f6-aa1019801f27 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:28:54 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c71d2f-7626-4ecf-91a4-20e0bcd41267 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:28:54 user nova-compute[72362]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f317f8-e6ea-43f6-89f6-aa1019801f27 (non-flash)
Aug 09 10:28:54 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:28:54 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c71d2f-7626-4ecf-91a4-20e0bcd41267 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:28:54 user nova-compute[72362]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f317f8-e6ea-43f6-89f6-aa1019801f27 (non-flash)
Aug 09 10:28:54 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:28:54 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c71d2f-7626-4ecf-91a4-20e0bcd41267 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34dc2acd30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53f317f8-e6ea-43f6-89f6-aa1019801f27'): ({'sdb'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:28:54 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-83c71d2f-7626-4ecf-91a4-20e0bcd41267 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Removing single pathed devices sdb {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:28:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:54 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:28:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:54 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6487e664-a700-4dd8-8f61-16619bda5597]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:28:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:54 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b183afa0-0cc7-42b1-99ca-b3f67a5eea11]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:28:54 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-83c71d2f-7626-4ecf-91a4-20e0bcd41267 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Flushing IO for device /dev/sdb {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:28:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:54 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1dc07c-c260-4615-be7c-a242b25c0b00]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:28:54 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-83c71d2f-7626-4ecf-91a4-20e0bcd41267 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:28:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:54 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5353a53-0c0d-4e6e-8722-591eeed202b5]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:28:54 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-83c71d2f-7626-4ecf-91a4-20e0bcd41267 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:28:54 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-83c71d2f-7626-4ecf-91a4-20e0bcd41267 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] SCSI volumes sdb have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:28:54 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c71d2f-7626-4ecf-91a4-20e0bcd41267 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53f317f8-e6ea-43f6-89f6-aa1019801f27')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:28:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53f317f8-e6ea-43f6-89f6-aa1019801f27 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53f317f8-e6ea-43f6-89f6-aa1019801f27 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:54 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[181b338e-9ad0-46a9-856c-df8b05605296]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:28:54 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c71d2f-7626-4ecf-91a4-20e0bcd41267 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:28:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53f317f8-e6ea-43f6-89f6-aa1019801f27 -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53f317f8-e6ea-43f6-89f6-aa1019801f27 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:54 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[041470f7-9bbd-4727-9387-7114d6da2015]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:53f317f8-e6ea-43f6-89f6-aa1019801f27, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:53f317f8-e6ea-43f6-89f6-aa1019801f27, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:28:54 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c71d2f-7626-4ecf-91a4-20e0bcd41267 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:53f317f8-e6ea-43f6-89f6-aa1019801f27, portal: 172.16.0.220,3260]
Aug 09 10:28:54 user nova-compute[72362]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:53f317f8-e6ea-43f6-89f6-aa1019801f27, portal: 172.16.0.220,3260] successful.
Aug 09 10:28:54 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:28:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53f317f8-e6ea-43f6-89f6-aa1019801f27 -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:28:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53f317f8-e6ea-43f6-89f6-aa1019801f27 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:28:54 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[da254100-1e13-4adc-9746-3d56100aa5d6]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:28:54 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c71d2f-7626-4ecf-91a4-20e0bcd41267 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:28:54 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-83c71d2f-7626-4ecf-91a4-20e0bcd41267 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:28:54 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c71d2f-7626-4ecf-91a4-20e0bcd41267 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] <== disconnect_volume: return (284ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:28:54 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83c71d2f-7626-4ecf-91a4-20e0bcd41267 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:28:55 user nova-compute[72362]: DEBUG nova.objects.instance [None req-83c71d2f-7626-4ecf-91a4-20e0bcd41267 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lazy-loading 'flavor' on Instance uuid 09fcf27a-c6dc-4c4a-b73c-555ea2339967 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:28:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-83c71d2f-7626-4ecf-91a4-20e0bcd41267 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "09fcf27a-c6dc-4c4a-b73c-555ea2339967" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.639s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:28:56 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:28:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:28:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:28:58 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:28:58 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:28:58 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 10:28:58 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:28:58 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:28:59 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:28:59 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:29:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:02 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:29:02 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 10:29:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "refresh_cache-3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:29:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquired lock "refresh_cache-3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:29:03 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Forcefully refreshing network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 10:29:03 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Updating instance_info_cache with network_info: [{"id": "9735e8ce-a2bd-49c8-adcf-846c05b7427e", "address": "fa:16:3e:91:34:e3", "network": {"id": "e6c54663-74e3-43e2-8f0d-61b300c1f68d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1222286883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ac22022944542c0b52dd912d3dbcce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9735e8ce-a2", "ovs_interfaceid": "9735e8ce-a2bd-49c8-adcf-846c05b7427e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:29:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Releasing lock "refresh_cache-3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:29:03 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Updated the network info_cache for instance {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 10:29:03 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:29:03 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:29:04 user nova-compute[72362]: DEBUG nova.compute.manager [req-c7930d35-ae74-475b-bf68-04eefcdd1af6 req-4af25b6a-255c-4435-a0ed-05844f1d4e19 service nova] [instance: f4087716-c913-48db-886e-2f21d1238c66] Received event network-changed-357779ea-2646-4d4b-926d-b069e0ae2aa2 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:29:04 user nova-compute[72362]: DEBUG nova.compute.manager [req-c7930d35-ae74-475b-bf68-04eefcdd1af6 req-4af25b6a-255c-4435-a0ed-05844f1d4e19 service nova] [instance: f4087716-c913-48db-886e-2f21d1238c66] Refreshing instance network info cache due to event network-changed-357779ea-2646-4d4b-926d-b069e0ae2aa2. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:29:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c7930d35-ae74-475b-bf68-04eefcdd1af6 req-4af25b6a-255c-4435-a0ed-05844f1d4e19 service nova] Acquiring lock "refresh_cache-f4087716-c913-48db-886e-2f21d1238c66" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:29:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c7930d35-ae74-475b-bf68-04eefcdd1af6 req-4af25b6a-255c-4435-a0ed-05844f1d4e19 service nova] Acquired lock "refresh_cache-f4087716-c913-48db-886e-2f21d1238c66" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:29:04 user nova-compute[72362]: DEBUG nova.network.neutron [req-c7930d35-ae74-475b-bf68-04eefcdd1af6 req-4af25b6a-255c-4435-a0ed-05844f1d4e19 service nova] [instance: f4087716-c913-48db-886e-2f21d1238c66] Refreshing network info cache for port 357779ea-2646-4d4b-926d-b069e0ae2aa2 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:29:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:05 user nova-compute[72362]: DEBUG nova.network.neutron [req-c7930d35-ae74-475b-bf68-04eefcdd1af6 req-4af25b6a-255c-4435-a0ed-05844f1d4e19 service nova] [instance: f4087716-c913-48db-886e-2f21d1238c66] Updated VIF entry in instance network info cache for port 357779ea-2646-4d4b-926d-b069e0ae2aa2. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:29:05 user nova-compute[72362]: DEBUG nova.network.neutron [req-c7930d35-ae74-475b-bf68-04eefcdd1af6 req-4af25b6a-255c-4435-a0ed-05844f1d4e19 service nova] [instance: f4087716-c913-48db-886e-2f21d1238c66] Updating instance_info_cache with network_info: [{"id": "357779ea-2646-4d4b-926d-b069e0ae2aa2", "address": "fa:16:3e:d9:6f:46", "network": {"id": "5b9407cc-c008-48b3-b93d-ed1ba23bcd90", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-399083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a66f472891e4aa18010200536e8f4f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap357779ea-26", "ovs_interfaceid": "357779ea-2646-4d4b-926d-b069e0ae2aa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:29:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c7930d35-ae74-475b-bf68-04eefcdd1af6 req-4af25b6a-255c-4435-a0ed-05844f1d4e19 service nova] Releasing lock "refresh_cache-f4087716-c913-48db-886e-2f21d1238c66" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:29:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1e8f3ed5-5e23-42f4-a7eb-f0faa5db28fa tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Acquiring lock "f4087716-c913-48db-886e-2f21d1238c66" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:29:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1e8f3ed5-5e23-42f4-a7eb-f0faa5db28fa tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Lock "f4087716-c913-48db-886e-2f21d1238c66" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:29:05 user nova-compute[72362]: DEBUG nova.objects.instance [None req-1e8f3ed5-5e23-42f4-a7eb-f0faa5db28fa tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Lazy-loading 'flavor' on Instance uuid f4087716-c913-48db-886e-2f21d1238c66 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:29:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1e8f3ed5-5e23-42f4-a7eb-f0faa5db28fa tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Lock "f4087716-c913-48db-886e-2f21d1238c66" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:29:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1e8f3ed5-5e23-42f4-a7eb-f0faa5db28fa tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Acquiring lock "f4087716-c913-48db-886e-2f21d1238c66" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:29:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1e8f3ed5-5e23-42f4-a7eb-f0faa5db28fa tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Lock "f4087716-c913-48db-886e-2f21d1238c66" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:29:05 user nova-compute[72362]: INFO nova.compute.manager [None req-1e8f3ed5-5e23-42f4-a7eb-f0faa5db28fa tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] [instance: f4087716-c913-48db-886e-2f21d1238c66] Attaching volume b0171c7d-a721-4169-aebd-bb284f7da7ac to /dev/vdb
Aug 09 10:29:05 user nova-compute[72362]: DEBUG os_brick.utils [None req-1e8f3ed5-5e23-42f4-a7eb-f0faa5db28fa tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:29:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ea4c82-23b8-4014-8825-978b917f8c08]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4332a87-8067-4236-ba03-f73907b057a0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91f3ad7-6d57-4264-a46c-73840f097b21]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2181a0-146a-42aa-833a-7937fe790923]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1e8f3ed5-5e23-42f4-a7eb-f0faa5db28fa tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1e8f3ed5-5e23-42f4-a7eb-f0faa5db28fa tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:29:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1e8f3ed5-5e23-42f4-a7eb-f0faa5db28fa tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:29:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:29:05 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:29:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8da343-7e36-4f66-bbb4-e7be59bff46a]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-1e8f3ed5-5e23-42f4-a7eb-f0faa5db28fa tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:29:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-1e8f3ed5-5e23-42f4-a7eb-f0faa5db28fa tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:29:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-1e8f3ed5-5e23-42f4-a7eb-f0faa5db28fa tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:29:05 user nova-compute[72362]: DEBUG os_brick.utils [None req-1e8f3ed5-5e23-42f4-a7eb-f0faa5db28fa tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:29:05 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-1e8f3ed5-5e23-42f4-a7eb-f0faa5db28fa tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] [instance: f4087716-c913-48db-886e-2f21d1238c66] Updating existing volume attachment record: d6f6d861-78d5-48f2-b584-7e32537145c6 {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 10:29:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:09 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:09 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:09 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:29:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:29:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:29:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:29:10 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 10:29:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09fcf27a-c6dc-4c4a-b73c-555ea2339967/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09fcf27a-c6dc-4c4a-b73c-555ea2339967/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09fcf27a-c6dc-4c4a-b73c-555ea2339967/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09fcf27a-c6dc-4c4a-b73c-555ea2339967/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:11 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:29:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a5a9ab8-ca97-454e-b850-c119ea2cd1bf/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a5a9ab8-ca97-454e-b850-c119ea2cd1bf/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a5a9ab8-ca97-454e-b850-c119ea2cd1bf/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a5a9ab8-ca97-454e-b850-c119ea2cd1bf/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94353851-e6a8-404b-b295-d539b2469d47/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:11 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94353851-e6a8-404b-b295-d539b2469d47/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94353851-e6a8-404b-b295-d539b2469d47/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94353851-e6a8-404b-b295-d539b2469d47/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4746beb1-d313-4cea-bf7b-75b507ebbdd2/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:11 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4746beb1-d313-4cea-bf7b-75b507ebbdd2/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4746beb1-d313-4cea-bf7b-75b507ebbdd2/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4746beb1-d313-4cea-bf7b-75b507ebbdd2/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4087716-c913-48db-886e-2f21d1238c66/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4087716-c913-48db-886e-2f21d1238c66/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4087716-c913-48db-886e-2f21d1238c66/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4087716-c913-48db-886e-2f21d1238c66/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:13 user nova-compute[72362]: DEBUG nova.compute.manager [req-95aec719-1df5-4d30-aa89-05c9296c172f req-3bdef807-3a41-4be7-9278-45dcce687d15 service nova] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Received event network-changed-012d406b-af0d-4583-b641-45775d43dfb3 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:29:13 user nova-compute[72362]: DEBUG nova.compute.manager [req-95aec719-1df5-4d30-aa89-05c9296c172f req-3bdef807-3a41-4be7-9278-45dcce687d15 service nova] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Refreshing instance network info cache due to event network-changed-012d406b-af0d-4583-b641-45775d43dfb3. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:29:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-95aec719-1df5-4d30-aa89-05c9296c172f req-3bdef807-3a41-4be7-9278-45dcce687d15 service nova] Acquiring lock "refresh_cache-1a5a9ab8-ca97-454e-b850-c119ea2cd1bf" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:29:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-95aec719-1df5-4d30-aa89-05c9296c172f req-3bdef807-3a41-4be7-9278-45dcce687d15 service nova] Acquired lock "refresh_cache-1a5a9ab8-ca97-454e-b850-c119ea2cd1bf" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:29:13 user nova-compute[72362]: DEBUG nova.network.neutron [req-95aec719-1df5-4d30-aa89-05c9296c172f req-3bdef807-3a41-4be7-9278-45dcce687d15 service nova] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Refreshing network info cache for port 012d406b-af0d-4583-b641-45775d43dfb3 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:29:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:13 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:29:13 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:29:13 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=7539MB free_disk=25.158985137939453GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 10:29:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:29:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:29:13 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 8e055c58-a365-4f18-a6e3-377e32e2189d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:29:13 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:29:13 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 4746beb1-d313-4cea-bf7b-75b507ebbdd2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:29:13 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance a6000393-6044-4b54-ac0b-1d631e2ed0ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:29:13 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 30213e67-6b1d-4d97-a971-1544335d02fb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:29:13 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 09fcf27a-c6dc-4c4a-b73c-555ea2339967 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:29:13 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance f4087716-c913-48db-886e-2f21d1238c66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:29:13 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:29:13 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance f8abc99c-b87b-4586-b9d4-7f5bcda60683 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:29:13 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 94353851-e6a8-404b-b295-d539b2469d47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:29:13 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 10:29:13 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e8f3ed5-5e23-42f4-a7eb-f0faa5db28fa tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] [instance: f4087716-c913-48db-886e-2f21d1238c66] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8f3ed5-5e23-42f4-a7eb-f0faa5db28fa tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nWDTiaVd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:29:14 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-1e8f3ed5-5e23-42f4-a7eb-f0faa5db28fa tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:29:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-1e8f3ed5-5e23-42f4-a7eb-f0faa5db28fa tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-1e8f3ed5-5e23-42f4-a7eb-f0faa5db28fa tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:29:14 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-1e8f3ed5-5e23-42f4-a7eb-f0faa5db28fa tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:29:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-1e8f3ed5-5e23-42f4-a7eb-f0faa5db28fa tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-1e8f3ed5-5e23-42f4-a7eb-f0faa5db28fa tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:29:14 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-1e8f3ed5-5e23-42f4-a7eb-f0faa5db28fa tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG nova.network.neutron [req-95aec719-1df5-4d30-aa89-05c9296c172f req-3bdef807-3a41-4be7-9278-45dcce687d15 service nova] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Updated VIF entry in instance network info cache for port 012d406b-af0d-4583-b641-45775d43dfb3. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG nova.network.neutron [req-95aec719-1df5-4d30-aa89-05c9296c172f req-3bdef807-3a41-4be7-9278-45dcce687d15 service nova] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Updating instance_info_cache with network_info: [{"id": "012d406b-af0d-4583-b641-45775d43dfb3", "address": "fa:16:3e:14:7b:dc", "network": {"id": "f9878e3c-f52a-4f3a-933d-b9c534dd3a59", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-797945070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc046adc7984378983895400e2b5e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap012d406b-af", "ovs_interfaceid": "012d406b-af0d-4583-b641-45775d43dfb3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[21cac10b-30a1-4134-ac39-f627dbaf448d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8f3ed5-5e23-42f4-a7eb-f0faa5db28fa tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:29:14 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-95aec719-1df5-4d30-aa89-05c9296c172f req-3bdef807-3a41-4be7-9278-45dcce687d15 service nova] Releasing lock "refresh_cache-1a5a9ab8-ca97-454e-b850-c119ea2cd1bf" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.032s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74dfb2b-fc35-4a7e-a85c-52e0454261b8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8f3ed5-5e23-42f4-a7eb-f0faa5db28fa tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac] added
Aug 09 10:29:14 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7048f263-800d-4ea1-9a89-ff4c0e35a262 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Acquiring lock "1a5a9ab8-ca97-454e-b850-c119ea2cd1bf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7048f263-800d-4ea1-9a89-ff4c0e35a262 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "1a5a9ab8-ca97-454e-b850-c119ea2cd1bf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[de088226-714f-4491-b1d4-920a0e9656aa]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8f3ed5-5e23-42f4-a7eb-f0faa5db28fa tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG nova.objects.instance [None req-7048f263-800d-4ea1-9a89-ff4c0e35a262 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lazy-loading 'flavor' on Instance uuid 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.752s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a822351-b5b8-478e-bfce-727f87ea62e7]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8f3ed5-5e23-42f4-a7eb-f0faa5db28fa tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nWDTiaVd {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:14 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-7048f263-800d-4ea1-9a89-ff4c0e35a262 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Ignoring supplied device name: /dev/vdb
Aug 09 10:29:14 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nWDTiaVd" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4698ce-3916-44c8-b234-129d2f5062ef]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8f3ed5-5e23-42f4-a7eb-f0faa5db28fa tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nWDTiaVd'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7048f263-800d-4ea1-9a89-ff4c0e35a262 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "1a5a9ab8-ca97-454e-b850-c119ea2cd1bf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc58337-959f-4d13-a941-c4aa0c0476f1]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8f3ed5-5e23-42f4-a7eb-f0faa5db28fa tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[030665a8-c32d-4ce9-9a23-31b4e93dac7e]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8f3ed5-5e23-42f4-a7eb-f0faa5db28fa tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:29:14 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8f3ed5-5e23-42f4-a7eb-f0faa5db28fa tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:29:14 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba58c34b-651c-4857-85d7-f9415ec19035]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8f3ed5-5e23-42f4-a7eb-f0faa5db28fa tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac, portal: 172.16.0.220,3260]
Aug 09 10:29:14 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac, portal: 172.16.0.220,3260] successful.
Aug 09 10:29:14 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f692003-18b3-422d-b2ff-8e59fbd4b765]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8f3ed5-5e23-42f4-a7eb-f0faa5db28fa tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7048f263-800d-4ea1-9a89-ff4c0e35a262 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Acquiring lock "1a5a9ab8-ca97-454e-b850-c119ea2cd1bf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7048f263-800d-4ea1-9a89-ff4c0e35a262 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "1a5a9ab8-ca97-454e-b850-c119ea2cd1bf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:29:14 user nova-compute[72362]: INFO nova.compute.manager [None req-7048f263-800d-4ea1-9a89-ff4c0e35a262 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Attaching volume 91c326b3-d5c5-4cae-b2cc-25f2971ba157 to /dev/vdb
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d8f2a9-b6f1-4624-88ce-43bfca8d77bb]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8f3ed5-5e23-42f4-a7eb-f0faa5db28fa tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:29:14 user nova-compute[72362]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac (non-flash)
Aug 09 10:29:14 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8f3ed5-5e23-42f4-a7eb-f0faa5db28fa tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:29:14 user nova-compute[72362]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac (non-flash)
Aug 09 10:29:14 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-1e8f3ed5-5e23-42f4-a7eb-f0faa5db28fa tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8f3ed5-5e23-42f4-a7eb-f0faa5db28fa tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-1e8f3ed5-5e23-42f4-a7eb-f0faa5db28fa tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-1e8f3ed5-5e23-42f4-a7eb-f0faa5db28fa tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d947651-6f48-4ba5-88af-1f2ce780a451]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-1e8f3ed5-5e23-42f4-a7eb-f0faa5db28fa tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8f3ed5-5e23-42f4-a7eb-f0faa5db28fa tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nWDTiaVd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG os_brick.utils [None req-7048f263-800d-4ea1-9a89-ff4c0e35a262 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb95f8a-69ea-4b4a-a0e7-73b7fe903ee3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed00f40-cc1e-4ce3-acfd-f9824878e799]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[342c93f7-45dc-4b9c-8f0b-7c60eac76475]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58383ea-c486-4ecd-86a7-5fef03be26c1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-7048f263-800d-4ea1-9a89-ff4c0e35a262 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-7048f263-800d-4ea1-9a89-ff4c0e35a262 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7048f263-800d-4ea1-9a89-ff4c0e35a262 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:29:14 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:29:14 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[78386445-885a-4535-bd63-f9e034938d9d]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-7048f263-800d-4ea1-9a89-ff4c0e35a262 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-7048f263-800d-4ea1-9a89-ff4c0e35a262 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-7048f263-800d-4ea1-9a89-ff4c0e35a262 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG os_brick.utils [None req-7048f263-800d-4ea1-9a89-ff4c0e35a262 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:29:14 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-7048f263-800d-4ea1-9a89-ff4c0e35a262 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Updating existing volume attachment record: 068a7b8c-34fc-4126-88ef-8408c1eee143 {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 10:29:15 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-1e8f3ed5-5e23-42f4-a7eb-f0faa5db28fa tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:29:15 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8f3ed5-5e23-42f4-a7eb-f0faa5db28fa tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] <== connect_volume: return (1387ms) {'type': 'block', 'scsi_wwn': '23330643930346265', 'path': '/dev/sdb'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:29:15 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e8f3ed5-5e23-42f4-a7eb-f0faa5db28fa tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] [instance: f4087716-c913-48db-886e-2f21d1238c66] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23330643930346265', 'path': '/dev/sdb'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:29:15 user nova-compute[72362]: DEBUG nova.objects.instance [None req-1e8f3ed5-5e23-42f4-a7eb-f0faa5db28fa tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Lazy-loading 'flavor' on Instance uuid f4087716-c913-48db-886e-2f21d1238c66 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:29:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Acquiring lock "fe1804e8-2340-4868-a0ff-32d5df5fad42" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:29:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Lock "fe1804e8-2340-4868-a0ff-32d5df5fad42" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:29:15 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-1e8f3ed5-5e23-42f4-a7eb-f0faa5db28fa tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 10:29:15 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:29:15 user nova-compute[72362]:   <source dev="/dev/sdb"/>
Aug 09 10:29:15 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:29:15 user nova-compute[72362]:   <serial>b0171c7d-a721-4169-aebd-bb284f7da7ac</serial>
Aug 09 10:29:15 user nova-compute[72362]: </disk>
Aug 09 10:29:15 user nova-compute[72362]:  {{(pid=72362) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 10:29:15 user nova-compute[72362]: DEBUG nova.compute.manager [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Starting instance... {{(pid=72362) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 10:29:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:29:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:29:15 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:29:15 user nova-compute[72362]: INFO nova.compute.claims [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Claim successful on node user
Aug 09 10:29:16 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1e8f3ed5-5e23-42f4-a7eb-f0faa5db28fa tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:29:16 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1e8f3ed5-5e23-42f4-a7eb-f0faa5db28fa tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:29:16 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1e8f3ed5-5e23-42f4-a7eb-f0faa5db28fa tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] No VIF found with MAC fa:16:3e:d9:6f:46, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:29:16 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:29:16 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:29:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1e8f3ed5-5e23-42f4-a7eb-f0faa5db28fa tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Lock "f4087716-c913-48db-886e-2f21d1238c66" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.943s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:29:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.528s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:29:16 user nova-compute[72362]: DEBUG nova.compute.manager [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Start building networks asynchronously for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 10:29:16 user nova-compute[72362]: DEBUG nova.compute.manager [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Allocating IP information in the background. {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 10:29:16 user nova-compute[72362]: DEBUG nova.network.neutron [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] allocate_for_instance() {{(pid=72362) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 10:29:16 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 10:29:16 user nova-compute[72362]: DEBUG nova.compute.manager [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Start building block device mappings for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 10:29:16 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:16 user nova-compute[72362]: DEBUG nova.compute.manager [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Start spawning the instance on the hypervisor. {{(pid=72362) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 10:29:16 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:29:16 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Creating image(s)
Aug 09 10:29:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Acquiring lock "/opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:29:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Lock "/opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:29:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Lock "/opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.018s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:29:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:16 user nova-compute[72362]: DEBUG nova.policy [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '40a78234613d42b4b3dbea339819f3ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fd45a7ce194cd4bc477f03bdebfe9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72362) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 10:29:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.147s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Acquiring lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:29:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:29:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.132s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/disk 1073741824 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/disk 1073741824" returned: 0 in 0.048s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:29:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.138s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:17 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/disk. size=1073741824 {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 10:29:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:17 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Cannot resize image /opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/disk to a smaller size. {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 10:29:17 user nova-compute[72362]: DEBUG nova.objects.instance [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Lazy-loading 'migration_context' on Instance uuid fe1804e8-2340-4868-a0ff-32d5df5fad42 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:29:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Created local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 10:29:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Ensure instance console log exists: /opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:29:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:29:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:29:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:29:17 user nova-compute[72362]: DEBUG nova.network.neutron [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Successfully created port: 3205c4d7-d431-4127-b2a5-436df06f6c4b {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:29:18 user nova-compute[72362]: DEBUG nova.network.neutron [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Successfully updated port: 3205c4d7-d431-4127-b2a5-436df06f6c4b {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:29:18 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Acquiring lock "refresh_cache-fe1804e8-2340-4868-a0ff-32d5df5fad42" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:29:18 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Acquired lock "refresh_cache-fe1804e8-2340-4868-a0ff-32d5df5fad42" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:29:18 user nova-compute[72362]: DEBUG nova.network.neutron [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:29:18 user nova-compute[72362]: DEBUG nova.compute.manager [req-f669f18f-fe1c-4b60-8072-3bacb9f7c5da req-e903df83-e850-4baa-abf8-5a9bfd0db904 service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Received event network-changed-3205c4d7-d431-4127-b2a5-436df06f6c4b {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:29:18 user nova-compute[72362]: DEBUG nova.compute.manager [req-f669f18f-fe1c-4b60-8072-3bacb9f7c5da req-e903df83-e850-4baa-abf8-5a9bfd0db904 service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Refreshing instance network info cache due to event network-changed-3205c4d7-d431-4127-b2a5-436df06f6c4b. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:29:18 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f669f18f-fe1c-4b60-8072-3bacb9f7c5da req-e903df83-e850-4baa-abf8-5a9bfd0db904 service nova] Acquiring lock "refresh_cache-fe1804e8-2340-4868-a0ff-32d5df5fad42" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:29:18 user nova-compute[72362]: DEBUG nova.network.neutron [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:29:18 user nova-compute[72362]: DEBUG nova.network.neutron [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Updating instance_info_cache with network_info: [{"id": "3205c4d7-d431-4127-b2a5-436df06f6c4b", "address": "fa:16:3e:44:ae:dc", "network": {"id": "322734db-2e92-4833-85a8-dc059a13b535", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-753064842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7fd45a7ce194cd4bc477f03bdebfe9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3205c4d7-d4", "ovs_interfaceid": "3205c4d7-d431-4127-b2a5-436df06f6c4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:29:18 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Releasing lock "refresh_cache-fe1804e8-2340-4868-a0ff-32d5df5fad42" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:29:18 user nova-compute[72362]: DEBUG nova.compute.manager [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Instance network_info: |[{"id": "3205c4d7-d431-4127-b2a5-436df06f6c4b", "address": "fa:16:3e:44:ae:dc", "network": {"id": "322734db-2e92-4833-85a8-dc059a13b535", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-753064842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7fd45a7ce194cd4bc477f03bdebfe9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3205c4d7-d4", "ovs_interfaceid": "3205c4d7-d431-4127-b2a5-436df06f6c4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 10:29:18 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f669f18f-fe1c-4b60-8072-3bacb9f7c5da req-e903df83-e850-4baa-abf8-5a9bfd0db904 service nova] Acquired lock "refresh_cache-fe1804e8-2340-4868-a0ff-32d5df5fad42" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:29:18 user nova-compute[72362]: DEBUG nova.network.neutron [req-f669f18f-fe1c-4b60-8072-3bacb9f7c5da req-e903df83-e850-4baa-abf8-5a9bfd0db904 service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Refreshing network info cache for port 3205c4d7-d431-4127-b2a5-436df06f6c4b {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:29:18 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Start _get_guest_xml network_info=[{"id": "3205c4d7-d431-4127-b2a5-436df06f6c4b", "address": "fa:16:3e:44:ae:dc", "network": {"id": "322734db-2e92-4833-85a8-dc059a13b535", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-753064842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7fd45a7ce194cd4bc477f03bdebfe9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3205c4d7-d4", "ovs_interfaceid": "3205c4d7-d431-4127-b2a5-436df06f6c4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': 'a08d1a11-49eb-4212-a351-e11ee9553b95'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:29:18 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:29:18 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:29:18 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:29:18 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:29:18 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:29:18 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:29:18 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:29:18 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:29:18 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:29:18 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:29:18 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:29:18 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:29:18 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:29:18 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:29:18 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:29:18 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:29:18 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:29:18 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:29:18 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:29:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1761559357',display_name='tempest-ServerStableDeviceRescueTest-server-1761559357',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1761559357',id=29,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOZ4Oer4n1DnitiHIilXA6F7pKlKFx/n4xsV/PbrQXmR8/0fskSLxaUGxc95Yb6OUuLhpJTUk+XkkpQUm2P/SNRsR8wXFgXI6C9yVCX/oYj9avRwisIFLdeBOydSQ+gRw==',key_name='tempest-keypair-2003538578',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7fd45a7ce194cd4bc477f03bdebfe9d',ramdisk_id='',reservation_id='r-0ptipo99',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1616327339',owner_user_name='tempest-ServerStableDeviceRescueTest-1616327339-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:29:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40a78234613d42b4b3dbea339819f3ba',uuid=fe1804e8-2340-4868-a0ff-32d5df5fad42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3205c4d7-d431-4127-b2a5-436df06f6c4b", "address": "fa:16:3e:44:ae:dc", "network": {"id": "322734db-2e92-4833-85a8-dc059a13b535", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-753064842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7fd45a7ce194cd4bc477f03bdebfe9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3205c4d7-d4", "ovs_interfaceid": "3205c4d7-d431-4127-b2a5-436df06f6c4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:29:18 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Converting VIF {"id": "3205c4d7-d431-4127-b2a5-436df06f6c4b", "address": "fa:16:3e:44:ae:dc", "network": {"id": "322734db-2e92-4833-85a8-dc059a13b535", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-753064842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7fd45a7ce194cd4bc477f03bdebfe9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3205c4d7-d4", "ovs_interfaceid": "3205c4d7-d431-4127-b2a5-436df06f6c4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:29:18 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:ae:dc,bridge_name='br-int',has_traffic_filtering=True,id=3205c4d7-d431-4127-b2a5-436df06f6c4b,network=Network(322734db-2e92-4833-85a8-dc059a13b535),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3205c4d7-d4') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:29:18 user nova-compute[72362]: DEBUG nova.objects.instance [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Lazy-loading 'pci_devices' on Instance uuid fe1804e8-2340-4868-a0ff-32d5df5fad42 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:29:18 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:29:18 user nova-compute[72362]:   <uuid>fe1804e8-2340-4868-a0ff-32d5df5fad42</uuid>
Aug 09 10:29:18 user nova-compute[72362]:   <name>instance-0000001d</name>
Aug 09 10:29:18 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:29:18 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:29:18 user nova-compute[72362]:   <metadata>
Aug 09 10:29:18 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:29:18 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:29:18 user nova-compute[72362]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1761559357</nova:name>
Aug 09 10:29:18 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:29:18</nova:creationTime>
Aug 09 10:29:18 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:29:18 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:29:18 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:29:18 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:29:18 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:29:18 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:29:18 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:29:18 user nova-compute[72362]:       <nova:owner>
Aug 09 10:29:18 user nova-compute[72362]:         <nova:user uuid="40a78234613d42b4b3dbea339819f3ba">tempest-ServerStableDeviceRescueTest-1616327339-project-member</nova:user>
Aug 09 10:29:18 user nova-compute[72362]:         <nova:project uuid="a7fd45a7ce194cd4bc477f03bdebfe9d">tempest-ServerStableDeviceRescueTest-1616327339</nova:project>
Aug 09 10:29:18 user nova-compute[72362]:       </nova:owner>
Aug 09 10:29:18 user nova-compute[72362]:       <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:29:18 user nova-compute[72362]:       <nova:ports>
Aug 09 10:29:18 user nova-compute[72362]:         <nova:port uuid="3205c4d7-d431-4127-b2a5-436df06f6c4b">
Aug 09 10:29:18 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 10:29:18 user nova-compute[72362]:         </nova:port>
Aug 09 10:29:18 user nova-compute[72362]:       </nova:ports>
Aug 09 10:29:18 user nova-compute[72362]:     </nova:instance>
Aug 09 10:29:18 user nova-compute[72362]:   </metadata>
Aug 09 10:29:18 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:29:18 user nova-compute[72362]:     <system>
Aug 09 10:29:18 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:29:18 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:29:18 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:29:18 user nova-compute[72362]:       <entry name="serial">fe1804e8-2340-4868-a0ff-32d5df5fad42</entry>
Aug 09 10:29:18 user nova-compute[72362]:       <entry name="uuid">fe1804e8-2340-4868-a0ff-32d5df5fad42</entry>
Aug 09 10:29:18 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:29:18 user nova-compute[72362]:     </system>
Aug 09 10:29:18 user nova-compute[72362]:   </sysinfo>
Aug 09 10:29:18 user nova-compute[72362]:   <os>
Aug 09 10:29:18 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:29:18 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:29:18 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:29:18 user nova-compute[72362]:   </os>
Aug 09 10:29:18 user nova-compute[72362]:   <features>
Aug 09 10:29:18 user nova-compute[72362]:     <acpi/>
Aug 09 10:29:18 user nova-compute[72362]:     <apic/>
Aug 09 10:29:18 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:29:18 user nova-compute[72362]:   </features>
Aug 09 10:29:18 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:29:18 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:29:18 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:29:18 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:29:18 user nova-compute[72362]:   </clock>
Aug 09 10:29:18 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:29:18 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:29:18 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:29:18 user nova-compute[72362]:   </cpu>
Aug 09 10:29:18 user nova-compute[72362]:   <devices>
Aug 09 10:29:18 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:29:18 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:29:18 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/disk"/>
Aug 09 10:29:18 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:29:18 user nova-compute[72362]:     </disk>
Aug 09 10:29:18 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:29:18 user nova-compute[72362]:       <mac address="fa:16:3e:44:ae:dc"/>
Aug 09 10:29:18 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:29:18 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:29:18 user nova-compute[72362]:       <target dev="tap3205c4d7-d4"/>
Aug 09 10:29:18 user nova-compute[72362]:     </interface>
Aug 09 10:29:18 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:29:18 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/console.log" append="off"/>
Aug 09 10:29:18 user nova-compute[72362]:     </serial>
Aug 09 10:29:18 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:29:18 user nova-compute[72362]:     <video>
Aug 09 10:29:18 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:29:18 user nova-compute[72362]:     </video>
Aug 09 10:29:18 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:29:18 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:29:18 user nova-compute[72362]:     </rng>
Aug 09 10:29:18 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:29:18 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:29:18 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:29:18 user nova-compute[72362]:     </memballoon>
Aug 09 10:29:18 user nova-compute[72362]:   </devices>
Aug 09 10:29:18 user nova-compute[72362]: </domain>
Aug 09 10:29:18 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:29:18 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:29:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1761559357',display_name='tempest-ServerStableDeviceRescueTest-server-1761559357',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1761559357',id=29,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOZ4Oer4n1DnitiHIilXA6F7pKlKFx/n4xsV/PbrQXmR8/0fskSLxaUGxc95Yb6OUuLhpJTUk+XkkpQUm2P/SNRsR8wXFgXI6C9yVCX/oYj9avRwisIFLdeBOydSQ+gRw==',key_name='tempest-keypair-2003538578',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7fd45a7ce194cd4bc477f03bdebfe9d',ramdisk_id='',reservation_id='r-0ptipo99',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1616327339',owner_user_name='tempest-ServerStableDeviceRescueTest-1616327339-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:29:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40a78234613d42b4b3dbea339819f3ba',uuid=fe1804e8-2340-4868-a0ff-32d5df5fad42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3205c4d7-d431-4127-b2a5-436df06f6c4b", "address": "fa:16:3e:44:ae:dc", "network": {"id": "322734db-2e92-4833-85a8-dc059a13b535", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-753064842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7fd45a7ce194cd4bc477f03bdebfe9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3205c4d7-d4", "ovs_interfaceid": "3205c4d7-d431-4127-b2a5-436df06f6c4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:29:18 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Converting VIF {"id": "3205c4d7-d431-4127-b2a5-436df06f6c4b", "address": "fa:16:3e:44:ae:dc", "network": {"id": "322734db-2e92-4833-85a8-dc059a13b535", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-753064842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7fd45a7ce194cd4bc477f03bdebfe9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3205c4d7-d4", "ovs_interfaceid": "3205c4d7-d431-4127-b2a5-436df06f6c4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:29:18 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:ae:dc,bridge_name='br-int',has_traffic_filtering=True,id=3205c4d7-d431-4127-b2a5-436df06f6c4b,network=Network(322734db-2e92-4833-85a8-dc059a13b535),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3205c4d7-d4') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:29:18 user nova-compute[72362]: DEBUG os_vif [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:ae:dc,bridge_name='br-int',has_traffic_filtering=True,id=3205c4d7-d431-4127-b2a5-436df06f6c4b,network=Network(322734db-2e92-4833-85a8-dc059a13b535),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3205c4d7-d4') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:29:18 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:18 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:29:18 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:29:18 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:18 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3205c4d7-d4, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:29:18 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3205c4d7-d4, col_values=(('external_ids', {'iface-id': '3205c4d7-d431-4127-b2a5-436df06f6c4b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:ae:dc', 'vm-uuid': 'fe1804e8-2340-4868-a0ff-32d5df5fad42'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:29:18 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:18 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:29:18 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:18 user nova-compute[72362]: INFO os_vif [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:ae:dc,bridge_name='br-int',has_traffic_filtering=True,id=3205c4d7-d431-4127-b2a5-436df06f6c4b,network=Network(322734db-2e92-4833-85a8-dc059a13b535),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3205c4d7-d4')
Aug 09 10:29:18 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:29:18 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] No VIF found with MAC fa:16:3e:44:ae:dc, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:29:19 user nova-compute[72362]: DEBUG nova.network.neutron [req-f669f18f-fe1c-4b60-8072-3bacb9f7c5da req-e903df83-e850-4baa-abf8-5a9bfd0db904 service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Updated VIF entry in instance network info cache for port 3205c4d7-d431-4127-b2a5-436df06f6c4b. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:29:19 user nova-compute[72362]: DEBUG nova.network.neutron [req-f669f18f-fe1c-4b60-8072-3bacb9f7c5da req-e903df83-e850-4baa-abf8-5a9bfd0db904 service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Updating instance_info_cache with network_info: [{"id": "3205c4d7-d431-4127-b2a5-436df06f6c4b", "address": "fa:16:3e:44:ae:dc", "network": {"id": "322734db-2e92-4833-85a8-dc059a13b535", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-753064842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7fd45a7ce194cd4bc477f03bdebfe9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3205c4d7-d4", "ovs_interfaceid": "3205c4d7-d431-4127-b2a5-436df06f6c4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:29:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f669f18f-fe1c-4b60-8072-3bacb9f7c5da req-e903df83-e850-4baa-abf8-5a9bfd0db904 service nova] Releasing lock "refresh_cache-fe1804e8-2340-4868-a0ff-32d5df5fad42" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:29:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:20 user nova-compute[72362]: DEBUG nova.compute.manager [req-3742e2e9-bb6a-44a4-aa63-0c912fdd94db req-32ff7124-8dd2-47df-a281-164cf80bc54b service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Received event network-vif-plugged-3205c4d7-d431-4127-b2a5-436df06f6c4b {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:29:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3742e2e9-bb6a-44a4-aa63-0c912fdd94db req-32ff7124-8dd2-47df-a281-164cf80bc54b service nova] Acquiring lock "fe1804e8-2340-4868-a0ff-32d5df5fad42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:29:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3742e2e9-bb6a-44a4-aa63-0c912fdd94db req-32ff7124-8dd2-47df-a281-164cf80bc54b service nova] Lock "fe1804e8-2340-4868-a0ff-32d5df5fad42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:29:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3742e2e9-bb6a-44a4-aa63-0c912fdd94db req-32ff7124-8dd2-47df-a281-164cf80bc54b service nova] Lock "fe1804e8-2340-4868-a0ff-32d5df5fad42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:29:20 user nova-compute[72362]: DEBUG nova.compute.manager [req-3742e2e9-bb6a-44a4-aa63-0c912fdd94db req-32ff7124-8dd2-47df-a281-164cf80bc54b service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] No waiting events found dispatching network-vif-plugged-3205c4d7-d431-4127-b2a5-436df06f6c4b {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:29:20 user nova-compute[72362]: WARNING nova.compute.manager [req-3742e2e9-bb6a-44a4-aa63-0c912fdd94db req-32ff7124-8dd2-47df-a281-164cf80bc54b service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Received unexpected event network-vif-plugged-3205c4d7-d431-4127-b2a5-436df06f6c4b for instance with vm_state building and task_state spawning.
Aug 09 10:29:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d3300041-eed0-4a5e-b55a-81631c52e511 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Acquiring lock "f4087716-c913-48db-886e-2f21d1238c66" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:29:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d3300041-eed0-4a5e-b55a-81631c52e511 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Lock "f4087716-c913-48db-886e-2f21d1238c66" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:29:20 user nova-compute[72362]: DEBUG nova.objects.instance [None req-d3300041-eed0-4a5e-b55a-81631c52e511 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Lazy-loading 'flavor' on Instance uuid f4087716-c913-48db-886e-2f21d1238c66 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:29:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d3300041-eed0-4a5e-b55a-81631c52e511 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Lock "f4087716-c913-48db-886e-2f21d1238c66" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:29:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d3300041-eed0-4a5e-b55a-81631c52e511 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Acquiring lock "f4087716-c913-48db-886e-2f21d1238c66" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:29:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d3300041-eed0-4a5e-b55a-81631c52e511 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Lock "f4087716-c913-48db-886e-2f21d1238c66" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:29:20 user nova-compute[72362]: INFO nova.compute.manager [None req-d3300041-eed0-4a5e-b55a-81631c52e511 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] [instance: f4087716-c913-48db-886e-2f21d1238c66] Attaching volume 98af759c-c699-49c3-ba21-b9c7cb647cf2 to /dev/vdc
Aug 09 10:29:20 user nova-compute[72362]: DEBUG os_brick.utils [None req-d3300041-eed0-4a5e-b55a-81631c52e511 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:29:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:20 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8930b1-d962-4082-85e3-a9deba1f5e8f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:20 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05164fa-e449-432e-a47d-c0b56d217f31]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:20 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4514d0-c3f4-4c00-9de3-79e6b8bbcfec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:20 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da3992b-cf80-4dff-9b73-2bd579d7e8d9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-d3300041-eed0-4a5e-b55a-81631c52e511 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-d3300041-eed0-4a5e-b55a-81631c52e511 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:29:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d3300041-eed0-4a5e-b55a-81631c52e511 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:29:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:29:20 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:29:20 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b88423-d6de-4e34-a917-f7ad90d340d3]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-d3300041-eed0-4a5e-b55a-81631c52e511 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:29:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-d3300041-eed0-4a5e-b55a-81631c52e511 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:29:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-d3300041-eed0-4a5e-b55a-81631c52e511 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:29:20 user nova-compute[72362]: DEBUG os_brick.utils [None req-d3300041-eed0-4a5e-b55a-81631c52e511 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:29:20 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-d3300041-eed0-4a5e-b55a-81631c52e511 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] [instance: f4087716-c913-48db-886e-2f21d1238c66] Updating existing volume attachment record: 6295ec42-cdb1-4979-a6d6-22e16da57557 {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 10:29:21 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:22 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576962.4553826, fe1804e8-2340-4868-a0ff-32d5df5fad42 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:29:22 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] VM Resumed (Lifecycle Event)
Aug 09 10:29:22 user nova-compute[72362]: DEBUG nova.compute.manager [req-faaaac4e-bc47-401f-9e1e-1145664a298d req-f560409a-a7be-4e7f-86ee-7cbe6a12ecf8 service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Received event network-vif-plugged-3205c4d7-d431-4127-b2a5-436df06f6c4b {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:29:22 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-faaaac4e-bc47-401f-9e1e-1145664a298d req-f560409a-a7be-4e7f-86ee-7cbe6a12ecf8 service nova] Acquiring lock "fe1804e8-2340-4868-a0ff-32d5df5fad42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:29:22 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-faaaac4e-bc47-401f-9e1e-1145664a298d req-f560409a-a7be-4e7f-86ee-7cbe6a12ecf8 service nova] Lock "fe1804e8-2340-4868-a0ff-32d5df5fad42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:29:22 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-faaaac4e-bc47-401f-9e1e-1145664a298d req-f560409a-a7be-4e7f-86ee-7cbe6a12ecf8 service nova] Lock "fe1804e8-2340-4868-a0ff-32d5df5fad42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:29:22 user nova-compute[72362]: DEBUG nova.compute.manager [req-faaaac4e-bc47-401f-9e1e-1145664a298d req-f560409a-a7be-4e7f-86ee-7cbe6a12ecf8 service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] No waiting events found dispatching network-vif-plugged-3205c4d7-d431-4127-b2a5-436df06f6c4b {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:29:22 user nova-compute[72362]: WARNING nova.compute.manager [req-faaaac4e-bc47-401f-9e1e-1145664a298d req-f560409a-a7be-4e7f-86ee-7cbe6a12ecf8 service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Received unexpected event network-vif-plugged-3205c4d7-d431-4127-b2a5-436df06f6c4b for instance with vm_state building and task_state spawning.
Aug 09 10:29:22 user nova-compute[72362]: DEBUG nova.compute.manager [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:29:22 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:29:22 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:29:22 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Instance spawned successfully.
Aug 09 10:29:22 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 10:29:22 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:29:22 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Found default for hw_cdrom_bus of ide {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:29:22 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Found default for hw_disk_bus of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:29:22 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:29:22 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:29:22 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Found default for hw_video_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:29:22 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Found default for hw_vif_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:29:22 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:29:22 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576962.457083, fe1804e8-2340-4868-a0ff-32d5df5fad42 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:29:22 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] VM Started (Lifecycle Event)
Aug 09 10:29:22 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:29:22 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:29:22 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:29:22 user nova-compute[72362]: INFO nova.compute.manager [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Took 5.93 seconds to spawn the instance on the hypervisor.
Aug 09 10:29:22 user nova-compute[72362]: DEBUG nova.compute.manager [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:29:22 user nova-compute[72362]: INFO nova.compute.manager [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Took 6.80 seconds to build instance.
Aug 09 10:29:22 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e3e2109e-17e7-4c90-b195-27191d3e5b6d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Lock "fe1804e8-2340-4868-a0ff-32d5df5fad42" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.911s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7048f263-800d-4ea1-9a89-ff4c0e35a262 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-7048f263-800d-4ea1-9a89-ff4c0e35a262 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rpGkyMJw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:29:23 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-7048f263-800d-4ea1-9a89-ff4c0e35a262 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:29:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-7048f263-800d-4ea1-9a89-ff4c0e35a262 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-7048f263-800d-4ea1-9a89-ff4c0e35a262 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:29:23 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-7048f263-800d-4ea1-9a89-ff4c0e35a262 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:29:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-7048f263-800d-4ea1-9a89-ff4c0e35a262 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-7048f263-800d-4ea1-9a89-ff4c0e35a262 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:29:23 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-7048f263-800d-4ea1-9a89-ff4c0e35a262 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:29:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157 -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[17aa17fe-bc59-4ce8-9e12-370c74c0eb09]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-7048f263-800d-4ea1-9a89-ff4c0e35a262 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:29:23 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157 -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[78bb7b1d-55dd-4a53-8232-ccd68caebeb1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-7048f263-800d-4ea1-9a89-ff4c0e35a262 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157] added
Aug 09 10:29:23 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3c2ba0-36df-404d-9968-f22fe77110c3]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-7048f263-800d-4ea1-9a89-ff4c0e35a262 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f391d7e4-40e5-4cc1-94f9-0e9b112a1171]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-7048f263-800d-4ea1-9a89-ff4c0e35a262 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rpGkyMJw {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rpGkyMJw" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd4751d-394e-4e24-8620-4edf4b392dc2]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-7048f263-800d-4ea1-9a89-ff4c0e35a262 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rpGkyMJw'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[82207abf-67aa-45f5-b4d0-45c1a08a6925]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-7048f263-800d-4ea1-9a89-ff4c0e35a262 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[348b3177-a56e-467b-aa6f-ce3e90671820]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-7048f263-800d-4ea1-9a89-ff4c0e35a262 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:29:23 user nova-compute[72362]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac (non-flash)
Aug 09 10:29:23 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-7048f263-800d-4ea1-9a89-ff4c0e35a262 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:29:23 user nova-compute[72362]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac (non-flash)
Aug 09 10:29:23 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157 -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4398b6e6-bb72-413d-b896-5028c0e943e7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-7048f263-800d-4ea1-9a89-ff4c0e35a262 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157, portal: 172.16.0.220,3260]
Aug 09 10:29:23 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157, portal: 172.16.0.220,3260] successful.
Aug 09 10:29:23 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7978aef-d952-47bf-8f9a-a03c8938692b]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-7048f263-800d-4ea1-9a89-ff4c0e35a262 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[2978c246-4997-4d92-bacb-ef3bbf2b6dad]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-7048f263-800d-4ea1-9a89-ff4c0e35a262 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:29:23 user nova-compute[72362]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac (non-flash)
Aug 09 10:29:23 user nova-compute[72362]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157 (non-flash)
Aug 09 10:29:23 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-7048f263-800d-4ea1-9a89-ff4c0e35a262 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:29:23 user nova-compute[72362]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac (non-flash)
Aug 09 10:29:23 user nova-compute[72362]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157 (non-flash)
Aug 09 10:29:23 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-7048f263-800d-4ea1-9a89-ff4c0e35a262 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-7048f263-800d-4ea1-9a89-ff4c0e35a262 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-7048f263-800d-4ea1-9a89-ff4c0e35a262 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] HCTL ('34', '-', '-', 0) found on session 37 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-7048f263-800d-4ea1-9a89-ff4c0e35a262 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc1290c-6490-4fa4-bfb0-7c9aed916c23]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-7048f263-800d-4ea1-9a89-ff4c0e35a262 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:29:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-7048f263-800d-4ea1-9a89-ff4c0e35a262 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rpGkyMJw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:29:24 user nova-compute[72362]: DEBUG nova.objects.instance [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lazy-loading 'flavor' on Instance uuid a6000393-6044-4b54-ac0b-1d631e2ed0ae {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:29:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Acquiring lock "refresh_cache-a6000393-6044-4b54-ac0b-1d631e2ed0ae" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:29:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Acquired lock "refresh_cache-a6000393-6044-4b54-ac0b-1d631e2ed0ae" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:29:24 user nova-compute[72362]: DEBUG nova.network.neutron [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:29:24 user nova-compute[72362]: DEBUG nova.objects.instance [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lazy-loading 'info_cache' on Instance uuid a6000393-6044-4b54-ac0b-1d631e2ed0ae {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:29:24 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-7048f263-800d-4ea1-9a89-ff4c0e35a262 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:29:24 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-7048f263-800d-4ea1-9a89-ff4c0e35a262 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23636333830656462', 'path': '/dev/sdc'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:29:24 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7048f263-800d-4ea1-9a89-ff4c0e35a262 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636333830656462', 'path': '/dev/sdc'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:29:24 user nova-compute[72362]: DEBUG nova.objects.instance [None req-7048f263-800d-4ea1-9a89-ff4c0e35a262 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lazy-loading 'flavor' on Instance uuid 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:29:25 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-7048f263-800d-4ea1-9a89-ff4c0e35a262 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 10:29:25 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:29:25 user nova-compute[72362]:   <source dev="/dev/sdc"/>
Aug 09 10:29:25 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:29:25 user nova-compute[72362]:   <serial>91c326b3-d5c5-4cae-b2cc-25f2971ba157</serial>
Aug 09 10:29:25 user nova-compute[72362]: </disk>
Aug 09 10:29:25 user nova-compute[72362]:  {{(pid=72362) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 10:29:25 user nova-compute[72362]: DEBUG nova.network.neutron [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Updating instance_info_cache with network_info: [{"id": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "address": "fa:16:3e:6e:b0:73", "network": {"id": "7358b925-3211-4419-84eb-df6967f5ea8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1360753488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dac04663e2f45378cc0e466740342d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c0230bc-c7", "ovs_interfaceid": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:29:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Releasing lock "refresh_cache-a6000393-6044-4b54-ac0b-1d631e2ed0ae" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:29:25 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Instance destroyed successfully.
Aug 09 10:29:25 user nova-compute[72362]: DEBUG nova.objects.instance [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lazy-loading 'resources' on Instance uuid a6000393-6044-4b54-ac0b-1d631e2ed0ae {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:29:25 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:21:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1940264170',display_name='tempest-AttachVolumeTestJSON-server-1940264170',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1940264170',id=19,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuD55hFJGS6ztpZ3pMNhoMVTtkOPfZJVd+6jLMFkU6lpGS3ntRkyZ61ihETUV7/q4X01P1baNsnIzL7TV/XH9281YGmZSyK/sCWwApv9GpxS0U8aCjbpuFwgIK7/Y1Z9Q==',key_name='tempest-keypair-208455084',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:21:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9dac04663e2f45378cc0e466740342d2',ramdisk_id='',reservation_id='r-i0cbsd0z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-986857971',owner_user_name='tempest-AttachVolumeTestJSON-986857971-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:27:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec007d0aa3c144f5a24a4913cc336ebb',uuid=a6000393-6044-4b54-ac0b-1d631e2ed0ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "address": "fa:16:3e:6e:b0:73", "network": {"id": "7358b925-3211-4419-84eb-df6967f5ea8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1360753488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dac04663e2f45378cc0e466740342d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c0230bc-c7", "ovs_interfaceid": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:29:25 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Converting VIF {"id": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "address": "fa:16:3e:6e:b0:73", "network": {"id": "7358b925-3211-4419-84eb-df6967f5ea8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1360753488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dac04663e2f45378cc0e466740342d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c0230bc-c7", "ovs_interfaceid": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:29:25 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:b0:73,bridge_name='br-int',has_traffic_filtering=True,id=8c0230bc-c7a7-4497-af9a-2fafb259605c,network=Network(7358b925-3211-4419-84eb-df6967f5ea8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c0230bc-c7') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:29:25 user nova-compute[72362]: DEBUG os_vif [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:b0:73,bridge_name='br-int',has_traffic_filtering=True,id=8c0230bc-c7a7-4497-af9a-2fafb259605c,network=Network(7358b925-3211-4419-84eb-df6967f5ea8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c0230bc-c7') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:29:25 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:25 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c0230bc-c7, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:29:25 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:29:25 user nova-compute[72362]: INFO os_vif [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:b0:73,bridge_name='br-int',has_traffic_filtering=True,id=8c0230bc-c7a7-4497-af9a-2fafb259605c,network=Network(7358b925-3211-4419-84eb-df6967f5ea8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c0230bc-c7')
Aug 09 10:29:25 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Start _get_guest_xml network_info=[{"id": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "address": "fa:16:3e:6e:b0:73", "network": {"id": "7358b925-3211-4419-84eb-df6967f5ea8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1360753488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dac04663e2f45378cc0e466740342d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c0230bc-c7", "ovs_interfaceid": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': 'a08d1a11-49eb-4212-a351-e11ee9553b95'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:29:25 user nova-compute[72362]: DEBUG nova.objects.instance [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lazy-loading 'numa_topology' on Instance uuid a6000393-6044-4b54-ac0b-1d631e2ed0ae {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:29:25 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:29:25 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:29:25 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:29:25 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:29:25 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:29:25 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:29:25 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:29:25 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:29:25 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:29:25 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:29:25 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:29:25 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:29:25 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:29:25 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:29:25 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:29:25 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:29:25 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:29:25 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:29:25 user nova-compute[72362]: DEBUG nova.objects.instance [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lazy-loading 'vcpu_model' on Instance uuid a6000393-6044-4b54-ac0b-1d631e2ed0ae {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:29:25 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:21:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1940264170',display_name='tempest-AttachVolumeTestJSON-server-1940264170',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1940264170',id=19,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuD55hFJGS6ztpZ3pMNhoMVTtkOPfZJVd+6jLMFkU6lpGS3ntRkyZ61ihETUV7/q4X01P1baNsnIzL7TV/XH9281YGmZSyK/sCWwApv9GpxS0U8aCjbpuFwgIK7/Y1Z9Q==',key_name='tempest-keypair-208455084',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:21:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9dac04663e2f45378cc0e466740342d2',ramdisk_id='',reservation_id='r-i0cbsd0z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-986857971',owner_user_name='tempest-AttachVolumeTestJSON-986857971-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:27:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec007d0aa3c144f5a24a4913cc336ebb',uuid=a6000393-6044-4b54-ac0b-1d631e2ed0ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "address": "fa:16:3e:6e:b0:73", "network": {"id": "7358b925-3211-4419-84eb-df6967f5ea8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1360753488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dac04663e2f45378cc0e466740342d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c0230bc-c7", "ovs_interfaceid": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:29:25 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Converting VIF {"id": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "address": "fa:16:3e:6e:b0:73", "network": {"id": "7358b925-3211-4419-84eb-df6967f5ea8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1360753488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dac04663e2f45378cc0e466740342d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c0230bc-c7", "ovs_interfaceid": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:29:25 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:b0:73,bridge_name='br-int',has_traffic_filtering=True,id=8c0230bc-c7a7-4497-af9a-2fafb259605c,network=Network(7358b925-3211-4419-84eb-df6967f5ea8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c0230bc-c7') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:29:25 user nova-compute[72362]: DEBUG nova.objects.instance [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lazy-loading 'pci_devices' on Instance uuid a6000393-6044-4b54-ac0b-1d631e2ed0ae {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:29:25 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7048f263-800d-4ea1-9a89-ff4c0e35a262 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:29:25 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7048f263-800d-4ea1-9a89-ff4c0e35a262 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:29:25 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7048f263-800d-4ea1-9a89-ff4c0e35a262 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] No VIF found with MAC fa:16:3e:14:7b:dc, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:29:25 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:29:25 user nova-compute[72362]:   <uuid>a6000393-6044-4b54-ac0b-1d631e2ed0ae</uuid>
Aug 09 10:29:25 user nova-compute[72362]:   <name>instance-00000013</name>
Aug 09 10:29:25 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:29:25 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:29:25 user nova-compute[72362]:   <metadata>
Aug 09 10:29:25 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:29:25 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:29:25 user nova-compute[72362]:       <nova:name>tempest-AttachVolumeTestJSON-server-1940264170</nova:name>
Aug 09 10:29:25 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:29:25</nova:creationTime>
Aug 09 10:29:25 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:29:25 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:29:25 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:29:25 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:29:25 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:29:25 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:29:25 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:29:25 user nova-compute[72362]:       <nova:owner>
Aug 09 10:29:25 user nova-compute[72362]:         <nova:user uuid="ec007d0aa3c144f5a24a4913cc336ebb">tempest-AttachVolumeTestJSON-986857971-project-member</nova:user>
Aug 09 10:29:25 user nova-compute[72362]:         <nova:project uuid="9dac04663e2f45378cc0e466740342d2">tempest-AttachVolumeTestJSON-986857971</nova:project>
Aug 09 10:29:25 user nova-compute[72362]:       </nova:owner>
Aug 09 10:29:25 user nova-compute[72362]:       <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:29:25 user nova-compute[72362]:       <nova:ports>
Aug 09 10:29:25 user nova-compute[72362]:         <nova:port uuid="8c0230bc-c7a7-4497-af9a-2fafb259605c">
Aug 09 10:29:25 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 10:29:25 user nova-compute[72362]:         </nova:port>
Aug 09 10:29:25 user nova-compute[72362]:       </nova:ports>
Aug 09 10:29:25 user nova-compute[72362]:     </nova:instance>
Aug 09 10:29:25 user nova-compute[72362]:   </metadata>
Aug 09 10:29:25 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:29:25 user nova-compute[72362]:     <system>
Aug 09 10:29:25 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:29:25 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:29:25 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:29:25 user nova-compute[72362]:       <entry name="serial">a6000393-6044-4b54-ac0b-1d631e2ed0ae</entry>
Aug 09 10:29:25 user nova-compute[72362]:       <entry name="uuid">a6000393-6044-4b54-ac0b-1d631e2ed0ae</entry>
Aug 09 10:29:25 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:29:25 user nova-compute[72362]:     </system>
Aug 09 10:29:25 user nova-compute[72362]:   </sysinfo>
Aug 09 10:29:25 user nova-compute[72362]:   <os>
Aug 09 10:29:25 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:29:25 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:29:25 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:29:25 user nova-compute[72362]:   </os>
Aug 09 10:29:25 user nova-compute[72362]:   <features>
Aug 09 10:29:25 user nova-compute[72362]:     <acpi/>
Aug 09 10:29:25 user nova-compute[72362]:     <apic/>
Aug 09 10:29:25 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:29:25 user nova-compute[72362]:   </features>
Aug 09 10:29:25 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:29:25 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:29:25 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:29:25 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:29:25 user nova-compute[72362]:   </clock>
Aug 09 10:29:25 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:29:25 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:29:25 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:29:25 user nova-compute[72362]:   </cpu>
Aug 09 10:29:25 user nova-compute[72362]:   <devices>
Aug 09 10:29:25 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:29:25 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:29:25 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk"/>
Aug 09 10:29:25 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:29:25 user nova-compute[72362]:     </disk>
Aug 09 10:29:25 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:29:25 user nova-compute[72362]:       <mac address="fa:16:3e:6e:b0:73"/>
Aug 09 10:29:25 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:29:25 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:29:25 user nova-compute[72362]:       <target dev="tap8c0230bc-c7"/>
Aug 09 10:29:25 user nova-compute[72362]:     </interface>
Aug 09 10:29:25 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:29:25 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/console.log" append="off"/>
Aug 09 10:29:25 user nova-compute[72362]:     </serial>
Aug 09 10:29:25 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:29:25 user nova-compute[72362]:     <video>
Aug 09 10:29:25 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:29:25 user nova-compute[72362]:     </video>
Aug 09 10:29:25 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:29:25 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:29:25 user nova-compute[72362]:     </rng>
Aug 09 10:29:25 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:29:25 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:29:25 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:29:25 user nova-compute[72362]:     </memballoon>
Aug 09 10:29:25 user nova-compute[72362]:   </devices>
Aug 09 10:29:25 user nova-compute[72362]: </domain>
Aug 09 10:29:25 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:29:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7048f263-800d-4ea1-9a89-ff4c0e35a262 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "1a5a9ab8-ca97-454e-b850-c119ea2cd1bf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.986s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:29:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:25 user nova-compute[72362]: DEBUG nova.objects.instance [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lazy-loading 'trusted_certs' on Instance uuid a6000393-6044-4b54-ac0b-1d631e2ed0ae {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:29:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.135s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:25 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk. size=1073741824 {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 10:29:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:26 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:26 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Cannot resize image /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk to a smaller size. {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 10:29:26 user nova-compute[72362]: DEBUG nova.objects.instance [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lazy-loading 'migration_context' on Instance uuid a6000393-6044-4b54-ac0b-1d631e2ed0ae {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:29:26 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:21:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1940264170',display_name='tempest-AttachVolumeTestJSON-server-1940264170',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1940264170',id=19,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuD55hFJGS6ztpZ3pMNhoMVTtkOPfZJVd+6jLMFkU6lpGS3ntRkyZ61ihETUV7/q4X01P1baNsnIzL7TV/XH9281YGmZSyK/sCWwApv9GpxS0U8aCjbpuFwgIK7/Y1Z9Q==',key_name='tempest-keypair-208455084',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:21:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='9dac04663e2f45378cc0e466740342d2',ramdisk_id='',reservation_id='r-i0cbsd0z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-986857971',owner_user_name='tempest-AttachVolumeTestJSON-986857971-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:27:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec007d0aa3c144f5a24a4913cc336ebb',uuid=a6000393-6044-4b54-ac0b-1d631e2ed0ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "address": "fa:16:3e:6e:b0:73", "network": {"id": "7358b925-3211-4419-84eb-df6967f5ea8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1360753488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dac04663e2f45378cc0e466740342d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c0230bc-c7", "ovs_interfaceid": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:29:26 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Converting VIF {"id": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "address": "fa:16:3e:6e:b0:73", "network": {"id": "7358b925-3211-4419-84eb-df6967f5ea8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1360753488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dac04663e2f45378cc0e466740342d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c0230bc-c7", "ovs_interfaceid": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:29:26 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:b0:73,bridge_name='br-int',has_traffic_filtering=True,id=8c0230bc-c7a7-4497-af9a-2fafb259605c,network=Network(7358b925-3211-4419-84eb-df6967f5ea8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c0230bc-c7') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:29:26 user nova-compute[72362]: DEBUG os_vif [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:b0:73,bridge_name='br-int',has_traffic_filtering=True,id=8c0230bc-c7a7-4497-af9a-2fafb259605c,network=Network(7358b925-3211-4419-84eb-df6967f5ea8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c0230bc-c7') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:29:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:29:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:29:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c0230bc-c7, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:29:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8c0230bc-c7, col_values=(('external_ids', {'iface-id': '8c0230bc-c7a7-4497-af9a-2fafb259605c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:b0:73', 'vm-uuid': 'a6000393-6044-4b54-ac0b-1d631e2ed0ae'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:29:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:29:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:26 user nova-compute[72362]: INFO os_vif [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:b0:73,bridge_name='br-int',has_traffic_filtering=True,id=8c0230bc-c7a7-4497-af9a-2fafb259605c,network=Network(7358b925-3211-4419-84eb-df6967f5ea8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c0230bc-c7')
Aug 09 10:29:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:27 user nova-compute[72362]: DEBUG nova.compute.manager [req-0290c580-2f1d-45c9-bb9e-47d6baeba9ea req-8f69c17a-1321-4da2-80aa-d104f07c4557 service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Received event network-vif-plugged-8c0230bc-c7a7-4497-af9a-2fafb259605c {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:29:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-0290c580-2f1d-45c9-bb9e-47d6baeba9ea req-8f69c17a-1321-4da2-80aa-d104f07c4557 service nova] Acquiring lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:29:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-0290c580-2f1d-45c9-bb9e-47d6baeba9ea req-8f69c17a-1321-4da2-80aa-d104f07c4557 service nova] Lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:29:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-0290c580-2f1d-45c9-bb9e-47d6baeba9ea req-8f69c17a-1321-4da2-80aa-d104f07c4557 service nova] Lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:29:28 user nova-compute[72362]: DEBUG nova.compute.manager [req-0290c580-2f1d-45c9-bb9e-47d6baeba9ea req-8f69c17a-1321-4da2-80aa-d104f07c4557 service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] No waiting events found dispatching network-vif-plugged-8c0230bc-c7a7-4497-af9a-2fafb259605c {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:29:28 user nova-compute[72362]: WARNING nova.compute.manager [req-0290c580-2f1d-45c9-bb9e-47d6baeba9ea req-8f69c17a-1321-4da2-80aa-d104f07c4557 service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Received unexpected event network-vif-plugged-8c0230bc-c7a7-4497-af9a-2fafb259605c for instance with vm_state stopped and task_state powering-on.
Aug 09 10:29:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:30 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576969.9988372, a6000393-6044-4b54-ac0b-1d631e2ed0ae => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:29:30 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] VM Resumed (Lifecycle Event)
Aug 09 10:29:30 user nova-compute[72362]: DEBUG nova.compute.manager [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:29:30 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Instance rebooted successfully.
Aug 09 10:29:30 user nova-compute[72362]: DEBUG nova.compute.manager [None req-99bee90e-45f0-40ec-bd0e-9e208cee85d3 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:29:30 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:29:30 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:29:30 user nova-compute[72362]: DEBUG nova.compute.manager [req-f9d37a3e-da35-45b5-9ad2-84cc3d239627 req-60ce8124-cfda-4cdc-a79a-184b0902458b service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Received event network-vif-plugged-8c0230bc-c7a7-4497-af9a-2fafb259605c {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:29:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f9d37a3e-da35-45b5-9ad2-84cc3d239627 req-60ce8124-cfda-4cdc-a79a-184b0902458b service nova] Acquiring lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:29:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f9d37a3e-da35-45b5-9ad2-84cc3d239627 req-60ce8124-cfda-4cdc-a79a-184b0902458b service nova] Lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:29:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f9d37a3e-da35-45b5-9ad2-84cc3d239627 req-60ce8124-cfda-4cdc-a79a-184b0902458b service nova] Lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:29:30 user nova-compute[72362]: DEBUG nova.compute.manager [req-f9d37a3e-da35-45b5-9ad2-84cc3d239627 req-60ce8124-cfda-4cdc-a79a-184b0902458b service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] No waiting events found dispatching network-vif-plugged-8c0230bc-c7a7-4497-af9a-2fafb259605c {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:29:30 user nova-compute[72362]: WARNING nova.compute.manager [req-f9d37a3e-da35-45b5-9ad2-84cc3d239627 req-60ce8124-cfda-4cdc-a79a-184b0902458b service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Received unexpected event network-vif-plugged-8c0230bc-c7a7-4497-af9a-2fafb259605c for instance with vm_state stopped and task_state powering-on.
Aug 09 10:29:30 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 09 10:29:30 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576970.0040398, a6000393-6044-4b54-ac0b-1d631e2ed0ae => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:29:30 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] VM Started (Lifecycle Event)
Aug 09 10:29:30 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:29:30 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:29:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1fcc1485-df75-4e61-a8e9-6733b131ea9c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Acquiring lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:29:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1fcc1485-df75-4e61-a8e9-6733b131ea9c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:29:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1fcc1485-df75-4e61-a8e9-6733b131ea9c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Acquiring lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:29:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1fcc1485-df75-4e61-a8e9-6733b131ea9c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:29:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1fcc1485-df75-4e61-a8e9-6733b131ea9c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:29:30 user nova-compute[72362]: INFO nova.compute.manager [None req-1fcc1485-df75-4e61-a8e9-6733b131ea9c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Terminating instance
Aug 09 10:29:30 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1fcc1485-df75-4e61-a8e9-6733b131ea9c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Start destroying the instance on the hypervisor. {{(pid=72362) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 10:29:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:31 user nova-compute[72362]: DEBUG nova.compute.manager [req-d57f7cc1-bab8-4ed9-b363-a181980f817b req-7bb2fe6e-ad85-4990-aa09-b4939c71e73d service nova] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Received event network-vif-unplugged-a10771ea-ee0f-4376-88cc-97dd0eb98d8d {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:29:31 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-d57f7cc1-bab8-4ed9-b363-a181980f817b req-7bb2fe6e-ad85-4990-aa09-b4939c71e73d service nova] Acquiring lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:29:31 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-d57f7cc1-bab8-4ed9-b363-a181980f817b req-7bb2fe6e-ad85-4990-aa09-b4939c71e73d service nova] Lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:29:31 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-d57f7cc1-bab8-4ed9-b363-a181980f817b req-7bb2fe6e-ad85-4990-aa09-b4939c71e73d service nova] Lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:29:31 user nova-compute[72362]: DEBUG nova.compute.manager [req-d57f7cc1-bab8-4ed9-b363-a181980f817b req-7bb2fe6e-ad85-4990-aa09-b4939c71e73d service nova] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] No waiting events found dispatching network-vif-unplugged-a10771ea-ee0f-4376-88cc-97dd0eb98d8d {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:29:31 user nova-compute[72362]: DEBUG nova.compute.manager [req-d57f7cc1-bab8-4ed9-b363-a181980f817b req-7bb2fe6e-ad85-4990-aa09-b4939c71e73d service nova] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Received event network-vif-unplugged-a10771ea-ee0f-4376-88cc-97dd0eb98d8d for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:29:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:31 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Instance destroyed successfully.
Aug 09 10:29:31 user nova-compute[72362]: DEBUG nova.objects.instance [None req-1fcc1485-df75-4e61-a8e9-6733b131ea9c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lazy-loading 'resources' on Instance uuid 4746beb1-d313-4cea-bf7b-75b507ebbdd2 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:29:31 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-1fcc1485-df75-4e61-a8e9-6733b131ea9c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:21:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1960873030',display_name='tempest-SnapshotDataIntegrityTests-server-1960873030',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1960873030',id=18,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsbdYtIq0/mw7Fz1AEtFgj9LJ6+IPseOi3WvAz5FrhvGNhmhuAri0RS0nhBd7cMv8MK+EjPrnff6yoSiHj84V9pxhjpoZujEn9n4/ijqqa/A57YW+EpWgDR8UzmAswx1g==',key_name='tempest-keypair-876253172',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:21:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='99716e91e68b4abfba3a4c9335e42955',ramdisk_id='',reservation_id='r-54npuj45',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-68329215',owner_user_name='tempest-SnapshotDataIntegrityTests-68329215-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:21:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14aafde2fed648b8a0431d4f32c4c7ac',uuid=4746beb1-d313-4cea-bf7b-75b507ebbdd2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a10771ea-ee0f-4376-88cc-97dd0eb98d8d", "address": "fa:16:3e:03:05:4e", "network": {"id": "557d516c-f355-4cc8-ae2e-5dbec7ce9762", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1511437856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99716e91e68b4abfba3a4c9335e42955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa10771ea-ee", "ovs_interfaceid": "a10771ea-ee0f-4376-88cc-97dd0eb98d8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:29:31 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-1fcc1485-df75-4e61-a8e9-6733b131ea9c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Converting VIF {"id": "a10771ea-ee0f-4376-88cc-97dd0eb98d8d", "address": "fa:16:3e:03:05:4e", "network": {"id": "557d516c-f355-4cc8-ae2e-5dbec7ce9762", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1511437856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99716e91e68b4abfba3a4c9335e42955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa10771ea-ee", "ovs_interfaceid": "a10771ea-ee0f-4376-88cc-97dd0eb98d8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:29:31 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-1fcc1485-df75-4e61-a8e9-6733b131ea9c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:05:4e,bridge_name='br-int',has_traffic_filtering=True,id=a10771ea-ee0f-4376-88cc-97dd0eb98d8d,network=Network(557d516c-f355-4cc8-ae2e-5dbec7ce9762),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa10771ea-ee') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:29:31 user nova-compute[72362]: DEBUG os_vif [None req-1fcc1485-df75-4e61-a8e9-6733b131ea9c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:05:4e,bridge_name='br-int',has_traffic_filtering=True,id=a10771ea-ee0f-4376-88cc-97dd0eb98d8d,network=Network(557d516c-f355-4cc8-ae2e-5dbec7ce9762),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa10771ea-ee') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:29:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa10771ea-ee, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:29:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:29:31 user nova-compute[72362]: INFO os_vif [None req-1fcc1485-df75-4e61-a8e9-6733b131ea9c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:05:4e,bridge_name='br-int',has_traffic_filtering=True,id=a10771ea-ee0f-4376-88cc-97dd0eb98d8d,network=Network(557d516c-f355-4cc8-ae2e-5dbec7ce9762),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa10771ea-ee')
Aug 09 10:29:31 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-1fcc1485-df75-4e61-a8e9-6733b131ea9c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Deleting instance files /opt/stack/data/nova/instances/4746beb1-d313-4cea-bf7b-75b507ebbdd2_del
Aug 09 10:29:31 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-1fcc1485-df75-4e61-a8e9-6733b131ea9c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Deletion of /opt/stack/data/nova/instances/4746beb1-d313-4cea-bf7b-75b507ebbdd2_del complete
Aug 09 10:29:31 user nova-compute[72362]: INFO nova.compute.manager [None req-1fcc1485-df75-4e61-a8e9-6733b131ea9c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Took 0.99 seconds to destroy the instance on the hypervisor.
Aug 09 10:29:31 user nova-compute[72362]: DEBUG oslo.service.loopingcall [None req-1fcc1485-df75-4e61-a8e9-6733b131ea9c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72362) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 10:29:31 user nova-compute[72362]: DEBUG nova.compute.manager [-] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Deallocating network for instance {{(pid=72362) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 10:29:31 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] deallocate_for_instance() {{(pid=72362) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 10:29:33 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:29:33 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Took 1.10 seconds to deallocate network for instance.
Aug 09 10:29:33 user nova-compute[72362]: DEBUG nova.compute.manager [req-459ca046-7b26-40a2-9f1c-0064ffe268c9 req-831747ad-f1d1-4c87-bf30-cd5eefd41270 service nova] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Received event network-vif-deleted-a10771ea-ee0f-4376-88cc-97dd0eb98d8d {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:29:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1fcc1485-df75-4e61-a8e9-6733b131ea9c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:29:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1fcc1485-df75-4e61-a8e9-6733b131ea9c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:29:33 user nova-compute[72362]: DEBUG nova.compute.manager [req-d47cebce-b72b-4aa0-8903-c6c0ead1656a req-5bf4a08a-5ad2-47f4-bf3e-6c676b55b1c0 service nova] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Received event network-vif-plugged-a10771ea-ee0f-4376-88cc-97dd0eb98d8d {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:29:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-d47cebce-b72b-4aa0-8903-c6c0ead1656a req-5bf4a08a-5ad2-47f4-bf3e-6c676b55b1c0 service nova] Acquiring lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:29:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-d47cebce-b72b-4aa0-8903-c6c0ead1656a req-5bf4a08a-5ad2-47f4-bf3e-6c676b55b1c0 service nova] Lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:29:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-d47cebce-b72b-4aa0-8903-c6c0ead1656a req-5bf4a08a-5ad2-47f4-bf3e-6c676b55b1c0 service nova] Lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:29:33 user nova-compute[72362]: DEBUG nova.compute.manager [req-d47cebce-b72b-4aa0-8903-c6c0ead1656a req-5bf4a08a-5ad2-47f4-bf3e-6c676b55b1c0 service nova] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] No waiting events found dispatching network-vif-plugged-a10771ea-ee0f-4376-88cc-97dd0eb98d8d {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:29:33 user nova-compute[72362]: WARNING nova.compute.manager [req-d47cebce-b72b-4aa0-8903-c6c0ead1656a req-5bf4a08a-5ad2-47f4-bf3e-6c676b55b1c0 service nova] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Received unexpected event network-vif-plugged-a10771ea-ee0f-4376-88cc-97dd0eb98d8d for instance with vm_state deleted and task_state None.
Aug 09 10:29:33 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1fcc1485-df75-4e61-a8e9-6733b131ea9c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:29:33 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1fcc1485-df75-4e61-a8e9-6733b131ea9c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:29:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1fcc1485-df75-4e61-a8e9-6733b131ea9c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.492s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:29:33 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-1fcc1485-df75-4e61-a8e9-6733b131ea9c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Deleted allocations for instance 4746beb1-d313-4cea-bf7b-75b507ebbdd2
Aug 09 10:29:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1fcc1485-df75-4e61-a8e9-6733b131ea9c tempest-SnapshotDataIntegrityTests-68329215 tempest-SnapshotDataIntegrityTests-68329215-project-member] Lock "4746beb1-d313-4cea-bf7b-75b507ebbdd2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.845s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:29:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3300041-eed0-4a5e-b55a-81631c52e511 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] [instance: f4087716-c913-48db-886e-2f21d1238c66] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:29:36 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3300041-eed0-4a5e-b55a-81631c52e511 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:98af759c-c699-49c3-ba21-b9c7cb647cf2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yaNbmGnT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:29:36 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-d3300041-eed0-4a5e-b55a-81631c52e511 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:29:36 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-d3300041-eed0-4a5e-b55a-81631c52e511 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:29:36 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-d3300041-eed0-4a5e-b55a-81631c52e511 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:29:36 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-d3300041-eed0-4a5e-b55a-81631c52e511 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:29:36 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-d3300041-eed0-4a5e-b55a-81631c52e511 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98af759c-c699-49c3-ba21-b9c7cb647cf2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:29:36 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-d3300041-eed0-4a5e-b55a-81631c52e511 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98af759c-c699-49c3-ba21-b9c7cb647cf2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:29:36 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-d3300041-eed0-4a5e-b55a-81631c52e511 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:29:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98af759c-c699-49c3-ba21-b9c7cb647cf2 -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98af759c-c699-49c3-ba21-b9c7cb647cf2 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:36 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c485b6-f9af-4b2b-97f9-dea49d73095f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:36 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3300041-eed0-4a5e-b55a-81631c52e511 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:29:36 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:29:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98af759c-c699-49c3-ba21-b9c7cb647cf2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98af759c-c699-49c3-ba21-b9c7cb647cf2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:36 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b68a624-32b6-4b2b-82f6-672b53c1ad01]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98af759c-c699-49c3-ba21-b9c7cb647cf2] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:36 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3300041-eed0-4a5e-b55a-81631c52e511 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98af759c-c699-49c3-ba21-b9c7cb647cf2] added
Aug 09 10:29:36 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:29:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98af759c-c699-49c3-ba21-b9c7cb647cf2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98af759c-c699-49c3-ba21-b9c7cb647cf2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.209s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:37 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c12dae-43d3-41fc-9562-4a10c7f0bcdc]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3300041-eed0-4a5e-b55a-81631c52e511 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:29:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98af759c-c699-49c3-ba21-b9c7cb647cf2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98af759c-c699-49c3-ba21-b9c7cb647cf2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:37 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c841794f-d0a7-4fee-9539-5d203ccd9f2a]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3300041-eed0-4a5e-b55a-81631c52e511 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:29:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98af759c-c699-49c3-ba21-b9c7cb647cf2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yaNbmGnT {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98af759c-c699-49c3-ba21-b9c7cb647cf2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yaNbmGnT" returned: 0 in 0.032s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:37 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[29807489-e706-471b-837b-afd11a2d33c4]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3300041-eed0-4a5e-b55a-81631c52e511 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yaNbmGnT'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:29:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98af759c-c699-49c3-ba21-b9c7cb647cf2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98af759c-c699-49c3-ba21-b9c7cb647cf2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:37 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d383b06-b583-4ea5-8ff8-b05269f0b29e]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3300041-eed0-4a5e-b55a-81631c52e511 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:29:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:37 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb1d7ae-4d43-4565-b8d9-edf7f33b9822]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3300041-eed0-4a5e-b55a-81631c52e511 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:29:37 user nova-compute[72362]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac (non-flash)
Aug 09 10:29:37 user nova-compute[72362]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157 (non-flash)
Aug 09 10:29:37 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:29:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3300041-eed0-4a5e-b55a-81631c52e511 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:29:37 user nova-compute[72362]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac (non-flash)
Aug 09 10:29:37 user nova-compute[72362]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157 (non-flash)
Aug 09 10:29:37 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:29:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98af759c-c699-49c3-ba21-b9c7cb647cf2 -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98af759c-c699-49c3-ba21-b9c7cb647cf2 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:37 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef9e628-65cf-4b5e-a4df-931f379f946c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:98af759c-c699-49c3-ba21-b9c7cb647cf2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:98af759c-c699-49c3-ba21-b9c7cb647cf2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3300041-eed0-4a5e-b55a-81631c52e511 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:98af759c-c699-49c3-ba21-b9c7cb647cf2, portal: 172.16.0.220,3260]
Aug 09 10:29:37 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:98af759c-c699-49c3-ba21-b9c7cb647cf2, portal: 172.16.0.220,3260] successful.
Aug 09 10:29:37 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:29:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98af759c-c699-49c3-ba21-b9c7cb647cf2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98af759c-c699-49c3-ba21-b9c7cb647cf2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:37 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a837b8e4-71fc-41a4-9050-fa9b4a789ffc]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3300041-eed0-4a5e-b55a-81631c52e511 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:29:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:37 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9922d0-b4e2-4855-86e5-9ca525183011]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98af759c-c699-49c3-ba21-b9c7cb647cf2 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3300041-eed0-4a5e-b55a-81631c52e511 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:29:37 user nova-compute[72362]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac (non-flash)
Aug 09 10:29:37 user nova-compute[72362]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157 (non-flash)
Aug 09 10:29:37 user nova-compute[72362]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98af759c-c699-49c3-ba21-b9c7cb647cf2 (non-flash)
Aug 09 10:29:37 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:29:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3300041-eed0-4a5e-b55a-81631c52e511 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:29:37 user nova-compute[72362]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac (non-flash)
Aug 09 10:29:37 user nova-compute[72362]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157 (non-flash)
Aug 09 10:29:37 user nova-compute[72362]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98af759c-c699-49c3-ba21-b9c7cb647cf2 (non-flash)
Aug 09 10:29:37 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:29:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-d3300041-eed0-4a5e-b55a-81631c52e511 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98af759c-c699-49c3-ba21-b9c7cb647cf2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.536s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:29:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3300041-eed0-4a5e-b55a-81631c52e511 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:29:37 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-d3300041-eed0-4a5e-b55a-81631c52e511 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] HCTL ('35', '-', '-', 0) found on session 38 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:29:37 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-d3300041-eed0-4a5e-b55a-81631c52e511 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:29:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:37 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0838671b-732c-4717-8292-796c29a79bfc]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:37 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-d3300041-eed0-4a5e-b55a-81631c52e511 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:29:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3300041-eed0-4a5e-b55a-81631c52e511 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yaNbmGnT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:29:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Acquiring lock "4b22a19f-300c-42fb-8175-e737eef7d531" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:29:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "4b22a19f-300c-42fb-8175-e737eef7d531" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:29:38 user nova-compute[72362]: DEBUG nova.compute.manager [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Starting instance... {{(pid=72362) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 10:29:38 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-d3300041-eed0-4a5e-b55a-81631c52e511 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.574s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:29:38 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3300041-eed0-4a5e-b55a-81631c52e511 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] <== connect_volume: return (1575ms) {'type': 'block', 'scsi_wwn': '26166656536646332', 'path': '/dev/sdd'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:29:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3300041-eed0-4a5e-b55a-81631c52e511 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] [instance: f4087716-c913-48db-886e-2f21d1238c66] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166656536646332', 'path': '/dev/sdd'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:29:38 user nova-compute[72362]: DEBUG nova.objects.instance [None req-d3300041-eed0-4a5e-b55a-81631c52e511 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Lazy-loading 'flavor' on Instance uuid f4087716-c913-48db-886e-2f21d1238c66 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:29:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-d3300041-eed0-4a5e-b55a-81631c52e511 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 10:29:38 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:29:38 user nova-compute[72362]:   <source dev="/dev/sdd"/>
Aug 09 10:29:38 user nova-compute[72362]:   <target dev="vdc" bus="virtio"/>
Aug 09 10:29:38 user nova-compute[72362]:   <serial>98af759c-c699-49c3-ba21-b9c7cb647cf2</serial>
Aug 09 10:29:38 user nova-compute[72362]: </disk>
Aug 09 10:29:38 user nova-compute[72362]:  {{(pid=72362) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 10:29:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:29:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:29:38 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:29:38 user nova-compute[72362]: INFO nova.compute.claims [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Claim successful on node user
Aug 09 10:29:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-d3300041-eed0-4a5e-b55a-81631c52e511 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:29:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-d3300041-eed0-4a5e-b55a-81631c52e511 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:29:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-d3300041-eed0-4a5e-b55a-81631c52e511 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:29:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-d3300041-eed0-4a5e-b55a-81631c52e511 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] No VIF found with MAC fa:16:3e:d9:6f:46, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:29:38 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:29:38 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:29:39 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.605s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:29:39 user nova-compute[72362]: DEBUG nova.compute.manager [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Start building networks asynchronously for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 10:29:39 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d3300041-eed0-4a5e-b55a-81631c52e511 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Lock "f4087716-c913-48db-886e-2f21d1238c66" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.339s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:29:39 user nova-compute[72362]: DEBUG nova.compute.manager [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Allocating IP information in the background. {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 10:29:39 user nova-compute[72362]: DEBUG nova.network.neutron [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] allocate_for_instance() {{(pid=72362) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 10:29:39 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 10:29:39 user nova-compute[72362]: DEBUG nova.compute.manager [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Start building block device mappings for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 10:29:39 user nova-compute[72362]: INFO nova.virt.block_device [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Booting with volume 31aca44a-c500-4972-873a-bb902c63755f at /dev/vda
Aug 09 10:29:39 user nova-compute[72362]: DEBUG os_brick.utils [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:29:39 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:39 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:39 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[261f8ebe-f6fe-4769-8a82-bd58eb2631b6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:39 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:39 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:39 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[2080fb42-f79e-4351-899f-72818e00bba9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:39 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:39 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:39 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8bfc0f-5b1b-4b1a-9e3b-a89f3663ae1b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:39 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[367adb5e-2d15-4702-9adb-335be1a3dcde]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:39 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:39 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:29:39 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:29:39 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:39 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:29:39 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:29:39 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0397c867-391c-453b-a77c-621fa09f5e29]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:39 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:29:39 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:29:39 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:29:39 user nova-compute[72362]: DEBUG os_brick.utils [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:29:39 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Updating existing volume attachment record: 5b74d0b7-9311-4410-b8c2-fe1beeae34b7 {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 10:29:39 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7f6ba9ab-3cc0-4ddc-84a5-18c3dd36c6c9 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Acquiring lock "f4087716-c913-48db-886e-2f21d1238c66" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:29:39 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7f6ba9ab-3cc0-4ddc-84a5-18c3dd36c6c9 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Lock "f4087716-c913-48db-886e-2f21d1238c66" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:29:39 user nova-compute[72362]: INFO nova.compute.manager [None req-7f6ba9ab-3cc0-4ddc-84a5-18c3dd36c6c9 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] [instance: f4087716-c913-48db-886e-2f21d1238c66] Detaching volume 98af759c-c699-49c3-ba21-b9c7cb647cf2
Aug 09 10:29:39 user nova-compute[72362]: INFO nova.virt.block_device [None req-7f6ba9ab-3cc0-4ddc-84a5-18c3dd36c6c9 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] [instance: f4087716-c913-48db-886e-2f21d1238c66] Attempting to driver detach volume 98af759c-c699-49c3-ba21-b9c7cb647cf2 from mountpoint /dev/vdc
Aug 09 10:29:39 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7f6ba9ab-3cc0-4ddc-84a5-18c3dd36c6c9 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Attempting to detach device vdc from instance f4087716-c913-48db-886e-2f21d1238c66 from the persistent domain config. {{(pid=72362) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 10:29:39 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-7f6ba9ab-3cc0-4ddc-84a5-18c3dd36c6c9 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 10:29:39 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:29:39 user nova-compute[72362]:   <source dev="/dev/sdd"/>
Aug 09 10:29:39 user nova-compute[72362]:   <target dev="vdc" bus="virtio"/>
Aug 09 10:29:39 user nova-compute[72362]:   <serial>98af759c-c699-49c3-ba21-b9c7cb647cf2</serial>
Aug 09 10:29:39 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 10:29:39 user nova-compute[72362]: </disk>
Aug 09 10:29:39 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:29:39 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-7f6ba9ab-3cc0-4ddc-84a5-18c3dd36c6c9 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Successfully detached device vdc from instance f4087716-c913-48db-886e-2f21d1238c66 from the persistent domain config.
Aug 09 10:29:39 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7f6ba9ab-3cc0-4ddc-84a5-18c3dd36c6c9 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance f4087716-c913-48db-886e-2f21d1238c66 from the live domain config. {{(pid=72362) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 10:29:39 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-7f6ba9ab-3cc0-4ddc-84a5-18c3dd36c6c9 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 10:29:39 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:29:39 user nova-compute[72362]:   <source dev="/dev/sdd"/>
Aug 09 10:29:39 user nova-compute[72362]:   <target dev="vdc" bus="virtio"/>
Aug 09 10:29:39 user nova-compute[72362]:   <serial>98af759c-c699-49c3-ba21-b9c7cb647cf2</serial>
Aug 09 10:29:39 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 10:29:39 user nova-compute[72362]: </disk>
Aug 09 10:29:39 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:29:39 user nova-compute[72362]: DEBUG nova.policy [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '990e2d160fdc4c599cee9f65d6d4e41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac22022944542c0b52dd912d3dbcce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72362) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 10:29:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Received event <DeviceRemovedEvent: 1691576980.2600644, f4087716-c913-48db-886e-2f21d1238c66 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72362) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 10:29:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7f6ba9ab-3cc0-4ddc-84a5-18c3dd36c6c9 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance f4087716-c913-48db-886e-2f21d1238c66 {{(pid=72362) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 10:29:40 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-7f6ba9ab-3cc0-4ddc-84a5-18c3dd36c6c9 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Successfully detached device vdc from instance f4087716-c913-48db-886e-2f21d1238c66 from the live domain config.
Aug 09 10:29:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f6ba9ab-3cc0-4ddc-84a5-18c3dd36c6c9 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] [instance: f4087716-c913-48db-886e-2f21d1238c66] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:29:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f6ba9ab-3cc0-4ddc-84a5-18c3dd36c6c9 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:98af759c-c699-49c3-ba21-b9c7cb647cf2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yaNbmGnT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:29:40 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-7f6ba9ab-3cc0-4ddc-84a5-18c3dd36c6c9 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:29:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-7f6ba9ab-3cc0-4ddc-84a5-18c3dd36c6c9 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:29:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-7f6ba9ab-3cc0-4ddc-84a5-18c3dd36c6c9 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:29:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f6ba9ab-3cc0-4ddc-84a5-18c3dd36c6c9 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98af759c-c699-49c3-ba21-b9c7cb647cf2', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:29:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:40 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e233dc-680f-40e7-90d0-46044c3fc3d9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98af759c-c699-49c3-ba21-b9c7cb647cf2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:40 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[32bff9f6-7339-404a-85ad-08486115bb9e]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98af759c-c699-49c3-ba21-b9c7cb647cf2 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f6ba9ab-3cc0-4ddc-84a5-18c3dd36c6c9 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:29:40 user nova-compute[72362]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac (non-flash)
Aug 09 10:29:40 user nova-compute[72362]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157 (non-flash)
Aug 09 10:29:40 user nova-compute[72362]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98af759c-c699-49c3-ba21-b9c7cb647cf2 (non-flash)
Aug 09 10:29:40 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:29:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f6ba9ab-3cc0-4ddc-84a5-18c3dd36c6c9 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:29:40 user nova-compute[72362]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac (non-flash)
Aug 09 10:29:40 user nova-compute[72362]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157 (non-flash)
Aug 09 10:29:40 user nova-compute[72362]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98af759c-c699-49c3-ba21-b9c7cb647cf2 (non-flash)
Aug 09 10:29:40 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:29:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f6ba9ab-3cc0-4ddc-84a5-18c3dd36c6c9 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e4461e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98af759c-c699-49c3-ba21-b9c7cb647cf2'): ({'sdd'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:29:40 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-7f6ba9ab-3cc0-4ddc-84a5-18c3dd36c6c9 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Removing single pathed devices sdd {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:29:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:40 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0598f25b-a54d-4c25-af40-55b2118e1750]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:40 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[af39c8e5-2ec5-4938-a678-f8bce1e30f98]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:40 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-7f6ba9ab-3cc0-4ddc-84a5-18c3dd36c6c9 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Flushing IO for device /dev/sdd {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:29:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:40 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[43716b5e-8850-48d4-8c60-db3dff8ee939]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:40 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-7f6ba9ab-3cc0-4ddc-84a5-18c3dd36c6c9 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:29:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:40 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f8dceb-b0cf-46b8-891f-105c3ac37485]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:40 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-7f6ba9ab-3cc0-4ddc-84a5-18c3dd36c6c9 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:29:40 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-7f6ba9ab-3cc0-4ddc-84a5-18c3dd36c6c9 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] SCSI volumes sdd have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:29:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f6ba9ab-3cc0-4ddc-84a5-18c3dd36c6c9 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98af759c-c699-49c3-ba21-b9c7cb647cf2')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:29:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98af759c-c699-49c3-ba21-b9c7cb647cf2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98af759c-c699-49c3-ba21-b9c7cb647cf2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:40 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f461c401-d8ec-4612-b793-2426fd0bdf6b]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f6ba9ab-3cc0-4ddc-84a5-18c3dd36c6c9 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:29:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98af759c-c699-49c3-ba21-b9c7cb647cf2 -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98af759c-c699-49c3-ba21-b9c7cb647cf2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:40 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c8701c-66be-418d-816e-312b59329e93]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:98af759c-c699-49c3-ba21-b9c7cb647cf2, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:98af759c-c699-49c3-ba21-b9c7cb647cf2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f6ba9ab-3cc0-4ddc-84a5-18c3dd36c6c9 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:98af759c-c699-49c3-ba21-b9c7cb647cf2, portal: 172.16.0.220,3260]
Aug 09 10:29:40 user nova-compute[72362]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:98af759c-c699-49c3-ba21-b9c7cb647cf2, portal: 172.16.0.220,3260] successful.
Aug 09 10:29:40 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:29:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98af759c-c699-49c3-ba21-b9c7cb647cf2 -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98af759c-c699-49c3-ba21-b9c7cb647cf2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:40 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a746e08-138d-451e-864d-e3082e5c967c]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f6ba9ab-3cc0-4ddc-84a5-18c3dd36c6c9 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:29:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-7f6ba9ab-3cc0-4ddc-84a5-18c3dd36c6c9 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:29:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f6ba9ab-3cc0-4ddc-84a5-18c3dd36c6c9 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] <== disconnect_volume: return (320ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:29:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f6ba9ab-3cc0-4ddc-84a5-18c3dd36c6c9 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] [instance: f4087716-c913-48db-886e-2f21d1238c66] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:29:40 user nova-compute[72362]: DEBUG nova.network.neutron [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Successfully created port: 0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:29:41 user nova-compute[72362]: DEBUG nova.network.neutron [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Successfully updated port: 0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:29:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Acquiring lock "refresh_cache-4b22a19f-300c-42fb-8175-e737eef7d531" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:29:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Acquired lock "refresh_cache-4b22a19f-300c-42fb-8175-e737eef7d531" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:29:41 user nova-compute[72362]: DEBUG nova.network.neutron [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:29:41 user nova-compute[72362]: DEBUG nova.compute.manager [req-3fe96302-6db0-4be5-a165-814652c980f6 req-2de631c2-e3f7-4413-9e6d-1d89bb9128b1 service nova] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Received event network-changed-0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:29:41 user nova-compute[72362]: DEBUG nova.compute.manager [req-3fe96302-6db0-4be5-a165-814652c980f6 req-2de631c2-e3f7-4413-9e6d-1d89bb9128b1 service nova] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Refreshing instance network info cache due to event network-changed-0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:29:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3fe96302-6db0-4be5-a165-814652c980f6 req-2de631c2-e3f7-4413-9e6d-1d89bb9128b1 service nova] Acquiring lock "refresh_cache-4b22a19f-300c-42fb-8175-e737eef7d531" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:29:41 user nova-compute[72362]: DEBUG nova.network.neutron [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:29:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:41 user nova-compute[72362]: DEBUG nova.network.neutron [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Updating instance_info_cache with network_info: [{"id": "0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa", "address": "fa:16:3e:39:ad:fb", "network": {"id": "e6c54663-74e3-43e2-8f0d-61b300c1f68d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1222286883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ac22022944542c0b52dd912d3dbcce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0942f4eb-e7", "ovs_interfaceid": "0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:29:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Releasing lock "refresh_cache-4b22a19f-300c-42fb-8175-e737eef7d531" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:29:41 user nova-compute[72362]: DEBUG nova.compute.manager [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Instance network_info: |[{"id": "0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa", "address": "fa:16:3e:39:ad:fb", "network": {"id": "e6c54663-74e3-43e2-8f0d-61b300c1f68d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1222286883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ac22022944542c0b52dd912d3dbcce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0942f4eb-e7", "ovs_interfaceid": "0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 10:29:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3fe96302-6db0-4be5-a165-814652c980f6 req-2de631c2-e3f7-4413-9e6d-1d89bb9128b1 service nova] Acquired lock "refresh_cache-4b22a19f-300c-42fb-8175-e737eef7d531" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:29:41 user nova-compute[72362]: DEBUG nova.network.neutron [req-3fe96302-6db0-4be5-a165-814652c980f6 req-2de631c2-e3f7-4413-9e6d-1d89bb9128b1 service nova] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Refreshing network info cache for port 0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:29:42 user nova-compute[72362]: DEBUG nova.network.neutron [req-3fe96302-6db0-4be5-a165-814652c980f6 req-2de631c2-e3f7-4413-9e6d-1d89bb9128b1 service nova] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Updated VIF entry in instance network info cache for port 0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:29:42 user nova-compute[72362]: DEBUG nova.network.neutron [req-3fe96302-6db0-4be5-a165-814652c980f6 req-2de631c2-e3f7-4413-9e6d-1d89bb9128b1 service nova] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Updating instance_info_cache with network_info: [{"id": "0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa", "address": "fa:16:3e:39:ad:fb", "network": {"id": "e6c54663-74e3-43e2-8f0d-61b300c1f68d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1222286883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ac22022944542c0b52dd912d3dbcce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0942f4eb-e7", "ovs_interfaceid": "0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:29:42 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3fe96302-6db0-4be5-a165-814652c980f6 req-2de631c2-e3f7-4413-9e6d-1d89bb9128b1 service nova] Releasing lock "refresh_cache-4b22a19f-300c-42fb-8175-e737eef7d531" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:29:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:46 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691576971.8223963, 4746beb1-d313-4cea-bf7b-75b507ebbdd2 => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:29:46 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] VM Stopped (Lifecycle Event)
Aug 09 10:29:46 user nova-compute[72362]: DEBUG nova.compute.manager [None req-18454ede-b5eb-42e8-b668-4c4c22f34fa7 None None] [instance: 4746beb1-d313-4cea-bf7b-75b507ebbdd2] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:29:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:48 user nova-compute[72362]: DEBUG nova.objects.instance [None req-7f6ba9ab-3cc0-4ddc-84a5-18c3dd36c6c9 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Lazy-loading 'flavor' on Instance uuid f4087716-c913-48db-886e-2f21d1238c66 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7f6ba9ab-3cc0-4ddc-84a5-18c3dd36c6c9 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Lock "f4087716-c913-48db-886e-2f21d1238c66" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 9.446s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG nova.compute.manager [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Start spawning the instance on the hypervisor. {{(pid=72362) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:29:49 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Creating image(s)
Aug 09 10:29:49 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Did not create local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Ensure instance console log exists: /opt/stack/data/nova/instances/4b22a19f-300c-42fb-8175-e737eef7d531/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Start _get_guest_xml network_info=[{"id": "0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa", "address": "fa:16:3e:39:ad:fb", "network": {"id": "e6c54663-74e3-43e2-8f0d-61b300c1f68d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1222286883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ac22022944542c0b52dd912d3dbcce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0942f4eb-e7", "ovs_interfaceid": "0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '5b74d0b7-9311-4410-b8c2-fe1beeae34b7', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IfUGAoaD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4b22a19f-300c-42fb-8175-e737eef7d531', 'attached_at': '', 'detached_at': '', 'volume_id': '31aca44a-c500-4972-873a-bb902c63755f', 'serial': '31aca44a-c500-4972-873a-bb902c63755f'}, 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:29:49 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:29:49 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:29:49 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IfUGAoaD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:29:49 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:29:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:29:49 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:29:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:29:49 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:29:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a321f5-fe2e-4806-8f50-380049a24524]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:29:49 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c66ce2-0c76-4bbd-a665-e51a32cb5398]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f] added
Aug 09 10:29:49 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29634ea-fa44-4476-8001-44c4dc092dc4]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5fa8de-0bb3-4b23-9dcb-a2ea63f198da]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IfUGAoaD {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IfUGAoaD" returned: 0 in 0.025s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e1e4b0-1106-47c1-98b6-c5c1a0f0d158]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IfUGAoaD'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f03c66-9521-446a-8bf1-65760bb66f8a]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ce1c42-68c3-4c75-a8e3-f23ce53f7069]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:29:49 user nova-compute[72362]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac (non-flash)
Aug 09 10:29:49 user nova-compute[72362]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157 (non-flash)
Aug 09 10:29:49 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:29:49 user nova-compute[72362]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac (non-flash)
Aug 09 10:29:49 user nova-compute[72362]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157 (non-flash)
Aug 09 10:29:49 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[956f3b9c-92b6-4961-83dd-c775cc77b874]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f, portal: 172.16.0.220,3260]
Aug 09 10:29:49 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f, portal: 172.16.0.220,3260] successful.
Aug 09 10:29:49 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3f381c-d1ee-411f-bb4c-503d64feb134]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[330843ce-2424-48b8-ad92-f2a90335ea4e]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:29:49 user nova-compute[72362]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac (non-flash)
Aug 09 10:29:49 user nova-compute[72362]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157 (non-flash)
Aug 09 10:29:49 user nova-compute[72362]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:29:49 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:29:49 user nova-compute[72362]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac (non-flash)
Aug 09 10:29:49 user nova-compute[72362]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157 (non-flash)
Aug 09 10:29:49 user nova-compute[72362]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:29:49 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] HCTL ('35', '-', '-', 0) found on session 39 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.029s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6296255-d9ac-48fc-b27a-a15a5b1df700]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IfUGAoaD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:29:49 user nova-compute[72362]: DEBUG nova.compute.manager [None req-718c9119-b400-4ee5-b363-7fdff0e0e83f tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:29:49 user nova-compute[72362]: INFO nova.compute.manager [None req-718c9119-b400-4ee5-b363-7fdff0e0e83f tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] instance snapshotting
Aug 09 10:29:49 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-718c9119-b400-4ee5-b363-7fdff0e0e83f tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Beginning live snapshot process
Aug 09 10:29:50 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-718c9119-b400-4ee5-b363-7fdff0e0e83f tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk --force-share --output=json -f qcow2 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:50 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-718c9119-b400-4ee5-b363-7fdff0e0e83f tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk --force-share --output=json -f qcow2" returned: 0 in 0.141s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:50 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-718c9119-b400-4ee5-b363-7fdff0e0e83f tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk --force-share --output=json -f qcow2 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:50 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Acquiring lock "8d42f648-8616-4974-b416-0b6534b002cc" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:29:50 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Lock "8d42f648-8616-4974-b416-0b6534b002cc" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:29:50 user nova-compute[72362]: INFO nova.compute.manager [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Unshelving
Aug 09 10:29:50 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-718c9119-b400-4ee5-b363-7fdff0e0e83f tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk --force-share --output=json -f qcow2" returned: 0 in 0.151s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:50 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-718c9119-b400-4ee5-b363-7fdff0e0e83f tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:50 user nova-compute[72362]: INFO nova.virt.block_device [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Booting with volume df0efc51-3970-4983-a224-c79511fab3d9 at /dev/vda
Aug 09 10:29:50 user nova-compute[72362]: DEBUG os_brick.utils [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:29:50 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:50 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:50 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6e9747-06f5-4305-8bd7-6a53f105924c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:50 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:50 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-718c9119-b400-4ee5-b363-7fdff0e0e83f tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.151s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:50 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-718c9119-b400-4ee5-b363-7fdff0e0e83f tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpa49kb0u7/4a2bf8949f0742dcb2b0a6b68fcbf973.delta 1073741824 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:50 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:50 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ba2bc7-332e-407b-866f-46648c61788f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:50 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:50 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-718c9119-b400-4ee5-b363-7fdff0e0e83f tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpa49kb0u7/4a2bf8949f0742dcb2b0a6b68fcbf973.delta 1073741824" returned: 0 in 0.056s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:50 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-718c9119-b400-4ee5-b363-7fdff0e0e83f tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 09 10:29:50 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:50 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e85234d-9e7e-4689-a8e9-2dda4721eaaa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:50 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36d5830-12a5-478b-b16e-c38815a6cc19]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:50 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:50 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:29:50 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:29:50 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:50 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:29:50 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:29:50 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5495a2be-254e-4be5-b7f7-dfa743fa5a5a]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:29:50 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:29:50 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:29:50 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:29:50 user nova-compute[72362]: DEBUG os_brick.utils [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:29:50 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Updating existing volume attachment record: 84616bba-eb32-43e8-8386-d4aff9ede921 {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 10:29:50 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:29:50 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '23963623563653539', 'path': '/dev/sdd'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:29:50 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963623563653539', 'path': '/dev/sdd'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:29:50 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:29:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1888482065',display_name='tempest-ServerActionsTestOtherA-server-1888482065',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1888482065',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwSFF251eQti/qkoXtJtG/hsB95elMyv8iaeRUjgcdf3ZQpb25r9rbEB2fGNjqP3pvOqQxJNR/NqVUD62omNMx/akMv5+i7VAu1R/GqhP2vqtVAvdiRNee4z2ROG7Jd8w==',key_name='tempest-keypair-122703468',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ac22022944542c0b52dd912d3dbcce2',ramdisk_id='',reservation_id='r-08r15keq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2101881579',owner_user_name='tempest-ServerActionsTestOtherA-2101881579-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:29:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='990e2d160fdc4c599cee9f65d6d4e41d',uuid=4b22a19f-300c-42fb-8175-e737eef7d531,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa", "address": "fa:16:3e:39:ad:fb", "network": {"id": "e6c54663-74e3-43e2-8f0d-61b300c1f68d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1222286883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ac22022944542c0b52dd912d3dbcce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0942f4eb-e7", "ovs_interfaceid": "0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:29:50 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Converting VIF {"id": "0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa", "address": "fa:16:3e:39:ad:fb", "network": {"id": "e6c54663-74e3-43e2-8f0d-61b300c1f68d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1222286883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ac22022944542c0b52dd912d3dbcce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0942f4eb-e7", "ovs_interfaceid": "0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:29:50 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:ad:fb,bridge_name='br-int',has_traffic_filtering=True,id=0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa,network=Network(e6c54663-74e3-43e2-8f0d-61b300c1f68d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0942f4eb-e7') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:29:50 user nova-compute[72362]: DEBUG nova.objects.instance [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b22a19f-300c-42fb-8175-e737eef7d531 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:29:50 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:29:50 user nova-compute[72362]:   <uuid>4b22a19f-300c-42fb-8175-e737eef7d531</uuid>
Aug 09 10:29:50 user nova-compute[72362]:   <name>instance-0000001e</name>
Aug 09 10:29:50 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:29:50 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:29:50 user nova-compute[72362]:   <metadata>
Aug 09 10:29:50 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:29:50 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:29:50 user nova-compute[72362]:       <nova:name>tempest-ServerActionsTestOtherA-server-1888482065</nova:name>
Aug 09 10:29:50 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:29:49</nova:creationTime>
Aug 09 10:29:50 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:29:50 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:29:50 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:29:50 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:29:50 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:29:50 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:29:50 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:29:50 user nova-compute[72362]:       <nova:owner>
Aug 09 10:29:50 user nova-compute[72362]:         <nova:user uuid="990e2d160fdc4c599cee9f65d6d4e41d">tempest-ServerActionsTestOtherA-2101881579-project-member</nova:user>
Aug 09 10:29:50 user nova-compute[72362]:         <nova:project uuid="8ac22022944542c0b52dd912d3dbcce2">tempest-ServerActionsTestOtherA-2101881579</nova:project>
Aug 09 10:29:50 user nova-compute[72362]:       </nova:owner>
Aug 09 10:29:50 user nova-compute[72362]:       <nova:ports>
Aug 09 10:29:50 user nova-compute[72362]:         <nova:port uuid="0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa">
Aug 09 10:29:50 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 10:29:50 user nova-compute[72362]:         </nova:port>
Aug 09 10:29:50 user nova-compute[72362]:       </nova:ports>
Aug 09 10:29:50 user nova-compute[72362]:     </nova:instance>
Aug 09 10:29:50 user nova-compute[72362]:   </metadata>
Aug 09 10:29:50 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:29:50 user nova-compute[72362]:     <system>
Aug 09 10:29:50 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:29:50 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:29:50 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:29:50 user nova-compute[72362]:       <entry name="serial">4b22a19f-300c-42fb-8175-e737eef7d531</entry>
Aug 09 10:29:50 user nova-compute[72362]:       <entry name="uuid">4b22a19f-300c-42fb-8175-e737eef7d531</entry>
Aug 09 10:29:50 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:29:50 user nova-compute[72362]:     </system>
Aug 09 10:29:50 user nova-compute[72362]:   </sysinfo>
Aug 09 10:29:50 user nova-compute[72362]:   <os>
Aug 09 10:29:50 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:29:50 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:29:50 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:29:50 user nova-compute[72362]:   </os>
Aug 09 10:29:50 user nova-compute[72362]:   <features>
Aug 09 10:29:50 user nova-compute[72362]:     <acpi/>
Aug 09 10:29:50 user nova-compute[72362]:     <apic/>
Aug 09 10:29:50 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:29:50 user nova-compute[72362]:   </features>
Aug 09 10:29:50 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:29:50 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:29:50 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:29:50 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:29:50 user nova-compute[72362]:   </clock>
Aug 09 10:29:50 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:29:50 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:29:50 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:29:50 user nova-compute[72362]:   </cpu>
Aug 09 10:29:50 user nova-compute[72362]:   <devices>
Aug 09 10:29:50 user nova-compute[72362]:     <disk type="block" device="disk">
Aug 09 10:29:50 user nova-compute[72362]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:29:50 user nova-compute[72362]:       <source dev="/dev/sdd"/>
Aug 09 10:29:50 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:29:50 user nova-compute[72362]:       <serial>31aca44a-c500-4972-873a-bb902c63755f</serial>
Aug 09 10:29:50 user nova-compute[72362]:     </disk>
Aug 09 10:29:50 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:29:50 user nova-compute[72362]:       <mac address="fa:16:3e:39:ad:fb"/>
Aug 09 10:29:50 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:29:50 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:29:50 user nova-compute[72362]:       <target dev="tap0942f4eb-e7"/>
Aug 09 10:29:50 user nova-compute[72362]:     </interface>
Aug 09 10:29:50 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:29:50 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/4b22a19f-300c-42fb-8175-e737eef7d531/console.log" append="off"/>
Aug 09 10:29:50 user nova-compute[72362]:     </serial>
Aug 09 10:29:50 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:29:50 user nova-compute[72362]:     <video>
Aug 09 10:29:50 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:29:50 user nova-compute[72362]:     </video>
Aug 09 10:29:50 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:29:50 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:29:50 user nova-compute[72362]:     </rng>
Aug 09 10:29:50 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:29:50 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:29:50 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:29:50 user nova-compute[72362]:     </memballoon>
Aug 09 10:29:50 user nova-compute[72362]:   </devices>
Aug 09 10:29:50 user nova-compute[72362]: </domain>
Aug 09 10:29:50 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:29:50 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:29:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1888482065',display_name='tempest-ServerActionsTestOtherA-server-1888482065',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1888482065',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwSFF251eQti/qkoXtJtG/hsB95elMyv8iaeRUjgcdf3ZQpb25r9rbEB2fGNjqP3pvOqQxJNR/NqVUD62omNMx/akMv5+i7VAu1R/GqhP2vqtVAvdiRNee4z2ROG7Jd8w==',key_name='tempest-keypair-122703468',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ac22022944542c0b52dd912d3dbcce2',ramdisk_id='',reservation_id='r-08r15keq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2101881579',owner_user_name='tempest-ServerActionsTestOtherA-2101881579-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:29:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='990e2d160fdc4c599cee9f65d6d4e41d',uuid=4b22a19f-300c-42fb-8175-e737eef7d531,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa", "address": "fa:16:3e:39:ad:fb", "network": {"id": "e6c54663-74e3-43e2-8f0d-61b300c1f68d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1222286883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ac22022944542c0b52dd912d3dbcce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0942f4eb-e7", "ovs_interfaceid": "0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:29:50 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Converting VIF {"id": "0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa", "address": "fa:16:3e:39:ad:fb", "network": {"id": "e6c54663-74e3-43e2-8f0d-61b300c1f68d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1222286883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ac22022944542c0b52dd912d3dbcce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0942f4eb-e7", "ovs_interfaceid": "0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:29:50 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:ad:fb,bridge_name='br-int',has_traffic_filtering=True,id=0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa,network=Network(e6c54663-74e3-43e2-8f0d-61b300c1f68d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0942f4eb-e7') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:29:50 user nova-compute[72362]: DEBUG os_vif [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:ad:fb,bridge_name='br-int',has_traffic_filtering=True,id=0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa,network=Network(e6c54663-74e3-43e2-8f0d-61b300c1f68d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0942f4eb-e7') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:29:50 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:50 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:29:50 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:29:50 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:50 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0942f4eb-e7, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:29:50 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0942f4eb-e7, col_values=(('external_ids', {'iface-id': '0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:ad:fb', 'vm-uuid': '4b22a19f-300c-42fb-8175-e737eef7d531'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:29:50 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:50 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:29:50 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:50 user nova-compute[72362]: INFO os_vif [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:ad:fb,bridge_name='br-int',has_traffic_filtering=True,id=0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa,network=Network(e6c54663-74e3-43e2-8f0d-61b300c1f68d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0942f4eb-e7')
Aug 09 10:29:51 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:29:51 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] No VIF found with MAC fa:16:3e:39:ad:fb, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:29:51 user nova-compute[72362]: DEBUG nova.compute.manager [None req-d43bc3cb-bfe0-4d23-9ec2-c5cdbbc8ea55 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:29:51 user nova-compute[72362]: INFO nova.compute.manager [None req-d43bc3cb-bfe0-4d23-9ec2-c5cdbbc8ea55 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] instance snapshotting
Aug 09 10:29:51 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-d43bc3cb-bfe0-4d23-9ec2-c5cdbbc8ea55 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Beginning live snapshot process
Aug 09 10:29:51 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-718c9119-b400-4ee5-b363-7fdff0e0e83f tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72362) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 10:29:51 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-d43bc3cb-bfe0-4d23-9ec2-c5cdbbc8ea55 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09fcf27a-c6dc-4c4a-b73c-555ea2339967/disk --force-share --output=json -f qcow2 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:51 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-d43bc3cb-bfe0-4d23-9ec2-c5cdbbc8ea55 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09fcf27a-c6dc-4c4a-b73c-555ea2339967/disk --force-share --output=json -f qcow2" returned: 0 in 0.153s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:51 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-d43bc3cb-bfe0-4d23-9ec2-c5cdbbc8ea55 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09fcf27a-c6dc-4c4a-b73c-555ea2339967/disk --force-share --output=json -f qcow2 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:51 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-d43bc3cb-bfe0-4d23-9ec2-c5cdbbc8ea55 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09fcf27a-c6dc-4c4a-b73c-555ea2339967/disk --force-share --output=json -f qcow2" returned: 0 in 0.165s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:51 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-d43bc3cb-bfe0-4d23-9ec2-c5cdbbc8ea55 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:51 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-d43bc3cb-bfe0-4d23-9ec2-c5cdbbc8ea55 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.138s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:51 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-d43bc3cb-bfe0-4d23-9ec2-c5cdbbc8ea55 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8dqrrcsl/a3b26d29d68841378e3ffbcbc3ad9512.delta 1073741824 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:52 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-718c9119-b400-4ee5-b363-7fdff0e0e83f tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72362) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 10:29:52 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-718c9119-b400-4ee5-b363-7fdff0e0e83f tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 09 10:29:52 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-d43bc3cb-bfe0-4d23-9ec2-c5cdbbc8ea55 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8dqrrcsl/a3b26d29d68841378e3ffbcbc3ad9512.delta 1073741824" returned: 0 in 0.068s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:52 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-d43bc3cb-bfe0-4d23-9ec2-c5cdbbc8ea55 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 09 10:29:52 user nova-compute[72362]: DEBUG nova.privsep.utils [None req-718c9119-b400-4ee5-b363-7fdff0e0e83f tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72362) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 10:29:52 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-718c9119-b400-4ee5-b363-7fdff0e0e83f tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpa49kb0u7/4a2bf8949f0742dcb2b0a6b68fcbf973.delta /opt/stack/data/nova/instances/snapshots/tmpa49kb0u7/4a2bf8949f0742dcb2b0a6b68fcbf973 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:52 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-718c9119-b400-4ee5-b363-7fdff0e0e83f tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpa49kb0u7/4a2bf8949f0742dcb2b0a6b68fcbf973.delta /opt/stack/data/nova/instances/snapshots/tmpa49kb0u7/4a2bf8949f0742dcb2b0a6b68fcbf973" returned: 0 in 0.509s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:52 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-718c9119-b400-4ee5-b363-7fdff0e0e83f tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Snapshot extracted, beginning image upload
Aug 09 10:29:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-d43bc3cb-bfe0-4d23-9ec2-c5cdbbc8ea55 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] COPY block job progress, current cursor: 1310720 final cursor: 75563008 {{(pid=72362) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 10:29:53 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:53 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:53 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-d43bc3cb-bfe0-4d23-9ec2-c5cdbbc8ea55 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=72362) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 10:29:53 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-d43bc3cb-bfe0-4d23-9ec2-c5cdbbc8ea55 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 09 10:29:53 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:53 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:53 user nova-compute[72362]: DEBUG nova.privsep.utils [None req-d43bc3cb-bfe0-4d23-9ec2-c5cdbbc8ea55 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72362) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 10:29:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-d43bc3cb-bfe0-4d23-9ec2-c5cdbbc8ea55 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8dqrrcsl/a3b26d29d68841378e3ffbcbc3ad9512.delta /opt/stack/data/nova/instances/snapshots/tmp8dqrrcsl/a3b26d29d68841378e3ffbcbc3ad9512 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:29:53 user nova-compute[72362]: DEBUG nova.compute.manager [req-2959a5fd-e01e-4940-8c10-30dc6e6ee0a2 req-6c2a8c98-a1b3-4ee4-88b7-50b08aa19e18 service nova] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Received event network-vif-plugged-0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:29:53 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-2959a5fd-e01e-4940-8c10-30dc6e6ee0a2 req-6c2a8c98-a1b3-4ee4-88b7-50b08aa19e18 service nova] Acquiring lock "4b22a19f-300c-42fb-8175-e737eef7d531-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:29:53 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-2959a5fd-e01e-4940-8c10-30dc6e6ee0a2 req-6c2a8c98-a1b3-4ee4-88b7-50b08aa19e18 service nova] Lock "4b22a19f-300c-42fb-8175-e737eef7d531-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:29:53 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-2959a5fd-e01e-4940-8c10-30dc6e6ee0a2 req-6c2a8c98-a1b3-4ee4-88b7-50b08aa19e18 service nova] Lock "4b22a19f-300c-42fb-8175-e737eef7d531-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:29:53 user nova-compute[72362]: DEBUG nova.compute.manager [req-2959a5fd-e01e-4940-8c10-30dc6e6ee0a2 req-6c2a8c98-a1b3-4ee4-88b7-50b08aa19e18 service nova] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] No waiting events found dispatching network-vif-plugged-0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:29:53 user nova-compute[72362]: WARNING nova.compute.manager [req-2959a5fd-e01e-4940-8c10-30dc6e6ee0a2 req-6c2a8c98-a1b3-4ee4-88b7-50b08aa19e18 service nova] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Received unexpected event network-vif-plugged-0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa for instance with vm_state building and task_state spawning.
Aug 09 10:29:54 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-d43bc3cb-bfe0-4d23-9ec2-c5cdbbc8ea55 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8dqrrcsl/a3b26d29d68841378e3ffbcbc3ad9512.delta /opt/stack/data/nova/instances/snapshots/tmp8dqrrcsl/a3b26d29d68841378e3ffbcbc3ad9512" returned: 0 in 0.591s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:29:54 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-d43bc3cb-bfe0-4d23-9ec2-c5cdbbc8ea55 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Snapshot extracted, beginning image upload
Aug 09 10:29:55 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-718c9119-b400-4ee5-b363-7fdff0e0e83f tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Snapshot image upload complete
Aug 09 10:29:55 user nova-compute[72362]: INFO nova.compute.manager [None req-718c9119-b400-4ee5-b363-7fdff0e0e83f tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Took 5.71 seconds to snapshot the instance on the hypervisor.
Aug 09 10:29:55 user nova-compute[72362]: DEBUG nova.compute.manager [req-686c35b3-0f68-4b27-8e05-fa1beb97d2ab req-3e9c4fbc-22e4-417f-a602-16a86a883514 service nova] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Received event network-vif-plugged-0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:29:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-686c35b3-0f68-4b27-8e05-fa1beb97d2ab req-3e9c4fbc-22e4-417f-a602-16a86a883514 service nova] Acquiring lock "4b22a19f-300c-42fb-8175-e737eef7d531-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:29:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-686c35b3-0f68-4b27-8e05-fa1beb97d2ab req-3e9c4fbc-22e4-417f-a602-16a86a883514 service nova] Lock "4b22a19f-300c-42fb-8175-e737eef7d531-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:29:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-686c35b3-0f68-4b27-8e05-fa1beb97d2ab req-3e9c4fbc-22e4-417f-a602-16a86a883514 service nova] Lock "4b22a19f-300c-42fb-8175-e737eef7d531-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:29:55 user nova-compute[72362]: DEBUG nova.compute.manager [req-686c35b3-0f68-4b27-8e05-fa1beb97d2ab req-3e9c4fbc-22e4-417f-a602-16a86a883514 service nova] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] No waiting events found dispatching network-vif-plugged-0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:29:55 user nova-compute[72362]: WARNING nova.compute.manager [req-686c35b3-0f68-4b27-8e05-fa1beb97d2ab req-3e9c4fbc-22e4-417f-a602-16a86a883514 service nova] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Received unexpected event network-vif-plugged-0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa for instance with vm_state building and task_state spawning.
Aug 09 10:29:55 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576995.8300762, 4b22a19f-300c-42fb-8175-e737eef7d531 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:29:55 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] VM Resumed (Lifecycle Event)
Aug 09 10:29:55 user nova-compute[72362]: DEBUG nova.compute.manager [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:29:55 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:29:55 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Instance spawned successfully.
Aug 09 10:29:55 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 10:29:55 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:29:55 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:29:55 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Found default for hw_cdrom_bus of ide {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:29:55 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Found default for hw_disk_bus of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:29:55 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:29:55 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:29:55 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Found default for hw_video_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:29:55 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Found default for hw_vif_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:29:55 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:29:55 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691576995.8314567, 4b22a19f-300c-42fb-8175-e737eef7d531 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:29:55 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] VM Started (Lifecycle Event)
Aug 09 10:29:55 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:29:55 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:29:55 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:29:55 user nova-compute[72362]: INFO nova.compute.manager [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Took 6.60 seconds to spawn the instance on the hypervisor.
Aug 09 10:29:55 user nova-compute[72362]: DEBUG nova.compute.manager [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:29:55 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:56 user nova-compute[72362]: INFO nova.compute.manager [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Took 17.71 seconds to build instance.
Aug 09 10:29:56 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a7ed4883-35c7-4993-9d85-a31bbe068ada tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "4b22a19f-300c-42fb-8175-e737eef7d531" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.882s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:29:56 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:29:57 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-d43bc3cb-bfe0-4d23-9ec2-c5cdbbc8ea55 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Snapshot image upload complete
Aug 09 10:29:57 user nova-compute[72362]: INFO nova.compute.manager [None req-d43bc3cb-bfe0-4d23-9ec2-c5cdbbc8ea55 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Took 5.96 seconds to snapshot the instance on the hypervisor.
Aug 09 10:29:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Acquiring lock "9268633a-36f0-4bd2-85f2-22ae7911a1f9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:29:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "9268633a-36f0-4bd2-85f2-22ae7911a1f9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:29:59 user nova-compute[72362]: DEBUG nova.compute.manager [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Starting instance... {{(pid=72362) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 10:29:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:29:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:29:59 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:29:59 user nova-compute[72362]: INFO nova.compute.claims [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Claim successful on node user
Aug 09 10:29:59 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:30:00 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:30:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.567s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:30:00 user nova-compute[72362]: DEBUG nova.compute.manager [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Start building networks asynchronously for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 10:30:00 user nova-compute[72362]: DEBUG nova.compute.manager [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Allocating IP information in the background. {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 10:30:00 user nova-compute[72362]: DEBUG nova.network.neutron [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] allocate_for_instance() {{(pid=72362) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 10:30:00 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 10:30:00 user nova-compute[72362]: DEBUG nova.compute.manager [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Start building block device mappings for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 10:30:00 user nova-compute[72362]: DEBUG nova.policy [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8bd184d9dcf64c6fa81bf0b7fa68a9b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb5a3be50242059591c9cbf8cc0f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72362) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 10:30:00 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:30:00 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:30:00 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:30:00 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 10:30:00 user nova-compute[72362]: DEBUG nova.compute.manager [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Start spawning the instance on the hypervisor. {{(pid=72362) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 10:30:00 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:30:00 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Creating image(s)
Aug 09 10:30:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Acquiring lock "/opt/stack/data/nova/instances/9268633a-36f0-4bd2-85f2-22ae7911a1f9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:30:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "/opt/stack/data/nova/instances/9268633a-36f0-4bd2-85f2-22ae7911a1f9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:30:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "/opt/stack/data/nova/instances/9268633a-36f0-4bd2-85f2-22ae7911a1f9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:30:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Acquiring lock "8f0c4736f09434b24db2aa0bc408b8a1831106fe" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:30:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "8f0c4736f09434b24db2aa0bc408b8a1831106fe" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:30:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f0c4736f09434b24db2aa0bc408b8a1831106fe.part --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:01 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:30:01 user nova-compute[72362]: DEBUG nova.network.neutron [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Successfully created port: 8f5858da-09e3-4939-8bf2-c6e8b35d8100 {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:30:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:30:01 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:30:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:30:01 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:30:01 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:30:01 user nova-compute[72362]: DEBUG nova.objects.instance [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Lazy-loading 'pci_requests' on Instance uuid 8d42f648-8616-4974-b416-0b6534b002cc {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:30:01 user nova-compute[72362]: DEBUG nova.objects.instance [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Lazy-loading 'numa_topology' on Instance uuid 8d42f648-8616-4974-b416-0b6534b002cc {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:30:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f0c4736f09434b24db2aa0bc408b8a1831106fe.part --force-share --output=json" returned: 0 in 0.171s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:01 user nova-compute[72362]: DEBUG nova.virt.images [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] e1066ed9-2540-445b-bde8-8ba4f645dbb8 was qcow2, converting to raw {{(pid=72362) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 10:30:01 user nova-compute[72362]: DEBUG nova.privsep.utils [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72362) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 10:30:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8f0c4736f09434b24db2aa0bc408b8a1831106fe.part /opt/stack/data/nova/instances/_base/8f0c4736f09434b24db2aa0bc408b8a1831106fe.converted {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:01 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:30:01 user nova-compute[72362]: INFO nova.compute.claims [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Claim successful on node user
Aug 09 10:30:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8f0c4736f09434b24db2aa0bc408b8a1831106fe.part /opt/stack/data/nova/instances/_base/8f0c4736f09434b24db2aa0bc408b8a1831106fe.converted" returned: 0 in 0.390s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f0c4736f09434b24db2aa0bc408b8a1831106fe.converted --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f0c4736f09434b24db2aa0bc408b8a1831106fe.converted --force-share --output=json" returned: 0 in 0.155s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "8f0c4736f09434b24db2aa0bc408b8a1831106fe" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.875s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:30:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f0c4736f09434b24db2aa0bc408b8a1831106fe --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:02 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:30:02 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:30:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f0c4736f09434b24db2aa0bc408b8a1831106fe --force-share --output=json" returned: 0 in 0.158s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Acquiring lock "8f0c4736f09434b24db2aa0bc408b8a1831106fe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:30:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "8f0c4736f09434b24db2aa0bc408b8a1831106fe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:30:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f0c4736f09434b24db2aa0bc408b8a1831106fe --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.841s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:30:02 user nova-compute[72362]: DEBUG nova.network.neutron [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Successfully updated port: 8f5858da-09e3-4939-8bf2-c6e8b35d8100 {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:30:02 user nova-compute[72362]: DEBUG nova.compute.manager [req-314fe0a9-c8c5-43f3-aeeb-bda6de8cc581 req-3b747c20-9af5-4a4c-b82e-b32fa5272290 service nova] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Received event network-changed-8f5858da-09e3-4939-8bf2-c6e8b35d8100 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:30:02 user nova-compute[72362]: DEBUG nova.compute.manager [req-314fe0a9-c8c5-43f3-aeeb-bda6de8cc581 req-3b747c20-9af5-4a4c-b82e-b32fa5272290 service nova] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Refreshing instance network info cache due to event network-changed-8f5858da-09e3-4939-8bf2-c6e8b35d8100. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:30:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-314fe0a9-c8c5-43f3-aeeb-bda6de8cc581 req-3b747c20-9af5-4a4c-b82e-b32fa5272290 service nova] Acquiring lock "refresh_cache-9268633a-36f0-4bd2-85f2-22ae7911a1f9" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:30:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-314fe0a9-c8c5-43f3-aeeb-bda6de8cc581 req-3b747c20-9af5-4a4c-b82e-b32fa5272290 service nova] Acquired lock "refresh_cache-9268633a-36f0-4bd2-85f2-22ae7911a1f9" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:30:02 user nova-compute[72362]: DEBUG nova.network.neutron [req-314fe0a9-c8c5-43f3-aeeb-bda6de8cc581 req-3b747c20-9af5-4a4c-b82e-b32fa5272290 service nova] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Refreshing network info cache for port 8f5858da-09e3-4939-8bf2-c6e8b35d8100 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:30:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Acquiring lock "refresh_cache-9268633a-36f0-4bd2-85f2-22ae7911a1f9" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:30:02 user nova-compute[72362]: INFO nova.network.neutron [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Updating port a722d26f-88e8-40a8-b13c-66ec2bc587cf with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 09 10:30:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f0c4736f09434b24db2aa0bc408b8a1831106fe --force-share --output=json" returned: 0 in 0.155s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f0c4736f09434b24db2aa0bc408b8a1831106fe,backing_fmt=raw /opt/stack/data/nova/instances/9268633a-36f0-4bd2-85f2-22ae7911a1f9/disk 1073741824 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:02 user nova-compute[72362]: DEBUG nova.network.neutron [req-314fe0a9-c8c5-43f3-aeeb-bda6de8cc581 req-3b747c20-9af5-4a4c-b82e-b32fa5272290 service nova] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:30:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f0c4736f09434b24db2aa0bc408b8a1831106fe,backing_fmt=raw /opt/stack/data/nova/instances/9268633a-36f0-4bd2-85f2-22ae7911a1f9/disk 1073741824" returned: 0 in 0.066s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "8f0c4736f09434b24db2aa0bc408b8a1831106fe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:30:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f0c4736f09434b24db2aa0bc408b8a1831106fe --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f0c4736f09434b24db2aa0bc408b8a1831106fe --force-share --output=json" returned: 0 in 0.163s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:02 user nova-compute[72362]: DEBUG nova.objects.instance [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lazy-loading 'migration_context' on Instance uuid 9268633a-36f0-4bd2-85f2-22ae7911a1f9 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Created local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Ensure instance console log exists: /opt/stack/data/nova/instances/9268633a-36f0-4bd2-85f2-22ae7911a1f9/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "refresh_cache-a6000393-6044-4b54-ac0b-1d631e2ed0ae" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquired lock "refresh_cache-a6000393-6044-4b54-ac0b-1d631e2ed0ae" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Forcefully refreshing network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG nova.network.neutron [req-314fe0a9-c8c5-43f3-aeeb-bda6de8cc581 req-3b747c20-9af5-4a4c-b82e-b32fa5272290 service nova] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-314fe0a9-c8c5-43f3-aeeb-bda6de8cc581 req-3b747c20-9af5-4a4c-b82e-b32fa5272290 service nova] Releasing lock "refresh_cache-9268633a-36f0-4bd2-85f2-22ae7911a1f9" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Acquired lock "refresh_cache-9268633a-36f0-4bd2-85f2-22ae7911a1f9" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG nova.network.neutron [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG nova.network.neutron [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Updating instance_info_cache with network_info: [{"id": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "address": "fa:16:3e:6e:b0:73", "network": {"id": "7358b925-3211-4419-84eb-df6967f5ea8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1360753488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dac04663e2f45378cc0e466740342d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c0230bc-c7", "ovs_interfaceid": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Releasing lock "refresh_cache-a6000393-6044-4b54-ac0b-1d631e2ed0ae" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Updated the network info_cache for instance {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG nova.network.neutron [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Updating instance_info_cache with network_info: [{"id": "8f5858da-09e3-4939-8bf2-c6e8b35d8100", "address": "fa:16:3e:46:83:42", "network": {"id": "5fe3b8dc-aa50-4e53-bb4d-2dcb773e501e", "bridge": "br-int", "label": "tempest-TestStampPattern-205380618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bb5a3be50242059591c9cbf8cc0f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f5858da-09", "ovs_interfaceid": "8f5858da-09e3-4939-8bf2-c6e8b35d8100", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Releasing lock "refresh_cache-9268633a-36f0-4bd2-85f2-22ae7911a1f9" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG nova.compute.manager [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Instance network_info: |[{"id": "8f5858da-09e3-4939-8bf2-c6e8b35d8100", "address": "fa:16:3e:46:83:42", "network": {"id": "5fe3b8dc-aa50-4e53-bb4d-2dcb773e501e", "bridge": "br-int", "label": "tempest-TestStampPattern-205380618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bb5a3be50242059591c9cbf8cc0f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f5858da-09", "ovs_interfaceid": "8f5858da-09e3-4939-8bf2-c6e8b35d8100", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Start _get_guest_xml network_info=[{"id": "8f5858da-09e3-4939-8bf2-c6e8b35d8100", "address": "fa:16:3e:46:83:42", "network": {"id": "5fe3b8dc-aa50-4e53-bb4d-2dcb773e501e", "bridge": "br-int", "label": "tempest-TestStampPattern-205380618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bb5a3be50242059591c9cbf8cc0f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f5858da-09", "ovs_interfaceid": "8f5858da-09e3-4939-8bf2-c6e8b35d8100", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='0e907f69d493d6baf2398e1279de43e5',container_format='bare',created_at=2023-08-09T10:29:51Z,direct_url=<?>,disk_format='qcow2',id=e1066ed9-2540-445b-bde8-8ba4f645dbb8,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-2115596825',owner='d7bb5a3be50242059591c9cbf8cc0f9d',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-09T10:29:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': 'e1066ed9-2540-445b-bde8-8ba4f645dbb8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:30:03 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:30:03 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:30:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0e907f69d493d6baf2398e1279de43e5',container_format='bare',created_at=2023-08-09T10:29:51Z,direct_url=<?>,disk_format='qcow2',id=e1066ed9-2540-445b-bde8-8ba4f645dbb8,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-2115596825',owner='d7bb5a3be50242059591c9cbf8cc0f9d',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-09T10:29:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2139529972',display_name='tempest-TestStampPattern-server-2139529972',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2139529972',id=31,image_ref='e1066ed9-2540-445b-bde8-8ba4f645dbb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKLVu2dFvNs/80YFheQzFf8fh5quQ6+XNPPKMAWty1o9Sg/SwStPSnUjW/MsHeKbh1Vmc8aVVjHIMDgyHJuEjaJiur5QU2xWgYQwqf957GAtOQZW38FZ3ltyAQ4vCaq5g==',key_name='tempest-TestStampPattern-2134506676',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7bb5a3be50242059591c9cbf8cc0f9d',ramdisk_id='',reservation_id='r-opjcpk0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='09fcf27a-c6dc-4c4a-b73c-555ea2339967',image_min_disk='1',image_min_ram='0',image_owner_id='d7bb5a3be50242059591c9cbf8cc0f9d',image_owner_project_name='tempest-TestStampPattern-1731024477',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1731024477-project-member',image_user_id='8bd184d9dcf64c6fa81bf0b7fa68a9b3',network_allocated='True',owner_project_name='tempest-TestStampPattern-1731024477',owner_user_name='tempest-TestStampPattern-1731024477-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:30:00Z,user_data=None,user_id='8bd184d9dcf64c6fa81bf0b7fa68a9b3',uuid=9268633a-36f0-4bd2-85f2-22ae7911a1f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f5858da-09e3-4939-8bf2-c6e8b35d8100", "address": "fa:16:3e:46:83:42", "network": {"id": "5fe3b8dc-aa50-4e53-bb4d-2dcb773e501e", "bridge": "br-int", "label": "tempest-TestStampPattern-205380618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bb5a3be50242059591c9cbf8cc0f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f5858da-09", "ovs_interfaceid": "8f5858da-09e3-4939-8bf2-c6e8b35d8100", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Converting VIF {"id": "8f5858da-09e3-4939-8bf2-c6e8b35d8100", "address": "fa:16:3e:46:83:42", "network": {"id": "5fe3b8dc-aa50-4e53-bb4d-2dcb773e501e", "bridge": "br-int", "label": "tempest-TestStampPattern-205380618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bb5a3be50242059591c9cbf8cc0f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f5858da-09", "ovs_interfaceid": "8f5858da-09e3-4939-8bf2-c6e8b35d8100", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:83:42,bridge_name='br-int',has_traffic_filtering=True,id=8f5858da-09e3-4939-8bf2-c6e8b35d8100,network=Network(5fe3b8dc-aa50-4e53-bb4d-2dcb773e501e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f5858da-09') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG nova.objects.instance [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lazy-loading 'pci_devices' on Instance uuid 9268633a-36f0-4bd2-85f2-22ae7911a1f9 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:30:03 user nova-compute[72362]:   <uuid>9268633a-36f0-4bd2-85f2-22ae7911a1f9</uuid>
Aug 09 10:30:03 user nova-compute[72362]:   <name>instance-0000001f</name>
Aug 09 10:30:03 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:30:03 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:30:03 user nova-compute[72362]:   <metadata>
Aug 09 10:30:03 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:30:03 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:30:03 user nova-compute[72362]:       <nova:name>tempest-TestStampPattern-server-2139529972</nova:name>
Aug 09 10:30:03 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:30:03</nova:creationTime>
Aug 09 10:30:03 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:30:03 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:30:03 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:30:03 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:30:03 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:30:03 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:30:03 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:30:03 user nova-compute[72362]:       <nova:owner>
Aug 09 10:30:03 user nova-compute[72362]:         <nova:user uuid="8bd184d9dcf64c6fa81bf0b7fa68a9b3">tempest-TestStampPattern-1731024477-project-member</nova:user>
Aug 09 10:30:03 user nova-compute[72362]:         <nova:project uuid="d7bb5a3be50242059591c9cbf8cc0f9d">tempest-TestStampPattern-1731024477</nova:project>
Aug 09 10:30:03 user nova-compute[72362]:       </nova:owner>
Aug 09 10:30:03 user nova-compute[72362]:       <nova:root type="image" uuid="e1066ed9-2540-445b-bde8-8ba4f645dbb8"/>
Aug 09 10:30:03 user nova-compute[72362]:       <nova:ports>
Aug 09 10:30:03 user nova-compute[72362]:         <nova:port uuid="8f5858da-09e3-4939-8bf2-c6e8b35d8100">
Aug 09 10:30:03 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 10:30:03 user nova-compute[72362]:         </nova:port>
Aug 09 10:30:03 user nova-compute[72362]:       </nova:ports>
Aug 09 10:30:03 user nova-compute[72362]:     </nova:instance>
Aug 09 10:30:03 user nova-compute[72362]:   </metadata>
Aug 09 10:30:03 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:30:03 user nova-compute[72362]:     <system>
Aug 09 10:30:03 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:30:03 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:30:03 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:30:03 user nova-compute[72362]:       <entry name="serial">9268633a-36f0-4bd2-85f2-22ae7911a1f9</entry>
Aug 09 10:30:03 user nova-compute[72362]:       <entry name="uuid">9268633a-36f0-4bd2-85f2-22ae7911a1f9</entry>
Aug 09 10:30:03 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:30:03 user nova-compute[72362]:     </system>
Aug 09 10:30:03 user nova-compute[72362]:   </sysinfo>
Aug 09 10:30:03 user nova-compute[72362]:   <os>
Aug 09 10:30:03 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:30:03 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:30:03 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:30:03 user nova-compute[72362]:   </os>
Aug 09 10:30:03 user nova-compute[72362]:   <features>
Aug 09 10:30:03 user nova-compute[72362]:     <acpi/>
Aug 09 10:30:03 user nova-compute[72362]:     <apic/>
Aug 09 10:30:03 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:30:03 user nova-compute[72362]:   </features>
Aug 09 10:30:03 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:30:03 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:30:03 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:30:03 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:30:03 user nova-compute[72362]:   </clock>
Aug 09 10:30:03 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:30:03 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:30:03 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:30:03 user nova-compute[72362]:   </cpu>
Aug 09 10:30:03 user nova-compute[72362]:   <devices>
Aug 09 10:30:03 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:30:03 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:30:03 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/9268633a-36f0-4bd2-85f2-22ae7911a1f9/disk"/>
Aug 09 10:30:03 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:30:03 user nova-compute[72362]:     </disk>
Aug 09 10:30:03 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:30:03 user nova-compute[72362]:       <mac address="fa:16:3e:46:83:42"/>
Aug 09 10:30:03 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:30:03 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:30:03 user nova-compute[72362]:       <target dev="tap8f5858da-09"/>
Aug 09 10:30:03 user nova-compute[72362]:     </interface>
Aug 09 10:30:03 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:30:03 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/9268633a-36f0-4bd2-85f2-22ae7911a1f9/console.log" append="off"/>
Aug 09 10:30:03 user nova-compute[72362]:     </serial>
Aug 09 10:30:03 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:30:03 user nova-compute[72362]:     <video>
Aug 09 10:30:03 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:30:03 user nova-compute[72362]:     </video>
Aug 09 10:30:03 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:30:03 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:30:03 user nova-compute[72362]:     </rng>
Aug 09 10:30:03 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:30:03 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:30:03 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:30:03 user nova-compute[72362]:     </memballoon>
Aug 09 10:30:03 user nova-compute[72362]:   </devices>
Aug 09 10:30:03 user nova-compute[72362]: </domain>
Aug 09 10:30:03 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2139529972',display_name='tempest-TestStampPattern-server-2139529972',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2139529972',id=31,image_ref='e1066ed9-2540-445b-bde8-8ba4f645dbb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKLVu2dFvNs/80YFheQzFf8fh5quQ6+XNPPKMAWty1o9Sg/SwStPSnUjW/MsHeKbh1Vmc8aVVjHIMDgyHJuEjaJiur5QU2xWgYQwqf957GAtOQZW38FZ3ltyAQ4vCaq5g==',key_name='tempest-TestStampPattern-2134506676',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7bb5a3be50242059591c9cbf8cc0f9d',ramdisk_id='',reservation_id='r-opjcpk0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='09fcf27a-c6dc-4c4a-b73c-555ea2339967',image_min_disk='1',image_min_ram='0',image_owner_id='d7bb5a3be50242059591c9cbf8cc0f9d',image_owner_project_name='tempest-TestStampPattern-1731024477',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1731024477-project-member',image_user_id='8bd184d9dcf64c6fa81bf0b7fa68a9b3',network_allocated='True',owner_project_name='tempest-TestStampPattern-1731024477',owner_user_name='tempest-TestStampPattern-1731024477-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:30:00Z,user_data=None,user_id='8bd184d9dcf64c6fa81bf0b7fa68a9b3',uuid=9268633a-36f0-4bd2-85f2-22ae7911a1f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f5858da-09e3-4939-8bf2-c6e8b35d8100", "address": "fa:16:3e:46:83:42", "network": {"id": "5fe3b8dc-aa50-4e53-bb4d-2dcb773e501e", "bridge": "br-int", "label": "tempest-TestStampPattern-205380618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bb5a3be50242059591c9cbf8cc0f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f5858da-09", "ovs_interfaceid": "8f5858da-09e3-4939-8bf2-c6e8b35d8100", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Converting VIF {"id": "8f5858da-09e3-4939-8bf2-c6e8b35d8100", "address": "fa:16:3e:46:83:42", "network": {"id": "5fe3b8dc-aa50-4e53-bb4d-2dcb773e501e", "bridge": "br-int", "label": "tempest-TestStampPattern-205380618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bb5a3be50242059591c9cbf8cc0f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f5858da-09", "ovs_interfaceid": "8f5858da-09e3-4939-8bf2-c6e8b35d8100", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:83:42,bridge_name='br-int',has_traffic_filtering=True,id=8f5858da-09e3-4939-8bf2-c6e8b35d8100,network=Network(5fe3b8dc-aa50-4e53-bb4d-2dcb773e501e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f5858da-09') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG os_vif [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:83:42,bridge_name='br-int',has_traffic_filtering=True,id=8f5858da-09e3-4939-8bf2-c6e8b35d8100,network=Network(5fe3b8dc-aa50-4e53-bb4d-2dcb773e501e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f5858da-09') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f5858da-09, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8f5858da-09, col_values=(('external_ids', {'iface-id': '8f5858da-09e3-4939-8bf2-c6e8b35d8100', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:83:42', 'vm-uuid': '9268633a-36f0-4bd2-85f2-22ae7911a1f9'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:30:03 user nova-compute[72362]: INFO os_vif [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:83:42,bridge_name='br-int',has_traffic_filtering=True,id=8f5858da-09e3-4939-8bf2-c6e8b35d8100,network=Network(5fe3b8dc-aa50-4e53-bb4d-2dcb773e501e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f5858da-09')
Aug 09 10:30:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Acquiring lock "refresh_cache-8d42f648-8616-4974-b416-0b6534b002cc" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Acquired lock "refresh_cache-8d42f648-8616-4974-b416-0b6534b002cc" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG nova.network.neutron [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:30:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] No VIF found with MAC fa:16:3e:46:83:42, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-88f236df-2ecd-4bf6-8212-c314fb7cafb3 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Acquiring lock "1a5a9ab8-ca97-454e-b850-c119ea2cd1bf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-88f236df-2ecd-4bf6-8212-c314fb7cafb3 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "1a5a9ab8-ca97-454e-b850-c119ea2cd1bf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:30:04 user nova-compute[72362]: INFO nova.compute.manager [None req-88f236df-2ecd-4bf6-8212-c314fb7cafb3 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Detaching volume 91c326b3-d5c5-4cae-b2cc-25f2971ba157
Aug 09 10:30:04 user nova-compute[72362]: DEBUG nova.network.neutron [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Updating instance_info_cache with network_info: [{"id": "a722d26f-88e8-40a8-b13c-66ec2bc587cf", "address": "fa:16:3e:9d:b1:56", "network": {"id": "da288577-5a89-4a87-aa94-d70e8e98cf83", "bridge": "br-int", "label": "tempest-TestShelveInstance-2076187029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4b0b83578f14c84a8fadd12e66911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa722d26f-88", "ovs_interfaceid": "a722d26f-88e8-40a8-b13c-66ec2bc587cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Releasing lock "refresh_cache-8d42f648-8616-4974-b416-0b6534b002cc" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:30:04 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Creating image(s)
Aug 09 10:30:04 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Did not create local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Ensure instance console log exists: /opt/stack/data/nova/instances/8d42f648-8616-4974-b416-0b6534b002cc/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Start _get_guest_xml network_info=[{"id": "a722d26f-88e8-40a8-b13c-66ec2bc587cf", "address": "fa:16:3e:9d:b1:56", "network": {"id": "da288577-5a89-4a87-aa94-d70e8e98cf83", "bridge": "br-int", "label": "tempest-TestShelveInstance-2076187029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4b0b83578f14c84a8fadd12e66911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa722d26f-88", "ovs_interfaceid": "a722d26f-88e8-40a8-b13c-66ec2bc587cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '84616bba-eb32-43e8-8386-d4aff9ede921', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Jkiypbdf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8d42f648-8616-4974-b416-0b6534b002cc', 'attached_at': '', 'detached_at': '', 'volume_id': 'df0efc51-3970-4983-a224-c79511fab3d9', 'serial': 'df0efc51-3970-4983-a224-c79511fab3d9'}, 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:30:04 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:30:04 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:30:04 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG nova.objects.instance [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8d42f648-8616-4974-b416-0b6534b002cc {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:30:04 user nova-compute[72362]: INFO nova.virt.block_device [None req-88f236df-2ecd-4bf6-8212-c314fb7cafb3 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Attempting to driver detach volume 91c326b3-d5c5-4cae-b2cc-25f2971ba157 from mountpoint /dev/vdb
Aug 09 10:30:04 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Jkiypbdf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:30:04 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:30:04 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:30:04 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:30:04 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:30:04 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:30:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-08c5a06d-730b-4843-a8ff-53939f4ff662 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Acquiring lock "1a5a9ab8-ca97-454e-b850-c119ea2cd1bf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c48e6be-e18c-4b99-8656-f06b376f0b1a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-88f236df-2ecd-4bf6-8212-c314fb7cafb3 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Attempting to detach device vdb from instance 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf from the persistent domain config. {{(pid=72362) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-88f236df-2ecd-4bf6-8212-c314fb7cafb3 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 10:30:04 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:30:04 user nova-compute[72362]:   <source dev="/dev/sdc"/>
Aug 09 10:30:04 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:30:04 user nova-compute[72362]:   <serial>91c326b3-d5c5-4cae-b2cc-25f2971ba157</serial>
Aug 09 10:30:04 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 10:30:04 user nova-compute[72362]: </disk>
Aug 09 10:30:04 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:30:04 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:04 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-88f236df-2ecd-4bf6-8212-c314fb7cafb3 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Successfully detached device vdb from instance 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf from the persistent domain config.
Aug 09 10:30:04 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-88f236df-2ecd-4bf6-8212-c314fb7cafb3 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf from the live domain config. {{(pid=72362) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-88f236df-2ecd-4bf6-8212-c314fb7cafb3 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 10:30:04 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:30:04 user nova-compute[72362]:   <source dev="/dev/sdc"/>
Aug 09 10:30:04 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:30:04 user nova-compute[72362]:   <serial>91c326b3-d5c5-4cae-b2cc-25f2971ba157</serial>
Aug 09 10:30:04 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 10:30:04 user nova-compute[72362]: </disk>
Aug 09 10:30:04 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5b1d2b-2ebd-42e2-97c0-95b1467294e1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9] added
Aug 09 10:30:04 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[1355a697-b632-4dfc-8253-e3b246e866fc]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[480321ea-86f0-4c82-80e0-b2a2235394f0]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Jkiypbdf {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Jkiypbdf" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a8b0fc-e4ea-48e4-a781-b31260a36545]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'Jkiypbdf'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ceb643-7b9e-4936-8563-cae3b40cede0]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03a0b34-d600-4a5a-b839-93e320e4793b]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:30:04 user nova-compute[72362]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac (non-flash)
Aug 09 10:30:04 user nova-compute[72362]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157 (non-flash)
Aug 09 10:30:04 user nova-compute[72362]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:30:04 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:30:04 user nova-compute[72362]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac (non-flash)
Aug 09 10:30:04 user nova-compute[72362]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157 (non-flash)
Aug 09 10:30:04 user nova-compute[72362]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:30:04 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e745d72d-99fe-4377-a467-1996ddbf6cbd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9, portal: 172.16.0.220,3260]
Aug 09 10:30:04 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9, portal: 172.16.0.220,3260] successful.
Aug 09 10:30:04 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1560b9-b76e-4fd0-b76b-35dea22e3e13]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d0bcad-f4ec-40ef-84be-8b59a8945063]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:30:04 user nova-compute[72362]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac (non-flash)
Aug 09 10:30:04 user nova-compute[72362]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157 (non-flash)
Aug 09 10:30:04 user nova-compute[72362]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:30:04 user nova-compute[72362]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)
Aug 09 10:30:04 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:30:04 user nova-compute[72362]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac (non-flash)
Aug 09 10:30:04 user nova-compute[72362]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157 (non-flash)
Aug 09 10:30:04 user nova-compute[72362]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:30:04 user nova-compute[72362]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)
Aug 09 10:30:04 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] HCTL ('36', '-', '-', 0) found on session 40 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.027s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[accfc6be-d4fc-4451-a8c4-176b6b4b534b]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Searching for a device in session 40 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Jkiypbdf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG nova.compute.manager [req-a72ed18f-85c0-4e24-a304-f812c07449a9 req-78266e2d-1346-4006-beca-64c0aa084797 service nova] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Received event network-changed-a722d26f-88e8-40a8-b13c-66ec2bc587cf {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG nova.compute.manager [req-a72ed18f-85c0-4e24-a304-f812c07449a9 req-78266e2d-1346-4006-beca-64c0aa084797 service nova] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Refreshing instance network info cache due to event network-changed-a722d26f-88e8-40a8-b13c-66ec2bc587cf. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-a72ed18f-85c0-4e24-a304-f812c07449a9 req-78266e2d-1346-4006-beca-64c0aa084797 service nova] Acquiring lock "refresh_cache-8d42f648-8616-4974-b416-0b6534b002cc" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-a72ed18f-85c0-4e24-a304-f812c07449a9 req-78266e2d-1346-4006-beca-64c0aa084797 service nova] Acquired lock "refresh_cache-8d42f648-8616-4974-b416-0b6534b002cc" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:30:04 user nova-compute[72362]: DEBUG nova.network.neutron [req-a72ed18f-85c0-4e24-a304-f812c07449a9 req-78266e2d-1346-4006-beca-64c0aa084797 service nova] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Refreshing network info cache for port a722d26f-88e8-40a8-b13c-66ec2bc587cf {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Received event <DeviceRemovedEvent: 1691577005.1999478, 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72362) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-88f236df-2ecd-4bf6-8212-c314fb7cafb3 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf {{(pid=72362) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 10:30:05 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-88f236df-2ecd-4bf6-8212-c314fb7cafb3 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Successfully detached device vdb from instance 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf from the live domain config.
Aug 09 10:30:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88f236df-2ecd-4bf6-8212-c314fb7cafb3 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f236df-2ecd-4bf6-8212-c314fb7cafb3 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rpGkyMJw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:30:05 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-88f236df-2ecd-4bf6-8212-c314fb7cafb3 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:30:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-88f236df-2ecd-4bf6-8212-c314fb7cafb3 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '23561646531633231', 'path': '/dev/sde'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23561646531633231', 'path': '/dev/sde'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-88f236df-2ecd-4bf6-8212-c314fb7cafb3 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.565s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f236df-2ecd-4bf6-8212-c314fb7cafb3 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0bd9d08-8c45-4145-ab5a-7add1909bc88]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG nova.compute.manager [req-b57fcd89-04bb-4f41-96eb-360276ae4bc2 req-dcca95e2-1c5e-48a4-85df-e3ac2b31fc4f service nova] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Received event network-vif-plugged-8f5858da-09e3-4939-8bf2-c6e8b35d8100 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b57fcd89-04bb-4f41-96eb-360276ae4bc2 req-dcca95e2-1c5e-48a4-85df-e3ac2b31fc4f service nova] Acquiring lock "9268633a-36f0-4bd2-85f2-22ae7911a1f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b57fcd89-04bb-4f41-96eb-360276ae4bc2 req-dcca95e2-1c5e-48a4-85df-e3ac2b31fc4f service nova] Lock "9268633a-36f0-4bd2-85f2-22ae7911a1f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b57fcd89-04bb-4f41-96eb-360276ae4bc2 req-dcca95e2-1c5e-48a4-85df-e3ac2b31fc4f service nova] Lock "9268633a-36f0-4bd2-85f2-22ae7911a1f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG nova.compute.manager [req-b57fcd89-04bb-4f41-96eb-360276ae4bc2 req-dcca95e2-1c5e-48a4-85df-e3ac2b31fc4f service nova] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] No waiting events found dispatching network-vif-plugged-8f5858da-09e3-4939-8bf2-c6e8b35d8100 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:30:05 user nova-compute[72362]: WARNING nova.compute.manager [req-b57fcd89-04bb-4f41-96eb-360276ae4bc2 req-dcca95e2-1c5e-48a4-85df-e3ac2b31fc4f service nova] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Received unexpected event network-vif-plugged-8f5858da-09e3-4939-8bf2-c6e8b35d8100 for instance with vm_state building and task_state spawning.
Aug 09 10:30:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T10:26:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1217884661',display_name='tempest-TestShelveInstance-server-1217884661',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1217884661',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1415559284',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:26:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d4b0b83578f14c84a8fadd12e66911f7',ramdisk_id='',reservation_id='r-4qse1uup',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-307673701',owner_user_name='tempest-TestShelveInstance-307673701-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:29:51Z,user_data=None,user_id='0b0a0c2a13af4b34ab0dedfaaeae864a',uuid=8d42f648-8616-4974-b416-0b6534b002cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a722d26f-88e8-40a8-b13c-66ec2bc587cf", "address": "fa:16:3e:9d:b1:56", "network": {"id": "da288577-5a89-4a87-aa94-d70e8e98cf83", "bridge": "br-int", "label": "tempest-TestShelveInstance-2076187029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4b0b83578f14c84a8fadd12e66911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa722d26f-88", "ovs_interfaceid": "a722d26f-88e8-40a8-b13c-66ec2bc587cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Converting VIF {"id": "a722d26f-88e8-40a8-b13c-66ec2bc587cf", "address": "fa:16:3e:9d:b1:56", "network": {"id": "da288577-5a89-4a87-aa94-d70e8e98cf83", "bridge": "br-int", "label": "tempest-TestShelveInstance-2076187029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4b0b83578f14c84a8fadd12e66911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa722d26f-88", "ovs_interfaceid": "a722d26f-88e8-40a8-b13c-66ec2bc587cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:b1:56,bridge_name='br-int',has_traffic_filtering=True,id=a722d26f-88e8-40a8-b13c-66ec2bc587cf,network=Network(da288577-5a89-4a87-aa94-d70e8e98cf83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa722d26f-88') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG nova.objects.instance [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d42f648-8616-4974-b416-0b6534b002cc {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:30:05 user nova-compute[72362]:   <uuid>8d42f648-8616-4974-b416-0b6534b002cc</uuid>
Aug 09 10:30:05 user nova-compute[72362]:   <name>instance-00000017</name>
Aug 09 10:30:05 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:30:05 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:30:05 user nova-compute[72362]:   <metadata>
Aug 09 10:30:05 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:30:05 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:30:05 user nova-compute[72362]:       <nova:name>tempest-TestShelveInstance-server-1217884661</nova:name>
Aug 09 10:30:05 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:30:04</nova:creationTime>
Aug 09 10:30:05 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:30:05 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:30:05 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:30:05 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:30:05 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:30:05 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:30:05 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:30:05 user nova-compute[72362]:       <nova:owner>
Aug 09 10:30:05 user nova-compute[72362]:         <nova:user uuid="0b0a0c2a13af4b34ab0dedfaaeae864a">tempest-TestShelveInstance-307673701-project-member</nova:user>
Aug 09 10:30:05 user nova-compute[72362]:         <nova:project uuid="d4b0b83578f14c84a8fadd12e66911f7">tempest-TestShelveInstance-307673701</nova:project>
Aug 09 10:30:05 user nova-compute[72362]:       </nova:owner>
Aug 09 10:30:05 user nova-compute[72362]:       <nova:ports>
Aug 09 10:30:05 user nova-compute[72362]:         <nova:port uuid="a722d26f-88e8-40a8-b13c-66ec2bc587cf">
Aug 09 10:30:05 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 10:30:05 user nova-compute[72362]:         </nova:port>
Aug 09 10:30:05 user nova-compute[72362]:       </nova:ports>
Aug 09 10:30:05 user nova-compute[72362]:     </nova:instance>
Aug 09 10:30:05 user nova-compute[72362]:   </metadata>
Aug 09 10:30:05 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:30:05 user nova-compute[72362]:     <system>
Aug 09 10:30:05 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:30:05 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:30:05 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:30:05 user nova-compute[72362]:       <entry name="serial">8d42f648-8616-4974-b416-0b6534b002cc</entry>
Aug 09 10:30:05 user nova-compute[72362]:       <entry name="uuid">8d42f648-8616-4974-b416-0b6534b002cc</entry>
Aug 09 10:30:05 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:30:05 user nova-compute[72362]:     </system>
Aug 09 10:30:05 user nova-compute[72362]:   </sysinfo>
Aug 09 10:30:05 user nova-compute[72362]:   <os>
Aug 09 10:30:05 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:30:05 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:30:05 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:30:05 user nova-compute[72362]:   </os>
Aug 09 10:30:05 user nova-compute[72362]:   <features>
Aug 09 10:30:05 user nova-compute[72362]:     <acpi/>
Aug 09 10:30:05 user nova-compute[72362]:     <apic/>
Aug 09 10:30:05 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:30:05 user nova-compute[72362]:   </features>
Aug 09 10:30:05 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:30:05 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:30:05 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:30:05 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:30:05 user nova-compute[72362]:   </clock>
Aug 09 10:30:05 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:30:05 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:30:05 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:30:05 user nova-compute[72362]:   </cpu>
Aug 09 10:30:05 user nova-compute[72362]:   <devices>
Aug 09 10:30:05 user nova-compute[72362]:     <disk type="block" device="disk">
Aug 09 10:30:05 user nova-compute[72362]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:30:05 user nova-compute[72362]:       <source dev="/dev/sde"/>
Aug 09 10:30:05 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:30:05 user nova-compute[72362]:       <serial>df0efc51-3970-4983-a224-c79511fab3d9</serial>
Aug 09 10:30:05 user nova-compute[72362]:     </disk>
Aug 09 10:30:05 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:30:05 user nova-compute[72362]:       <mac address="fa:16:3e:9d:b1:56"/>
Aug 09 10:30:05 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:30:05 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:30:05 user nova-compute[72362]:       <target dev="tapa722d26f-88"/>
Aug 09 10:30:05 user nova-compute[72362]:     </interface>
Aug 09 10:30:05 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:30:05 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/8d42f648-8616-4974-b416-0b6534b002cc/console.log" append="off"/>
Aug 09 10:30:05 user nova-compute[72362]:     </serial>
Aug 09 10:30:05 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:30:05 user nova-compute[72362]:     <video>
Aug 09 10:30:05 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:30:05 user nova-compute[72362]:     </video>
Aug 09 10:30:05 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:30:05 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:30:05 user nova-compute[72362]:     </rng>
Aug 09 10:30:05 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:30:05 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:30:05 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:30:05 user nova-compute[72362]:     </memballoon>
Aug 09 10:30:05 user nova-compute[72362]:   </devices>
Aug 09 10:30:05 user nova-compute[72362]: </domain>
Aug 09 10:30:05 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T10:26:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1217884661',display_name='tempest-TestShelveInstance-server-1217884661',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1217884661',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1415559284',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:26:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d4b0b83578f14c84a8fadd12e66911f7',ramdisk_id='',reservation_id='r-4qse1uup',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-307673701',owner_user_name='tempest-TestShelveInstance-307673701-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:29:51Z,user_data=None,user_id='0b0a0c2a13af4b34ab0dedfaaeae864a',uuid=8d42f648-8616-4974-b416-0b6534b002cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a722d26f-88e8-40a8-b13c-66ec2bc587cf", "address": "fa:16:3e:9d:b1:56", "network": {"id": "da288577-5a89-4a87-aa94-d70e8e98cf83", "bridge": "br-int", "label": "tempest-TestShelveInstance-2076187029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4b0b83578f14c84a8fadd12e66911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa722d26f-88", "ovs_interfaceid": "a722d26f-88e8-40a8-b13c-66ec2bc587cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Converting VIF {"id": "a722d26f-88e8-40a8-b13c-66ec2bc587cf", "address": "fa:16:3e:9d:b1:56", "network": {"id": "da288577-5a89-4a87-aa94-d70e8e98cf83", "bridge": "br-int", "label": "tempest-TestShelveInstance-2076187029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4b0b83578f14c84a8fadd12e66911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa722d26f-88", "ovs_interfaceid": "a722d26f-88e8-40a8-b13c-66ec2bc587cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:b1:56,bridge_name='br-int',has_traffic_filtering=True,id=a722d26f-88e8-40a8-b13c-66ec2bc587cf,network=Network(da288577-5a89-4a87-aa94-d70e8e98cf83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa722d26f-88') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG os_vif [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:b1:56,bridge_name='br-int',has_traffic_filtering=True,id=a722d26f-88e8-40a8-b13c-66ec2bc587cf,network=Network(da288577-5a89-4a87-aa94-d70e8e98cf83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa722d26f-88') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8cf37b-6379-4eb5-9d78-227859123722]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f236df-2ecd-4bf6-8212-c314fb7cafb3 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:30:05 user nova-compute[72362]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac (non-flash)
Aug 09 10:30:05 user nova-compute[72362]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157 (non-flash)
Aug 09 10:30:05 user nova-compute[72362]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:30:05 user nova-compute[72362]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)
Aug 09 10:30:05 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f236df-2ecd-4bf6-8212-c314fb7cafb3 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:30:05 user nova-compute[72362]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac (non-flash)
Aug 09 10:30:05 user nova-compute[72362]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157 (non-flash)
Aug 09 10:30:05 user nova-compute[72362]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:30:05 user nova-compute[72362]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)
Aug 09 10:30:05 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f236df-2ecd-4bf6-8212-c314fb7cafb3 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34dc244af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157'): ({'sdc'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-88f236df-2ecd-4bf6-8212-c314fb7cafb3 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Removing single pathed devices sdc {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa722d26f-88, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa722d26f-88, col_values=(('external_ids', {'iface-id': 'a722d26f-88e8-40a8-b13c-66ec2bc587cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:b1:56', 'vm-uuid': '8d42f648-8616-4974-b416-0b6534b002cc'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:30:05 user nova-compute[72362]: INFO os_vif [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:b1:56,bridge_name='br-int',has_traffic_filtering=True,id=a722d26f-88e8-40a8-b13c-66ec2bc587cf,network=Network(da288577-5a89-4a87-aa94-d70e8e98cf83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa722d26f-88')
Aug 09 10:30:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.041s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[818edf1a-fa0c-433e-9525-2b752934d945]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.032s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eec18dc-9356-4b39-bf57-e8c527b49416]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-88f236df-2ecd-4bf6-8212-c314fb7cafb3 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Flushing IO for device /dev/sdc {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG nova.network.neutron [req-a72ed18f-85c0-4e24-a304-f812c07449a9 req-78266e2d-1346-4006-beca-64c0aa084797 service nova] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Updated VIF entry in instance network info cache for port a722d26f-88e8-40a8-b13c-66ec2bc587cf. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG nova.network.neutron [req-a72ed18f-85c0-4e24-a304-f812c07449a9 req-78266e2d-1346-4006-beca-64c0aa084797 service nova] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Updating instance_info_cache with network_info: [{"id": "a722d26f-88e8-40a8-b13c-66ec2bc587cf", "address": "fa:16:3e:9d:b1:56", "network": {"id": "da288577-5a89-4a87-aa94-d70e8e98cf83", "bridge": "br-int", "label": "tempest-TestShelveInstance-2076187029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4b0b83578f14c84a8fadd12e66911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa722d26f-88", "ovs_interfaceid": "a722d26f-88e8-40a8-b13c-66ec2bc587cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] No VIF found with MAC fa:16:3e:9d:b1:56, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.037s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[358a72c5-ee98-4fc0-846a-f1dadd676864]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-88f236df-2ecd-4bf6-8212-c314fb7cafb3 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-a72ed18f-85c0-4e24-a304-f812c07449a9 req-78266e2d-1346-4006-beca-64c0aa084797 service nova] Releasing lock "refresh_cache-8d42f648-8616-4974-b416-0b6534b002cc" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:30:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:06 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[013dd033-7c67-43e5-ad8d-91eda73502e9]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:06 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-88f236df-2ecd-4bf6-8212-c314fb7cafb3 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:30:06 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-88f236df-2ecd-4bf6-8212-c314fb7cafb3 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] SCSI volumes sdc have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:30:06 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f236df-2ecd-4bf6-8212-c314fb7cafb3 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:30:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:06 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c196e283-c38c-4905-b3f0-cd9cf0c97def]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:06 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f236df-2ecd-4bf6-8212-c314fb7cafb3 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:30:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157 -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:06 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6deef9-dd27-4cbb-8f4b-46f26d782791]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:06 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f236df-2ecd-4bf6-8212-c314fb7cafb3 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157, portal: 172.16.0.220,3260]
Aug 09 10:30:06 user nova-compute[72362]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157, portal: 172.16.0.220,3260] successful.
Aug 09 10:30:06 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:30:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157 -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:06 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[40316c95-1161-4e4b-89fd-1d7e09970fb9]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:06 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f236df-2ecd-4bf6-8212-c314fb7cafb3 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:30:06 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-88f236df-2ecd-4bf6-8212-c314fb7cafb3 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.401s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:30:06 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f236df-2ecd-4bf6-8212-c314fb7cafb3 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] <== disconnect_volume: return (966ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:30:06 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88f236df-2ecd-4bf6-8212-c314fb7cafb3 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:30:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:30:07 user nova-compute[72362]: DEBUG nova.objects.instance [None req-88f236df-2ecd-4bf6-8212-c314fb7cafb3 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lazy-loading 'flavor' on Instance uuid 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:30:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-88f236df-2ecd-4bf6-8212-c314fb7cafb3 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "1a5a9ab8-ca97-454e-b850-c119ea2cd1bf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.796s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:30:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-08c5a06d-730b-4843-a8ff-53939f4ff662 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "1a5a9ab8-ca97-454e-b850-c119ea2cd1bf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 2.644s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:30:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-08c5a06d-730b-4843-a8ff-53939f4ff662 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Acquiring lock "1a5a9ab8-ca97-454e-b850-c119ea2cd1bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:30:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-08c5a06d-730b-4843-a8ff-53939f4ff662 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "1a5a9ab8-ca97-454e-b850-c119ea2cd1bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:30:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-08c5a06d-730b-4843-a8ff-53939f4ff662 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "1a5a9ab8-ca97-454e-b850-c119ea2cd1bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:30:07 user nova-compute[72362]: INFO nova.compute.manager [None req-08c5a06d-730b-4843-a8ff-53939f4ff662 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Terminating instance
Aug 09 10:30:07 user nova-compute[72362]: DEBUG nova.compute.manager [None req-08c5a06d-730b-4843-a8ff-53939f4ff662 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Start destroying the instance on the hypervisor. {{(pid=72362) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 10:30:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:30:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:30:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:30:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:30:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:30:07 user nova-compute[72362]: DEBUG nova.compute.manager [req-3a84647e-7979-40f8-9ec6-0855ab03fb28 req-4f4ec657-0af0-4ee0-83cd-8a88eb84f22f service nova] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Received event network-vif-unplugged-012d406b-af0d-4583-b641-45775d43dfb3 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:30:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3a84647e-7979-40f8-9ec6-0855ab03fb28 req-4f4ec657-0af0-4ee0-83cd-8a88eb84f22f service nova] Acquiring lock "1a5a9ab8-ca97-454e-b850-c119ea2cd1bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:30:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3a84647e-7979-40f8-9ec6-0855ab03fb28 req-4f4ec657-0af0-4ee0-83cd-8a88eb84f22f service nova] Lock "1a5a9ab8-ca97-454e-b850-c119ea2cd1bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:30:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3a84647e-7979-40f8-9ec6-0855ab03fb28 req-4f4ec657-0af0-4ee0-83cd-8a88eb84f22f service nova] Lock "1a5a9ab8-ca97-454e-b850-c119ea2cd1bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:30:07 user nova-compute[72362]: DEBUG nova.compute.manager [req-3a84647e-7979-40f8-9ec6-0855ab03fb28 req-4f4ec657-0af0-4ee0-83cd-8a88eb84f22f service nova] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] No waiting events found dispatching network-vif-unplugged-012d406b-af0d-4583-b641-45775d43dfb3 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:30:07 user nova-compute[72362]: DEBUG nova.compute.manager [req-3a84647e-7979-40f8-9ec6-0855ab03fb28 req-4f4ec657-0af0-4ee0-83cd-8a88eb84f22f service nova] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Received event network-vif-unplugged-012d406b-af0d-4583-b641-45775d43dfb3 for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:30:07 user nova-compute[72362]: DEBUG nova.compute.manager [req-d3653d93-f831-4c47-9248-edcce23ddad6 req-7ca46cc2-abd8-4de7-bfbf-1b9643b0c1af service nova] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Received event network-vif-plugged-8f5858da-09e3-4939-8bf2-c6e8b35d8100 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:30:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-d3653d93-f831-4c47-9248-edcce23ddad6 req-7ca46cc2-abd8-4de7-bfbf-1b9643b0c1af service nova] Acquiring lock "9268633a-36f0-4bd2-85f2-22ae7911a1f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:30:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-d3653d93-f831-4c47-9248-edcce23ddad6 req-7ca46cc2-abd8-4de7-bfbf-1b9643b0c1af service nova] Lock "9268633a-36f0-4bd2-85f2-22ae7911a1f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:30:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-d3653d93-f831-4c47-9248-edcce23ddad6 req-7ca46cc2-abd8-4de7-bfbf-1b9643b0c1af service nova] Lock "9268633a-36f0-4bd2-85f2-22ae7911a1f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:30:07 user nova-compute[72362]: DEBUG nova.compute.manager [req-d3653d93-f831-4c47-9248-edcce23ddad6 req-7ca46cc2-abd8-4de7-bfbf-1b9643b0c1af service nova] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] No waiting events found dispatching network-vif-plugged-8f5858da-09e3-4939-8bf2-c6e8b35d8100 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:30:07 user nova-compute[72362]: WARNING nova.compute.manager [req-d3653d93-f831-4c47-9248-edcce23ddad6 req-7ca46cc2-abd8-4de7-bfbf-1b9643b0c1af service nova] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Received unexpected event network-vif-plugged-8f5858da-09e3-4939-8bf2-c6e8b35d8100 for instance with vm_state building and task_state spawning.
Aug 09 10:30:07 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Instance destroyed successfully.
Aug 09 10:30:07 user nova-compute[72362]: DEBUG nova.objects.instance [None req-08c5a06d-730b-4843-a8ff-53939f4ff662 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lazy-loading 'resources' on Instance uuid 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:30:07 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-08c5a06d-730b-4843-a8ff-53939f4ff662 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:27:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2056024681',display_name='tempest-VolumesSnapshotTestJSON-instance-2056024681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2056024681',id=26,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSomeTFU43ejGb86sHV4XUf29Dr00Hfdm1XyoWkhUXexJTrJi2ZyMPAvHN1Q5HimB2PMvrfn3OEk8eFrPIA9j0mDQ3VmXC/NxHW0IkScFJ8yYrJkt+ZxqXihoEiDJc3Jw==',key_name='tempest-keypair-255463968',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:27:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4fc046adc7984378983895400e2b5e04',ramdisk_id='',reservation_id='r-yeu6wzt6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1214114448',owner_user_name='tempest-VolumesSnapshotTestJSON-1214114448-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:27:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='755ef9806a264f15bb80d2cd5db55d9b',uuid=1a5a9ab8-ca97-454e-b850-c119ea2cd1bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "012d406b-af0d-4583-b641-45775d43dfb3", "address": "fa:16:3e:14:7b:dc", "network": {"id": "f9878e3c-f52a-4f3a-933d-b9c534dd3a59", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-797945070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc046adc7984378983895400e2b5e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap012d406b-af", "ovs_interfaceid": "012d406b-af0d-4583-b641-45775d43dfb3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:30:07 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-08c5a06d-730b-4843-a8ff-53939f4ff662 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Converting VIF {"id": "012d406b-af0d-4583-b641-45775d43dfb3", "address": "fa:16:3e:14:7b:dc", "network": {"id": "f9878e3c-f52a-4f3a-933d-b9c534dd3a59", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-797945070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc046adc7984378983895400e2b5e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap012d406b-af", "ovs_interfaceid": "012d406b-af0d-4583-b641-45775d43dfb3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:30:07 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-08c5a06d-730b-4843-a8ff-53939f4ff662 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:7b:dc,bridge_name='br-int',has_traffic_filtering=True,id=012d406b-af0d-4583-b641-45775d43dfb3,network=Network(f9878e3c-f52a-4f3a-933d-b9c534dd3a59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap012d406b-af') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:30:07 user nova-compute[72362]: DEBUG os_vif [None req-08c5a06d-730b-4843-a8ff-53939f4ff662 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:7b:dc,bridge_name='br-int',has_traffic_filtering=True,id=012d406b-af0d-4583-b641-45775d43dfb3,network=Network(f9878e3c-f52a-4f3a-933d-b9c534dd3a59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap012d406b-af') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:30:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:30:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap012d406b-af, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:30:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:30:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:30:07 user nova-compute[72362]: INFO os_vif [None req-08c5a06d-730b-4843-a8ff-53939f4ff662 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:7b:dc,bridge_name='br-int',has_traffic_filtering=True,id=012d406b-af0d-4583-b641-45775d43dfb3,network=Network(f9878e3c-f52a-4f3a-933d-b9c534dd3a59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap012d406b-af')
Aug 09 10:30:07 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08c5a06d-730b-4843-a8ff-53939f4ff662 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:30:07 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c5a06d-730b-4843-a8ff-53939f4ff662 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rpGkyMJw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:30:07 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-08c5a06d-730b-4843-a8ff-53939f4ff662 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:30:07 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-08c5a06d-730b-4843-a8ff-53939f4ff662 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:30:07 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-08c5a06d-730b-4843-a8ff-53939f4ff662 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:30:07 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c5a06d-730b-4843-a8ff-53939f4ff662 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91c326b3-d5c5-4cae-b2cc-25f2971ba157', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:30:07 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:07 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:07 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eea2d38-b95d-479f-b426-40a019d79032]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:07 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:08 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a5df3f-0df1-4acc-9096-3f55b325d0db]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:08 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c5a06d-730b-4843-a8ff-53939f4ff662 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:30:08 user nova-compute[72362]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac (non-flash)
Aug 09 10:30:08 user nova-compute[72362]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:30:08 user nova-compute[72362]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)
Aug 09 10:30:08 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:30:08 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c5a06d-730b-4843-a8ff-53939f4ff662 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:30:08 user nova-compute[72362]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac (non-flash)
Aug 09 10:30:08 user nova-compute[72362]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:30:08 user nova-compute[72362]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)
Aug 09 10:30:08 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:30:08 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c5a06d-730b-4843-a8ff-53939f4ff662 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e5cbc160>, {}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:30:08 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c5a06d-730b-4843-a8ff-53939f4ff662 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Disconnecting from: [] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:30:08 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-08c5a06d-730b-4843-a8ff-53939f4ff662 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.058s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:30:08 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c5a06d-730b-4843-a8ff-53939f4ff662 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] <== disconnect_volume: return (60ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:30:08 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08c5a06d-730b-4843-a8ff-53939f4ff662 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:30:08 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-08c5a06d-730b-4843-a8ff-53939f4ff662 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Deleting instance files /opt/stack/data/nova/instances/1a5a9ab8-ca97-454e-b850-c119ea2cd1bf_del
Aug 09 10:30:08 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-08c5a06d-730b-4843-a8ff-53939f4ff662 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Deletion of /opt/stack/data/nova/instances/1a5a9ab8-ca97-454e-b850-c119ea2cd1bf_del complete
Aug 09 10:30:08 user nova-compute[72362]: INFO nova.compute.manager [None req-08c5a06d-730b-4843-a8ff-53939f4ff662 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Took 1.01 seconds to destroy the instance on the hypervisor.
Aug 09 10:30:08 user nova-compute[72362]: DEBUG oslo.service.loopingcall [None req-08c5a06d-730b-4843-a8ff-53939f4ff662 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72362) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 10:30:08 user nova-compute[72362]: DEBUG nova.compute.manager [-] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Deallocating network for instance {{(pid=72362) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 10:30:08 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] deallocate_for_instance() {{(pid=72362) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 10:30:08 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:30:08 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:30:08 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:30:08 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:30:08 user nova-compute[72362]: DEBUG nova.compute.manager [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:30:08 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:30:08 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577008.7613578, 9268633a-36f0-4bd2-85f2-22ae7911a1f9 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:30:08 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] VM Resumed (Lifecycle Event)
Aug 09 10:30:08 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Instance spawned successfully.
Aug 09 10:30:08 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 10:30:08 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:30:08 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:30:08 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:30:08 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:30:08 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:30:08 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577008.7614934, 9268633a-36f0-4bd2-85f2-22ae7911a1f9 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:30:08 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] VM Started (Lifecycle Event)
Aug 09 10:30:08 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:30:08 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:30:08 user nova-compute[72362]: INFO nova.compute.manager [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Took 8.36 seconds to spawn the instance on the hypervisor.
Aug 09 10:30:08 user nova-compute[72362]: DEBUG nova.compute.manager [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:30:08 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:30:09 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:30:09 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Took 0.96 seconds to deallocate network for instance.
Aug 09 10:30:09 user nova-compute[72362]: INFO nova.compute.manager [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Took 9.60 seconds to build instance.
Aug 09 10:30:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0ee250e2-9353-47d0-b6b3-7b98dbd09ca1 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "9268633a-36f0-4bd2-85f2-22ae7911a1f9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.714s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:30:09 user nova-compute[72362]: DEBUG nova.compute.manager [req-e3417a98-82ce-46a8-998b-fff23cfb45e3 req-f281c1c8-1a02-4b01-aae0-a74eb16d2c14 service nova] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Received event network-vif-deleted-012d406b-af0d-4583-b641-45775d43dfb3 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:30:09 user nova-compute[72362]: WARNING nova.volume.cinder [None req-08c5a06d-730b-4843-a8ff-53939f4ff662 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Attachment 068a7b8c-34fc-4126-88ef-8408c1eee143 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 068a7b8c-34fc-4126-88ef-8408c1eee143. (HTTP 404) (Request-ID: req-1036a169-7b15-4ab3-8ffe-bd03fe94c4fc)
Aug 09 10:30:09 user nova-compute[72362]: INFO nova.compute.manager [None req-08c5a06d-730b-4843-a8ff-53939f4ff662 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Took 0.04 seconds to detach 1 volumes for instance.
Aug 09 10:30:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-08c5a06d-730b-4843-a8ff-53939f4ff662 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:30:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-08c5a06d-730b-4843-a8ff-53939f4ff662 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:30:09 user nova-compute[72362]: DEBUG nova.compute.manager [req-da9d2dfc-ee22-4e2d-99f7-8ddcefaeabe7 req-a3e01d11-5fd3-42f8-b1e1-fb3e69286885 service nova] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Received event network-vif-plugged-012d406b-af0d-4583-b641-45775d43dfb3 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:30:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-da9d2dfc-ee22-4e2d-99f7-8ddcefaeabe7 req-a3e01d11-5fd3-42f8-b1e1-fb3e69286885 service nova] Acquiring lock "1a5a9ab8-ca97-454e-b850-c119ea2cd1bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:30:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-da9d2dfc-ee22-4e2d-99f7-8ddcefaeabe7 req-a3e01d11-5fd3-42f8-b1e1-fb3e69286885 service nova] Lock "1a5a9ab8-ca97-454e-b850-c119ea2cd1bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:30:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-da9d2dfc-ee22-4e2d-99f7-8ddcefaeabe7 req-a3e01d11-5fd3-42f8-b1e1-fb3e69286885 service nova] Lock "1a5a9ab8-ca97-454e-b850-c119ea2cd1bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:30:09 user nova-compute[72362]: DEBUG nova.compute.manager [req-da9d2dfc-ee22-4e2d-99f7-8ddcefaeabe7 req-a3e01d11-5fd3-42f8-b1e1-fb3e69286885 service nova] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] No waiting events found dispatching network-vif-plugged-012d406b-af0d-4583-b641-45775d43dfb3 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:30:09 user nova-compute[72362]: WARNING nova.compute.manager [req-da9d2dfc-ee22-4e2d-99f7-8ddcefaeabe7 req-a3e01d11-5fd3-42f8-b1e1-fb3e69286885 service nova] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Received unexpected event network-vif-plugged-012d406b-af0d-4583-b641-45775d43dfb3 for instance with vm_state deleted and task_state None.
Aug 09 10:30:09 user nova-compute[72362]: DEBUG nova.compute.manager [req-da9d2dfc-ee22-4e2d-99f7-8ddcefaeabe7 req-a3e01d11-5fd3-42f8-b1e1-fb3e69286885 service nova] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Received event network-vif-plugged-a722d26f-88e8-40a8-b13c-66ec2bc587cf {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:30:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-da9d2dfc-ee22-4e2d-99f7-8ddcefaeabe7 req-a3e01d11-5fd3-42f8-b1e1-fb3e69286885 service nova] Acquiring lock "8d42f648-8616-4974-b416-0b6534b002cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:30:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-da9d2dfc-ee22-4e2d-99f7-8ddcefaeabe7 req-a3e01d11-5fd3-42f8-b1e1-fb3e69286885 service nova] Lock "8d42f648-8616-4974-b416-0b6534b002cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:30:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-da9d2dfc-ee22-4e2d-99f7-8ddcefaeabe7 req-a3e01d11-5fd3-42f8-b1e1-fb3e69286885 service nova] Lock "8d42f648-8616-4974-b416-0b6534b002cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:30:09 user nova-compute[72362]: DEBUG nova.compute.manager [req-da9d2dfc-ee22-4e2d-99f7-8ddcefaeabe7 req-a3e01d11-5fd3-42f8-b1e1-fb3e69286885 service nova] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] No waiting events found dispatching network-vif-plugged-a722d26f-88e8-40a8-b13c-66ec2bc587cf {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:30:09 user nova-compute[72362]: WARNING nova.compute.manager [req-da9d2dfc-ee22-4e2d-99f7-8ddcefaeabe7 req-a3e01d11-5fd3-42f8-b1e1-fb3e69286885 service nova] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Received unexpected event network-vif-plugged-a722d26f-88e8-40a8-b13c-66ec2bc587cf for instance with vm_state shelved_offloaded and task_state spawning.
Aug 09 10:30:09 user nova-compute[72362]: DEBUG nova.compute.manager [req-da9d2dfc-ee22-4e2d-99f7-8ddcefaeabe7 req-a3e01d11-5fd3-42f8-b1e1-fb3e69286885 service nova] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Received event network-vif-plugged-a722d26f-88e8-40a8-b13c-66ec2bc587cf {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:30:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-da9d2dfc-ee22-4e2d-99f7-8ddcefaeabe7 req-a3e01d11-5fd3-42f8-b1e1-fb3e69286885 service nova] Acquiring lock "8d42f648-8616-4974-b416-0b6534b002cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:30:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-da9d2dfc-ee22-4e2d-99f7-8ddcefaeabe7 req-a3e01d11-5fd3-42f8-b1e1-fb3e69286885 service nova] Lock "8d42f648-8616-4974-b416-0b6534b002cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:30:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-da9d2dfc-ee22-4e2d-99f7-8ddcefaeabe7 req-a3e01d11-5fd3-42f8-b1e1-fb3e69286885 service nova] Lock "8d42f648-8616-4974-b416-0b6534b002cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:30:09 user nova-compute[72362]: DEBUG nova.compute.manager [req-da9d2dfc-ee22-4e2d-99f7-8ddcefaeabe7 req-a3e01d11-5fd3-42f8-b1e1-fb3e69286885 service nova] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] No waiting events found dispatching network-vif-plugged-a722d26f-88e8-40a8-b13c-66ec2bc587cf {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:30:09 user nova-compute[72362]: WARNING nova.compute.manager [req-da9d2dfc-ee22-4e2d-99f7-8ddcefaeabe7 req-a3e01d11-5fd3-42f8-b1e1-fb3e69286885 service nova] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Received unexpected event network-vif-plugged-a722d26f-88e8-40a8-b13c-66ec2bc587cf for instance with vm_state shelved_offloaded and task_state spawning.
Aug 09 10:30:09 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-08c5a06d-730b-4843-a8ff-53939f4ff662 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:30:09 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-08c5a06d-730b-4843-a8ff-53939f4ff662 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:30:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-08c5a06d-730b-4843-a8ff-53939f4ff662 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.416s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:30:09 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-08c5a06d-730b-4843-a8ff-53939f4ff662 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Deleted allocations for instance 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf
Aug 09 10:30:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-08c5a06d-730b-4843-a8ff-53939f4ff662 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "1a5a9ab8-ca97-454e-b850-c119ea2cd1bf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.622s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:30:09 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577009.842463, 8d42f648-8616-4974-b416-0b6534b002cc => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:30:09 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] VM Resumed (Lifecycle Event)
Aug 09 10:30:09 user nova-compute[72362]: DEBUG nova.compute.manager [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:30:09 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:30:09 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Instance spawned successfully.
Aug 09 10:30:09 user nova-compute[72362]: DEBUG nova.compute.manager [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:30:09 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:30:09 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:30:09 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:30:09 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577009.8427315, 8d42f648-8616-4974-b416-0b6534b002cc => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:30:09 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] VM Started (Lifecycle Event)
Aug 09 10:30:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-35a422ae-9bee-4518-adb9-b5dcf8f35b6f tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Lock "8d42f648-8616-4974-b416-0b6534b002cc" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 19.499s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:30:09 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:30:09 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:30:09 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:30:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:30:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:30:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:30:10 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 10:30:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09fcf27a-c6dc-4c4a-b73c-555ea2339967/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09fcf27a-c6dc-4c4a-b73c-555ea2339967/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09fcf27a-c6dc-4c4a-b73c-555ea2339967/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09fcf27a-c6dc-4c4a-b73c-555ea2339967/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:11 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:30:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:11 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:30:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:11 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:30:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94353851-e6a8-404b-b295-d539b2469d47/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94353851-e6a8-404b-b295-d539b2469d47/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94353851-e6a8-404b-b295-d539b2469d47/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94353851-e6a8-404b-b295-d539b2469d47/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:12 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:30:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4087716-c913-48db-886e-2f21d1238c66/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4087716-c913-48db-886e-2f21d1238c66/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4087716-c913-48db-886e-2f21d1238c66/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4087716-c913-48db-886e-2f21d1238c66/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:12 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:30:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9268633a-36f0-4bd2-85f2-22ae7911a1f9/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:30:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9268633a-36f0-4bd2-85f2-22ae7911a1f9/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9268633a-36f0-4bd2-85f2-22ae7911a1f9/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9268633a-36f0-4bd2-85f2-22ae7911a1f9/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:13 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:30:13 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:30:13 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=7316MB free_disk=24.978748321533203GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 10:30:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:30:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:30:13 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 8e055c58-a365-4f18-a6e3-377e32e2189d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:30:13 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:30:13 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance a6000393-6044-4b54-ac0b-1d631e2ed0ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:30:13 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 30213e67-6b1d-4d97-a971-1544335d02fb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:30:13 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 09fcf27a-c6dc-4c4a-b73c-555ea2339967 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:30:13 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance f4087716-c913-48db-886e-2f21d1238c66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:30:13 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance f8abc99c-b87b-4586-b9d4-7f5bcda60683 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:30:13 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 94353851-e6a8-404b-b295-d539b2469d47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:30:13 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance fe1804e8-2340-4868-a0ff-32d5df5fad42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:30:13 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 4b22a19f-300c-42fb-8175-e737eef7d531 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:30:13 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 8d42f648-8616-4974-b416-0b6534b002cc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:30:13 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 9268633a-36f0-4bd2-85f2-22ae7911a1f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:30:13 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 10:30:13 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 10:30:14 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:30:14 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:30:14 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 10:30:14 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.574s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:30:16 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:30:17 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:30:18 user nova-compute[72362]: DEBUG nova.compute.manager [req-8d1f1d1c-ddd7-4ffb-8f6e-c826070ede0e req-42ff28b0-b982-4b98-8ab0-c54fa574178a service nova] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Received event network-changed-63863234-78a1-41d7-8bd0-ee5d0657d86b {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:30:18 user nova-compute[72362]: DEBUG nova.compute.manager [req-8d1f1d1c-ddd7-4ffb-8f6e-c826070ede0e req-42ff28b0-b982-4b98-8ab0-c54fa574178a service nova] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Refreshing instance network info cache due to event network-changed-63863234-78a1-41d7-8bd0-ee5d0657d86b. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:30:18 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8d1f1d1c-ddd7-4ffb-8f6e-c826070ede0e req-42ff28b0-b982-4b98-8ab0-c54fa574178a service nova] Acquiring lock "refresh_cache-94353851-e6a8-404b-b295-d539b2469d47" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:30:18 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8d1f1d1c-ddd7-4ffb-8f6e-c826070ede0e req-42ff28b0-b982-4b98-8ab0-c54fa574178a service nova] Acquired lock "refresh_cache-94353851-e6a8-404b-b295-d539b2469d47" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:30:18 user nova-compute[72362]: DEBUG nova.network.neutron [req-8d1f1d1c-ddd7-4ffb-8f6e-c826070ede0e req-42ff28b0-b982-4b98-8ab0-c54fa574178a service nova] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Refreshing network info cache for port 63863234-78a1-41d7-8bd0-ee5d0657d86b {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:30:18 user nova-compute[72362]: DEBUG nova.network.neutron [req-8d1f1d1c-ddd7-4ffb-8f6e-c826070ede0e req-42ff28b0-b982-4b98-8ab0-c54fa574178a service nova] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Updated VIF entry in instance network info cache for port 63863234-78a1-41d7-8bd0-ee5d0657d86b. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:30:18 user nova-compute[72362]: DEBUG nova.network.neutron [req-8d1f1d1c-ddd7-4ffb-8f6e-c826070ede0e req-42ff28b0-b982-4b98-8ab0-c54fa574178a service nova] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Updating instance_info_cache with network_info: [{"id": "63863234-78a1-41d7-8bd0-ee5d0657d86b", "address": "fa:16:3e:d8:02:57", "network": {"id": "a5d87bf9-d44f-41f5-982b-a65355683bed", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1108251458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc168485d7424eb68b10725588022a8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63863234-78", "ovs_interfaceid": "63863234-78a1-41d7-8bd0-ee5d0657d86b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:30:18 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8d1f1d1c-ddd7-4ffb-8f6e-c826070ede0e req-42ff28b0-b982-4b98-8ab0-c54fa574178a service nova] Releasing lock "refresh_cache-94353851-e6a8-404b-b295-d539b2469d47" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:30:21 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:30:22 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-67dbf3fc-4b20-4229-a065-bd75efb55d23 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Acquiring lock "94353851-e6a8-404b-b295-d539b2469d47" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:30:22 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-67dbf3fc-4b20-4229-a065-bd75efb55d23 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Lock "94353851-e6a8-404b-b295-d539b2469d47" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:30:22 user nova-compute[72362]: DEBUG nova.objects.instance [None req-67dbf3fc-4b20-4229-a065-bd75efb55d23 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Lazy-loading 'flavor' on Instance uuid 94353851-e6a8-404b-b295-d539b2469d47 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:30:22 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-67dbf3fc-4b20-4229-a065-bd75efb55d23 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Lock "94353851-e6a8-404b-b295-d539b2469d47" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:30:22 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-67dbf3fc-4b20-4229-a065-bd75efb55d23 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Acquiring lock "94353851-e6a8-404b-b295-d539b2469d47" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:30:22 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-67dbf3fc-4b20-4229-a065-bd75efb55d23 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Lock "94353851-e6a8-404b-b295-d539b2469d47" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:30:22 user nova-compute[72362]: INFO nova.compute.manager [None req-67dbf3fc-4b20-4229-a065-bd75efb55d23 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Attaching volume 7ed33fa7-44d4-4832-b947-ed766f430d56 to /dev/vdb
Aug 09 10:30:22 user nova-compute[72362]: DEBUG os_brick.utils [None req-67dbf3fc-4b20-4229-a065-bd75efb55d23 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:30:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:22 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[67345db1-60d7-47bc-a1a4-21d304dee5ff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:22 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a9dbe3-e755-404b-b47f-e40bd19b8472]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:22 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a7894a-c30c-4744-917b-39d9bc47c0ae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:22 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcdc87e5-c59b-431a-83da-44d535d2a026]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-67dbf3fc-4b20-4229-a065-bd75efb55d23 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-67dbf3fc-4b20-4229-a065-bd75efb55d23 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:30:22 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-67dbf3fc-4b20-4229-a065-bd75efb55d23 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:30:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:30:22 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:30:22 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[679c030f-09d6-4fa7-a3ac-14874f30c778]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:22 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-67dbf3fc-4b20-4229-a065-bd75efb55d23 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:30:22 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-67dbf3fc-4b20-4229-a065-bd75efb55d23 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:30:22 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-67dbf3fc-4b20-4229-a065-bd75efb55d23 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:30:22 user nova-compute[72362]: DEBUG os_brick.utils [None req-67dbf3fc-4b20-4229-a065-bd75efb55d23 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:30:22 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-67dbf3fc-4b20-4229-a065-bd75efb55d23 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Updating existing volume attachment record: 7b7023c9-6a1b-4a4f-90cb-a2220a1d8de7 {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 10:30:22 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691577007.8861136, 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:30:22 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] VM Stopped (Lifecycle Event)
Aug 09 10:30:22 user nova-compute[72362]: DEBUG nova.compute.manager [None req-4492be4c-5307-4cfe-8774-c9b970790675 None None] [instance: 1a5a9ab8-ca97-454e-b850-c119ea2cd1bf] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:30:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:30:25 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:30:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:30:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:30:29 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:30:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-df0bd4c9-d8c0-4c8c-a8ac-6a7af72d24c2 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Acquiring lock "f4087716-c913-48db-886e-2f21d1238c66" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:30:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-df0bd4c9-d8c0-4c8c-a8ac-6a7af72d24c2 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Lock "f4087716-c913-48db-886e-2f21d1238c66" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:30:30 user nova-compute[72362]: INFO nova.compute.manager [None req-df0bd4c9-d8c0-4c8c-a8ac-6a7af72d24c2 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] [instance: f4087716-c913-48db-886e-2f21d1238c66] Detaching volume b0171c7d-a721-4169-aebd-bb284f7da7ac
Aug 09 10:30:30 user nova-compute[72362]: INFO nova.virt.block_device [None req-df0bd4c9-d8c0-4c8c-a8ac-6a7af72d24c2 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] [instance: f4087716-c913-48db-886e-2f21d1238c66] Attempting to driver detach volume b0171c7d-a721-4169-aebd-bb284f7da7ac from mountpoint /dev/vdb
Aug 09 10:30:30 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-df0bd4c9-d8c0-4c8c-a8ac-6a7af72d24c2 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Attempting to detach device vdb from instance f4087716-c913-48db-886e-2f21d1238c66 from the persistent domain config. {{(pid=72362) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 10:30:30 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-df0bd4c9-d8c0-4c8c-a8ac-6a7af72d24c2 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 10:30:30 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:30:30 user nova-compute[72362]:   <source dev="/dev/sdb"/>
Aug 09 10:30:30 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:30:30 user nova-compute[72362]:   <serial>b0171c7d-a721-4169-aebd-bb284f7da7ac</serial>
Aug 09 10:30:30 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 10:30:30 user nova-compute[72362]: </disk>
Aug 09 10:30:30 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:30:30 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-df0bd4c9-d8c0-4c8c-a8ac-6a7af72d24c2 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Successfully detached device vdb from instance f4087716-c913-48db-886e-2f21d1238c66 from the persistent domain config.
Aug 09 10:30:30 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-df0bd4c9-d8c0-4c8c-a8ac-6a7af72d24c2 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f4087716-c913-48db-886e-2f21d1238c66 from the live domain config. {{(pid=72362) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 10:30:30 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-df0bd4c9-d8c0-4c8c-a8ac-6a7af72d24c2 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 10:30:30 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:30:30 user nova-compute[72362]:   <source dev="/dev/sdb"/>
Aug 09 10:30:30 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:30:30 user nova-compute[72362]:   <serial>b0171c7d-a721-4169-aebd-bb284f7da7ac</serial>
Aug 09 10:30:30 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 10:30:30 user nova-compute[72362]: </disk>
Aug 09 10:30:30 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:30:30 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Received event <DeviceRemovedEvent: 1691577030.8071442, f4087716-c913-48db-886e-2f21d1238c66 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72362) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 10:30:30 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-df0bd4c9-d8c0-4c8c-a8ac-6a7af72d24c2 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f4087716-c913-48db-886e-2f21d1238c66 {{(pid=72362) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 10:30:30 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-df0bd4c9-d8c0-4c8c-a8ac-6a7af72d24c2 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Successfully detached device vdb from instance f4087716-c913-48db-886e-2f21d1238c66 from the live domain config.
Aug 09 10:30:30 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df0bd4c9-d8c0-4c8c-a8ac-6a7af72d24c2 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] [instance: f4087716-c913-48db-886e-2f21d1238c66] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:30:30 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0bd4c9-d8c0-4c8c-a8ac-6a7af72d24c2 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nWDTiaVd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:30:30 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-df0bd4c9-d8c0-4c8c-a8ac-6a7af72d24c2 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:30:30 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-df0bd4c9-d8c0-4c8c-a8ac-6a7af72d24c2 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:30:30 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-df0bd4c9-d8c0-4c8c-a8ac-6a7af72d24c2 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:30:30 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0bd4c9-d8c0-4c8c-a8ac-6a7af72d24c2 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:30:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:30 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d171754f-2d7b-469b-8e2b-c12c55090fbc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:30 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f6bb6d-71ad-4281-bc2c-103f5ecf0c0f]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:30 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0bd4c9-d8c0-4c8c-a8ac-6a7af72d24c2 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:30:30 user nova-compute[72362]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac (non-flash)
Aug 09 10:30:30 user nova-compute[72362]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:30:30 user nova-compute[72362]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)
Aug 09 10:30:30 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:30:30 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0bd4c9-d8c0-4c8c-a8ac-6a7af72d24c2 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:30:30 user nova-compute[72362]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac (non-flash)
Aug 09 10:30:30 user nova-compute[72362]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:30:30 user nova-compute[72362]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)
Aug 09 10:30:30 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:30:30 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0bd4c9-d8c0-4c8c-a8ac-6a7af72d24c2 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34dc2aed40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac'): ({'sdb'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:30:30 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-df0bd4c9-d8c0-4c8c-a8ac-6a7af72d24c2 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Removing single pathed devices sdb {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:30:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:30 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbe2e82-5c6e-4c76-930a-525e47f45e6c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:30 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee309b37-4d89-4a44-adcd-51d9918ff439]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:30 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-df0bd4c9-d8c0-4c8c-a8ac-6a7af72d24c2 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Flushing IO for device /dev/sdb {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:30:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:30 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ea92f8-8d1b-478b-804c-243037dd44a2]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:30 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-df0bd4c9-d8c0-4c8c-a8ac-6a7af72d24c2 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:30:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6951c5f-4d8d-429a-bd48-d16244329cc0]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-df0bd4c9-d8c0-4c8c-a8ac-6a7af72d24c2 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-df0bd4c9-d8c0-4c8c-a8ac-6a7af72d24c2 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] SCSI volumes sdb have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0bd4c9-d8c0-4c8c-a8ac-6a7af72d24c2 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b445562f-4d47-4360-acf0-9e64789485d3]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0bd4c9-d8c0-4c8c-a8ac-6a7af72d24c2 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a57ff5-83c3-4867-8a95-775516befea2]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0bd4c9-d8c0-4c8c-a8ac-6a7af72d24c2 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac, portal: 172.16.0.220,3260]
Aug 09 10:30:31 user nova-compute[72362]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac, portal: 172.16.0.220,3260] successful.
Aug 09 10:30:31 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0171c7d-a721-4169-aebd-bb284f7da7ac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e8f6ad-7604-40a1-843f-b7dfb4ce2f9d]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0bd4c9-d8c0-4c8c-a8ac-6a7af72d24c2 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-df0bd4c9-d8c0-4c8c-a8ac-6a7af72d24c2 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0bd4c9-d8c0-4c8c-a8ac-6a7af72d24c2 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] <== disconnect_volume: return (312ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df0bd4c9-d8c0-4c8c-a8ac-6a7af72d24c2 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] [instance: f4087716-c913-48db-886e-2f21d1238c66] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67dbf3fc-4b20-4229-a065-bd75efb55d23 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-67dbf3fc-4b20-4229-a065-bd75efb55d23 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7ed33fa7-44d4-4832-b947-ed766f430d56'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ebourQjI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:30:31 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-67dbf3fc-4b20-4229-a065-bd75efb55d23 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:30:31 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-67dbf3fc-4b20-4229-a065-bd75efb55d23 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-67dbf3fc-4b20-4229-a065-bd75efb55d23 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:30:31 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-67dbf3fc-4b20-4229-a065-bd75efb55d23 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:30:31 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-67dbf3fc-4b20-4229-a065-bd75efb55d23 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ed33fa7-44d4-4832-b947-ed766f430d56" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-67dbf3fc-4b20-4229-a065-bd75efb55d23 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ed33fa7-44d4-4832-b947-ed766f430d56" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:30:31 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-67dbf3fc-4b20-4229-a065-bd75efb55d23 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:30:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ed33fa7-44d4-4832-b947-ed766f430d56 -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ed33fa7-44d4-4832-b947-ed766f430d56 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dbf5651-72bd-4a37-ac06-8ef9488e43aa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-67dbf3fc-4b20-4229-a065-bd75efb55d23 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:30:31 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ed33fa7-44d4-4832-b947-ed766f430d56 -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ed33fa7-44d4-4832-b947-ed766f430d56 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[54dfbd39-ec8f-4bfd-9524-e2c7df182c17]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ed33fa7-44d4-4832-b947-ed766f430d56] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-67dbf3fc-4b20-4229-a065-bd75efb55d23 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ed33fa7-44d4-4832-b947-ed766f430d56] added
Aug 09 10:30:31 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ed33fa7-44d4-4832-b947-ed766f430d56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ed33fa7-44d4-4832-b947-ed766f430d56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0b6377-c33a-467d-b4bb-0080698dfec8]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-67dbf3fc-4b20-4229-a065-bd75efb55d23 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ed33fa7-44d4-4832-b947-ed766f430d56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ed33fa7-44d4-4832-b947-ed766f430d56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1bb9b9e-778b-43e0-b9f6-cda5a7e4c40e]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-67dbf3fc-4b20-4229-a065-bd75efb55d23 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ed33fa7-44d4-4832-b947-ed766f430d56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ebourQjI {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ed33fa7-44d4-4832-b947-ed766f430d56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ebourQjI" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf20c6a-1655-4140-ab57-e4ecab11f829]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-67dbf3fc-4b20-4229-a065-bd75efb55d23 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ebourQjI'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ed33fa7-44d4-4832-b947-ed766f430d56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ed33fa7-44d4-4832-b947-ed766f430d56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[24dfcc7b-40a0-4a7e-aea4-84fc24e8184c]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-67dbf3fc-4b20-4229-a065-bd75efb55d23 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde47a25-a441-4874-b9c2-c60b3e917c53]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-67dbf3fc-4b20-4229-a065-bd75efb55d23 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:30:31 user nova-compute[72362]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:30:31 user nova-compute[72362]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)
Aug 09 10:30:31 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-67dbf3fc-4b20-4229-a065-bd75efb55d23 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:30:31 user nova-compute[72362]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:30:31 user nova-compute[72362]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)
Aug 09 10:30:31 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ed33fa7-44d4-4832-b947-ed766f430d56 -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ed33fa7-44d4-4832-b947-ed766f430d56 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[362da706-ec40-4cb4-8eeb-6866e470f179]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ed33fa7-44d4-4832-b947-ed766f430d56, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7ed33fa7-44d4-4832-b947-ed766f430d56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-67dbf3fc-4b20-4229-a065-bd75efb55d23 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ed33fa7-44d4-4832-b947-ed766f430d56, portal: 172.16.0.220,3260]
Aug 09 10:30:31 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:7ed33fa7-44d4-4832-b947-ed766f430d56, portal: 172.16.0.220,3260] successful.
Aug 09 10:30:31 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ed33fa7-44d4-4832-b947-ed766f430d56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG nova.objects.instance [None req-df0bd4c9-d8c0-4c8c-a8ac-6a7af72d24c2 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Lazy-loading 'flavor' on Instance uuid f4087716-c913-48db-886e-2f21d1238c66 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ed33fa7-44d4-4832-b947-ed766f430d56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[55103e62-ea45-40b3-aab2-0ef45c0b0093]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-67dbf3fc-4b20-4229-a065-bd75efb55d23 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f094d1-6db9-414f-83e5-db776b379cf9]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ed33fa7-44d4-4832-b947-ed766f430d56 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-67dbf3fc-4b20-4229-a065-bd75efb55d23 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:30:31 user nova-compute[72362]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:30:31 user nova-compute[72362]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)
Aug 09 10:30:31 user nova-compute[72362]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ed33fa7-44d4-4832-b947-ed766f430d56 (non-flash)
Aug 09 10:30:31 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-67dbf3fc-4b20-4229-a065-bd75efb55d23 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:30:31 user nova-compute[72362]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:30:31 user nova-compute[72362]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)
Aug 09 10:30:31 user nova-compute[72362]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ed33fa7-44d4-4832-b947-ed766f430d56 (non-flash)
Aug 09 10:30:31 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-67dbf3fc-4b20-4229-a065-bd75efb55d23 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ed33fa7-44d4-4832-b947-ed766f430d56" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-67dbf3fc-4b20-4229-a065-bd75efb55d23 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-67dbf3fc-4b20-4229-a065-bd75efb55d23 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:30:31 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-67dbf3fc-4b20-4229-a065-bd75efb55d23 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:30:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-df0bd4c9-d8c0-4c8c-a8ac-6a7af72d24c2 tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Lock "f4087716-c913-48db-886e-2f21d1238c66" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.877s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:30:32 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:32 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:32 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8508d84-3d5c-4faa-b52e-4ed0c94aff77]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:32 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-67dbf3fc-4b20-4229-a065-bd75efb55d23 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:30:32 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-67dbf3fc-4b20-4229-a065-bd75efb55d23 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ebourQjI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:30:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:30:33 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-67dbf3fc-4b20-4229-a065-bd75efb55d23 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:30:33 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-67dbf3fc-4b20-4229-a065-bd75efb55d23 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '26332323636353439', 'path': '/dev/sdb'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:30:33 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67dbf3fc-4b20-4229-a065-bd75efb55d23 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332323636353439', 'path': '/dev/sdb'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:30:33 user nova-compute[72362]: DEBUG nova.objects.instance [None req-67dbf3fc-4b20-4229-a065-bd75efb55d23 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Lazy-loading 'flavor' on Instance uuid 94353851-e6a8-404b-b295-d539b2469d47 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:30:33 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-67dbf3fc-4b20-4229-a065-bd75efb55d23 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 10:30:33 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:30:33 user nova-compute[72362]:   <source dev="/dev/sdb"/>
Aug 09 10:30:33 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:30:33 user nova-compute[72362]:   <serial>7ed33fa7-44d4-4832-b947-ed766f430d56</serial>
Aug 09 10:30:33 user nova-compute[72362]: </disk>
Aug 09 10:30:33 user nova-compute[72362]:  {{(pid=72362) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 10:30:33 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-67dbf3fc-4b20-4229-a065-bd75efb55d23 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:30:33 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-67dbf3fc-4b20-4229-a065-bd75efb55d23 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:30:33 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-67dbf3fc-4b20-4229-a065-bd75efb55d23 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] No VIF found with MAC fa:16:3e:d8:02:57, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:30:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-67dbf3fc-4b20-4229-a065-bd75efb55d23 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Lock "94353851-e6a8-404b-b295-d539b2469d47" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.106s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:30:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0d0afe7a-09f1-489b-97a5-cd938f513676 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Acquiring lock "94353851-e6a8-404b-b295-d539b2469d47" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:30:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0d0afe7a-09f1-489b-97a5-cd938f513676 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Lock "94353851-e6a8-404b-b295-d539b2469d47" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:30:35 user nova-compute[72362]: INFO nova.compute.manager [None req-0d0afe7a-09f1-489b-97a5-cd938f513676 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Detaching volume 7ed33fa7-44d4-4832-b947-ed766f430d56
Aug 09 10:30:35 user nova-compute[72362]: INFO nova.virt.block_device [None req-0d0afe7a-09f1-489b-97a5-cd938f513676 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Attempting to driver detach volume 7ed33fa7-44d4-4832-b947-ed766f430d56 from mountpoint /dev/vdb
Aug 09 10:30:35 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-0d0afe7a-09f1-489b-97a5-cd938f513676 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Attempting to detach device vdb from instance 94353851-e6a8-404b-b295-d539b2469d47 from the persistent domain config. {{(pid=72362) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 10:30:35 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-0d0afe7a-09f1-489b-97a5-cd938f513676 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 10:30:35 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:30:35 user nova-compute[72362]:   <source dev="/dev/sdb"/>
Aug 09 10:30:35 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:30:35 user nova-compute[72362]:   <serial>7ed33fa7-44d4-4832-b947-ed766f430d56</serial>
Aug 09 10:30:35 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 10:30:35 user nova-compute[72362]: </disk>
Aug 09 10:30:35 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:30:35 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-0d0afe7a-09f1-489b-97a5-cd938f513676 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Successfully detached device vdb from instance 94353851-e6a8-404b-b295-d539b2469d47 from the persistent domain config.
Aug 09 10:30:35 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-0d0afe7a-09f1-489b-97a5-cd938f513676 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 94353851-e6a8-404b-b295-d539b2469d47 from the live domain config. {{(pid=72362) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 10:30:35 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-0d0afe7a-09f1-489b-97a5-cd938f513676 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 10:30:35 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:30:35 user nova-compute[72362]:   <source dev="/dev/sdb"/>
Aug 09 10:30:35 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:30:35 user nova-compute[72362]:   <serial>7ed33fa7-44d4-4832-b947-ed766f430d56</serial>
Aug 09 10:30:35 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 10:30:35 user nova-compute[72362]: </disk>
Aug 09 10:30:35 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:30:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Received event <DeviceRemovedEvent: 1691577036.2931998, 94353851-e6a8-404b-b295-d539b2469d47 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72362) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 10:30:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-0d0afe7a-09f1-489b-97a5-cd938f513676 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 94353851-e6a8-404b-b295-d539b2469d47 {{(pid=72362) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 10:30:36 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-0d0afe7a-09f1-489b-97a5-cd938f513676 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Successfully detached device vdb from instance 94353851-e6a8-404b-b295-d539b2469d47 from the live domain config.
Aug 09 10:30:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d0afe7a-09f1-489b-97a5-cd938f513676 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] [instance: 94353851-e6a8-404b-b295-d539b2469d47] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:30:36 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0afe7a-09f1-489b-97a5-cd938f513676 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:7ed33fa7-44d4-4832-b947-ed766f430d56'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ebourQjI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:30:36 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-0d0afe7a-09f1-489b-97a5-cd938f513676 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:30:36 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-0d0afe7a-09f1-489b-97a5-cd938f513676 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:30:36 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-0d0afe7a-09f1-489b-97a5-cd938f513676 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:30:36 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0afe7a-09f1-489b-97a5-cd938f513676 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ed33fa7-44d4-4832-b947-ed766f430d56', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:30:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:36 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0058525e-b4f4-40b1-a0fa-536575dfa435]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ed33fa7-44d4-4832-b947-ed766f430d56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:36 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[075bf9b6-b253-4e2c-8ced-85a097a173c6]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ed33fa7-44d4-4832-b947-ed766f430d56 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:36 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0afe7a-09f1-489b-97a5-cd938f513676 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:30:36 user nova-compute[72362]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:30:36 user nova-compute[72362]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)
Aug 09 10:30:36 user nova-compute[72362]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ed33fa7-44d4-4832-b947-ed766f430d56 (non-flash)
Aug 09 10:30:36 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:30:36 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0afe7a-09f1-489b-97a5-cd938f513676 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:30:36 user nova-compute[72362]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:30:36 user nova-compute[72362]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)
Aug 09 10:30:36 user nova-compute[72362]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ed33fa7-44d4-4832-b947-ed766f430d56 (non-flash)
Aug 09 10:30:36 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:30:36 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0afe7a-09f1-489b-97a5-cd938f513676 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34dc247010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ed33fa7-44d4-4832-b947-ed766f430d56'): ({'sdb'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:30:36 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-0d0afe7a-09f1-489b-97a5-cd938f513676 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Removing single pathed devices sdb {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:30:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:36 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[afca08fc-de25-44a9-9481-025ed0d06aee]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:36 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b178ae7f-2db6-4a7d-9d7e-9d6a83a5a9dd]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:36 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-0d0afe7a-09f1-489b-97a5-cd938f513676 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Flushing IO for device /dev/sdb {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:30:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:36 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc3f346-bc5e-45c0-b1f6-dd30d971137e]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:36 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-0d0afe7a-09f1-489b-97a5-cd938f513676 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:30:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:36 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d96698-1b91-47c9-8cb5-3c73a003d279]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:36 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-0d0afe7a-09f1-489b-97a5-cd938f513676 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:30:36 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-0d0afe7a-09f1-489b-97a5-cd938f513676 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] SCSI volumes sdb have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:30:36 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0afe7a-09f1-489b-97a5-cd938f513676 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ed33fa7-44d4-4832-b947-ed766f430d56')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:30:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ed33fa7-44d4-4832-b947-ed766f430d56 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ed33fa7-44d4-4832-b947-ed766f430d56 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:36 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0289ca9b-ea9a-4806-9010-0705f54fae1f]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:36 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0afe7a-09f1-489b-97a5-cd938f513676 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:30:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ed33fa7-44d4-4832-b947-ed766f430d56 -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ed33fa7-44d4-4832-b947-ed766f430d56 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:36 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0a6c0c-a124-424a-9490-2a810f623603]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:7ed33fa7-44d4-4832-b947-ed766f430d56, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:7ed33fa7-44d4-4832-b947-ed766f430d56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:36 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0afe7a-09f1-489b-97a5-cd938f513676 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:7ed33fa7-44d4-4832-b947-ed766f430d56, portal: 172.16.0.220,3260]
Aug 09 10:30:36 user nova-compute[72362]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:7ed33fa7-44d4-4832-b947-ed766f430d56, portal: 172.16.0.220,3260] successful.
Aug 09 10:30:36 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:30:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ed33fa7-44d4-4832-b947-ed766f430d56 -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:30:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ed33fa7-44d4-4832-b947-ed766f430d56 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:30:36 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a76d9f0-463a-44f5-a1e3-ddde3991ffbb]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:30:36 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0afe7a-09f1-489b-97a5-cd938f513676 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:30:36 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-0d0afe7a-09f1-489b-97a5-cd938f513676 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:30:36 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0afe7a-09f1-489b-97a5-cd938f513676 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] <== disconnect_volume: return (272ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:30:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d0afe7a-09f1-489b-97a5-cd938f513676 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:30:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:30:37 user nova-compute[72362]: DEBUG nova.objects.instance [None req-0d0afe7a-09f1-489b-97a5-cd938f513676 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Lazy-loading 'flavor' on Instance uuid 94353851-e6a8-404b-b295-d539b2469d47 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:30:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0d0afe7a-09f1-489b-97a5-cd938f513676 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Lock "94353851-e6a8-404b-b295-d539b2469d47" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.566s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:30:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:30:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:30:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:30:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:30:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:30:52 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:30:57 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquiring lock "f3cdf152-da86-447b-aa7c-921b6fa87ef8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:30:57 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "f3cdf152-da86-447b-aa7c-921b6fa87ef8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:30:57 user nova-compute[72362]: DEBUG nova.compute.manager [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Starting instance... {{(pid=72362) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 10:30:57 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:30:57 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:30:57 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:30:57 user nova-compute[72362]: INFO nova.compute.claims [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Claim successful on node user
Aug 09 10:30:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:30:58 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:30:58 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:30:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.456s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:30:58 user nova-compute[72362]: DEBUG nova.compute.manager [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Start building networks asynchronously for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 10:30:58 user nova-compute[72362]: DEBUG nova.compute.manager [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Allocating IP information in the background. {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 10:30:58 user nova-compute[72362]: DEBUG nova.network.neutron [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] allocate_for_instance() {{(pid=72362) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 10:30:58 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 10:30:58 user nova-compute[72362]: DEBUG nova.compute.manager [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Start building block device mappings for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 10:30:58 user nova-compute[72362]: INFO nova.virt.block_device [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Booting with volume-backed-image a08d1a11-49eb-4212-a351-e11ee9553b95 at /dev/vda
Aug 09 10:30:58 user nova-compute[72362]: DEBUG nova.policy [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4a1904ffd10b4e8b959971b5e2383113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f206cedc59df46deb91e7ec2167c1f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72362) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 10:30:59 user nova-compute[72362]: DEBUG nova.network.neutron [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Successfully created port: cb4bdd64-bb23-4c96-8912-377268174872 {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:30:59 user nova-compute[72362]: DEBUG nova.network.neutron [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Successfully updated port: cb4bdd64-bb23-4c96-8912-377268174872 {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:30:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquiring lock "refresh_cache-f3cdf152-da86-447b-aa7c-921b6fa87ef8" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:30:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquired lock "refresh_cache-f3cdf152-da86-447b-aa7c-921b6fa87ef8" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:30:59 user nova-compute[72362]: DEBUG nova.network.neutron [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:31:00 user nova-compute[72362]: DEBUG nova.compute.manager [req-1acb8951-81e3-4128-848d-942621a6e594 req-5d38942c-e374-44e5-b71b-75b453d47060 service nova] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Received event network-changed-cb4bdd64-bb23-4c96-8912-377268174872 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:31:00 user nova-compute[72362]: DEBUG nova.compute.manager [req-1acb8951-81e3-4128-848d-942621a6e594 req-5d38942c-e374-44e5-b71b-75b453d47060 service nova] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Refreshing instance network info cache due to event network-changed-cb4bdd64-bb23-4c96-8912-377268174872. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:31:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-1acb8951-81e3-4128-848d-942621a6e594 req-5d38942c-e374-44e5-b71b-75b453d47060 service nova] Acquiring lock "refresh_cache-f3cdf152-da86-447b-aa7c-921b6fa87ef8" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:31:00 user nova-compute[72362]: DEBUG nova.network.neutron [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:31:00 user nova-compute[72362]: DEBUG nova.network.neutron [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Updating instance_info_cache with network_info: [{"id": "cb4bdd64-bb23-4c96-8912-377268174872", "address": "fa:16:3e:78:c7:96", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4bdd64-bb", "ovs_interfaceid": "cb4bdd64-bb23-4c96-8912-377268174872", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:31:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Releasing lock "refresh_cache-f3cdf152-da86-447b-aa7c-921b6fa87ef8" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:31:00 user nova-compute[72362]: DEBUG nova.compute.manager [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Instance network_info: |[{"id": "cb4bdd64-bb23-4c96-8912-377268174872", "address": "fa:16:3e:78:c7:96", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4bdd64-bb", "ovs_interfaceid": "cb4bdd64-bb23-4c96-8912-377268174872", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 10:31:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-1acb8951-81e3-4128-848d-942621a6e594 req-5d38942c-e374-44e5-b71b-75b453d47060 service nova] Acquired lock "refresh_cache-f3cdf152-da86-447b-aa7c-921b6fa87ef8" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:31:00 user nova-compute[72362]: DEBUG nova.network.neutron [req-1acb8951-81e3-4128-848d-942621a6e594 req-5d38942c-e374-44e5-b71b-75b453d47060 service nova] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Refreshing network info cache for port cb4bdd64-bb23-4c96-8912-377268174872 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:31:00 user nova-compute[72362]: DEBUG nova.network.neutron [req-1acb8951-81e3-4128-848d-942621a6e594 req-5d38942c-e374-44e5-b71b-75b453d47060 service nova] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Updated VIF entry in instance network info cache for port cb4bdd64-bb23-4c96-8912-377268174872. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:31:00 user nova-compute[72362]: DEBUG nova.network.neutron [req-1acb8951-81e3-4128-848d-942621a6e594 req-5d38942c-e374-44e5-b71b-75b453d47060 service nova] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Updating instance_info_cache with network_info: [{"id": "cb4bdd64-bb23-4c96-8912-377268174872", "address": "fa:16:3e:78:c7:96", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4bdd64-bb", "ovs_interfaceid": "cb4bdd64-bb23-4c96-8912-377268174872", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:31:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-1acb8951-81e3-4128-848d-942621a6e594 req-5d38942c-e374-44e5-b71b-75b453d47060 service nova] Releasing lock "refresh_cache-f3cdf152-da86-447b-aa7c-921b6fa87ef8" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:31:01 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:31:01 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:31:01 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:31:01 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:31:01 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 10:31:01 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:31:02 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:31:02 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 10:31:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:31:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "refresh_cache-30213e67-6b1d-4d97-a971-1544335d02fb" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:31:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquired lock "refresh_cache-30213e67-6b1d-4d97-a971-1544335d02fb" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:31:03 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Forcefully refreshing network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 10:31:03 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Updating instance_info_cache with network_info: [{"id": "86a5b4ed-c891-4322-9ed4-4ddb3795148c", "address": "fa:16:3e:7b:56:f2", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a5b4ed-c8", "ovs_interfaceid": "86a5b4ed-c891-4322-9ed4-4ddb3795148c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:31:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Releasing lock "refresh_cache-30213e67-6b1d-4d97-a971-1544335d02fb" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:31:03 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Updated the network info_cache for instance {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 10:31:03 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:31:05 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:31:07 user nova-compute[72362]: DEBUG nova.compute.manager [req-193f9543-da2d-44ba-99a1-5dcc3c1542fc req-0fbc4ca0-b03a-4154-b36c-730fdacdbd81 service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Received event network-changed-3205c4d7-d431-4127-b2a5-436df06f6c4b {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:31:07 user nova-compute[72362]: DEBUG nova.compute.manager [req-193f9543-da2d-44ba-99a1-5dcc3c1542fc req-0fbc4ca0-b03a-4154-b36c-730fdacdbd81 service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Refreshing instance network info cache due to event network-changed-3205c4d7-d431-4127-b2a5-436df06f6c4b. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:31:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-193f9543-da2d-44ba-99a1-5dcc3c1542fc req-0fbc4ca0-b03a-4154-b36c-730fdacdbd81 service nova] Acquiring lock "refresh_cache-fe1804e8-2340-4868-a0ff-32d5df5fad42" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:31:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-193f9543-da2d-44ba-99a1-5dcc3c1542fc req-0fbc4ca0-b03a-4154-b36c-730fdacdbd81 service nova] Acquired lock "refresh_cache-fe1804e8-2340-4868-a0ff-32d5df5fad42" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:31:07 user nova-compute[72362]: DEBUG nova.network.neutron [req-193f9543-da2d-44ba-99a1-5dcc3c1542fc req-0fbc4ca0-b03a-4154-b36c-730fdacdbd81 service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Refreshing network info cache for port 3205c4d7-d431-4127-b2a5-436df06f6c4b {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:31:07 user nova-compute[72362]: DEBUG nova.network.neutron [req-193f9543-da2d-44ba-99a1-5dcc3c1542fc req-0fbc4ca0-b03a-4154-b36c-730fdacdbd81 service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Updated VIF entry in instance network info cache for port 3205c4d7-d431-4127-b2a5-436df06f6c4b. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:31:07 user nova-compute[72362]: DEBUG nova.network.neutron [req-193f9543-da2d-44ba-99a1-5dcc3c1542fc req-0fbc4ca0-b03a-4154-b36c-730fdacdbd81 service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Updating instance_info_cache with network_info: [{"id": "3205c4d7-d431-4127-b2a5-436df06f6c4b", "address": "fa:16:3e:44:ae:dc", "network": {"id": "322734db-2e92-4833-85a8-dc059a13b535", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-753064842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7fd45a7ce194cd4bc477f03bdebfe9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3205c4d7-d4", "ovs_interfaceid": "3205c4d7-d431-4127-b2a5-436df06f6c4b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:31:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-193f9543-da2d-44ba-99a1-5dcc3c1542fc req-0fbc4ca0-b03a-4154-b36c-730fdacdbd81 service nova] Releasing lock "refresh_cache-fe1804e8-2340-4868-a0ff-32d5df5fad42" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:31:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:31:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 10:31:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 10:31:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 10:31:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:08 user nova-compute[72362]: DEBUG nova.compute.manager [None req-c9b9454c-028a-427e-869d-115879fac28d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:31:08 user nova-compute[72362]: INFO nova.compute.manager [None req-c9b9454c-028a-427e-869d-115879fac28d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] instance snapshotting
Aug 09 10:31:08 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-c9b9454c-028a-427e-869d-115879fac28d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Beginning live snapshot process
Aug 09 10:31:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-c9b9454c-028a-427e-869d-115879fac28d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/disk --force-share --output=json -f qcow2 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-c9b9454c-028a-427e-869d-115879fac28d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/disk --force-share --output=json -f qcow2" returned: 0 in 0.143s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-c9b9454c-028a-427e-869d-115879fac28d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/disk --force-share --output=json -f qcow2 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:09 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-c9b9454c-028a-427e-869d-115879fac28d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/disk --force-share --output=json -f qcow2" returned: 0 in 0.137s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:09 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-c9b9454c-028a-427e-869d-115879fac28d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:09 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-c9b9454c-028a-427e-869d-115879fac28d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.138s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:09 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-c9b9454c-028a-427e-869d-115879fac28d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpztvok01x/e9483a416a3346ac847f13013ad8bf38.delta 1073741824 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:09 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-c9b9454c-028a-427e-869d-115879fac28d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpztvok01x/e9483a416a3346ac847f13013ad8bf38.delta 1073741824" returned: 0 in 0.049s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:09 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-c9b9454c-028a-427e-869d-115879fac28d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 09 10:31:09 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-c9b9454c-028a-427e-869d-115879fac28d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=72362) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 10:31:10 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-c9b9454c-028a-427e-869d-115879fac28d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=72362) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 10:31:10 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-c9b9454c-028a-427e-869d-115879fac28d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 09 10:31:10 user nova-compute[72362]: DEBUG nova.privsep.utils [None req-c9b9454c-028a-427e-869d-115879fac28d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72362) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 10:31:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-c9b9454c-028a-427e-869d-115879fac28d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpztvok01x/e9483a416a3346ac847f13013ad8bf38.delta /opt/stack/data/nova/instances/snapshots/tmpztvok01x/e9483a416a3346ac847f13013ad8bf38 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-c9b9454c-028a-427e-869d-115879fac28d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpztvok01x/e9483a416a3346ac847f13013ad8bf38.delta /opt/stack/data/nova/instances/snapshots/tmpztvok01x/e9483a416a3346ac847f13013ad8bf38" returned: 0 in 0.554s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:11 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-c9b9454c-028a-427e-869d-115879fac28d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Snapshot extracted, beginning image upload
Aug 09 10:31:11 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:11 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:31:12 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:31:12 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:31:12 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:31:12 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 10:31:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09fcf27a-c6dc-4c4a-b73c-555ea2339967/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09fcf27a-c6dc-4c4a-b73c-555ea2339967/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09fcf27a-c6dc-4c4a-b73c-555ea2339967/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09fcf27a-c6dc-4c4a-b73c-555ea2339967/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:12 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:31:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:13 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:31:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94353851-e6a8-404b-b295-d539b2469d47/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:13 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-c9b9454c-028a-427e-869d-115879fac28d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Snapshot image upload complete
Aug 09 10:31:13 user nova-compute[72362]: INFO nova.compute.manager [None req-c9b9454c-028a-427e-869d-115879fac28d tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Took 4.98 seconds to snapshot the instance on the hypervisor.
Aug 09 10:31:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94353851-e6a8-404b-b295-d539b2469d47/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94353851-e6a8-404b-b295-d539b2469d47/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94353851-e6a8-404b-b295-d539b2469d47/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:14 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:31:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4087716-c913-48db-886e-2f21d1238c66/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4087716-c913-48db-886e-2f21d1238c66/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4087716-c913-48db-886e-2f21d1238c66/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4087716-c913-48db-886e-2f21d1238c66/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9268633a-36f0-4bd2-85f2-22ae7911a1f9/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9268633a-36f0-4bd2-85f2-22ae7911a1f9/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9268633a-36f0-4bd2-85f2-22ae7911a1f9/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9268633a-36f0-4bd2-85f2-22ae7911a1f9/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:15 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:31:15 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:31:15 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=7130MB free_disk=24.917537689208984GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 10:31:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:31:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:31:15 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 8e055c58-a365-4f18-a6e3-377e32e2189d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:31:15 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:31:15 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance a6000393-6044-4b54-ac0b-1d631e2ed0ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:31:15 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 30213e67-6b1d-4d97-a971-1544335d02fb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:31:15 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 09fcf27a-c6dc-4c4a-b73c-555ea2339967 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:31:15 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance f4087716-c913-48db-886e-2f21d1238c66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:31:15 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance f8abc99c-b87b-4586-b9d4-7f5bcda60683 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:31:15 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 94353851-e6a8-404b-b295-d539b2469d47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:31:15 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance fe1804e8-2340-4868-a0ff-32d5df5fad42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:31:15 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 4b22a19f-300c-42fb-8175-e737eef7d531 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:31:15 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 8d42f648-8616-4974-b416-0b6534b002cc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:31:15 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 9268633a-36f0-4bd2-85f2-22ae7911a1f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:31:15 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance f3cdf152-da86-447b-aa7c-921b6fa87ef8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:31:15 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 10:31:15 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 10:31:15 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:31:15 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:31:15 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 10:31:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.535s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:31:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-69215454-fdff-4731-ab14-0eb3d7a7c2f6 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Acquiring lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:31:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-69215454-fdff-4731-ab14-0eb3d7a7c2f6 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:31:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-69215454-fdff-4731-ab14-0eb3d7a7c2f6 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Acquiring lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:31:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-69215454-fdff-4731-ab14-0eb3d7a7c2f6 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:31:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-69215454-fdff-4731-ab14-0eb3d7a7c2f6 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:31:15 user nova-compute[72362]: INFO nova.compute.manager [None req-69215454-fdff-4731-ab14-0eb3d7a7c2f6 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Terminating instance
Aug 09 10:31:15 user nova-compute[72362]: DEBUG nova.compute.manager [None req-69215454-fdff-4731-ab14-0eb3d7a7c2f6 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Start destroying the instance on the hypervisor. {{(pid=72362) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 10:31:15 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:16 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:16 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:16 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:16 user nova-compute[72362]: DEBUG nova.compute.manager [req-b275a1f3-ecfe-4fba-8c5f-9ef227e718cd req-b0cd70e2-2844-4612-b5c4-a6cc731682a0 service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Received event network-vif-unplugged-8c0230bc-c7a7-4497-af9a-2fafb259605c {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:31:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b275a1f3-ecfe-4fba-8c5f-9ef227e718cd req-b0cd70e2-2844-4612-b5c4-a6cc731682a0 service nova] Acquiring lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:31:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b275a1f3-ecfe-4fba-8c5f-9ef227e718cd req-b0cd70e2-2844-4612-b5c4-a6cc731682a0 service nova] Lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:31:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b275a1f3-ecfe-4fba-8c5f-9ef227e718cd req-b0cd70e2-2844-4612-b5c4-a6cc731682a0 service nova] Lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:31:16 user nova-compute[72362]: DEBUG nova.compute.manager [req-b275a1f3-ecfe-4fba-8c5f-9ef227e718cd req-b0cd70e2-2844-4612-b5c4-a6cc731682a0 service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] No waiting events found dispatching network-vif-unplugged-8c0230bc-c7a7-4497-af9a-2fafb259605c {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:31:16 user nova-compute[72362]: DEBUG nova.compute.manager [req-b275a1f3-ecfe-4fba-8c5f-9ef227e718cd req-b0cd70e2-2844-4612-b5c4-a6cc731682a0 service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Received event network-vif-unplugged-8c0230bc-c7a7-4497-af9a-2fafb259605c for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:31:16 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:16 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Instance destroyed successfully.
Aug 09 10:31:16 user nova-compute[72362]: DEBUG nova.objects.instance [None req-69215454-fdff-4731-ab14-0eb3d7a7c2f6 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lazy-loading 'resources' on Instance uuid a6000393-6044-4b54-ac0b-1d631e2ed0ae {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:31:16 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:16 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-69215454-fdff-4731-ab14-0eb3d7a7c2f6 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:21:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1940264170',display_name='tempest-AttachVolumeTestJSON-server-1940264170',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1940264170',id=19,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuD55hFJGS6ztpZ3pMNhoMVTtkOPfZJVd+6jLMFkU6lpGS3ntRkyZ61ihETUV7/q4X01P1baNsnIzL7TV/XH9281YGmZSyK/sCWwApv9GpxS0U8aCjbpuFwgIK7/Y1Z9Q==',key_name='tempest-keypair-208455084',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:21:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9dac04663e2f45378cc0e466740342d2',ramdisk_id='',reservation_id='r-i0cbsd0z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-986857971',owner_user_name='tempest-AttachVolumeTestJSON-986857971-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:29:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec007d0aa3c144f5a24a4913cc336ebb',uuid=a6000393-6044-4b54-ac0b-1d631e2ed0ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "address": "fa:16:3e:6e:b0:73", "network": {"id": "7358b925-3211-4419-84eb-df6967f5ea8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1360753488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dac04663e2f45378cc0e466740342d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c0230bc-c7", "ovs_interfaceid": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:31:16 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-69215454-fdff-4731-ab14-0eb3d7a7c2f6 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Converting VIF {"id": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "address": "fa:16:3e:6e:b0:73", "network": {"id": "7358b925-3211-4419-84eb-df6967f5ea8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1360753488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dac04663e2f45378cc0e466740342d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c0230bc-c7", "ovs_interfaceid": "8c0230bc-c7a7-4497-af9a-2fafb259605c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:31:16 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-69215454-fdff-4731-ab14-0eb3d7a7c2f6 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:b0:73,bridge_name='br-int',has_traffic_filtering=True,id=8c0230bc-c7a7-4497-af9a-2fafb259605c,network=Network(7358b925-3211-4419-84eb-df6967f5ea8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c0230bc-c7') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:31:16 user nova-compute[72362]: DEBUG os_vif [None req-69215454-fdff-4731-ab14-0eb3d7a7c2f6 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:b0:73,bridge_name='br-int',has_traffic_filtering=True,id=8c0230bc-c7a7-4497-af9a-2fafb259605c,network=Network(7358b925-3211-4419-84eb-df6967f5ea8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c0230bc-c7') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:31:16 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:16 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c0230bc-c7, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:31:16 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:16 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:16 user nova-compute[72362]: INFO os_vif [None req-69215454-fdff-4731-ab14-0eb3d7a7c2f6 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:b0:73,bridge_name='br-int',has_traffic_filtering=True,id=8c0230bc-c7a7-4497-af9a-2fafb259605c,network=Network(7358b925-3211-4419-84eb-df6967f5ea8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c0230bc-c7')
Aug 09 10:31:16 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-69215454-fdff-4731-ab14-0eb3d7a7c2f6 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Deleting instance files /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae_del
Aug 09 10:31:16 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-69215454-fdff-4731-ab14-0eb3d7a7c2f6 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Deletion of /opt/stack/data/nova/instances/a6000393-6044-4b54-ac0b-1d631e2ed0ae_del complete
Aug 09 10:31:16 user nova-compute[72362]: INFO nova.compute.manager [None req-69215454-fdff-4731-ab14-0eb3d7a7c2f6 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 09 10:31:16 user nova-compute[72362]: DEBUG oslo.service.loopingcall [None req-69215454-fdff-4731-ab14-0eb3d7a7c2f6 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72362) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 10:31:16 user nova-compute[72362]: DEBUG nova.compute.manager [-] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Deallocating network for instance {{(pid=72362) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 10:31:16 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] deallocate_for_instance() {{(pid=72362) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 10:31:17 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:31:17 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Took 1.21 seconds to deallocate network for instance.
Aug 09 10:31:18 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-69215454-fdff-4731-ab14-0eb3d7a7c2f6 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:31:18 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-69215454-fdff-4731-ab14-0eb3d7a7c2f6 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:31:18 user nova-compute[72362]: DEBUG nova.compute.manager [req-17ce708d-6f67-4f45-b309-cc66e5fd25d5 req-a7982f49-57d9-4c14-b620-6747de45a021 service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Received event network-vif-plugged-8c0230bc-c7a7-4497-af9a-2fafb259605c {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:31:18 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-17ce708d-6f67-4f45-b309-cc66e5fd25d5 req-a7982f49-57d9-4c14-b620-6747de45a021 service nova] Acquiring lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:31:18 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-17ce708d-6f67-4f45-b309-cc66e5fd25d5 req-a7982f49-57d9-4c14-b620-6747de45a021 service nova] Lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:31:18 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-17ce708d-6f67-4f45-b309-cc66e5fd25d5 req-a7982f49-57d9-4c14-b620-6747de45a021 service nova] Lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:31:18 user nova-compute[72362]: DEBUG nova.compute.manager [req-17ce708d-6f67-4f45-b309-cc66e5fd25d5 req-a7982f49-57d9-4c14-b620-6747de45a021 service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] No waiting events found dispatching network-vif-plugged-8c0230bc-c7a7-4497-af9a-2fafb259605c {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:31:18 user nova-compute[72362]: WARNING nova.compute.manager [req-17ce708d-6f67-4f45-b309-cc66e5fd25d5 req-a7982f49-57d9-4c14-b620-6747de45a021 service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Received unexpected event network-vif-plugged-8c0230bc-c7a7-4497-af9a-2fafb259605c for instance with vm_state deleted and task_state None.
Aug 09 10:31:18 user nova-compute[72362]: DEBUG nova.compute.manager [req-17ce708d-6f67-4f45-b309-cc66e5fd25d5 req-a7982f49-57d9-4c14-b620-6747de45a021 service nova] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Received event network-vif-deleted-8c0230bc-c7a7-4497-af9a-2fafb259605c {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:31:18 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-69215454-fdff-4731-ab14-0eb3d7a7c2f6 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:31:18 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-69215454-fdff-4731-ab14-0eb3d7a7c2f6 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:31:18 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-69215454-fdff-4731-ab14-0eb3d7a7c2f6 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.438s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:31:18 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-69215454-fdff-4731-ab14-0eb3d7a7c2f6 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Deleted allocations for instance a6000393-6044-4b54-ac0b-1d631e2ed0ae
Aug 09 10:31:18 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-69215454-fdff-4731-ab14-0eb3d7a7c2f6 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "a6000393-6044-4b54-ac0b-1d631e2ed0ae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.690s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:31:19 user nova-compute[72362]: DEBUG os_brick.utils [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:31:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:19 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[7656e5b2-f60f-4020-a228-3c2bab0ac736]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:19 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed66188e-fad9-40a1-8a22-75b72c947d34]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:19 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0728679-9014-42d4-b30b-76ca36a80651]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:19 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b251330b-8231-4af7-94c0-e40ffa91e7cb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:31:19 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:31:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:31:19 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:31:19 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f41bba-c161-4ebc-802e-a25b95ca1306]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:19 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:31:19 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:31:19 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:31:19 user nova-compute[72362]: DEBUG os_brick.utils [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:31:19 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Updating existing volume attachment record: 349d9b4a-56a1-43d0-b9b0-128e350c18cb {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 10:31:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-88dfc3fc-56ac-49ba-910d-7eeaf4f7fa9c tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Acquiring lock "f4087716-c913-48db-886e-2f21d1238c66" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:31:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-88dfc3fc-56ac-49ba-910d-7eeaf4f7fa9c tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Lock "f4087716-c913-48db-886e-2f21d1238c66" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:31:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-88dfc3fc-56ac-49ba-910d-7eeaf4f7fa9c tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Acquiring lock "f4087716-c913-48db-886e-2f21d1238c66-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:31:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-88dfc3fc-56ac-49ba-910d-7eeaf4f7fa9c tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Lock "f4087716-c913-48db-886e-2f21d1238c66-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:31:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-88dfc3fc-56ac-49ba-910d-7eeaf4f7fa9c tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Lock "f4087716-c913-48db-886e-2f21d1238c66-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:31:20 user nova-compute[72362]: INFO nova.compute.manager [None req-88dfc3fc-56ac-49ba-910d-7eeaf4f7fa9c tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] [instance: f4087716-c913-48db-886e-2f21d1238c66] Terminating instance
Aug 09 10:31:20 user nova-compute[72362]: DEBUG nova.compute.manager [None req-88dfc3fc-56ac-49ba-910d-7eeaf4f7fa9c tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] [instance: f4087716-c913-48db-886e-2f21d1238c66] Start destroying the instance on the hypervisor. {{(pid=72362) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 10:31:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:20 user nova-compute[72362]: DEBUG nova.compute.manager [req-ae77a978-e6b0-4197-a7f8-d8e5e44beeae req-38b3db2e-b9cd-4676-8534-c8db86625230 service nova] [instance: f4087716-c913-48db-886e-2f21d1238c66] Received event network-vif-unplugged-357779ea-2646-4d4b-926d-b069e0ae2aa2 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:31:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ae77a978-e6b0-4197-a7f8-d8e5e44beeae req-38b3db2e-b9cd-4676-8534-c8db86625230 service nova] Acquiring lock "f4087716-c913-48db-886e-2f21d1238c66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:31:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ae77a978-e6b0-4197-a7f8-d8e5e44beeae req-38b3db2e-b9cd-4676-8534-c8db86625230 service nova] Lock "f4087716-c913-48db-886e-2f21d1238c66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:31:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ae77a978-e6b0-4197-a7f8-d8e5e44beeae req-38b3db2e-b9cd-4676-8534-c8db86625230 service nova] Lock "f4087716-c913-48db-886e-2f21d1238c66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:31:20 user nova-compute[72362]: DEBUG nova.compute.manager [req-ae77a978-e6b0-4197-a7f8-d8e5e44beeae req-38b3db2e-b9cd-4676-8534-c8db86625230 service nova] [instance: f4087716-c913-48db-886e-2f21d1238c66] No waiting events found dispatching network-vif-unplugged-357779ea-2646-4d4b-926d-b069e0ae2aa2 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:31:20 user nova-compute[72362]: DEBUG nova.compute.manager [req-ae77a978-e6b0-4197-a7f8-d8e5e44beeae req-38b3db2e-b9cd-4676-8534-c8db86625230 service nova] [instance: f4087716-c913-48db-886e-2f21d1238c66] Received event network-vif-unplugged-357779ea-2646-4d4b-926d-b069e0ae2aa2 for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:31:21 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:21 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:21 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: f4087716-c913-48db-886e-2f21d1238c66] Instance destroyed successfully.
Aug 09 10:31:21 user nova-compute[72362]: DEBUG nova.objects.instance [None req-88dfc3fc-56ac-49ba-910d-7eeaf4f7fa9c tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Lazy-loading 'resources' on Instance uuid f4087716-c913-48db-886e-2f21d1238c66 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:31:21 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-88dfc3fc-56ac-49ba-910d-7eeaf4f7fa9c tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:27:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-758890688',display_name='tempest-TestServerVolumeAttachmentScenario-server-758890688',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-758890688',id=25,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDg4F13idmURqiWtNU+qBvKofHOBiyrWkUEpu5CygWpmgvhhgcdsZiUXe11Me9S5M51qSnDe7eFBU62NU8km2DW3eb2LAFIK5qAztxD23xiypjEvyaFKNDVOIndnRc2kRg==',key_name='tempest-keypair-5128969',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:27:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a66f472891e4aa18010200536e8f4f1',ramdisk_id='',reservation_id='r-7cu4q6wu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1243199391',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1243199391-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:27:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30a526d59c834b44b4eea04eb4141559',uuid=f4087716-c913-48db-886e-2f21d1238c66,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "357779ea-2646-4d4b-926d-b069e0ae2aa2", "address": "fa:16:3e:d9:6f:46", "network": {"id": "5b9407cc-c008-48b3-b93d-ed1ba23bcd90", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-399083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a66f472891e4aa18010200536e8f4f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap357779ea-26", "ovs_interfaceid": "357779ea-2646-4d4b-926d-b069e0ae2aa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:31:21 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-88dfc3fc-56ac-49ba-910d-7eeaf4f7fa9c tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Converting VIF {"id": "357779ea-2646-4d4b-926d-b069e0ae2aa2", "address": "fa:16:3e:d9:6f:46", "network": {"id": "5b9407cc-c008-48b3-b93d-ed1ba23bcd90", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-399083321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a66f472891e4aa18010200536e8f4f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap357779ea-26", "ovs_interfaceid": "357779ea-2646-4d4b-926d-b069e0ae2aa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:31:21 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-88dfc3fc-56ac-49ba-910d-7eeaf4f7fa9c tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:6f:46,bridge_name='br-int',has_traffic_filtering=True,id=357779ea-2646-4d4b-926d-b069e0ae2aa2,network=Network(5b9407cc-c008-48b3-b93d-ed1ba23bcd90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap357779ea-26') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:31:21 user nova-compute[72362]: DEBUG os_vif [None req-88dfc3fc-56ac-49ba-910d-7eeaf4f7fa9c tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:6f:46,bridge_name='br-int',has_traffic_filtering=True,id=357779ea-2646-4d4b-926d-b069e0ae2aa2,network=Network(5b9407cc-c008-48b3-b93d-ed1ba23bcd90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap357779ea-26') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:31:21 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:21 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap357779ea-26, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:31:21 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:21 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:21 user nova-compute[72362]: INFO os_vif [None req-88dfc3fc-56ac-49ba-910d-7eeaf4f7fa9c tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:6f:46,bridge_name='br-int',has_traffic_filtering=True,id=357779ea-2646-4d4b-926d-b069e0ae2aa2,network=Network(5b9407cc-c008-48b3-b93d-ed1ba23bcd90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap357779ea-26')
Aug 09 10:31:21 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-88dfc3fc-56ac-49ba-910d-7eeaf4f7fa9c tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] [instance: f4087716-c913-48db-886e-2f21d1238c66] Deleting instance files /opt/stack/data/nova/instances/f4087716-c913-48db-886e-2f21d1238c66_del
Aug 09 10:31:21 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-88dfc3fc-56ac-49ba-910d-7eeaf4f7fa9c tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] [instance: f4087716-c913-48db-886e-2f21d1238c66] Deletion of /opt/stack/data/nova/instances/f4087716-c913-48db-886e-2f21d1238c66_del complete
Aug 09 10:31:21 user nova-compute[72362]: INFO nova.compute.manager [None req-88dfc3fc-56ac-49ba-910d-7eeaf4f7fa9c tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] [instance: f4087716-c913-48db-886e-2f21d1238c66] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 09 10:31:21 user nova-compute[72362]: DEBUG oslo.service.loopingcall [None req-88dfc3fc-56ac-49ba-910d-7eeaf4f7fa9c tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72362) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 10:31:21 user nova-compute[72362]: DEBUG nova.compute.manager [-] [instance: f4087716-c913-48db-886e-2f21d1238c66] Deallocating network for instance {{(pid=72362) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 10:31:21 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: f4087716-c913-48db-886e-2f21d1238c66] deallocate_for_instance() {{(pid=72362) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 10:31:22 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: f4087716-c913-48db-886e-2f21d1238c66] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:31:22 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: f4087716-c913-48db-886e-2f21d1238c66] Took 0.78 seconds to deallocate network for instance.
Aug 09 10:31:22 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-88dfc3fc-56ac-49ba-910d-7eeaf4f7fa9c tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:31:22 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-88dfc3fc-56ac-49ba-910d-7eeaf4f7fa9c tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:31:22 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-88dfc3fc-56ac-49ba-910d-7eeaf4f7fa9c tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:31:22 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-88dfc3fc-56ac-49ba-910d-7eeaf4f7fa9c tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:31:22 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-88dfc3fc-56ac-49ba-910d-7eeaf4f7fa9c tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.355s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:31:22 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-88dfc3fc-56ac-49ba-910d-7eeaf4f7fa9c tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Deleted allocations for instance f4087716-c913-48db-886e-2f21d1238c66
Aug 09 10:31:22 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-88dfc3fc-56ac-49ba-910d-7eeaf4f7fa9c tempest-TestServerVolumeAttachmentScenario-1243199391 tempest-TestServerVolumeAttachmentScenario-1243199391-project-member] Lock "f4087716-c913-48db-886e-2f21d1238c66" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.195s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:31:23 user nova-compute[72362]: DEBUG nova.compute.manager [req-c84d67d0-0d23-4a18-8ae6-edc8fa113c00 req-0543a8d3-e8eb-4ed0-b06b-65a804b6e45a service nova] [instance: f4087716-c913-48db-886e-2f21d1238c66] Received event network-vif-plugged-357779ea-2646-4d4b-926d-b069e0ae2aa2 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:31:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c84d67d0-0d23-4a18-8ae6-edc8fa113c00 req-0543a8d3-e8eb-4ed0-b06b-65a804b6e45a service nova] Acquiring lock "f4087716-c913-48db-886e-2f21d1238c66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:31:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c84d67d0-0d23-4a18-8ae6-edc8fa113c00 req-0543a8d3-e8eb-4ed0-b06b-65a804b6e45a service nova] Lock "f4087716-c913-48db-886e-2f21d1238c66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:31:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c84d67d0-0d23-4a18-8ae6-edc8fa113c00 req-0543a8d3-e8eb-4ed0-b06b-65a804b6e45a service nova] Lock "f4087716-c913-48db-886e-2f21d1238c66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:31:23 user nova-compute[72362]: DEBUG nova.compute.manager [req-c84d67d0-0d23-4a18-8ae6-edc8fa113c00 req-0543a8d3-e8eb-4ed0-b06b-65a804b6e45a service nova] [instance: f4087716-c913-48db-886e-2f21d1238c66] No waiting events found dispatching network-vif-plugged-357779ea-2646-4d4b-926d-b069e0ae2aa2 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:31:23 user nova-compute[72362]: WARNING nova.compute.manager [req-c84d67d0-0d23-4a18-8ae6-edc8fa113c00 req-0543a8d3-e8eb-4ed0-b06b-65a804b6e45a service nova] [instance: f4087716-c913-48db-886e-2f21d1238c66] Received unexpected event network-vif-plugged-357779ea-2646-4d4b-926d-b069e0ae2aa2 for instance with vm_state deleted and task_state None.
Aug 09 10:31:23 user nova-compute[72362]: DEBUG nova.compute.manager [req-c84d67d0-0d23-4a18-8ae6-edc8fa113c00 req-0543a8d3-e8eb-4ed0-b06b-65a804b6e45a service nova] [instance: f4087716-c913-48db-886e-2f21d1238c66] Received event network-vif-deleted-357779ea-2646-4d4b-926d-b069e0ae2aa2 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:31:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG nova.compute.manager [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Start spawning the instance on the hypervisor. {{(pid=72362) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:31:28 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Creating image(s)
Aug 09 10:31:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Did not create local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Ensure instance console log exists: /opt/stack/data/nova/instances/f3cdf152-da86-447b-aa7c-921b6fa87ef8/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Start _get_guest_xml network_info=[{"id": "cb4bdd64-bb23-4c96-8912-377268174872", "address": "fa:16:3e:78:c7:96", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4bdd64-bb", "ovs_interfaceid": "cb4bdd64-bb23-4c96-8912-377268174872", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '349d9b4a-56a1-43d0-b9b0-128e350c18cb', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tAiBWcaz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f3cdf152-da86-447b-aa7c-921b6fa87ef8', 'attached_at': '', 'detached_at': '', 'volume_id': 'a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3', 'serial': 'a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3'}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:31:28 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:31:28 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:31:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tAiBWcaz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:31:28 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:31:28 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:31:28 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:31:28 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:31:28 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:31:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e41fc1-e1aa-44fa-8155-a88ebae84be5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:31:28 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f8ceed-f263-4468-9afe-963e2584c8d3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3] added
Aug 09 10:31:28 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c120ec49-6cf0-4650-8f7f-8ee1a30ffd4c]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e601fb-1560-4ab2-aff5-e77f5ae6261f]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tAiBWcaz {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tAiBWcaz" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6d5207-08f2-4ad8-8a24-3937f818d312]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tAiBWcaz'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b2d9c1-d742-4aed-958a-b654555fe337]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ecc2d5-720e-4cb6-b50d-303f21acb322]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:31:28 user nova-compute[72362]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:31:28 user nova-compute[72362]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)
Aug 09 10:31:28 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:31:28 user nova-compute[72362]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:31:28 user nova-compute[72362]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)
Aug 09 10:31:28 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29646b5-79ce-4d5d-be66-e69c07e95e38]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3, portal: 172.16.0.220,3260]
Aug 09 10:31:28 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3, portal: 172.16.0.220,3260] successful.
Aug 09 10:31:28 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21523f4-7adc-4d73-aaf2-3b4b3df35cd0]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4625251-a863-498b-9b7e-af0e57923323]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:31:28 user nova-compute[72362]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:31:28 user nova-compute[72362]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)
Aug 09 10:31:28 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:31:28 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:31:28 user nova-compute[72362]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:31:28 user nova-compute[72362]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)
Aug 09 10:31:28 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:31:28 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0cfabb-4490-4112-8b14-b51b13259ae1]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:31:28 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tAiBWcaz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:31:29 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:31:29 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23566316431643836', 'path': '/dev/sdb'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:31:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566316431643836', 'path': '/dev/sdb'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:31:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:30:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2124446381',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2124446381',id=32,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f206cedc59df46deb91e7ec2167c1f2b',ramdisk_id='',reservation_id='r-fmo0v4k0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1706340435',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:30:58Z,user_data=None,user_id='4a1904ffd10b4e8b959971b5e2383113',uuid=f3cdf152-da86-447b-aa7c-921b6fa87ef8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb4bdd64-bb23-4c96-8912-377268174872", "address": "fa:16:3e:78:c7:96", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4bdd64-bb", "ovs_interfaceid": "cb4bdd64-bb23-4c96-8912-377268174872", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:31:29 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Converting VIF {"id": "cb4bdd64-bb23-4c96-8912-377268174872", "address": "fa:16:3e:78:c7:96", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4bdd64-bb", "ovs_interfaceid": "cb4bdd64-bb23-4c96-8912-377268174872", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:31:29 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:c7:96,bridge_name='br-int',has_traffic_filtering=True,id=cb4bdd64-bb23-4c96-8912-377268174872,network=Network(bb852331-57aa-4911-b8ff-30f5411f65b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb4bdd64-bb') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:31:29 user nova-compute[72362]: DEBUG nova.objects.instance [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lazy-loading 'pci_devices' on Instance uuid f3cdf152-da86-447b-aa7c-921b6fa87ef8 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:31:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:31:29 user nova-compute[72362]:   <uuid>f3cdf152-da86-447b-aa7c-921b6fa87ef8</uuid>
Aug 09 10:31:29 user nova-compute[72362]:   <name>instance-00000020</name>
Aug 09 10:31:29 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:31:29 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:31:29 user nova-compute[72362]:   <metadata>
Aug 09 10:31:29 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:31:29 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:31:29 user nova-compute[72362]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2124446381</nova:name>
Aug 09 10:31:29 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:31:28</nova:creationTime>
Aug 09 10:31:29 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:31:29 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:31:29 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:31:29 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:31:29 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:31:29 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:31:29 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:31:29 user nova-compute[72362]:       <nova:owner>
Aug 09 10:31:29 user nova-compute[72362]:         <nova:user uuid="4a1904ffd10b4e8b959971b5e2383113">tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member</nova:user>
Aug 09 10:31:29 user nova-compute[72362]:         <nova:project uuid="f206cedc59df46deb91e7ec2167c1f2b">tempest-ServerBootFromVolumeStableRescueTest-1706340435</nova:project>
Aug 09 10:31:29 user nova-compute[72362]:       </nova:owner>
Aug 09 10:31:29 user nova-compute[72362]:       <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:31:29 user nova-compute[72362]:       <nova:ports>
Aug 09 10:31:29 user nova-compute[72362]:         <nova:port uuid="cb4bdd64-bb23-4c96-8912-377268174872">
Aug 09 10:31:29 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 10:31:29 user nova-compute[72362]:         </nova:port>
Aug 09 10:31:29 user nova-compute[72362]:       </nova:ports>
Aug 09 10:31:29 user nova-compute[72362]:     </nova:instance>
Aug 09 10:31:29 user nova-compute[72362]:   </metadata>
Aug 09 10:31:29 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:31:29 user nova-compute[72362]:     <system>
Aug 09 10:31:29 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:31:29 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:31:29 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:31:29 user nova-compute[72362]:       <entry name="serial">f3cdf152-da86-447b-aa7c-921b6fa87ef8</entry>
Aug 09 10:31:29 user nova-compute[72362]:       <entry name="uuid">f3cdf152-da86-447b-aa7c-921b6fa87ef8</entry>
Aug 09 10:31:29 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:31:29 user nova-compute[72362]:     </system>
Aug 09 10:31:29 user nova-compute[72362]:   </sysinfo>
Aug 09 10:31:29 user nova-compute[72362]:   <os>
Aug 09 10:31:29 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:31:29 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:31:29 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:31:29 user nova-compute[72362]:   </os>
Aug 09 10:31:29 user nova-compute[72362]:   <features>
Aug 09 10:31:29 user nova-compute[72362]:     <acpi/>
Aug 09 10:31:29 user nova-compute[72362]:     <apic/>
Aug 09 10:31:29 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:31:29 user nova-compute[72362]:   </features>
Aug 09 10:31:29 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:31:29 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:31:29 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:31:29 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:31:29 user nova-compute[72362]:   </clock>
Aug 09 10:31:29 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:31:29 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:31:29 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:31:29 user nova-compute[72362]:   </cpu>
Aug 09 10:31:29 user nova-compute[72362]:   <devices>
Aug 09 10:31:29 user nova-compute[72362]:     <disk type="block" device="disk">
Aug 09 10:31:29 user nova-compute[72362]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:31:29 user nova-compute[72362]:       <source dev="/dev/sdb"/>
Aug 09 10:31:29 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:31:29 user nova-compute[72362]:       <serial>a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3</serial>
Aug 09 10:31:29 user nova-compute[72362]:     </disk>
Aug 09 10:31:29 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:31:29 user nova-compute[72362]:       <mac address="fa:16:3e:78:c7:96"/>
Aug 09 10:31:29 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:31:29 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:31:29 user nova-compute[72362]:       <target dev="tapcb4bdd64-bb"/>
Aug 09 10:31:29 user nova-compute[72362]:     </interface>
Aug 09 10:31:29 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:31:29 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/f3cdf152-da86-447b-aa7c-921b6fa87ef8/console.log" append="off"/>
Aug 09 10:31:29 user nova-compute[72362]:     </serial>
Aug 09 10:31:29 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:31:29 user nova-compute[72362]:     <video>
Aug 09 10:31:29 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:31:29 user nova-compute[72362]:     </video>
Aug 09 10:31:29 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:31:29 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:31:29 user nova-compute[72362]:     </rng>
Aug 09 10:31:29 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:31:29 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:31:29 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:31:29 user nova-compute[72362]:     </memballoon>
Aug 09 10:31:29 user nova-compute[72362]:   </devices>
Aug 09 10:31:29 user nova-compute[72362]: </domain>
Aug 09 10:31:29 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:31:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:30:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2124446381',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2124446381',id=32,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f206cedc59df46deb91e7ec2167c1f2b',ramdisk_id='',reservation_id='r-fmo0v4k0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1706340435',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:30:58Z,user_data=None,user_id='4a1904ffd10b4e8b959971b5e2383113',uuid=f3cdf152-da86-447b-aa7c-921b6fa87ef8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb4bdd64-bb23-4c96-8912-377268174872", "address": "fa:16:3e:78:c7:96", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4bdd64-bb", "ovs_interfaceid": "cb4bdd64-bb23-4c96-8912-377268174872", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:31:29 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Converting VIF {"id": "cb4bdd64-bb23-4c96-8912-377268174872", "address": "fa:16:3e:78:c7:96", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4bdd64-bb", "ovs_interfaceid": "cb4bdd64-bb23-4c96-8912-377268174872", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:31:29 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:c7:96,bridge_name='br-int',has_traffic_filtering=True,id=cb4bdd64-bb23-4c96-8912-377268174872,network=Network(bb852331-57aa-4911-b8ff-30f5411f65b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb4bdd64-bb') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:31:29 user nova-compute[72362]: DEBUG os_vif [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:c7:96,bridge_name='br-int',has_traffic_filtering=True,id=cb4bdd64-bb23-4c96-8912-377268174872,network=Network(bb852331-57aa-4911-b8ff-30f5411f65b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb4bdd64-bb') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:31:29 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:29 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:31:29 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:31:29 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:29 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb4bdd64-bb, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:31:29 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcb4bdd64-bb, col_values=(('external_ids', {'iface-id': 'cb4bdd64-bb23-4c96-8912-377268174872', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:c7:96', 'vm-uuid': 'f3cdf152-da86-447b-aa7c-921b6fa87ef8'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:31:29 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:29 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:31:29 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:29 user nova-compute[72362]: INFO os_vif [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:c7:96,bridge_name='br-int',has_traffic_filtering=True,id=cb4bdd64-bb23-4c96-8912-377268174872,network=Network(bb852331-57aa-4911-b8ff-30f5411f65b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb4bdd64-bb')
Aug 09 10:31:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:31:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] No VIF found with MAC fa:16:3e:78:c7:96, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:31:29 user nova-compute[72362]: DEBUG nova.compute.manager [req-58962fda-5126-4417-a55b-a8f73e166a28 req-598d89c6-8af1-454f-96c5-37cea3d627f9 service nova] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Received event network-changed-9735e8ce-a2bd-49c8-adcf-846c05b7427e {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:31:29 user nova-compute[72362]: DEBUG nova.compute.manager [req-58962fda-5126-4417-a55b-a8f73e166a28 req-598d89c6-8af1-454f-96c5-37cea3d627f9 service nova] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Refreshing instance network info cache due to event network-changed-9735e8ce-a2bd-49c8-adcf-846c05b7427e. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:31:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-58962fda-5126-4417-a55b-a8f73e166a28 req-598d89c6-8af1-454f-96c5-37cea3d627f9 service nova] Acquiring lock "refresh_cache-3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:31:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-58962fda-5126-4417-a55b-a8f73e166a28 req-598d89c6-8af1-454f-96c5-37cea3d627f9 service nova] Acquired lock "refresh_cache-3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:31:29 user nova-compute[72362]: DEBUG nova.network.neutron [req-58962fda-5126-4417-a55b-a8f73e166a28 req-598d89c6-8af1-454f-96c5-37cea3d627f9 service nova] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Refreshing network info cache for port 9735e8ce-a2bd-49c8-adcf-846c05b7427e {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:31:30 user nova-compute[72362]: DEBUG nova.network.neutron [req-58962fda-5126-4417-a55b-a8f73e166a28 req-598d89c6-8af1-454f-96c5-37cea3d627f9 service nova] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Updated VIF entry in instance network info cache for port 9735e8ce-a2bd-49c8-adcf-846c05b7427e. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:31:30 user nova-compute[72362]: DEBUG nova.network.neutron [req-58962fda-5126-4417-a55b-a8f73e166a28 req-598d89c6-8af1-454f-96c5-37cea3d627f9 service nova] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Updating instance_info_cache with network_info: [{"id": "9735e8ce-a2bd-49c8-adcf-846c05b7427e", "address": "fa:16:3e:91:34:e3", "network": {"id": "e6c54663-74e3-43e2-8f0d-61b300c1f68d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1222286883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ac22022944542c0b52dd912d3dbcce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9735e8ce-a2", "ovs_interfaceid": "9735e8ce-a2bd-49c8-adcf-846c05b7427e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:31:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-58962fda-5126-4417-a55b-a8f73e166a28 req-598d89c6-8af1-454f-96c5-37cea3d627f9 service nova] Releasing lock "refresh_cache-3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:31:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:31 user nova-compute[72362]: DEBUG nova.compute.manager [req-cc9e4eda-0deb-4824-aa47-63df56a518cf req-943432a3-de45-4f24-a1ab-480ef7baada2 service nova] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Received event network-vif-plugged-cb4bdd64-bb23-4c96-8912-377268174872 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:31:31 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-cc9e4eda-0deb-4824-aa47-63df56a518cf req-943432a3-de45-4f24-a1ab-480ef7baada2 service nova] Acquiring lock "f3cdf152-da86-447b-aa7c-921b6fa87ef8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:31:31 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-cc9e4eda-0deb-4824-aa47-63df56a518cf req-943432a3-de45-4f24-a1ab-480ef7baada2 service nova] Lock "f3cdf152-da86-447b-aa7c-921b6fa87ef8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:31:31 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-cc9e4eda-0deb-4824-aa47-63df56a518cf req-943432a3-de45-4f24-a1ab-480ef7baada2 service nova] Lock "f3cdf152-da86-447b-aa7c-921b6fa87ef8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:31:31 user nova-compute[72362]: DEBUG nova.compute.manager [req-cc9e4eda-0deb-4824-aa47-63df56a518cf req-943432a3-de45-4f24-a1ab-480ef7baada2 service nova] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] No waiting events found dispatching network-vif-plugged-cb4bdd64-bb23-4c96-8912-377268174872 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:31:31 user nova-compute[72362]: WARNING nova.compute.manager [req-cc9e4eda-0deb-4824-aa47-63df56a518cf req-943432a3-de45-4f24-a1ab-480ef7baada2 service nova] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Received unexpected event network-vif-plugged-cb4bdd64-bb23-4c96-8912-377268174872 for instance with vm_state building and task_state spawning.
Aug 09 10:31:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:31 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-bc8dacff-bd16-4c61-90fb-8955375dcb74 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Acquiring lock "94353851-e6a8-404b-b295-d539b2469d47" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:31:31 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-bc8dacff-bd16-4c61-90fb-8955375dcb74 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Lock "94353851-e6a8-404b-b295-d539b2469d47" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:31:31 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-bc8dacff-bd16-4c61-90fb-8955375dcb74 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Acquiring lock "94353851-e6a8-404b-b295-d539b2469d47-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:31:31 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-bc8dacff-bd16-4c61-90fb-8955375dcb74 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Lock "94353851-e6a8-404b-b295-d539b2469d47-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.003s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:31:31 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-bc8dacff-bd16-4c61-90fb-8955375dcb74 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Lock "94353851-e6a8-404b-b295-d539b2469d47-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:31:31 user nova-compute[72362]: INFO nova.compute.manager [None req-bc8dacff-bd16-4c61-90fb-8955375dcb74 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Terminating instance
Aug 09 10:31:31 user nova-compute[72362]: DEBUG nova.compute.manager [None req-bc8dacff-bd16-4c61-90fb-8955375dcb74 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Start destroying the instance on the hypervisor. {{(pid=72362) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 10:31:31 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691577076.676774, a6000393-6044-4b54-ac0b-1d631e2ed0ae => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:31:31 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] VM Stopped (Lifecycle Event)
Aug 09 10:31:31 user nova-compute[72362]: DEBUG nova.compute.manager [None req-cdc9ab45-2053-498e-9ef8-3afd27482a1f None None] [instance: a6000393-6044-4b54-ac0b-1d631e2ed0ae] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:31:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:31 user nova-compute[72362]: DEBUG nova.compute.manager [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Stashing vm_state: active {{(pid=72362) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 09 10:31:31 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:31:31 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:31:31 user nova-compute[72362]: DEBUG nova.objects.instance [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lazy-loading 'pci_requests' on Instance uuid 4b22a19f-300c-42fb-8175-e737eef7d531 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:31:31 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:31:31 user nova-compute[72362]: INFO nova.compute.claims [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Claim successful on node user
Aug 09 10:31:31 user nova-compute[72362]: DEBUG nova.objects.instance [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lazy-loading 'resources' on Instance uuid 4b22a19f-300c-42fb-8175-e737eef7d531 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:31:32 user nova-compute[72362]: DEBUG nova.objects.instance [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b22a19f-300c-42fb-8175-e737eef7d531 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:31:32 user nova-compute[72362]: DEBUG nova.compute.manager [req-e2968fb5-5e60-4cae-848c-a680e05784bb req-1cccda6f-640f-42cc-b108-a564fc2b2048 service nova] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Received event network-changed-0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:31:32 user nova-compute[72362]: DEBUG nova.compute.manager [req-e2968fb5-5e60-4cae-848c-a680e05784bb req-1cccda6f-640f-42cc-b108-a564fc2b2048 service nova] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Refreshing instance network info cache due to event network-changed-0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:31:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e2968fb5-5e60-4cae-848c-a680e05784bb req-1cccda6f-640f-42cc-b108-a564fc2b2048 service nova] Acquiring lock "refresh_cache-4b22a19f-300c-42fb-8175-e737eef7d531" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:31:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e2968fb5-5e60-4cae-848c-a680e05784bb req-1cccda6f-640f-42cc-b108-a564fc2b2048 service nova] Acquired lock "refresh_cache-4b22a19f-300c-42fb-8175-e737eef7d531" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:31:32 user nova-compute[72362]: DEBUG nova.network.neutron [req-e2968fb5-5e60-4cae-848c-a680e05784bb req-1cccda6f-640f-42cc-b108-a564fc2b2048 service nova] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Refreshing network info cache for port 0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:31:32 user nova-compute[72362]: INFO nova.compute.resource_tracker [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Updating resource usage from migration 923fa5eb-be1a-447b-a6b8-eee245a0e028
Aug 09 10:31:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:32 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Instance destroyed successfully.
Aug 09 10:31:32 user nova-compute[72362]: DEBUG nova.objects.instance [None req-bc8dacff-bd16-4c61-90fb-8955375dcb74 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Lazy-loading 'resources' on Instance uuid 94353851-e6a8-404b-b295-d539b2469d47 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:31:32 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:31:32 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:31:32 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-bc8dacff-bd16-4c61-90fb-8955375dcb74 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:28:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1699619469',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1699619469',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1699619',id=28,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJpiSLpbiQYD1SfunFU/GBvTdT5AnjKSLVNUh2l5Y4pV+NviHkBRzWru0VxImeKx4nFnEbdHyi96oSQe2CsXetCO1u0wHje0JeQyfXV1iOq5Tevaa3yDHYQMHnzbwWsLw==',key_name='tempest-keypair-634249765',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:28:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc168485d7424eb68b10725588022a8d',ramdisk_id='',reservation_id='r-kczemg2x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1177254404',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:28:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6299d4ac974c477e92914e677654f0f9',uuid=94353851-e6a8-404b-b295-d539b2469d47,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63863234-78a1-41d7-8bd0-ee5d0657d86b", "address": "fa:16:3e:d8:02:57", "network": {"id": "a5d87bf9-d44f-41f5-982b-a65355683bed", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1108251458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc168485d7424eb68b10725588022a8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63863234-78", "ovs_interfaceid": "63863234-78a1-41d7-8bd0-ee5d0657d86b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:31:32 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-bc8dacff-bd16-4c61-90fb-8955375dcb74 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Converting VIF {"id": "63863234-78a1-41d7-8bd0-ee5d0657d86b", "address": "fa:16:3e:d8:02:57", "network": {"id": "a5d87bf9-d44f-41f5-982b-a65355683bed", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1108251458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc168485d7424eb68b10725588022a8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63863234-78", "ovs_interfaceid": "63863234-78a1-41d7-8bd0-ee5d0657d86b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:31:32 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-bc8dacff-bd16-4c61-90fb-8955375dcb74 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:02:57,bridge_name='br-int',has_traffic_filtering=True,id=63863234-78a1-41d7-8bd0-ee5d0657d86b,network=Network(a5d87bf9-d44f-41f5-982b-a65355683bed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63863234-78') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:31:32 user nova-compute[72362]: DEBUG os_vif [None req-bc8dacff-bd16-4c61-90fb-8955375dcb74 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:02:57,bridge_name='br-int',has_traffic_filtering=True,id=63863234-78a1-41d7-8bd0-ee5d0657d86b,network=Network(a5d87bf9-d44f-41f5-982b-a65355683bed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63863234-78') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:31:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap63863234-78, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:31:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:31:32 user nova-compute[72362]: INFO os_vif [None req-bc8dacff-bd16-4c61-90fb-8955375dcb74 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:02:57,bridge_name='br-int',has_traffic_filtering=True,id=63863234-78a1-41d7-8bd0-ee5d0657d86b,network=Network(a5d87bf9-d44f-41f5-982b-a65355683bed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63863234-78')
Aug 09 10:31:32 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-bc8dacff-bd16-4c61-90fb-8955375dcb74 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Deleting instance files /opt/stack/data/nova/instances/94353851-e6a8-404b-b295-d539b2469d47_del
Aug 09 10:31:32 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-bc8dacff-bd16-4c61-90fb-8955375dcb74 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Deletion of /opt/stack/data/nova/instances/94353851-e6a8-404b-b295-d539b2469d47_del complete
Aug 09 10:31:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.577s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:31:32 user nova-compute[72362]: INFO nova.compute.manager [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Migrating
Aug 09 10:31:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Acquiring lock "refresh_cache-4b22a19f-300c-42fb-8175-e737eef7d531" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:31:32 user nova-compute[72362]: INFO nova.compute.manager [None req-bc8dacff-bd16-4c61-90fb-8955375dcb74 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 09 10:31:32 user nova-compute[72362]: DEBUG oslo.service.loopingcall [None req-bc8dacff-bd16-4c61-90fb-8955375dcb74 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72362) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 10:31:32 user nova-compute[72362]: DEBUG nova.compute.manager [-] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Deallocating network for instance {{(pid=72362) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 10:31:32 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 94353851-e6a8-404b-b295-d539b2469d47] deallocate_for_instance() {{(pid=72362) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 10:31:33 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:33 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:33 user nova-compute[72362]: DEBUG nova.compute.manager [req-0f03e7bd-e0d2-4d0d-84c5-27fd256dbc64 req-81a03c76-d90f-4bc9-bc14-bd8027b94117 service nova] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Received event network-vif-plugged-cb4bdd64-bb23-4c96-8912-377268174872 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:31:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-0f03e7bd-e0d2-4d0d-84c5-27fd256dbc64 req-81a03c76-d90f-4bc9-bc14-bd8027b94117 service nova] Acquiring lock "f3cdf152-da86-447b-aa7c-921b6fa87ef8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:31:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-0f03e7bd-e0d2-4d0d-84c5-27fd256dbc64 req-81a03c76-d90f-4bc9-bc14-bd8027b94117 service nova] Lock "f3cdf152-da86-447b-aa7c-921b6fa87ef8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:31:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-0f03e7bd-e0d2-4d0d-84c5-27fd256dbc64 req-81a03c76-d90f-4bc9-bc14-bd8027b94117 service nova] Lock "f3cdf152-da86-447b-aa7c-921b6fa87ef8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:31:33 user nova-compute[72362]: DEBUG nova.compute.manager [req-0f03e7bd-e0d2-4d0d-84c5-27fd256dbc64 req-81a03c76-d90f-4bc9-bc14-bd8027b94117 service nova] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] No waiting events found dispatching network-vif-plugged-cb4bdd64-bb23-4c96-8912-377268174872 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:31:33 user nova-compute[72362]: WARNING nova.compute.manager [req-0f03e7bd-e0d2-4d0d-84c5-27fd256dbc64 req-81a03c76-d90f-4bc9-bc14-bd8027b94117 service nova] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Received unexpected event network-vif-plugged-cb4bdd64-bb23-4c96-8912-377268174872 for instance with vm_state building and task_state spawning.
Aug 09 10:31:33 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:33 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:33 user nova-compute[72362]: DEBUG nova.compute.manager [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:31:33 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:31:33 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577093.268446, f3cdf152-da86-447b-aa7c-921b6fa87ef8 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:31:33 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] VM Resumed (Lifecycle Event)
Aug 09 10:31:33 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:31:33 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Instance spawned successfully.
Aug 09 10:31:33 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 10:31:33 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:31:33 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Found default for hw_cdrom_bus of ide {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:31:33 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Found default for hw_disk_bus of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:31:33 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:31:33 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:31:33 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Found default for hw_video_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:31:33 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Found default for hw_vif_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:31:33 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:31:33 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577093.2686622, f3cdf152-da86-447b-aa7c-921b6fa87ef8 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:31:33 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] VM Started (Lifecycle Event)
Aug 09 10:31:33 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:31:33 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:31:33 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:31:33 user nova-compute[72362]: INFO nova.compute.manager [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Took 5.35 seconds to spawn the instance on the hypervisor.
Aug 09 10:31:33 user nova-compute[72362]: DEBUG nova.compute.manager [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:31:33 user nova-compute[72362]: INFO nova.compute.manager [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Took 35.81 seconds to build instance.
Aug 09 10:31:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e1ba263c-3b56-4eae-9365-ad866a38b023 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "f3cdf152-da86-447b-aa7c-921b6fa87ef8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 35.895s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:31:33 user nova-compute[72362]: DEBUG nova.network.neutron [req-e2968fb5-5e60-4cae-848c-a680e05784bb req-1cccda6f-640f-42cc-b108-a564fc2b2048 service nova] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Updated VIF entry in instance network info cache for port 0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:31:33 user nova-compute[72362]: DEBUG nova.network.neutron [req-e2968fb5-5e60-4cae-848c-a680e05784bb req-1cccda6f-640f-42cc-b108-a564fc2b2048 service nova] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Updating instance_info_cache with network_info: [{"id": "0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa", "address": "fa:16:3e:39:ad:fb", "network": {"id": "e6c54663-74e3-43e2-8f0d-61b300c1f68d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1222286883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ac22022944542c0b52dd912d3dbcce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0942f4eb-e7", "ovs_interfaceid": "0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:31:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e2968fb5-5e60-4cae-848c-a680e05784bb req-1cccda6f-640f-42cc-b108-a564fc2b2048 service nova] Releasing lock "refresh_cache-4b22a19f-300c-42fb-8175-e737eef7d531" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:31:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Acquired lock "refresh_cache-4b22a19f-300c-42fb-8175-e737eef7d531" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:31:33 user nova-compute[72362]: DEBUG nova.network.neutron [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:31:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Acquiring lock "5502750a-6b11-4600-9363-a814a12573d2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:31:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "5502750a-6b11-4600-9363-a814a12573d2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:31:33 user nova-compute[72362]: DEBUG nova.compute.manager [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Starting instance... {{(pid=72362) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 10:31:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:31:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:31:33 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:31:33 user nova-compute[72362]: INFO nova.compute.claims [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Claim successful on node user
Aug 09 10:31:34 user nova-compute[72362]: DEBUG nova.compute.manager [req-64027fd8-4f7b-43a2-b1e5-767bdb3bbf61 req-72d23ea6-0ce0-417b-9152-2e3127c11695 service nova] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Received event network-vif-unplugged-63863234-78a1-41d7-8bd0-ee5d0657d86b {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:31:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-64027fd8-4f7b-43a2-b1e5-767bdb3bbf61 req-72d23ea6-0ce0-417b-9152-2e3127c11695 service nova] Acquiring lock "94353851-e6a8-404b-b295-d539b2469d47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:31:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-64027fd8-4f7b-43a2-b1e5-767bdb3bbf61 req-72d23ea6-0ce0-417b-9152-2e3127c11695 service nova] Lock "94353851-e6a8-404b-b295-d539b2469d47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:31:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-64027fd8-4f7b-43a2-b1e5-767bdb3bbf61 req-72d23ea6-0ce0-417b-9152-2e3127c11695 service nova] Lock "94353851-e6a8-404b-b295-d539b2469d47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:31:34 user nova-compute[72362]: DEBUG nova.compute.manager [req-64027fd8-4f7b-43a2-b1e5-767bdb3bbf61 req-72d23ea6-0ce0-417b-9152-2e3127c11695 service nova] [instance: 94353851-e6a8-404b-b295-d539b2469d47] No waiting events found dispatching network-vif-unplugged-63863234-78a1-41d7-8bd0-ee5d0657d86b {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:31:34 user nova-compute[72362]: DEBUG nova.compute.manager [req-64027fd8-4f7b-43a2-b1e5-767bdb3bbf61 req-72d23ea6-0ce0-417b-9152-2e3127c11695 service nova] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Received event network-vif-unplugged-63863234-78a1-41d7-8bd0-ee5d0657d86b for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:31:34 user nova-compute[72362]: DEBUG nova.compute.manager [req-64027fd8-4f7b-43a2-b1e5-767bdb3bbf61 req-72d23ea6-0ce0-417b-9152-2e3127c11695 service nova] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Received event network-vif-plugged-63863234-78a1-41d7-8bd0-ee5d0657d86b {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:31:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-64027fd8-4f7b-43a2-b1e5-767bdb3bbf61 req-72d23ea6-0ce0-417b-9152-2e3127c11695 service nova] Acquiring lock "94353851-e6a8-404b-b295-d539b2469d47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:31:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-64027fd8-4f7b-43a2-b1e5-767bdb3bbf61 req-72d23ea6-0ce0-417b-9152-2e3127c11695 service nova] Lock "94353851-e6a8-404b-b295-d539b2469d47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:31:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-64027fd8-4f7b-43a2-b1e5-767bdb3bbf61 req-72d23ea6-0ce0-417b-9152-2e3127c11695 service nova] Lock "94353851-e6a8-404b-b295-d539b2469d47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:31:34 user nova-compute[72362]: DEBUG nova.compute.manager [req-64027fd8-4f7b-43a2-b1e5-767bdb3bbf61 req-72d23ea6-0ce0-417b-9152-2e3127c11695 service nova] [instance: 94353851-e6a8-404b-b295-d539b2469d47] No waiting events found dispatching network-vif-plugged-63863234-78a1-41d7-8bd0-ee5d0657d86b {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:31:34 user nova-compute[72362]: WARNING nova.compute.manager [req-64027fd8-4f7b-43a2-b1e5-767bdb3bbf61 req-72d23ea6-0ce0-417b-9152-2e3127c11695 service nova] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Received unexpected event network-vif-plugged-63863234-78a1-41d7-8bd0-ee5d0657d86b for instance with vm_state active and task_state deleting.
Aug 09 10:31:34 user nova-compute[72362]: DEBUG nova.compute.manager [req-64027fd8-4f7b-43a2-b1e5-767bdb3bbf61 req-72d23ea6-0ce0-417b-9152-2e3127c11695 service nova] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Received event network-vif-plugged-63863234-78a1-41d7-8bd0-ee5d0657d86b {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:31:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-64027fd8-4f7b-43a2-b1e5-767bdb3bbf61 req-72d23ea6-0ce0-417b-9152-2e3127c11695 service nova] Acquiring lock "94353851-e6a8-404b-b295-d539b2469d47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:31:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-64027fd8-4f7b-43a2-b1e5-767bdb3bbf61 req-72d23ea6-0ce0-417b-9152-2e3127c11695 service nova] Lock "94353851-e6a8-404b-b295-d539b2469d47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:31:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-64027fd8-4f7b-43a2-b1e5-767bdb3bbf61 req-72d23ea6-0ce0-417b-9152-2e3127c11695 service nova] Lock "94353851-e6a8-404b-b295-d539b2469d47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:31:34 user nova-compute[72362]: DEBUG nova.compute.manager [req-64027fd8-4f7b-43a2-b1e5-767bdb3bbf61 req-72d23ea6-0ce0-417b-9152-2e3127c11695 service nova] [instance: 94353851-e6a8-404b-b295-d539b2469d47] No waiting events found dispatching network-vif-plugged-63863234-78a1-41d7-8bd0-ee5d0657d86b {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:31:34 user nova-compute[72362]: WARNING nova.compute.manager [req-64027fd8-4f7b-43a2-b1e5-767bdb3bbf61 req-72d23ea6-0ce0-417b-9152-2e3127c11695 service nova] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Received unexpected event network-vif-plugged-63863234-78a1-41d7-8bd0-ee5d0657d86b for instance with vm_state active and task_state deleting.
Aug 09 10:31:34 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:31:34 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:31:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.665s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:31:34 user nova-compute[72362]: DEBUG nova.compute.manager [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Start building networks asynchronously for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 10:31:34 user nova-compute[72362]: DEBUG nova.compute.manager [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Allocating IP information in the background. {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 10:31:34 user nova-compute[72362]: DEBUG nova.network.neutron [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 5502750a-6b11-4600-9363-a814a12573d2] allocate_for_instance() {{(pid=72362) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 10:31:34 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 10:31:34 user nova-compute[72362]: DEBUG nova.compute.manager [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Start building block device mappings for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 10:31:34 user nova-compute[72362]: DEBUG nova.network.neutron [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Updating instance_info_cache with network_info: [{"id": "0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa", "address": "fa:16:3e:39:ad:fb", "network": {"id": "e6c54663-74e3-43e2-8f0d-61b300c1f68d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1222286883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ac22022944542c0b52dd912d3dbcce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0942f4eb-e7", "ovs_interfaceid": "0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:31:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Releasing lock "refresh_cache-4b22a19f-300c-42fb-8175-e737eef7d531" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:31:34 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:31:34 user nova-compute[72362]: DEBUG nova.policy [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '755ef9806a264f15bb80d2cd5db55d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc046adc7984378983895400e2b5e04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72362) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 10:31:34 user nova-compute[72362]: DEBUG nova.compute.manager [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Start spawning the instance on the hypervisor. {{(pid=72362) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 10:31:34 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:31:34 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Creating image(s)
Aug 09 10:31:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Acquiring lock "/opt/stack/data/nova/instances/5502750a-6b11-4600-9363-a814a12573d2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:31:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "/opt/stack/data/nova/instances/5502750a-6b11-4600-9363-a814a12573d2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:31:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "/opt/stack/data/nova/instances/5502750a-6b11-4600-9363-a814a12573d2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:31:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:34 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Took 2.33 seconds to deallocate network for instance.
Aug 09 10:31:35 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Starting migrate_disk_and_power_off {{(pid=72362) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 09 10:31:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-bc8dacff-bd16-4c61-90fb-8955375dcb74 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:31:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-bc8dacff-bd16-4c61-90fb-8955375dcb74 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:31:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.164s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Acquiring lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:31:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:31:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:35 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.197s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/5502750a-6b11-4600-9363-a814a12573d2/disk 1073741824 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/5502750a-6b11-4600-9363-a814a12573d2/disk 1073741824" returned: 0 in 0.101s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.303s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:31:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:35 user nova-compute[72362]: DEBUG nova.compute.manager [req-bf507481-e472-462e-8720-6387600819ff req-5232959b-e0c1-4026-9c04-33c429775eb1 service nova] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Received event network-vif-unplugged-0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:31:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-bf507481-e472-462e-8720-6387600819ff req-5232959b-e0c1-4026-9c04-33c429775eb1 service nova] Acquiring lock "4b22a19f-300c-42fb-8175-e737eef7d531-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:31:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-bf507481-e472-462e-8720-6387600819ff req-5232959b-e0c1-4026-9c04-33c429775eb1 service nova] Lock "4b22a19f-300c-42fb-8175-e737eef7d531-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:31:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-bf507481-e472-462e-8720-6387600819ff req-5232959b-e0c1-4026-9c04-33c429775eb1 service nova] Lock "4b22a19f-300c-42fb-8175-e737eef7d531-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:31:35 user nova-compute[72362]: DEBUG nova.compute.manager [req-bf507481-e472-462e-8720-6387600819ff req-5232959b-e0c1-4026-9c04-33c429775eb1 service nova] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] No waiting events found dispatching network-vif-unplugged-0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:31:35 user nova-compute[72362]: WARNING nova.compute.manager [req-bf507481-e472-462e-8720-6387600819ff req-5232959b-e0c1-4026-9c04-33c429775eb1 service nova] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Received unexpected event network-vif-unplugged-0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa for instance with vm_state active and task_state resize_migrating.
Aug 09 10:31:35 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:35 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.175s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:35 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5502750a-6b11-4600-9363-a814a12573d2/disk. size=1073741824 {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 10:31:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5502750a-6b11-4600-9363-a814a12573d2/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5502750a-6b11-4600-9363-a814a12573d2/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:35 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Cannot resize image /opt/stack/data/nova/instances/5502750a-6b11-4600-9363-a814a12573d2/disk to a smaller size. {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 10:31:35 user nova-compute[72362]: DEBUG nova.objects.instance [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lazy-loading 'migration_context' on Instance uuid 5502750a-6b11-4600-9363-a814a12573d2 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:31:35 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-bc8dacff-bd16-4c61-90fb-8955375dcb74 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:31:35 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Created local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 10:31:35 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Ensure instance console log exists: /opt/stack/data/nova/instances/5502750a-6b11-4600-9363-a814a12573d2/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:31:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:31:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:31:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:31:35 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-bc8dacff-bd16-4c61-90fb-8955375dcb74 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:31:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-bc8dacff-bd16-4c61-90fb-8955375dcb74 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.751s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:31:35 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-bc8dacff-bd16-4c61-90fb-8955375dcb74 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Deleted allocations for instance 94353851-e6a8-404b-b295-d539b2469d47
Aug 09 10:31:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-bc8dacff-bd16-4c61-90fb-8955375dcb74 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404 tempest-TestServerVolumeAttachScenarioOldVersion-1177254404-project-member] Lock "94353851-e6a8-404b-b295-d539b2469d47" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.357s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:31:36 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Instance destroyed successfully.
Aug 09 10:31:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:29:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1888482065',display_name='tempest-ServerActionsTestOtherA-server-1888482065',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1888482065',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwSFF251eQti/qkoXtJtG/hsB95elMyv8iaeRUjgcdf3ZQpb25r9rbEB2fGNjqP3pvOqQxJNR/NqVUD62omNMx/akMv5+i7VAu1R/GqhP2vqtVAvdiRNee4z2ROG7Jd8w==',key_name='tempest-keypair-122703468',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:29:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8ac22022944542c0b52dd912d3dbcce2',ramdisk_id='',reservation_id='r-08r15keq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2101881579',owner_user_name='tempest-ServerActionsTestOtherA-2101881579-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:31:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='990e2d160fdc4c599cee9f65d6d4e41d',uuid=4b22a19f-300c-42fb-8175-e737eef7d531,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa", "address": "fa:16:3e:39:ad:fb", "network": {"id": "e6c54663-74e3-43e2-8f0d-61b300c1f68d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1222286883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1222286883-network", "vif_mac": "fa:16:3e:39:ad:fb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ac22022944542c0b52dd912d3dbcce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0942f4eb-e7", "ovs_interfaceid": "0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Converting VIF {"id": "0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa", "address": "fa:16:3e:39:ad:fb", "network": {"id": "e6c54663-74e3-43e2-8f0d-61b300c1f68d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1222286883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1222286883-network", "vif_mac": "fa:16:3e:39:ad:fb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ac22022944542c0b52dd912d3dbcce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0942f4eb-e7", "ovs_interfaceid": "0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:ad:fb,bridge_name='br-int',has_traffic_filtering=True,id=0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa,network=Network(e6c54663-74e3-43e2-8f0d-61b300c1f68d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0942f4eb-e7') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG os_vif [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:ad:fb,bridge_name='br-int',has_traffic_filtering=True,id=0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa,network=Network(e6c54663-74e3-43e2-8f0d-61b300c1f68d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0942f4eb-e7') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0942f4eb-e7, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:31:36 user nova-compute[72362]: INFO os_vif [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:ad:fb,bridge_name='br-int',has_traffic_filtering=True,id=0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa,network=Network(e6c54663-74e3-43e2-8f0d-61b300c1f68d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0942f4eb-e7')
Aug 09 10:31:36 user nova-compute[72362]: DEBUG nova.network.neutron [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Successfully created port: 8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249 {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IfUGAoaD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:31:36 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:31:36 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[944115f5-21e1-4bcf-bfe1-1d6d26dea0b2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3057ffb3-84b3-4630-af0f-6a5e8339d90b]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:31:36 user nova-compute[72362]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:31:36 user nova-compute[72362]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)
Aug 09 10:31:36 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:31:36 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:31:36 user nova-compute[72362]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:31:36 user nova-compute[72362]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)
Aug 09 10:31:36 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:31:36 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34dc293d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f'): ({'sdd'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Removing single pathed devices sdd {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e056a3-12d1-44c9-ad32-7ca81210e263]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG nova.compute.manager [req-898044dc-5b17-4ef0-9260-fb5232dccf0f req-d31f57ef-ed83-4515-a785-3bb410b226d0 service nova] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Received event network-vif-plugged-63863234-78a1-41d7-8bd0-ee5d0657d86b {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-898044dc-5b17-4ef0-9260-fb5232dccf0f req-d31f57ef-ed83-4515-a785-3bb410b226d0 service nova] Acquiring lock "94353851-e6a8-404b-b295-d539b2469d47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-898044dc-5b17-4ef0-9260-fb5232dccf0f req-d31f57ef-ed83-4515-a785-3bb410b226d0 service nova] Lock "94353851-e6a8-404b-b295-d539b2469d47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-898044dc-5b17-4ef0-9260-fb5232dccf0f req-d31f57ef-ed83-4515-a785-3bb410b226d0 service nova] Lock "94353851-e6a8-404b-b295-d539b2469d47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG nova.compute.manager [req-898044dc-5b17-4ef0-9260-fb5232dccf0f req-d31f57ef-ed83-4515-a785-3bb410b226d0 service nova] [instance: 94353851-e6a8-404b-b295-d539b2469d47] No waiting events found dispatching network-vif-plugged-63863234-78a1-41d7-8bd0-ee5d0657d86b {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:31:36 user nova-compute[72362]: WARNING nova.compute.manager [req-898044dc-5b17-4ef0-9260-fb5232dccf0f req-d31f57ef-ed83-4515-a785-3bb410b226d0 service nova] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Received unexpected event network-vif-plugged-63863234-78a1-41d7-8bd0-ee5d0657d86b for instance with vm_state deleted and task_state None.
Aug 09 10:31:36 user nova-compute[72362]: DEBUG nova.compute.manager [req-898044dc-5b17-4ef0-9260-fb5232dccf0f req-d31f57ef-ed83-4515-a785-3bb410b226d0 service nova] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Received event network-vif-plugged-63863234-78a1-41d7-8bd0-ee5d0657d86b {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-898044dc-5b17-4ef0-9260-fb5232dccf0f req-d31f57ef-ed83-4515-a785-3bb410b226d0 service nova] Acquiring lock "94353851-e6a8-404b-b295-d539b2469d47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-898044dc-5b17-4ef0-9260-fb5232dccf0f req-d31f57ef-ed83-4515-a785-3bb410b226d0 service nova] Lock "94353851-e6a8-404b-b295-d539b2469d47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-898044dc-5b17-4ef0-9260-fb5232dccf0f req-d31f57ef-ed83-4515-a785-3bb410b226d0 service nova] Lock "94353851-e6a8-404b-b295-d539b2469d47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG nova.compute.manager [req-898044dc-5b17-4ef0-9260-fb5232dccf0f req-d31f57ef-ed83-4515-a785-3bb410b226d0 service nova] [instance: 94353851-e6a8-404b-b295-d539b2469d47] No waiting events found dispatching network-vif-plugged-63863234-78a1-41d7-8bd0-ee5d0657d86b {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:31:36 user nova-compute[72362]: WARNING nova.compute.manager [req-898044dc-5b17-4ef0-9260-fb5232dccf0f req-d31f57ef-ed83-4515-a785-3bb410b226d0 service nova] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Received unexpected event network-vif-plugged-63863234-78a1-41d7-8bd0-ee5d0657d86b for instance with vm_state deleted and task_state None.
Aug 09 10:31:36 user nova-compute[72362]: DEBUG nova.compute.manager [req-898044dc-5b17-4ef0-9260-fb5232dccf0f req-d31f57ef-ed83-4515-a785-3bb410b226d0 service nova] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Received event network-vif-deleted-63863234-78a1-41d7-8bd0-ee5d0657d86b {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.031s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9f5e8a-3392-4c3b-81f6-7ba96077cc65]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Flushing IO for device /dev/sdd {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91d2097-f783-4cc3-8c53-f653c406408f]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691577081.2482998, f4087716-c913-48db-886e-2f21d1238c66 => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:31:36 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: f4087716-c913-48db-886e-2f21d1238c66] VM Stopped (Lifecycle Event)
Aug 09 10:31:36 user nova-compute[72362]: DEBUG nova.compute.manager [None req-ed02c369-aac5-4250-9b26-4b69dbc9505f None None] [instance: f4087716-c913-48db-886e-2f21d1238c66] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f7b1af-2325-4a39-88de-6c549da60e11]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] SCSI volumes sdd have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23963623563653539', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d9c261bf', '/dev/disk/by-id/scsi-1SCST_BIOd9c261bf-9cb5ce597a822674') {{(pid=84003) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 10:31:36 user nova-compute[72362]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23963623563653539
Aug 09 10:31:36 user nova-compute[72362]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_d9c261bf
Aug 09 10:31:36 user nova-compute[72362]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOd9c261bf-9cb5ce597a822674
Aug 09 10:31:36 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3edd517-bedc-43ee-b47e-b3be196eeb6b]: (4, None) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79dc5a3-d86d-4573-a74f-2a6e265081ed]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fed6e52-9792-4172-83db-a836ac311768]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f, portal: 172.16.0.220,3260]
Aug 09 10:31:36 user nova-compute[72362]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f, portal: 172.16.0.220,3260] successful.
Aug 09 10:31:36 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dbf0097-ce54-47c4-a17e-ce723da836aa]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] <== disconnect_volume: return (347ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:31:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG nova.network.neutron [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Successfully updated port: 8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249 {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Acquiring lock "refresh_cache-5502750a-6b11-4600-9363-a814a12573d2" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Acquired lock "refresh_cache-5502750a-6b11-4600-9363-a814a12573d2" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG nova.network.neutron [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG nova.network.neutron [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG nova.compute.manager [req-c7e54a53-54a1-4dc0-8c66-c674763e75ec req-c44628b0-ca3c-4be0-8e9f-7acac238743b service nova] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Received event network-vif-plugged-0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c7e54a53-54a1-4dc0-8c66-c674763e75ec req-c44628b0-ca3c-4be0-8e9f-7acac238743b service nova] Acquiring lock "4b22a19f-300c-42fb-8175-e737eef7d531-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c7e54a53-54a1-4dc0-8c66-c674763e75ec req-c44628b0-ca3c-4be0-8e9f-7acac238743b service nova] Lock "4b22a19f-300c-42fb-8175-e737eef7d531-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c7e54a53-54a1-4dc0-8c66-c674763e75ec req-c44628b0-ca3c-4be0-8e9f-7acac238743b service nova] Lock "4b22a19f-300c-42fb-8175-e737eef7d531-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG nova.compute.manager [req-c7e54a53-54a1-4dc0-8c66-c674763e75ec req-c44628b0-ca3c-4be0-8e9f-7acac238743b service nova] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] No waiting events found dispatching network-vif-plugged-0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:31:37 user nova-compute[72362]: WARNING nova.compute.manager [req-c7e54a53-54a1-4dc0-8c66-c674763e75ec req-c44628b0-ca3c-4be0-8e9f-7acac238743b service nova] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Received unexpected event network-vif-plugged-0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa for instance with vm_state active and task_state resize_migrating.
Aug 09 10:31:37 user nova-compute[72362]: DEBUG nova.compute.manager [req-c7e54a53-54a1-4dc0-8c66-c674763e75ec req-c44628b0-ca3c-4be0-8e9f-7acac238743b service nova] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Received event network-changed-8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG nova.compute.manager [req-c7e54a53-54a1-4dc0-8c66-c674763e75ec req-c44628b0-ca3c-4be0-8e9f-7acac238743b service nova] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Refreshing instance network info cache due to event network-changed-8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c7e54a53-54a1-4dc0-8c66-c674763e75ec req-c44628b0-ca3c-4be0-8e9f-7acac238743b service nova] Acquiring lock "refresh_cache-5502750a-6b11-4600-9363-a814a12573d2" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG nova.network.neutron [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Updating instance_info_cache with network_info: [{"id": "8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249", "address": "fa:16:3e:9f:29:a6", "network": {"id": "f9878e3c-f52a-4f3a-933d-b9c534dd3a59", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-797945070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc046adc7984378983895400e2b5e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4b73e7-3e", "ovs_interfaceid": "8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Releasing lock "refresh_cache-5502750a-6b11-4600-9363-a814a12573d2" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG nova.compute.manager [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Instance network_info: |[{"id": "8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249", "address": "fa:16:3e:9f:29:a6", "network": {"id": "f9878e3c-f52a-4f3a-933d-b9c534dd3a59", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-797945070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc046adc7984378983895400e2b5e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4b73e7-3e", "ovs_interfaceid": "8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c7e54a53-54a1-4dc0-8c66-c674763e75ec req-c44628b0-ca3c-4be0-8e9f-7acac238743b service nova] Acquired lock "refresh_cache-5502750a-6b11-4600-9363-a814a12573d2" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG nova.network.neutron [req-c7e54a53-54a1-4dc0-8c66-c674763e75ec req-c44628b0-ca3c-4be0-8e9f-7acac238743b service nova] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Refreshing network info cache for port 8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Start _get_guest_xml network_info=[{"id": "8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249", "address": "fa:16:3e:9f:29:a6", "network": {"id": "f9878e3c-f52a-4f3a-933d-b9c534dd3a59", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-797945070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc046adc7984378983895400e2b5e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4b73e7-3e", "ovs_interfaceid": "8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': 'a08d1a11-49eb-4212-a351-e11ee9553b95'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG nova.network.neutron [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Port 0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa binding to destination host user is already ACTIVE {{(pid=72362) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 09 10:31:37 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:31:37 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:31:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:31:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1911527310',display_name='tempest-VolumesSnapshotTestJSON-instance-1911527310',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1911527310',id=33,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvp1G8Sq7NTtefSVQmgix95Wjwbvo+/ezkIPRrKPwplEFxrtQ1QwXWKuKOOF47Gg987ptaLDKzBqaUaWGqOX/zp3EiwEOaDwS7EBo+2KcefyR/MJgE8q5OnUx2txNDX/Q==',key_name='tempest-keypair-1119633726',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fc046adc7984378983895400e2b5e04',ramdisk_id='',reservation_id='r-ta7kbahi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1214114448',owner_user_name='tempest-VolumesSnapshotTestJSON-1214114448-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:31:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='755ef9806a264f15bb80d2cd5db55d9b',uuid=5502750a-6b11-4600-9363-a814a12573d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249", "address": "fa:16:3e:9f:29:a6", "network": {"id": "f9878e3c-f52a-4f3a-933d-b9c534dd3a59", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-797945070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc046adc7984378983895400e2b5e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4b73e7-3e", "ovs_interfaceid": "8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Converting VIF {"id": "8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249", "address": "fa:16:3e:9f:29:a6", "network": {"id": "f9878e3c-f52a-4f3a-933d-b9c534dd3a59", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-797945070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc046adc7984378983895400e2b5e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4b73e7-3e", "ovs_interfaceid": "8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:29:a6,bridge_name='br-int',has_traffic_filtering=True,id=8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249,network=Network(f9878e3c-f52a-4f3a-933d-b9c534dd3a59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e4b73e7-3e') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG nova.objects.instance [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lazy-loading 'pci_devices' on Instance uuid 5502750a-6b11-4600-9363-a814a12573d2 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 5502750a-6b11-4600-9363-a814a12573d2] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:31:37 user nova-compute[72362]:   <uuid>5502750a-6b11-4600-9363-a814a12573d2</uuid>
Aug 09 10:31:37 user nova-compute[72362]:   <name>instance-00000021</name>
Aug 09 10:31:37 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:31:37 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:31:37 user nova-compute[72362]:   <metadata>
Aug 09 10:31:37 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:31:37 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:31:37 user nova-compute[72362]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1911527310</nova:name>
Aug 09 10:31:37 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:31:37</nova:creationTime>
Aug 09 10:31:37 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:31:37 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:31:37 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:31:37 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:31:37 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:31:37 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:31:37 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:31:37 user nova-compute[72362]:       <nova:owner>
Aug 09 10:31:37 user nova-compute[72362]:         <nova:user uuid="755ef9806a264f15bb80d2cd5db55d9b">tempest-VolumesSnapshotTestJSON-1214114448-project-member</nova:user>
Aug 09 10:31:37 user nova-compute[72362]:         <nova:project uuid="4fc046adc7984378983895400e2b5e04">tempest-VolumesSnapshotTestJSON-1214114448</nova:project>
Aug 09 10:31:37 user nova-compute[72362]:       </nova:owner>
Aug 09 10:31:37 user nova-compute[72362]:       <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:31:37 user nova-compute[72362]:       <nova:ports>
Aug 09 10:31:37 user nova-compute[72362]:         <nova:port uuid="8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249">
Aug 09 10:31:37 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 09 10:31:37 user nova-compute[72362]:         </nova:port>
Aug 09 10:31:37 user nova-compute[72362]:       </nova:ports>
Aug 09 10:31:37 user nova-compute[72362]:     </nova:instance>
Aug 09 10:31:37 user nova-compute[72362]:   </metadata>
Aug 09 10:31:37 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:31:37 user nova-compute[72362]:     <system>
Aug 09 10:31:37 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:31:37 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:31:37 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:31:37 user nova-compute[72362]:       <entry name="serial">5502750a-6b11-4600-9363-a814a12573d2</entry>
Aug 09 10:31:37 user nova-compute[72362]:       <entry name="uuid">5502750a-6b11-4600-9363-a814a12573d2</entry>
Aug 09 10:31:37 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:31:37 user nova-compute[72362]:     </system>
Aug 09 10:31:37 user nova-compute[72362]:   </sysinfo>
Aug 09 10:31:37 user nova-compute[72362]:   <os>
Aug 09 10:31:37 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:31:37 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:31:37 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:31:37 user nova-compute[72362]:   </os>
Aug 09 10:31:37 user nova-compute[72362]:   <features>
Aug 09 10:31:37 user nova-compute[72362]:     <acpi/>
Aug 09 10:31:37 user nova-compute[72362]:     <apic/>
Aug 09 10:31:37 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:31:37 user nova-compute[72362]:   </features>
Aug 09 10:31:37 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:31:37 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:31:37 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:31:37 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:31:37 user nova-compute[72362]:   </clock>
Aug 09 10:31:37 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:31:37 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:31:37 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:31:37 user nova-compute[72362]:   </cpu>
Aug 09 10:31:37 user nova-compute[72362]:   <devices>
Aug 09 10:31:37 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:31:37 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:31:37 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/5502750a-6b11-4600-9363-a814a12573d2/disk"/>
Aug 09 10:31:37 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:31:37 user nova-compute[72362]:     </disk>
Aug 09 10:31:37 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:31:37 user nova-compute[72362]:       <mac address="fa:16:3e:9f:29:a6"/>
Aug 09 10:31:37 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:31:37 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:31:37 user nova-compute[72362]:       <target dev="tap8e4b73e7-3e"/>
Aug 09 10:31:37 user nova-compute[72362]:     </interface>
Aug 09 10:31:37 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:31:37 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/5502750a-6b11-4600-9363-a814a12573d2/console.log" append="off"/>
Aug 09 10:31:37 user nova-compute[72362]:     </serial>
Aug 09 10:31:37 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:31:37 user nova-compute[72362]:     <video>
Aug 09 10:31:37 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:31:37 user nova-compute[72362]:     </video>
Aug 09 10:31:37 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:31:37 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:31:37 user nova-compute[72362]:     </rng>
Aug 09 10:31:37 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:31:37 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:31:37 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:31:37 user nova-compute[72362]:     </memballoon>
Aug 09 10:31:37 user nova-compute[72362]:   </devices>
Aug 09 10:31:37 user nova-compute[72362]: </domain>
Aug 09 10:31:37 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:31:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1911527310',display_name='tempest-VolumesSnapshotTestJSON-instance-1911527310',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1911527310',id=33,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvp1G8Sq7NTtefSVQmgix95Wjwbvo+/ezkIPRrKPwplEFxrtQ1QwXWKuKOOF47Gg987ptaLDKzBqaUaWGqOX/zp3EiwEOaDwS7EBo+2KcefyR/MJgE8q5OnUx2txNDX/Q==',key_name='tempest-keypair-1119633726',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fc046adc7984378983895400e2b5e04',ramdisk_id='',reservation_id='r-ta7kbahi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1214114448',owner_user_name='tempest-VolumesSnapshotTestJSON-1214114448-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:31:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='755ef9806a264f15bb80d2cd5db55d9b',uuid=5502750a-6b11-4600-9363-a814a12573d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249", "address": "fa:16:3e:9f:29:a6", "network": {"id": "f9878e3c-f52a-4f3a-933d-b9c534dd3a59", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-797945070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc046adc7984378983895400e2b5e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4b73e7-3e", "ovs_interfaceid": "8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Converting VIF {"id": "8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249", "address": "fa:16:3e:9f:29:a6", "network": {"id": "f9878e3c-f52a-4f3a-933d-b9c534dd3a59", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-797945070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc046adc7984378983895400e2b5e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4b73e7-3e", "ovs_interfaceid": "8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:29:a6,bridge_name='br-int',has_traffic_filtering=True,id=8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249,network=Network(f9878e3c-f52a-4f3a-933d-b9c534dd3a59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e4b73e7-3e') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG os_vif [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:29:a6,bridge_name='br-int',has_traffic_filtering=True,id=8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249,network=Network(f9878e3c-f52a-4f3a-933d-b9c534dd3a59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e4b73e7-3e') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e4b73e7-3e, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8e4b73e7-3e, col_values=(('external_ids', {'iface-id': '8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:29:a6', 'vm-uuid': '5502750a-6b11-4600-9363-a814a12573d2'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Acquiring lock "4b22a19f-300c-42fb-8175-e737eef7d531-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "4b22a19f-300c-42fb-8175-e737eef7d531-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "4b22a19f-300c-42fb-8175-e737eef7d531-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:31:37 user nova-compute[72362]: INFO os_vif [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:29:a6,bridge_name='br-int',has_traffic_filtering=True,id=8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249,network=Network(f9878e3c-f52a-4f3a-933d-b9c534dd3a59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e4b73e7-3e')
Aug 09 10:31:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] No VIF found with MAC fa:16:3e:9f:29:a6, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Acquiring lock "refresh_cache-4b22a19f-300c-42fb-8175-e737eef7d531" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Acquired lock "refresh_cache-4b22a19f-300c-42fb-8175-e737eef7d531" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:31:37 user nova-compute[72362]: DEBUG nova.network.neutron [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:31:38 user nova-compute[72362]: DEBUG nova.network.neutron [req-c7e54a53-54a1-4dc0-8c66-c674763e75ec req-c44628b0-ca3c-4be0-8e9f-7acac238743b service nova] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Updated VIF entry in instance network info cache for port 8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:31:38 user nova-compute[72362]: DEBUG nova.network.neutron [req-c7e54a53-54a1-4dc0-8c66-c674763e75ec req-c44628b0-ca3c-4be0-8e9f-7acac238743b service nova] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Updating instance_info_cache with network_info: [{"id": "8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249", "address": "fa:16:3e:9f:29:a6", "network": {"id": "f9878e3c-f52a-4f3a-933d-b9c534dd3a59", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-797945070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc046adc7984378983895400e2b5e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4b73e7-3e", "ovs_interfaceid": "8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:31:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c7e54a53-54a1-4dc0-8c66-c674763e75ec req-c44628b0-ca3c-4be0-8e9f-7acac238743b service nova] Releasing lock "refresh_cache-5502750a-6b11-4600-9363-a814a12573d2" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:31:38 user nova-compute[72362]: DEBUG nova.network.neutron [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Updating instance_info_cache with network_info: [{"id": "0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa", "address": "fa:16:3e:39:ad:fb", "network": {"id": "e6c54663-74e3-43e2-8f0d-61b300c1f68d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1222286883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ac22022944542c0b52dd912d3dbcce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0942f4eb-e7", "ovs_interfaceid": "0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:31:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Releasing lock "refresh_cache-4b22a19f-300c-42fb-8175-e737eef7d531" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:31:38 user nova-compute[72362]: DEBUG os_brick.utils [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:31:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:38 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[641766ab-6e3b-40d4-8f7d-277c95883e4f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:38 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[85eeac43-956a-4e19-913b-ce17b8f87ae7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:38 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[364254f7-60c0-49c4-9190-a0ca3142dd65]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:38 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68db369-2e6b-4dae-9766-dcb2678b9347]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:31:38 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:31:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:31:38 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:31:38 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd7509f-e5bb-4cc7-bc57-ac3658399e85]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:38 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:31:38 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:31:38 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:31:38 user nova-compute[72362]: DEBUG os_brick.utils [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:31:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:39 user nova-compute[72362]: DEBUG nova.compute.manager [req-ada30401-a96f-4595-9089-c7ae554c86d9 req-bde55430-b100-4de4-844f-63d6e03da3ff service nova] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Received event network-vif-plugged-8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:31:39 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ada30401-a96f-4595-9089-c7ae554c86d9 req-bde55430-b100-4de4-844f-63d6e03da3ff service nova] Acquiring lock "5502750a-6b11-4600-9363-a814a12573d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:31:39 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ada30401-a96f-4595-9089-c7ae554c86d9 req-bde55430-b100-4de4-844f-63d6e03da3ff service nova] Lock "5502750a-6b11-4600-9363-a814a12573d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:31:39 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ada30401-a96f-4595-9089-c7ae554c86d9 req-bde55430-b100-4de4-844f-63d6e03da3ff service nova] Lock "5502750a-6b11-4600-9363-a814a12573d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:31:39 user nova-compute[72362]: DEBUG nova.compute.manager [req-ada30401-a96f-4595-9089-c7ae554c86d9 req-bde55430-b100-4de4-844f-63d6e03da3ff service nova] [instance: 5502750a-6b11-4600-9363-a814a12573d2] No waiting events found dispatching network-vif-plugged-8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:31:39 user nova-compute[72362]: WARNING nova.compute.manager [req-ada30401-a96f-4595-9089-c7ae554c86d9 req-bde55430-b100-4de4-844f-63d6e03da3ff service nova] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Received unexpected event network-vif-plugged-8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249 for instance with vm_state building and task_state spawning.
Aug 09 10:31:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:41 user nova-compute[72362]: DEBUG nova.compute.manager [req-1c6402f9-30b3-487e-9e3d-394f11b126a5 req-8a36819c-548c-44a3-b098-80f4bd8a1a8e service nova] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Received event network-changed-a722d26f-88e8-40a8-b13c-66ec2bc587cf {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:31:41 user nova-compute[72362]: DEBUG nova.compute.manager [req-1c6402f9-30b3-487e-9e3d-394f11b126a5 req-8a36819c-548c-44a3-b098-80f4bd8a1a8e service nova] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Refreshing instance network info cache due to event network-changed-a722d26f-88e8-40a8-b13c-66ec2bc587cf. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:31:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-1c6402f9-30b3-487e-9e3d-394f11b126a5 req-8a36819c-548c-44a3-b098-80f4bd8a1a8e service nova] Acquiring lock "refresh_cache-8d42f648-8616-4974-b416-0b6534b002cc" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:31:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-1c6402f9-30b3-487e-9e3d-394f11b126a5 req-8a36819c-548c-44a3-b098-80f4bd8a1a8e service nova] Acquired lock "refresh_cache-8d42f648-8616-4974-b416-0b6534b002cc" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:31:41 user nova-compute[72362]: DEBUG nova.network.neutron [req-1c6402f9-30b3-487e-9e3d-394f11b126a5 req-8a36819c-548c-44a3-b098-80f4bd8a1a8e service nova] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Refreshing network info cache for port a722d26f-88e8-40a8-b13c-66ec2bc587cf {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:31:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-120f55cf-7ad4-487b-8664-221afc4bbbe2 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Acquiring lock "8d42f648-8616-4974-b416-0b6534b002cc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:31:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-120f55cf-7ad4-487b-8664-221afc4bbbe2 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Lock "8d42f648-8616-4974-b416-0b6534b002cc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:31:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-120f55cf-7ad4-487b-8664-221afc4bbbe2 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Acquiring lock "8d42f648-8616-4974-b416-0b6534b002cc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:31:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-120f55cf-7ad4-487b-8664-221afc4bbbe2 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Lock "8d42f648-8616-4974-b416-0b6534b002cc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:31:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-120f55cf-7ad4-487b-8664-221afc4bbbe2 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Lock "8d42f648-8616-4974-b416-0b6534b002cc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:31:41 user nova-compute[72362]: INFO nova.compute.manager [None req-120f55cf-7ad4-487b-8664-221afc4bbbe2 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Terminating instance
Aug 09 10:31:41 user nova-compute[72362]: DEBUG nova.compute.manager [None req-120f55cf-7ad4-487b-8664-221afc4bbbe2 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Start destroying the instance on the hypervisor. {{(pid=72362) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 10:31:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:41 user nova-compute[72362]: DEBUG nova.network.neutron [req-1c6402f9-30b3-487e-9e3d-394f11b126a5 req-8a36819c-548c-44a3-b098-80f4bd8a1a8e service nova] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Updated VIF entry in instance network info cache for port a722d26f-88e8-40a8-b13c-66ec2bc587cf. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:31:41 user nova-compute[72362]: DEBUG nova.network.neutron [req-1c6402f9-30b3-487e-9e3d-394f11b126a5 req-8a36819c-548c-44a3-b098-80f4bd8a1a8e service nova] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Updating instance_info_cache with network_info: [{"id": "a722d26f-88e8-40a8-b13c-66ec2bc587cf", "address": "fa:16:3e:9d:b1:56", "network": {"id": "da288577-5a89-4a87-aa94-d70e8e98cf83", "bridge": "br-int", "label": "tempest-TestShelveInstance-2076187029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4b0b83578f14c84a8fadd12e66911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa722d26f-88", "ovs_interfaceid": "a722d26f-88e8-40a8-b13c-66ec2bc587cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:31:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-1c6402f9-30b3-487e-9e3d-394f11b126a5 req-8a36819c-548c-44a3-b098-80f4bd8a1a8e service nova] Releasing lock "refresh_cache-8d42f648-8616-4974-b416-0b6534b002cc" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:31:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:41 user nova-compute[72362]: DEBUG nova.compute.manager [req-cb2f6feb-cfd7-4b42-8729-96d23a4fdd56 req-9fbc1901-c9b2-48f0-86a3-ebc475091391 service nova] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Received event network-vif-plugged-8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:31:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-cb2f6feb-cfd7-4b42-8729-96d23a4fdd56 req-9fbc1901-c9b2-48f0-86a3-ebc475091391 service nova] Acquiring lock "5502750a-6b11-4600-9363-a814a12573d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:31:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-cb2f6feb-cfd7-4b42-8729-96d23a4fdd56 req-9fbc1901-c9b2-48f0-86a3-ebc475091391 service nova] Lock "5502750a-6b11-4600-9363-a814a12573d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:31:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-cb2f6feb-cfd7-4b42-8729-96d23a4fdd56 req-9fbc1901-c9b2-48f0-86a3-ebc475091391 service nova] Lock "5502750a-6b11-4600-9363-a814a12573d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:31:41 user nova-compute[72362]: DEBUG nova.compute.manager [req-cb2f6feb-cfd7-4b42-8729-96d23a4fdd56 req-9fbc1901-c9b2-48f0-86a3-ebc475091391 service nova] [instance: 5502750a-6b11-4600-9363-a814a12573d2] No waiting events found dispatching network-vif-plugged-8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:31:41 user nova-compute[72362]: WARNING nova.compute.manager [req-cb2f6feb-cfd7-4b42-8729-96d23a4fdd56 req-9fbc1901-c9b2-48f0-86a3-ebc475091391 service nova] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Received unexpected event network-vif-plugged-8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249 for instance with vm_state building and task_state spawning.
Aug 09 10:31:42 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Instance destroyed successfully.
Aug 09 10:31:42 user nova-compute[72362]: DEBUG nova.objects.instance [None req-120f55cf-7ad4-487b-8664-221afc4bbbe2 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Lazy-loading 'resources' on Instance uuid 8d42f648-8616-4974-b416-0b6534b002cc {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-120f55cf-7ad4-487b-8664-221afc4bbbe2 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T10:26:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1217884661',display_name='tempest-TestShelveInstance-server-1217884661',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1217884661',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOmjYX+nb6oC43JrBd2BJzwvKVraDBLQFtiNrt1C0JH07OfZmS7euFshiJsgrHA9mKVxj6ykyCXOcr6o2Xd6tEVsv+X2yXun7E9pphr2j2+BP4TP+ZXevz40p5xbEPaYA==',key_name='tempest-TestShelveInstance-1415559284',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:30:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d4b0b83578f14c84a8fadd12e66911f7',ramdisk_id='',reservation_id='r-4qse1uup',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-307673701',owner_user_name='tempest-TestShelveInstance-307673701-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:30:10Z,user_data=None,user_id='0b0a0c2a13af4b34ab0dedfaaeae864a',uuid=8d42f648-8616-4974-b416-0b6534b002cc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a722d26f-88e8-40a8-b13c-66ec2bc587cf", "address": "fa:16:3e:9d:b1:56", "network": {"id": "da288577-5a89-4a87-aa94-d70e8e98cf83", "bridge": "br-int", "label": "tempest-TestShelveInstance-2076187029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4b0b83578f14c84a8fadd12e66911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa722d26f-88", "ovs_interfaceid": "a722d26f-88e8-40a8-b13c-66ec2bc587cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-120f55cf-7ad4-487b-8664-221afc4bbbe2 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Converting VIF {"id": "a722d26f-88e8-40a8-b13c-66ec2bc587cf", "address": "fa:16:3e:9d:b1:56", "network": {"id": "da288577-5a89-4a87-aa94-d70e8e98cf83", "bridge": "br-int", "label": "tempest-TestShelveInstance-2076187029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4b0b83578f14c84a8fadd12e66911f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa722d26f-88", "ovs_interfaceid": "a722d26f-88e8-40a8-b13c-66ec2bc587cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-120f55cf-7ad4-487b-8664-221afc4bbbe2 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:b1:56,bridge_name='br-int',has_traffic_filtering=True,id=a722d26f-88e8-40a8-b13c-66ec2bc587cf,network=Network(da288577-5a89-4a87-aa94-d70e8e98cf83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa722d26f-88') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG os_vif [None req-120f55cf-7ad4-487b-8664-221afc4bbbe2 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:b1:56,bridge_name='br-int',has_traffic_filtering=True,id=a722d26f-88e8-40a8-b13c-66ec2bc587cf,network=Network(da288577-5a89-4a87-aa94-d70e8e98cf83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa722d26f-88') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa722d26f-88, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:31:42 user nova-compute[72362]: INFO os_vif [None req-120f55cf-7ad4-487b-8664-221afc4bbbe2 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:b1:56,bridge_name='br-int',has_traffic_filtering=True,id=a722d26f-88e8-40a8-b13c-66ec2bc587cf,network=Network(da288577-5a89-4a87-aa94-d70e8e98cf83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa722d26f-88')
Aug 09 10:31:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-120f55cf-7ad4-487b-8664-221afc4bbbe2 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-120f55cf-7ad4-487b-8664-221afc4bbbe2 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Jkiypbdf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:31:42 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-120f55cf-7ad4-487b-8664-221afc4bbbe2 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:31:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-120f55cf-7ad4-487b-8664-221afc4bbbe2 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-120f55cf-7ad4-487b-8664-221afc4bbbe2 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-120f55cf-7ad4-487b-8664-221afc4bbbe2 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bfcdebc-1408-4355-8bfa-afac303cdcd3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577102.0960696, 5502750a-6b11-4600-9363-a814a12573d2 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:31:42 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 5502750a-6b11-4600-9363-a814a12573d2] VM Resumed (Lifecycle Event)
Aug 09 10:31:42 user nova-compute[72362]: DEBUG nova.compute.manager [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[8456196a-1ba9-4930-8655-2682c5400880]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-120f55cf-7ad4-487b-8664-221afc4bbbe2 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:31:42 user nova-compute[72362]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)
Aug 09 10:31:42 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:31:42 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-120f55cf-7ad4-487b-8664-221afc4bbbe2 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:31:42 user nova-compute[72362]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 (non-flash)
Aug 09 10:31:42 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:31:42 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-120f55cf-7ad4-487b-8664-221afc4bbbe2 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e414a8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9'): ({'sde'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-120f55cf-7ad4-487b-8664-221afc4bbbe2 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Removing single pathed devices sde {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:42 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Instance spawned successfully.
Aug 09 10:31:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[beaca360-49a0-4460-a470-bfe914bac0d4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:42 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 5502750a-6b11-4600-9363-a814a12573d2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:31:42 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577102.0963836, 5502750a-6b11-4600-9363-a814a12573d2 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:31:42 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 5502750a-6b11-4600-9363-a814a12573d2] VM Started (Lifecycle Event)
Aug 09 10:31:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a603cc-9f7e-448e-9c53-72ddf23eb88d]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-120f55cf-7ad4-487b-8664-221afc4bbbe2 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Flushing IO for device /dev/sde {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Found default for hw_cdrom_bus of ide {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Found default for hw_disk_bus of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Found default for hw_video_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Found default for hw_vif_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.028s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[25984e03-272a-44e7-ad08-711e15e3c090]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-120f55cf-7ad4-487b-8664-221afc4bbbe2 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:31:42 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 5502750a-6b11-4600-9363-a814a12573d2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:31:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e72d09-01b1-4a87-ab1f-66f22940588f]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-120f55cf-7ad4-487b-8664-221afc4bbbe2 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-120f55cf-7ad4-487b-8664-221afc4bbbe2 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] SCSI volumes sde have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOf4e56ed3-5ade1c2185a45810', '/dev/disk/by-id/scsi-23561646531633231', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f4e56ed3') {{(pid=84003) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3596cfb8-c309-459f-8603-5cd18acb9d2b]: (4, None) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-120f55cf-7ad4-487b-8664-221afc4bbbe2 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:42 user nova-compute[72362]: INFO nova.compute.manager [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Took 7.39 seconds to spawn the instance on the hypervisor.
Aug 09 10:31:42 user nova-compute[72362]: DEBUG nova.compute.manager [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb5435a-a94e-4983-b5ce-1fc9f7df8148]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-120f55cf-7ad4-487b-8664-221afc4bbbe2 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b074400d-9d3e-43ae-8ecd-fd2f91c481a6]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-120f55cf-7ad4-487b-8664-221afc4bbbe2 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9, portal: 172.16.0.220,3260]
Aug 09 10:31:42 user nova-compute[72362]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9, portal: 172.16.0.220,3260] successful.
Aug 09 10:31:42 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:42 user nova-compute[72362]: INFO nova.compute.manager [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Took 8.47 seconds to build instance.
Aug 09 10:31:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df0efc51-3970-4983-a224-c79511fab3d9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[2017c84d-3f63-4b4e-a77f-1ada2b7ce4bc]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-120f55cf-7ad4-487b-8664-221afc4bbbe2 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-120f55cf-7ad4-487b-8664-221afc4bbbe2 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-120f55cf-7ad4-487b-8664-221afc4bbbe2 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] <== disconnect_volume: return (356ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-120f55cf-7ad4-487b-8664-221afc4bbbe2 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:31:42 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-120f55cf-7ad4-487b-8664-221afc4bbbe2 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Deleting instance files /opt/stack/data/nova/instances/8d42f648-8616-4974-b416-0b6534b002cc_del
Aug 09 10:31:42 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-120f55cf-7ad4-487b-8664-221afc4bbbe2 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Deletion of /opt/stack/data/nova/instances/8d42f648-8616-4974-b416-0b6534b002cc_del complete
Aug 09 10:31:42 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-699b2205-dbe9-402b-bb32-7e3e89bbb4c1 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "5502750a-6b11-4600-9363-a814a12573d2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.568s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:31:42 user nova-compute[72362]: INFO nova.compute.manager [None req-120f55cf-7ad4-487b-8664-221afc4bbbe2 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Took 1.26 seconds to destroy the instance on the hypervisor.
Aug 09 10:31:42 user nova-compute[72362]: DEBUG oslo.service.loopingcall [None req-120f55cf-7ad4-487b-8664-221afc4bbbe2 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72362) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG nova.compute.manager [-] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Deallocating network for instance {{(pid=72362) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 10:31:42 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] deallocate_for_instance() {{(pid=72362) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 10:31:43 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:31:43 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Took 0.52 seconds to deallocate network for instance.
Aug 09 10:31:43 user nova-compute[72362]: DEBUG nova.compute.manager [req-318b08c4-bcdb-4068-9126-d4bbcadbc378 req-4a7cc2b8-c9c6-404b-83f5-99304580fa3c service nova] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Received event network-vif-unplugged-a722d26f-88e8-40a8-b13c-66ec2bc587cf {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:31:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-318b08c4-bcdb-4068-9126-d4bbcadbc378 req-4a7cc2b8-c9c6-404b-83f5-99304580fa3c service nova] Acquiring lock "8d42f648-8616-4974-b416-0b6534b002cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:31:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-318b08c4-bcdb-4068-9126-d4bbcadbc378 req-4a7cc2b8-c9c6-404b-83f5-99304580fa3c service nova] Lock "8d42f648-8616-4974-b416-0b6534b002cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:31:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-318b08c4-bcdb-4068-9126-d4bbcadbc378 req-4a7cc2b8-c9c6-404b-83f5-99304580fa3c service nova] Lock "8d42f648-8616-4974-b416-0b6534b002cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:31:43 user nova-compute[72362]: DEBUG nova.compute.manager [req-318b08c4-bcdb-4068-9126-d4bbcadbc378 req-4a7cc2b8-c9c6-404b-83f5-99304580fa3c service nova] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] No waiting events found dispatching network-vif-unplugged-a722d26f-88e8-40a8-b13c-66ec2bc587cf {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:31:43 user nova-compute[72362]: DEBUG nova.compute.manager [req-318b08c4-bcdb-4068-9126-d4bbcadbc378 req-4a7cc2b8-c9c6-404b-83f5-99304580fa3c service nova] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Received event network-vif-unplugged-a722d26f-88e8-40a8-b13c-66ec2bc587cf for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:31:43 user nova-compute[72362]: DEBUG nova.compute.manager [req-318b08c4-bcdb-4068-9126-d4bbcadbc378 req-4a7cc2b8-c9c6-404b-83f5-99304580fa3c service nova] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Received event network-vif-plugged-a722d26f-88e8-40a8-b13c-66ec2bc587cf {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:31:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-318b08c4-bcdb-4068-9126-d4bbcadbc378 req-4a7cc2b8-c9c6-404b-83f5-99304580fa3c service nova] Acquiring lock "8d42f648-8616-4974-b416-0b6534b002cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:31:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-318b08c4-bcdb-4068-9126-d4bbcadbc378 req-4a7cc2b8-c9c6-404b-83f5-99304580fa3c service nova] Lock "8d42f648-8616-4974-b416-0b6534b002cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:31:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-318b08c4-bcdb-4068-9126-d4bbcadbc378 req-4a7cc2b8-c9c6-404b-83f5-99304580fa3c service nova] Lock "8d42f648-8616-4974-b416-0b6534b002cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:31:43 user nova-compute[72362]: DEBUG nova.compute.manager [req-318b08c4-bcdb-4068-9126-d4bbcadbc378 req-4a7cc2b8-c9c6-404b-83f5-99304580fa3c service nova] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] No waiting events found dispatching network-vif-plugged-a722d26f-88e8-40a8-b13c-66ec2bc587cf {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:31:43 user nova-compute[72362]: WARNING nova.compute.manager [req-318b08c4-bcdb-4068-9126-d4bbcadbc378 req-4a7cc2b8-c9c6-404b-83f5-99304580fa3c service nova] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Received unexpected event network-vif-plugged-a722d26f-88e8-40a8-b13c-66ec2bc587cf for instance with vm_state active and task_state deleting.
Aug 09 10:31:43 user nova-compute[72362]: DEBUG nova.compute.manager [req-5a965f6b-cb93-4d34-b50b-595bf88a5417 req-811d2acc-d87c-4c2c-865c-c2ad3ccb7651 service nova] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Received event network-vif-deleted-a722d26f-88e8-40a8-b13c-66ec2bc587cf {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:31:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:47 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691577092.439121, 94353851-e6a8-404b-b295-d539b2469d47 => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:31:47 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 94353851-e6a8-404b-b295-d539b2469d47] VM Stopped (Lifecycle Event)
Aug 09 10:31:47 user nova-compute[72362]: DEBUG nova.compute.manager [None req-ed4af026-d1d6-465f-85ae-246b23d92708 None None] [instance: 94353851-e6a8-404b-b295-d539b2469d47] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Starting finish_migration {{(pid=72362) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Instance directory exists: not creating {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 10:31:48 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Creating image(s)
Aug 09 10:31:48 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Did not create local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Ensure instance console log exists: /opt/stack/data/nova/instances/4b22a19f-300c-42fb-8175-e737eef7d531/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Start _get_guest_xml network_info=[{"id": "0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa", "address": "fa:16:3e:39:ad:fb", "network": {"id": "e6c54663-74e3-43e2-8f0d-61b300c1f68d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1222286883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1222286883-network", "vif_mac": "fa:16:3e:39:ad:fb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ac22022944542c0b52dd912d3dbcce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0942f4eb-e7", "ovs_interfaceid": "0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '33e263e3-f5b2-431f-8355-4e4adb55f7a7', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IfUGAoaD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '4b22a19f-300c-42fb-8175-e737eef7d531', 'attached_at': '2023-08-09T10:31:48.000000', 'detached_at': '', 'volume_id': '31aca44a-c500-4972-873a-bb902c63755f', 'serial': '31aca44a-c500-4972-873a-bb902c63755f'}, 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:31:48 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:31:48 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:31:48 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:05Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG nova.objects.instance [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4b22a19f-300c-42fb-8175-e737eef7d531 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IfUGAoaD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:31:48 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:31:48 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:31:48 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:31:48 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:31:48 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:31:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd11e84-89fd-4483-b235-b3176699d76e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:31:48 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1b8139-15f7-459f-a8cb-a6a7c5dbb313]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f] added
Aug 09 10:31:48 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9aefc28-d446-4577-b1de-bbf5b728d819]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[774fded7-254e-4afc-865e-00e349a5aab2]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IfUGAoaD {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IfUGAoaD" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd57773-996d-4b52-93ee-4eb405763dfe]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IfUGAoaD'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:48 user nova-compute[72362]: INFO nova.compute.manager [None req-120f55cf-7ad4-487b-8664-221afc4bbbe2 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Took 5.38 seconds to detach 1 volumes for instance.
Aug 09 10:31:48 user nova-compute[72362]: DEBUG nova.compute.manager [None req-120f55cf-7ad4-487b-8664-221afc4bbbe2 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Deleting volume: df0efc51-3970-4983-a224-c79511fab3d9 {{(pid=72362) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2dcb121-ac43-4bfa-80e2-0e9eeaa0cf43]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64b16b1-3416-4b58-b00c-2a629d74f1e5]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:31:48 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:31:48 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:31:48 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:31:48 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6d4519-b53b-49d0-93a1-1f3a09e9ef41]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f, portal: 172.16.0.220,3260]
Aug 09 10:31:48 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f, portal: 172.16.0.220,3260] successful.
Aug 09 10:31:48 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-120f55cf-7ad4-487b-8664-221afc4bbbe2 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-120f55cf-7ad4-487b-8664-221afc4bbbe2 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[77733b0b-832c-4d35-a3e0-690ab6c30f16]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6793aae0-e4bf-49b4-a29a-0ecb12cabe30]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:31:48 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:31:48 user nova-compute[72362]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:31:48 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:31:48 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:31:48 user nova-compute[72362]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:31:48 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6fd7400-e12c-42ef-94c1-1125ed0c32cd]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IfUGAoaD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-120f55cf-7ad4-487b-8664-221afc4bbbe2 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-120f55cf-7ad4-487b-8664-221afc4bbbe2 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:31:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-120f55cf-7ad4-487b-8664-221afc4bbbe2 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.352s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:31:48 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-120f55cf-7ad4-487b-8664-221afc4bbbe2 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Deleted allocations for instance 8d42f648-8616-4974-b416-0b6534b002cc
Aug 09 10:31:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-120f55cf-7ad4-487b-8664-221afc4bbbe2 tempest-TestShelveInstance-307673701 tempest-TestShelveInstance-307673701-project-member] Lock "8d42f648-8616-4974-b416-0b6534b002cc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.754s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:31:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:31:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23963623563653539', 'path': '/dev/sdc'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:31:49 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963623563653539', 'path': '/dev/sdc'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:31:49 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:29:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1888482065',display_name='tempest-ServerActionsTestOtherA-server-1888482065',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1888482065',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwSFF251eQti/qkoXtJtG/hsB95elMyv8iaeRUjgcdf3ZQpb25r9rbEB2fGNjqP3pvOqQxJNR/NqVUD62omNMx/akMv5+i7VAu1R/GqhP2vqtVAvdiRNee4z2ROG7Jd8w==',key_name='tempest-keypair-122703468',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:29:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8ac22022944542c0b52dd912d3dbcce2',ramdisk_id='',reservation_id='r-08r15keq',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2101881579',owner_user_name='tempest-ServerActionsTestOtherA-2101881579-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:31:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='990e2d160fdc4c599cee9f65d6d4e41d',uuid=4b22a19f-300c-42fb-8175-e737eef7d531,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa", "address": "fa:16:3e:39:ad:fb", "network": {"id": "e6c54663-74e3-43e2-8f0d-61b300c1f68d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1222286883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1222286883-network", "vif_mac": "fa:16:3e:39:ad:fb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ac22022944542c0b52dd912d3dbcce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0942f4eb-e7", "ovs_interfaceid": "0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:31:49 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Converting VIF {"id": "0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa", "address": "fa:16:3e:39:ad:fb", "network": {"id": "e6c54663-74e3-43e2-8f0d-61b300c1f68d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1222286883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1222286883-network", "vif_mac": "fa:16:3e:39:ad:fb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ac22022944542c0b52dd912d3dbcce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0942f4eb-e7", "ovs_interfaceid": "0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:31:49 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:ad:fb,bridge_name='br-int',has_traffic_filtering=True,id=0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa,network=Network(e6c54663-74e3-43e2-8f0d-61b300c1f68d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0942f4eb-e7') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:31:49 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:31:49 user nova-compute[72362]:   <uuid>4b22a19f-300c-42fb-8175-e737eef7d531</uuid>
Aug 09 10:31:49 user nova-compute[72362]:   <name>instance-0000001e</name>
Aug 09 10:31:49 user nova-compute[72362]:   <memory>2097152</memory>
Aug 09 10:31:49 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:31:49 user nova-compute[72362]:   <metadata>
Aug 09 10:31:49 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:31:49 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:31:49 user nova-compute[72362]:       <nova:name>tempest-ServerActionsTestOtherA-server-1888482065</nova:name>
Aug 09 10:31:49 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:31:48</nova:creationTime>
Aug 09 10:31:49 user nova-compute[72362]:       <nova:flavor name="m1.small">
Aug 09 10:31:49 user nova-compute[72362]:         <nova:memory>2048</nova:memory>
Aug 09 10:31:49 user nova-compute[72362]:         <nova:disk>20</nova:disk>
Aug 09 10:31:49 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:31:49 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:31:49 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:31:49 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:31:49 user nova-compute[72362]:       <nova:owner>
Aug 09 10:31:49 user nova-compute[72362]:         <nova:user uuid="990e2d160fdc4c599cee9f65d6d4e41d">tempest-ServerActionsTestOtherA-2101881579-project-member</nova:user>
Aug 09 10:31:49 user nova-compute[72362]:         <nova:project uuid="8ac22022944542c0b52dd912d3dbcce2">tempest-ServerActionsTestOtherA-2101881579</nova:project>
Aug 09 10:31:49 user nova-compute[72362]:       </nova:owner>
Aug 09 10:31:49 user nova-compute[72362]:       <nova:ports>
Aug 09 10:31:49 user nova-compute[72362]:         <nova:port uuid="0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa">
Aug 09 10:31:49 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 10:31:49 user nova-compute[72362]:         </nova:port>
Aug 09 10:31:49 user nova-compute[72362]:       </nova:ports>
Aug 09 10:31:49 user nova-compute[72362]:     </nova:instance>
Aug 09 10:31:49 user nova-compute[72362]:   </metadata>
Aug 09 10:31:49 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:31:49 user nova-compute[72362]:     <system>
Aug 09 10:31:49 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:31:49 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:31:49 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:31:49 user nova-compute[72362]:       <entry name="serial">4b22a19f-300c-42fb-8175-e737eef7d531</entry>
Aug 09 10:31:49 user nova-compute[72362]:       <entry name="uuid">4b22a19f-300c-42fb-8175-e737eef7d531</entry>
Aug 09 10:31:49 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:31:49 user nova-compute[72362]:     </system>
Aug 09 10:31:49 user nova-compute[72362]:   </sysinfo>
Aug 09 10:31:49 user nova-compute[72362]:   <os>
Aug 09 10:31:49 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:31:49 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:31:49 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:31:49 user nova-compute[72362]:   </os>
Aug 09 10:31:49 user nova-compute[72362]:   <features>
Aug 09 10:31:49 user nova-compute[72362]:     <acpi/>
Aug 09 10:31:49 user nova-compute[72362]:     <apic/>
Aug 09 10:31:49 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:31:49 user nova-compute[72362]:   </features>
Aug 09 10:31:49 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:31:49 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:31:49 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:31:49 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:31:49 user nova-compute[72362]:   </clock>
Aug 09 10:31:49 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:31:49 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:31:49 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:31:49 user nova-compute[72362]:   </cpu>
Aug 09 10:31:49 user nova-compute[72362]:   <devices>
Aug 09 10:31:49 user nova-compute[72362]:     <disk type="block" device="disk">
Aug 09 10:31:49 user nova-compute[72362]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:31:49 user nova-compute[72362]:       <source dev="/dev/sdc"/>
Aug 09 10:31:49 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:31:49 user nova-compute[72362]:       <serial>31aca44a-c500-4972-873a-bb902c63755f</serial>
Aug 09 10:31:49 user nova-compute[72362]:     </disk>
Aug 09 10:31:49 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:31:49 user nova-compute[72362]:       <mac address="fa:16:3e:39:ad:fb"/>
Aug 09 10:31:49 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:31:49 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:31:49 user nova-compute[72362]:       <target dev="tap0942f4eb-e7"/>
Aug 09 10:31:49 user nova-compute[72362]:     </interface>
Aug 09 10:31:49 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:31:49 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/4b22a19f-300c-42fb-8175-e737eef7d531/console.log" append="off"/>
Aug 09 10:31:49 user nova-compute[72362]:     </serial>
Aug 09 10:31:49 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:31:49 user nova-compute[72362]:     <video>
Aug 09 10:31:49 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:31:49 user nova-compute[72362]:     </video>
Aug 09 10:31:49 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:31:49 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:31:49 user nova-compute[72362]:     </rng>
Aug 09 10:31:49 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:31:49 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:31:49 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:31:49 user nova-compute[72362]:     </memballoon>
Aug 09 10:31:49 user nova-compute[72362]:   </devices>
Aug 09 10:31:49 user nova-compute[72362]: </domain>
Aug 09 10:31:49 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:31:49 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:29:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1888482065',display_name='tempest-ServerActionsTestOtherA-server-1888482065',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1888482065',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwSFF251eQti/qkoXtJtG/hsB95elMyv8iaeRUjgcdf3ZQpb25r9rbEB2fGNjqP3pvOqQxJNR/NqVUD62omNMx/akMv5+i7VAu1R/GqhP2vqtVAvdiRNee4z2ROG7Jd8w==',key_name='tempest-keypair-122703468',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:29:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8ac22022944542c0b52dd912d3dbcce2',ramdisk_id='',reservation_id='r-08r15keq',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2101881579',owner_user_name='tempest-ServerActionsTestOtherA-2101881579-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:31:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='990e2d160fdc4c599cee9f65d6d4e41d',uuid=4b22a19f-300c-42fb-8175-e737eef7d531,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa", "address": "fa:16:3e:39:ad:fb", "network": {"id": "e6c54663-74e3-43e2-8f0d-61b300c1f68d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1222286883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1222286883-network", "vif_mac": "fa:16:3e:39:ad:fb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ac22022944542c0b52dd912d3dbcce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0942f4eb-e7", "ovs_interfaceid": "0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:31:49 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Converting VIF {"id": "0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa", "address": "fa:16:3e:39:ad:fb", "network": {"id": "e6c54663-74e3-43e2-8f0d-61b300c1f68d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1222286883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1222286883-network", "vif_mac": "fa:16:3e:39:ad:fb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ac22022944542c0b52dd912d3dbcce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0942f4eb-e7", "ovs_interfaceid": "0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:31:49 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:ad:fb,bridge_name='br-int',has_traffic_filtering=True,id=0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa,network=Network(e6c54663-74e3-43e2-8f0d-61b300c1f68d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0942f4eb-e7') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:31:49 user nova-compute[72362]: DEBUG os_vif [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:ad:fb,bridge_name='br-int',has_traffic_filtering=True,id=0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa,network=Network(e6c54663-74e3-43e2-8f0d-61b300c1f68d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0942f4eb-e7') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:31:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:31:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:31:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0942f4eb-e7, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:31:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0942f4eb-e7, col_values=(('external_ids', {'iface-id': '0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:ad:fb', 'vm-uuid': '4b22a19f-300c-42fb-8175-e737eef7d531'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:31:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:31:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:49 user nova-compute[72362]: INFO os_vif [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:ad:fb,bridge_name='br-int',has_traffic_filtering=True,id=0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa,network=Network(e6c54663-74e3-43e2-8f0d-61b300c1f68d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0942f4eb-e7')
Aug 09 10:31:49 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:31:49 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] No VIF found with MAC fa:16:3e:39:ad:fb, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:31:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:51 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691577096.0201306, 4b22a19f-300c-42fb-8175-e737eef7d531 => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:31:51 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] VM Stopped (Lifecycle Event)
Aug 09 10:31:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:51 user nova-compute[72362]: DEBUG nova.compute.manager [None req-0c739dfc-4933-4a45-9f74-535cfb233827 None None] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:31:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:51 user nova-compute[72362]: DEBUG nova.compute.manager [req-32a9323f-0de2-4343-be99-67760a80ddc5 req-a78b76c2-924a-4bf0-9b29-c4a1532d95e6 service nova] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Received event network-vif-plugged-0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:31:51 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-32a9323f-0de2-4343-be99-67760a80ddc5 req-a78b76c2-924a-4bf0-9b29-c4a1532d95e6 service nova] Acquiring lock "4b22a19f-300c-42fb-8175-e737eef7d531-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:31:51 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-32a9323f-0de2-4343-be99-67760a80ddc5 req-a78b76c2-924a-4bf0-9b29-c4a1532d95e6 service nova] Lock "4b22a19f-300c-42fb-8175-e737eef7d531-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:31:51 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-32a9323f-0de2-4343-be99-67760a80ddc5 req-a78b76c2-924a-4bf0-9b29-c4a1532d95e6 service nova] Lock "4b22a19f-300c-42fb-8175-e737eef7d531-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:31:51 user nova-compute[72362]: DEBUG nova.compute.manager [req-32a9323f-0de2-4343-be99-67760a80ddc5 req-a78b76c2-924a-4bf0-9b29-c4a1532d95e6 service nova] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] No waiting events found dispatching network-vif-plugged-0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:31:51 user nova-compute[72362]: WARNING nova.compute.manager [req-32a9323f-0de2-4343-be99-67760a80ddc5 req-a78b76c2-924a-4bf0-9b29-c4a1532d95e6 service nova] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Received unexpected event network-vif-plugged-0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa for instance with vm_state active and task_state resize_finish.
Aug 09 10:31:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:52 user nova-compute[72362]: DEBUG nova.compute.manager [req-49c299f1-a3c4-4f67-a0ea-a67e2f771eaa req-c9e3b31a-62f8-4d2d-ad7c-22b50d2ab18d service nova] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Received event network-changed-8f5858da-09e3-4939-8bf2-c6e8b35d8100 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:31:52 user nova-compute[72362]: DEBUG nova.compute.manager [req-49c299f1-a3c4-4f67-a0ea-a67e2f771eaa req-c9e3b31a-62f8-4d2d-ad7c-22b50d2ab18d service nova] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Refreshing instance network info cache due to event network-changed-8f5858da-09e3-4939-8bf2-c6e8b35d8100. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:31:52 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-49c299f1-a3c4-4f67-a0ea-a67e2f771eaa req-c9e3b31a-62f8-4d2d-ad7c-22b50d2ab18d service nova] Acquiring lock "refresh_cache-9268633a-36f0-4bd2-85f2-22ae7911a1f9" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:31:52 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-49c299f1-a3c4-4f67-a0ea-a67e2f771eaa req-c9e3b31a-62f8-4d2d-ad7c-22b50d2ab18d service nova] Acquired lock "refresh_cache-9268633a-36f0-4bd2-85f2-22ae7911a1f9" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:31:52 user nova-compute[72362]: DEBUG nova.network.neutron [req-49c299f1-a3c4-4f67-a0ea-a67e2f771eaa req-c9e3b31a-62f8-4d2d-ad7c-22b50d2ab18d service nova] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Refreshing network info cache for port 8f5858da-09e3-4939-8bf2-c6e8b35d8100 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:31:52 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-cf274b6a-cae1-498a-9674-dd4f4a697b94 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Acquiring lock "9268633a-36f0-4bd2-85f2-22ae7911a1f9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:31:52 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-cf274b6a-cae1-498a-9674-dd4f4a697b94 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "9268633a-36f0-4bd2-85f2-22ae7911a1f9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:31:52 user nova-compute[72362]: DEBUG nova.objects.instance [None req-cf274b6a-cae1-498a-9674-dd4f4a697b94 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lazy-loading 'flavor' on Instance uuid 9268633a-36f0-4bd2-85f2-22ae7911a1f9 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:31:52 user nova-compute[72362]: DEBUG nova.network.neutron [req-49c299f1-a3c4-4f67-a0ea-a67e2f771eaa req-c9e3b31a-62f8-4d2d-ad7c-22b50d2ab18d service nova] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Updated VIF entry in instance network info cache for port 8f5858da-09e3-4939-8bf2-c6e8b35d8100. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:31:52 user nova-compute[72362]: DEBUG nova.network.neutron [req-49c299f1-a3c4-4f67-a0ea-a67e2f771eaa req-c9e3b31a-62f8-4d2d-ad7c-22b50d2ab18d service nova] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Updating instance_info_cache with network_info: [{"id": "8f5858da-09e3-4939-8bf2-c6e8b35d8100", "address": "fa:16:3e:46:83:42", "network": {"id": "5fe3b8dc-aa50-4e53-bb4d-2dcb773e501e", "bridge": "br-int", "label": "tempest-TestStampPattern-205380618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bb5a3be50242059591c9cbf8cc0f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f5858da-09", "ovs_interfaceid": "8f5858da-09e3-4939-8bf2-c6e8b35d8100", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:31:52 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-49c299f1-a3c4-4f67-a0ea-a67e2f771eaa req-c9e3b31a-62f8-4d2d-ad7c-22b50d2ab18d service nova] Releasing lock "refresh_cache-9268633a-36f0-4bd2-85f2-22ae7911a1f9" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:31:52 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-cf274b6a-cae1-498a-9674-dd4f4a697b94 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "9268633a-36f0-4bd2-85f2-22ae7911a1f9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:31:53 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-cf274b6a-cae1-498a-9674-dd4f4a697b94 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Acquiring lock "9268633a-36f0-4bd2-85f2-22ae7911a1f9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:31:53 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-cf274b6a-cae1-498a-9674-dd4f4a697b94 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "9268633a-36f0-4bd2-85f2-22ae7911a1f9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:31:53 user nova-compute[72362]: INFO nova.compute.manager [None req-cf274b6a-cae1-498a-9674-dd4f4a697b94 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Attaching volume 648672c2-9b30-4231-a76c-dba0e3cfa0a4 to /dev/vdb
Aug 09 10:31:53 user nova-compute[72362]: DEBUG nova.compute.manager [req-e74ddf62-3b74-42d8-8344-b83b80d914b5 req-69a77dde-5963-4e29-b595-ffd145e147ce service nova] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Received event network-vif-plugged-0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:31:53 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e74ddf62-3b74-42d8-8344-b83b80d914b5 req-69a77dde-5963-4e29-b595-ffd145e147ce service nova] Acquiring lock "4b22a19f-300c-42fb-8175-e737eef7d531-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:31:53 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e74ddf62-3b74-42d8-8344-b83b80d914b5 req-69a77dde-5963-4e29-b595-ffd145e147ce service nova] Lock "4b22a19f-300c-42fb-8175-e737eef7d531-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:31:53 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e74ddf62-3b74-42d8-8344-b83b80d914b5 req-69a77dde-5963-4e29-b595-ffd145e147ce service nova] Lock "4b22a19f-300c-42fb-8175-e737eef7d531-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:31:53 user nova-compute[72362]: DEBUG nova.compute.manager [req-e74ddf62-3b74-42d8-8344-b83b80d914b5 req-69a77dde-5963-4e29-b595-ffd145e147ce service nova] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] No waiting events found dispatching network-vif-plugged-0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:31:53 user nova-compute[72362]: WARNING nova.compute.manager [req-e74ddf62-3b74-42d8-8344-b83b80d914b5 req-69a77dde-5963-4e29-b595-ffd145e147ce service nova] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Received unexpected event network-vif-plugged-0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa for instance with vm_state active and task_state resize_finish.
Aug 09 10:31:53 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577113.3842614, 4b22a19f-300c-42fb-8175-e737eef7d531 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:31:53 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] VM Resumed (Lifecycle Event)
Aug 09 10:31:53 user nova-compute[72362]: DEBUG nova.compute.manager [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:31:53 user nova-compute[72362]: DEBUG os_brick.utils [None req-cf274b6a-cae1-498a-9674-dd4f4a697b94 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:31:53 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:31:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:53 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Instance running successfully.
Aug 09 10:31:53 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:31:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Failed to set time: agent not configured {{(pid=72362) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 09 10:31:53 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-94b6c607-4e7d-4077-a505-0b1c115f45c0 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] finish_migration finished successfully. {{(pid=72362) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 09 10:31:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:53 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b165ff-46a6-4efc-861a-c70ca7aeae0c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:53 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 09 10:31:53 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577113.385884, 4b22a19f-300c-42fb-8175-e737eef7d531 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:31:53 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] VM Started (Lifecycle Event)
Aug 09 10:31:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:53 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[28006896-22da-4224-a052-831d10256ca8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:53 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:31:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:31:53 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[52fd128d-24e6-454b-b558-74a8926e2581]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:53 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:31:53 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e399175-430d-4dfe-9098-0f44856cb555]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-cf274b6a-cae1-498a-9674-dd4f4a697b94 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-cf274b6a-cae1-498a-9674-dd4f4a697b94 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:31:53 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cf274b6a-cae1-498a-9674-dd4f4a697b94 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:31:53 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 09 10:31:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:31:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:31:53 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:31:53 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2dd82fa-38d6-47a5-ace2-4e95e7668347]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:31:53 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-cf274b6a-cae1-498a-9674-dd4f4a697b94 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:31:53 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-cf274b6a-cae1-498a-9674-dd4f4a697b94 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:31:53 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-cf274b6a-cae1-498a-9674-dd4f4a697b94 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:31:53 user nova-compute[72362]: DEBUG os_brick.utils [None req-cf274b6a-cae1-498a-9674-dd4f4a697b94 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:31:53 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-cf274b6a-cae1-498a-9674-dd4f4a697b94 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Updating existing volume attachment record: 1cdbfe48-3e74-4488-9d01-bad57ee3e7b8 {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 10:31:54 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:56 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:31:56 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:31:56 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Cleaning up deleted instances {{(pid=72362) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 10:31:56 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] There are 0 instances to clean {{(pid=72362) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 10:31:57 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691577102.0074959, 8d42f648-8616-4974-b416-0b6534b002cc => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:31:57 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] VM Stopped (Lifecycle Event)
Aug 09 10:31:57 user nova-compute[72362]: DEBUG nova.compute.manager [None req-f8896cc0-267b-44e4-a513-59d2c54bded4 None None] [instance: 8d42f648-8616-4974-b416-0b6534b002cc] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:31:57 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:31:57 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:31:59 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:00 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:32:00 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 10:32:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:01 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:32:01 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:32:01 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf274b6a-cae1-498a-9674-dd4f4a697b94 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:32:02 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf274b6a-cae1-498a-9674-dd4f4a697b94 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:648672c2-9b30-4231-a76c-dba0e3cfa0a4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YNLntUbj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:32:02 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-cf274b6a-cae1-498a-9674-dd4f4a697b94 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:32:02 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-cf274b6a-cae1-498a-9674-dd4f4a697b94 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:32:02 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-cf274b6a-cae1-498a-9674-dd4f4a697b94 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:32:02 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-cf274b6a-cae1-498a-9674-dd4f4a697b94 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:32:02 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-cf274b6a-cae1-498a-9674-dd4f4a697b94 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:648672c2-9b30-4231-a76c-dba0e3cfa0a4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:32:02 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-cf274b6a-cae1-498a-9674-dd4f4a697b94 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:648672c2-9b30-4231-a76c-dba0e3cfa0a4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:32:02 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-cf274b6a-cae1-498a-9674-dd4f4a697b94 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:32:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:648672c2-9b30-4231-a76c-dba0e3cfa0a4 -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:32:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:648672c2-9b30-4231-a76c-dba0e3cfa0a4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:32:02 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f8bf2b-a2f7-4a7a-8cca-efd2b653f2f3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:32:02 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf274b6a-cae1-498a-9674-dd4f4a697b94 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:32:02 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:32:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:648672c2-9b30-4231-a76c-dba0e3cfa0a4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:32:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:648672c2-9b30-4231-a76c-dba0e3cfa0a4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:32:02 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b45f81-64a3-40a5-9fc8-b75cb2860512]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:648672c2-9b30-4231-a76c-dba0e3cfa0a4] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:32:02 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf274b6a-cae1-498a-9674-dd4f4a697b94 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:648672c2-9b30-4231-a76c-dba0e3cfa0a4] added
Aug 09 10:32:02 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:32:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:648672c2-9b30-4231-a76c-dba0e3cfa0a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:32:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:648672c2-9b30-4231-a76c-dba0e3cfa0a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:32:02 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[55fba9da-61df-4469-933d-82ac98be9d0e]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:32:02 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf274b6a-cae1-498a-9674-dd4f4a697b94 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:32:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:648672c2-9b30-4231-a76c-dba0e3cfa0a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:32:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:648672c2-9b30-4231-a76c-dba0e3cfa0a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:32:02 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[7613b4f8-0897-4867-9de0-67c0f17d4aab]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:32:02 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf274b6a-cae1-498a-9674-dd4f4a697b94 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:32:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:648672c2-9b30-4231-a76c-dba0e3cfa0a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YNLntUbj {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:32:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:648672c2-9b30-4231-a76c-dba0e3cfa0a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YNLntUbj" returned: 0 in 0.028s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:32:02 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2f2ba3-6210-45f0-bd6f-cc37e59a97c8]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:32:02 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf274b6a-cae1-498a-9674-dd4f4a697b94 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YNLntUbj'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:32:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:648672c2-9b30-4231-a76c-dba0e3cfa0a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:32:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:648672c2-9b30-4231-a76c-dba0e3cfa0a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:32:02 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d661153-4dc1-4fed-bcd4-039b12bb6719]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:32:02 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf274b6a-cae1-498a-9674-dd4f4a697b94 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:32:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:32:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.081s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:32:02 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b100fc18-075c-4b33-a0ac-9e65d0dd5f37]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:32:02 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf274b6a-cae1-498a-9674-dd4f4a697b94 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:32:02 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:32:02 user nova-compute[72362]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:32:02 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:32:02 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf274b6a-cae1-498a-9674-dd4f4a697b94 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:32:02 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:32:02 user nova-compute[72362]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:32:02 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:32:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:648672c2-9b30-4231-a76c-dba0e3cfa0a4 -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:32:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:648672c2-9b30-4231-a76c-dba0e3cfa0a4 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:32:02 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[286235db-ad16-460e-8c94-54ae60b94605]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:648672c2-9b30-4231-a76c-dba0e3cfa0a4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:648672c2-9b30-4231-a76c-dba0e3cfa0a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:32:02 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf274b6a-cae1-498a-9674-dd4f4a697b94 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:648672c2-9b30-4231-a76c-dba0e3cfa0a4, portal: 172.16.0.220,3260]
Aug 09 10:32:02 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:648672c2-9b30-4231-a76c-dba0e3cfa0a4, portal: 172.16.0.220,3260] successful.
Aug 09 10:32:02 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:32:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:648672c2-9b30-4231-a76c-dba0e3cfa0a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:32:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:648672c2-9b30-4231-a76c-dba0e3cfa0a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:32:02 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[01afad18-a399-4325-b209-ac24c268f022]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:32:02 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf274b6a-cae1-498a-9674-dd4f4a697b94 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:32:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:32:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:32:02 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de16ccf-1246-4849-84e2-676795704429]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:648672c2-9b30-4231-a76c-dba0e3cfa0a4 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:32:02 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf274b6a-cae1-498a-9674-dd4f4a697b94 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:32:02 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:32:02 user nova-compute[72362]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:32:02 user nova-compute[72362]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:648672c2-9b30-4231-a76c-dba0e3cfa0a4 (non-flash)
Aug 09 10:32:02 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:32:02 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf274b6a-cae1-498a-9674-dd4f4a697b94 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:32:02 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:32:02 user nova-compute[72362]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:32:02 user nova-compute[72362]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:648672c2-9b30-4231-a76c-dba0e3cfa0a4 (non-flash)
Aug 09 10:32:02 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:32:02 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-cf274b6a-cae1-498a-9674-dd4f4a697b94 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:648672c2-9b30-4231-a76c-dba0e3cfa0a4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:32:02 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf274b6a-cae1-498a-9674-dd4f4a697b94 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:32:02 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-cf274b6a-cae1-498a-9674-dd4f4a697b94 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] HCTL ('35', '-', '-', 0) found on session 44 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:32:02 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-cf274b6a-cae1-498a-9674-dd4f4a697b94 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:32:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:32:02 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:32:02 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[05271993-bcf7-473e-a6b0-be13e83d81ad]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:32:02 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-cf274b6a-cae1-498a-9674-dd4f4a697b94 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: None {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:32:03 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-cf274b6a-cae1-498a-9674-dd4f4a697b94 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:32:03 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf274b6a-cae1-498a-9674-dd4f4a697b94 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YNLntUbj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:32:03 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-cf274b6a-cae1-498a-9674-dd4f4a697b94 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:32:03 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf274b6a-cae1-498a-9674-dd4f4a697b94 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] <== connect_volume: return (1387ms) {'type': 'block', 'scsi_wwn': '23637666638653030', 'path': '/dev/sdd'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:32:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf274b6a-cae1-498a-9674-dd4f4a697b94 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637666638653030', 'path': '/dev/sdd'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:32:03 user nova-compute[72362]: DEBUG nova.objects.instance [None req-cf274b6a-cae1-498a-9674-dd4f4a697b94 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lazy-loading 'flavor' on Instance uuid 9268633a-36f0-4bd2-85f2-22ae7911a1f9 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:32:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-cf274b6a-cae1-498a-9674-dd4f4a697b94 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 10:32:03 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:32:03 user nova-compute[72362]:   <source dev="/dev/sdd"/>
Aug 09 10:32:03 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:32:03 user nova-compute[72362]:   <serial>648672c2-9b30-4231-a76c-dba0e3cfa0a4</serial>
Aug 09 10:32:03 user nova-compute[72362]: </disk>
Aug 09 10:32:03 user nova-compute[72362]:  {{(pid=72362) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 10:32:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-cf274b6a-cae1-498a-9674-dd4f4a697b94 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:32:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-cf274b6a-cae1-498a-9674-dd4f4a697b94 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:32:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-cf274b6a-cae1-498a-9674-dd4f4a697b94 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] No VIF found with MAC fa:16:3e:46:83:42, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:32:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-cf274b6a-cae1-498a-9674-dd4f4a697b94 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "9268633a-36f0-4bd2-85f2-22ae7911a1f9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.622s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:32:03 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:32:03 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:32:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:04 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:32:04 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 10:32:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "refresh_cache-09fcf27a-c6dc-4c4a-b73c-555ea2339967" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:32:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquired lock "refresh_cache-09fcf27a-c6dc-4c4a-b73c-555ea2339967" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:32:05 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Forcefully refreshing network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 10:32:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-8da48d94-eca0-432c-89dd-58070000facf tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Acquiring lock "9268633a-36f0-4bd2-85f2-22ae7911a1f9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:32:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-8da48d94-eca0-432c-89dd-58070000facf tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "9268633a-36f0-4bd2-85f2-22ae7911a1f9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:32:05 user nova-compute[72362]: INFO nova.compute.manager [None req-8da48d94-eca0-432c-89dd-58070000facf tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Detaching volume 648672c2-9b30-4231-a76c-dba0e3cfa0a4
Aug 09 10:32:05 user nova-compute[72362]: INFO nova.virt.block_device [None req-8da48d94-eca0-432c-89dd-58070000facf tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Attempting to driver detach volume 648672c2-9b30-4231-a76c-dba0e3cfa0a4 from mountpoint /dev/vdb
Aug 09 10:32:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-8da48d94-eca0-432c-89dd-58070000facf tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Attempting to detach device vdb from instance 9268633a-36f0-4bd2-85f2-22ae7911a1f9 from the persistent domain config. {{(pid=72362) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 10:32:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-8da48d94-eca0-432c-89dd-58070000facf tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 10:32:05 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:32:05 user nova-compute[72362]:   <source dev="/dev/sdd"/>
Aug 09 10:32:05 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:32:05 user nova-compute[72362]:   <serial>648672c2-9b30-4231-a76c-dba0e3cfa0a4</serial>
Aug 09 10:32:05 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 10:32:05 user nova-compute[72362]: </disk>
Aug 09 10:32:05 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:32:05 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-8da48d94-eca0-432c-89dd-58070000facf tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Successfully detached device vdb from instance 9268633a-36f0-4bd2-85f2-22ae7911a1f9 from the persistent domain config.
Aug 09 10:32:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-8da48d94-eca0-432c-89dd-58070000facf tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9268633a-36f0-4bd2-85f2-22ae7911a1f9 from the live domain config. {{(pid=72362) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 10:32:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-8da48d94-eca0-432c-89dd-58070000facf tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 10:32:05 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:32:05 user nova-compute[72362]:   <source dev="/dev/sdd"/>
Aug 09 10:32:05 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:32:05 user nova-compute[72362]:   <serial>648672c2-9b30-4231-a76c-dba0e3cfa0a4</serial>
Aug 09 10:32:05 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 10:32:05 user nova-compute[72362]: </disk>
Aug 09 10:32:05 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:32:05 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Updating instance_info_cache with network_info: [{"id": "f99044c7-fa30-4e74-b2f3-0e937c17b02e", "address": "fa:16:3e:40:57:6c", "network": {"id": "5fe3b8dc-aa50-4e53-bb4d-2dcb773e501e", "bridge": "br-int", "label": "tempest-TestStampPattern-205380618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bb5a3be50242059591c9cbf8cc0f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf99044c7-fa", "ovs_interfaceid": "f99044c7-fa30-4e74-b2f3-0e937c17b02e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:32:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Releasing lock "refresh_cache-09fcf27a-c6dc-4c4a-b73c-555ea2339967" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:32:05 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Updated the network info_cache for instance {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 10:32:05 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:32:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Received event <DeviceRemovedEvent: 1691577125.8757315, 9268633a-36f0-4bd2-85f2-22ae7911a1f9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72362) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 10:32:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-8da48d94-eca0-432c-89dd-58070000facf tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9268633a-36f0-4bd2-85f2-22ae7911a1f9 {{(pid=72362) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 10:32:05 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-8da48d94-eca0-432c-89dd-58070000facf tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Successfully detached device vdb from instance 9268633a-36f0-4bd2-85f2-22ae7911a1f9 from the live domain config.
Aug 09 10:32:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8da48d94-eca0-432c-89dd-58070000facf tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:32:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da48d94-eca0-432c-89dd-58070000facf tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:648672c2-9b30-4231-a76c-dba0e3cfa0a4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YNLntUbj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:32:05 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-8da48d94-eca0-432c-89dd-58070000facf tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:32:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-8da48d94-eca0-432c-89dd-58070000facf tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:32:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-8da48d94-eca0-432c-89dd-58070000facf tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:32:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da48d94-eca0-432c-89dd-58070000facf tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:648672c2-9b30-4231-a76c-dba0e3cfa0a4', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:32:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:32:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:32:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ccb5356-58f2-4994-81d1-f4d506416d30]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:648672c2-9b30-4231-a76c-dba0e3cfa0a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:32:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:32:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:32:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19e7d16-5888-476c-90db-9837f17a7a89]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:648672c2-9b30-4231-a76c-dba0e3cfa0a4 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:32:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da48d94-eca0-432c-89dd-58070000facf tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:32:05 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:32:05 user nova-compute[72362]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:32:05 user nova-compute[72362]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:648672c2-9b30-4231-a76c-dba0e3cfa0a4 (non-flash)
Aug 09 10:32:05 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:32:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da48d94-eca0-432c-89dd-58070000facf tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:32:05 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:32:05 user nova-compute[72362]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:32:05 user nova-compute[72362]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:648672c2-9b30-4231-a76c-dba0e3cfa0a4 (non-flash)
Aug 09 10:32:05 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:32:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da48d94-eca0-432c-89dd-58070000facf tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e43c5e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:648672c2-9b30-4231-a76c-dba0e3cfa0a4'): ({'sdd'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:32:05 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-8da48d94-eca0-432c-89dd-58070000facf tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Removing single pathed devices sdd {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:32:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:32:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:32:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a022e7-ce92-4185-99b4-51bed62c9c0e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:32:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:32:05 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:32:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:32:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e466d9-a9bf-4f67-bcbe-d10731ef2885]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:32:05 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-8da48d94-eca0-432c-89dd-58070000facf tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Flushing IO for device /dev/sdd {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:32:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:32:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:32:06 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f289fe-e454-44a7-b52e-400f27684f98]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:32:06 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-8da48d94-eca0-432c-89dd-58070000facf tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:32:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:32:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:32:06 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab0eabe-93fb-4294-a9c0-2c3b7e184647]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:32:06 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-8da48d94-eca0-432c-89dd-58070000facf tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:32:06 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-8da48d94-eca0-432c-89dd-58070000facf tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] SCSI volumes sdd have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:32:06 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da48d94-eca0-432c-89dd-58070000facf tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:648672c2-9b30-4231-a76c-dba0e3cfa0a4')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:32:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:648672c2-9b30-4231-a76c-dba0e3cfa0a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:32:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:648672c2-9b30-4231-a76c-dba0e3cfa0a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:32:06 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a21093-949c-4204-9561-48d499f5fe46]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:32:06 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da48d94-eca0-432c-89dd-58070000facf tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:32:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:648672c2-9b30-4231-a76c-dba0e3cfa0a4 -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:32:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:648672c2-9b30-4231-a76c-dba0e3cfa0a4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:32:06 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e78ebdb-7a60-421c-b395-3fc3a68ab9a1]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:648672c2-9b30-4231-a76c-dba0e3cfa0a4, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:648672c2-9b30-4231-a76c-dba0e3cfa0a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:32:06 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da48d94-eca0-432c-89dd-58070000facf tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:648672c2-9b30-4231-a76c-dba0e3cfa0a4, portal: 172.16.0.220,3260]
Aug 09 10:32:06 user nova-compute[72362]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:648672c2-9b30-4231-a76c-dba0e3cfa0a4, portal: 172.16.0.220,3260] successful.
Aug 09 10:32:06 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:32:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:648672c2-9b30-4231-a76c-dba0e3cfa0a4 -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:32:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:648672c2-9b30-4231-a76c-dba0e3cfa0a4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:32:06 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c8b677-f8eb-4489-b8d6-69b61e9a2529]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:32:06 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da48d94-eca0-432c-89dd-58070000facf tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:32:06 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-8da48d94-eca0-432c-89dd-58070000facf tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:32:06 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da48d94-eca0-432c-89dd-58070000facf tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] <== disconnect_volume: return (281ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:32:06 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8da48d94-eca0-432c-89dd-58070000facf tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:32:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:06 user nova-compute[72362]: DEBUG nova.objects.instance [None req-8da48d94-eca0-432c-89dd-58070000facf tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lazy-loading 'flavor' on Instance uuid 9268633a-36f0-4bd2-85f2-22ae7911a1f9 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:32:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-8da48d94-eca0-432c-89dd-58070000facf tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "9268633a-36f0-4bd2-85f2-22ae7911a1f9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.657s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:32:09 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Acquiring lock "14e4ba46-d39d-4163-873a-6957ce64e635" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:32:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "14e4ba46-d39d-4163-873a-6957ce64e635" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:32:09 user nova-compute[72362]: DEBUG nova.compute.manager [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Starting instance... {{(pid=72362) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 10:32:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:32:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:32:09 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:32:09 user nova-compute[72362]: INFO nova.compute.claims [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Claim successful on node user
Aug 09 10:32:10 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:32:10 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:32:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.463s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:32:10 user nova-compute[72362]: DEBUG nova.compute.manager [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Start building networks asynchronously for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 10:32:10 user nova-compute[72362]: DEBUG nova.compute.manager [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Allocating IP information in the background. {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 10:32:10 user nova-compute[72362]: DEBUG nova.network.neutron [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] allocate_for_instance() {{(pid=72362) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 10:32:10 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 10:32:10 user nova-compute[72362]: DEBUG nova.compute.manager [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Start building block device mappings for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 10:32:10 user nova-compute[72362]: DEBUG nova.policy [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec007d0aa3c144f5a24a4913cc336ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dac04663e2f45378cc0e466740342d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72362) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 10:32:10 user nova-compute[72362]: DEBUG nova.compute.manager [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Start spawning the instance on the hypervisor. {{(pid=72362) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 10:32:10 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:32:10 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Creating image(s)
Aug 09 10:32:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Acquiring lock "/opt/stack/data/nova/instances/14e4ba46-d39d-4163-873a-6957ce64e635/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:32:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "/opt/stack/data/nova/instances/14e4ba46-d39d-4163-873a-6957ce64e635/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:32:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "/opt/stack/data/nova/instances/14e4ba46-d39d-4163-873a-6957ce64e635/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:32:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:32:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.130s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:32:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Acquiring lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:32:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:32:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:32:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.131s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:32:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/14e4ba46-d39d-4163-873a-6957ce64e635/disk 1073741824 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:32:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/14e4ba46-d39d-4163-873a-6957ce64e635/disk 1073741824" returned: 0 in 0.048s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:32:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.185s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:32:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:32:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.131s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:32:11 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Checking if we can resize image /opt/stack/data/nova/instances/14e4ba46-d39d-4163-873a-6957ce64e635/disk. size=1073741824 {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 10:32:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e4ba46-d39d-4163-873a-6957ce64e635/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:32:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e4ba46-d39d-4163-873a-6957ce64e635/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:32:11 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Cannot resize image /opt/stack/data/nova/instances/14e4ba46-d39d-4163-873a-6957ce64e635/disk to a smaller size. {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 10:32:11 user nova-compute[72362]: DEBUG nova.objects.instance [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lazy-loading 'migration_context' on Instance uuid 14e4ba46-d39d-4163-873a-6957ce64e635 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:32:11 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Created local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 10:32:11 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Ensure instance console log exists: /opt/stack/data/nova/instances/14e4ba46-d39d-4163-873a-6957ce64e635/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:32:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:32:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:32:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:32:11 user nova-compute[72362]: DEBUG nova.network.neutron [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Successfully created port: 96c248f7-669c-49dd-b2bb-0e8668584239 {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:32:11 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:11 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:32:12 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:32:12 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:32:12 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:32:12 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 10:32:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:32:12 user nova-compute[72362]: DEBUG nova.network.neutron [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Successfully updated port: 96c248f7-669c-49dd-b2bb-0e8668584239 {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:32:12 user nova-compute[72362]: DEBUG nova.compute.manager [req-edf446cf-a4cf-4d04-8a18-cef07967d7e4 req-811a7c5a-e967-42b5-9d78-ad7fb73f88fe service nova] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Received event network-changed-96c248f7-669c-49dd-b2bb-0e8668584239 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:32:12 user nova-compute[72362]: DEBUG nova.compute.manager [req-edf446cf-a4cf-4d04-8a18-cef07967d7e4 req-811a7c5a-e967-42b5-9d78-ad7fb73f88fe service nova] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Refreshing instance network info cache due to event network-changed-96c248f7-669c-49dd-b2bb-0e8668584239. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:32:12 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-edf446cf-a4cf-4d04-8a18-cef07967d7e4 req-811a7c5a-e967-42b5-9d78-ad7fb73f88fe service nova] Acquiring lock "refresh_cache-14e4ba46-d39d-4163-873a-6957ce64e635" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:32:12 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-edf446cf-a4cf-4d04-8a18-cef07967d7e4 req-811a7c5a-e967-42b5-9d78-ad7fb73f88fe service nova] Acquired lock "refresh_cache-14e4ba46-d39d-4163-873a-6957ce64e635" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:32:12 user nova-compute[72362]: DEBUG nova.network.neutron [req-edf446cf-a4cf-4d04-8a18-cef07967d7e4 req-811a7c5a-e967-42b5-9d78-ad7fb73f88fe service nova] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Refreshing network info cache for port 96c248f7-669c-49dd-b2bb-0e8668584239 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:32:12 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Acquiring lock "refresh_cache-14e4ba46-d39d-4163-873a-6957ce64e635" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:32:12 user nova-compute[72362]: DEBUG nova.network.neutron [req-edf446cf-a4cf-4d04-8a18-cef07967d7e4 req-811a7c5a-e967-42b5-9d78-ad7fb73f88fe service nova] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:32:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:32:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:32:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:32:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09fcf27a-c6dc-4c4a-b73c-555ea2339967/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:32:12 user nova-compute[72362]: DEBUG nova.network.neutron [req-edf446cf-a4cf-4d04-8a18-cef07967d7e4 req-811a7c5a-e967-42b5-9d78-ad7fb73f88fe service nova] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:32:12 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-edf446cf-a4cf-4d04-8a18-cef07967d7e4 req-811a7c5a-e967-42b5-9d78-ad7fb73f88fe service nova] Releasing lock "refresh_cache-14e4ba46-d39d-4163-873a-6957ce64e635" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:32:12 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Acquired lock "refresh_cache-14e4ba46-d39d-4163-873a-6957ce64e635" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:32:12 user nova-compute[72362]: DEBUG nova.network.neutron [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:32:12 user nova-compute[72362]: DEBUG nova.network.neutron [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:32:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09fcf27a-c6dc-4c4a-b73c-555ea2339967/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:32:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09fcf27a-c6dc-4c4a-b73c-555ea2339967/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:32:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09fcf27a-c6dc-4c4a-b73c-555ea2339967/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:32:12 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:32:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5502750a-6b11-4600-9363-a814a12573d2/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:32:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5502750a-6b11-4600-9363-a814a12573d2/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:32:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5502750a-6b11-4600-9363-a814a12573d2/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:32:13 user nova-compute[72362]: DEBUG nova.network.neutron [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Updating instance_info_cache with network_info: [{"id": "96c248f7-669c-49dd-b2bb-0e8668584239", "address": "fa:16:3e:89:4b:4e", "network": {"id": "7358b925-3211-4419-84eb-df6967f5ea8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1360753488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dac04663e2f45378cc0e466740342d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96c248f7-66", "ovs_interfaceid": "96c248f7-669c-49dd-b2bb-0e8668584239", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:32:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Releasing lock "refresh_cache-14e4ba46-d39d-4163-873a-6957ce64e635" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:32:13 user nova-compute[72362]: DEBUG nova.compute.manager [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Instance network_info: |[{"id": "96c248f7-669c-49dd-b2bb-0e8668584239", "address": "fa:16:3e:89:4b:4e", "network": {"id": "7358b925-3211-4419-84eb-df6967f5ea8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1360753488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dac04663e2f45378cc0e466740342d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96c248f7-66", "ovs_interfaceid": "96c248f7-669c-49dd-b2bb-0e8668584239", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 10:32:13 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Start _get_guest_xml network_info=[{"id": "96c248f7-669c-49dd-b2bb-0e8668584239", "address": "fa:16:3e:89:4b:4e", "network": {"id": "7358b925-3211-4419-84eb-df6967f5ea8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1360753488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dac04663e2f45378cc0e466740342d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96c248f7-66", "ovs_interfaceid": "96c248f7-669c-49dd-b2bb-0e8668584239", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': 'a08d1a11-49eb-4212-a351-e11ee9553b95'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:32:13 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:32:13 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:32:13 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:32:13 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:32:13 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:32:13 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:32:13 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:32:13 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:32:13 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:32:13 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:32:13 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:32:13 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:32:13 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:32:13 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:32:13 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:32:13 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:32:13 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:32:13 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:32:13 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:32:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1121390700',display_name='tempest-AttachVolumeTestJSON-server-1121390700',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1121390700',id=34,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMiZQd3dVSmASREC4D1H6EW44d+FKdFRNgU6bF/OpKJKtiz2F3bHAClk8luDZaJpv/lIwGiezALNov6NlNhdeBWeXfA2dxHRY7PogRnhQZzW7iJflXqMSSfMoQs3MldtEw==',key_name='tempest-keypair-1881273753',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9dac04663e2f45378cc0e466740342d2',ramdisk_id='',reservation_id='r-p16xclaa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-986857971',owner_user_name='tempest-AttachVolumeTestJSON-986857971-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:32:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec007d0aa3c144f5a24a4913cc336ebb',uuid=14e4ba46-d39d-4163-873a-6957ce64e635,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96c248f7-669c-49dd-b2bb-0e8668584239", "address": "fa:16:3e:89:4b:4e", "network": {"id": "7358b925-3211-4419-84eb-df6967f5ea8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1360753488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dac04663e2f45378cc0e466740342d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96c248f7-66", "ovs_interfaceid": "96c248f7-669c-49dd-b2bb-0e8668584239", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:32:13 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Converting VIF {"id": "96c248f7-669c-49dd-b2bb-0e8668584239", "address": "fa:16:3e:89:4b:4e", "network": {"id": "7358b925-3211-4419-84eb-df6967f5ea8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1360753488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dac04663e2f45378cc0e466740342d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96c248f7-66", "ovs_interfaceid": "96c248f7-669c-49dd-b2bb-0e8668584239", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:32:13 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:4b:4e,bridge_name='br-int',has_traffic_filtering=True,id=96c248f7-669c-49dd-b2bb-0e8668584239,network=Network(7358b925-3211-4419-84eb-df6967f5ea8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96c248f7-66') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:32:13 user nova-compute[72362]: DEBUG nova.objects.instance [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lazy-loading 'pci_devices' on Instance uuid 14e4ba46-d39d-4163-873a-6957ce64e635 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:32:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5502750a-6b11-4600-9363-a814a12573d2/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:32:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:32:13 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:32:13 user nova-compute[72362]:   <uuid>14e4ba46-d39d-4163-873a-6957ce64e635</uuid>
Aug 09 10:32:13 user nova-compute[72362]:   <name>instance-00000022</name>
Aug 09 10:32:13 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:32:13 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:32:13 user nova-compute[72362]:   <metadata>
Aug 09 10:32:13 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:32:13 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:32:13 user nova-compute[72362]:       <nova:name>tempest-AttachVolumeTestJSON-server-1121390700</nova:name>
Aug 09 10:32:13 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:32:13</nova:creationTime>
Aug 09 10:32:13 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:32:13 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:32:13 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:32:13 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:32:13 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:32:13 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:32:13 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:32:13 user nova-compute[72362]:       <nova:owner>
Aug 09 10:32:13 user nova-compute[72362]:         <nova:user uuid="ec007d0aa3c144f5a24a4913cc336ebb">tempest-AttachVolumeTestJSON-986857971-project-member</nova:user>
Aug 09 10:32:13 user nova-compute[72362]:         <nova:project uuid="9dac04663e2f45378cc0e466740342d2">tempest-AttachVolumeTestJSON-986857971</nova:project>
Aug 09 10:32:13 user nova-compute[72362]:       </nova:owner>
Aug 09 10:32:13 user nova-compute[72362]:       <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:32:13 user nova-compute[72362]:       <nova:ports>
Aug 09 10:32:13 user nova-compute[72362]:         <nova:port uuid="96c248f7-669c-49dd-b2bb-0e8668584239">
Aug 09 10:32:13 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 10:32:13 user nova-compute[72362]:         </nova:port>
Aug 09 10:32:13 user nova-compute[72362]:       </nova:ports>
Aug 09 10:32:13 user nova-compute[72362]:     </nova:instance>
Aug 09 10:32:13 user nova-compute[72362]:   </metadata>
Aug 09 10:32:13 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:32:13 user nova-compute[72362]:     <system>
Aug 09 10:32:13 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:32:13 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:32:13 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:32:13 user nova-compute[72362]:       <entry name="serial">14e4ba46-d39d-4163-873a-6957ce64e635</entry>
Aug 09 10:32:13 user nova-compute[72362]:       <entry name="uuid">14e4ba46-d39d-4163-873a-6957ce64e635</entry>
Aug 09 10:32:13 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:32:13 user nova-compute[72362]:     </system>
Aug 09 10:32:13 user nova-compute[72362]:   </sysinfo>
Aug 09 10:32:13 user nova-compute[72362]:   <os>
Aug 09 10:32:13 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:32:13 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:32:13 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:32:13 user nova-compute[72362]:   </os>
Aug 09 10:32:13 user nova-compute[72362]:   <features>
Aug 09 10:32:13 user nova-compute[72362]:     <acpi/>
Aug 09 10:32:13 user nova-compute[72362]:     <apic/>
Aug 09 10:32:13 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:32:13 user nova-compute[72362]:   </features>
Aug 09 10:32:13 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:32:13 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:32:13 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:32:13 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:32:13 user nova-compute[72362]:   </clock>
Aug 09 10:32:13 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:32:13 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:32:13 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:32:13 user nova-compute[72362]:   </cpu>
Aug 09 10:32:13 user nova-compute[72362]:   <devices>
Aug 09 10:32:13 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:32:13 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:32:13 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/14e4ba46-d39d-4163-873a-6957ce64e635/disk"/>
Aug 09 10:32:13 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:32:13 user nova-compute[72362]:     </disk>
Aug 09 10:32:13 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:32:13 user nova-compute[72362]:       <mac address="fa:16:3e:89:4b:4e"/>
Aug 09 10:32:13 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:32:13 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:32:13 user nova-compute[72362]:       <target dev="tap96c248f7-66"/>
Aug 09 10:32:13 user nova-compute[72362]:     </interface>
Aug 09 10:32:13 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:32:13 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/14e4ba46-d39d-4163-873a-6957ce64e635/console.log" append="off"/>
Aug 09 10:32:13 user nova-compute[72362]:     </serial>
Aug 09 10:32:13 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:32:13 user nova-compute[72362]:     <video>
Aug 09 10:32:13 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:32:13 user nova-compute[72362]:     </video>
Aug 09 10:32:13 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:32:13 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:32:13 user nova-compute[72362]:     </rng>
Aug 09 10:32:13 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:32:13 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:32:13 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:32:13 user nova-compute[72362]:     </memballoon>
Aug 09 10:32:13 user nova-compute[72362]:   </devices>
Aug 09 10:32:13 user nova-compute[72362]: </domain>
Aug 09 10:32:13 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:32:13 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:32:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1121390700',display_name='tempest-AttachVolumeTestJSON-server-1121390700',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1121390700',id=34,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMiZQd3dVSmASREC4D1H6EW44d+FKdFRNgU6bF/OpKJKtiz2F3bHAClk8luDZaJpv/lIwGiezALNov6NlNhdeBWeXfA2dxHRY7PogRnhQZzW7iJflXqMSSfMoQs3MldtEw==',key_name='tempest-keypair-1881273753',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9dac04663e2f45378cc0e466740342d2',ramdisk_id='',reservation_id='r-p16xclaa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-986857971',owner_user_name='tempest-AttachVolumeTestJSON-986857971-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:32:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec007d0aa3c144f5a24a4913cc336ebb',uuid=14e4ba46-d39d-4163-873a-6957ce64e635,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96c248f7-669c-49dd-b2bb-0e8668584239", "address": "fa:16:3e:89:4b:4e", "network": {"id": "7358b925-3211-4419-84eb-df6967f5ea8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1360753488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dac04663e2f45378cc0e466740342d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96c248f7-66", "ovs_interfaceid": "96c248f7-669c-49dd-b2bb-0e8668584239", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:32:13 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Converting VIF {"id": "96c248f7-669c-49dd-b2bb-0e8668584239", "address": "fa:16:3e:89:4b:4e", "network": {"id": "7358b925-3211-4419-84eb-df6967f5ea8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1360753488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dac04663e2f45378cc0e466740342d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96c248f7-66", "ovs_interfaceid": "96c248f7-669c-49dd-b2bb-0e8668584239", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:32:13 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:4b:4e,bridge_name='br-int',has_traffic_filtering=True,id=96c248f7-669c-49dd-b2bb-0e8668584239,network=Network(7358b925-3211-4419-84eb-df6967f5ea8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96c248f7-66') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:32:13 user nova-compute[72362]: DEBUG os_vif [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:4b:4e,bridge_name='br-int',has_traffic_filtering=True,id=96c248f7-669c-49dd-b2bb-0e8668584239,network=Network(7358b925-3211-4419-84eb-df6967f5ea8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96c248f7-66') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:32:13 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:13 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:32:13 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:32:13 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:13 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96c248f7-66, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:32:13 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap96c248f7-66, col_values=(('external_ids', {'iface-id': '96c248f7-669c-49dd-b2bb-0e8668584239', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:4b:4e', 'vm-uuid': '14e4ba46-d39d-4163-873a-6957ce64e635'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:32:13 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:32:13 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:13 user nova-compute[72362]: INFO os_vif [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:4b:4e,bridge_name='br-int',has_traffic_filtering=True,id=96c248f7-669c-49dd-b2bb-0e8668584239,network=Network(7358b925-3211-4419-84eb-df6967f5ea8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96c248f7-66')
Aug 09 10:32:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:32:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:32:13 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:32:13 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] No VIF found with MAC fa:16:3e:89:4b:4e, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:32:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:32:13 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:32:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:32:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:32:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:32:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:32:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:32:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:32:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:32:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:32:14 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:32:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9268633a-36f0-4bd2-85f2-22ae7911a1f9/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:32:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9268633a-36f0-4bd2-85f2-22ae7911a1f9/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:32:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9268633a-36f0-4bd2-85f2-22ae7911a1f9/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:32:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9268633a-36f0-4bd2-85f2-22ae7911a1f9/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:32:17 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577136.8520138, 14e4ba46-d39d-4163-873a-6957ce64e635 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:32:17 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] VM Resumed (Lifecycle Event)
Aug 09 10:32:17 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:17 user nova-compute[72362]: DEBUG nova.compute.manager [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:32:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:32:17 user nova-compute[72362]: DEBUG nova.compute.manager [req-5885930c-2ae3-4c07-b59d-6b20f4308625 req-66f1ed46-fd38-4c21-ab1f-80cefa7354e1 service nova] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Received event network-vif-plugged-96c248f7-669c-49dd-b2bb-0e8668584239 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:32:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-5885930c-2ae3-4c07-b59d-6b20f4308625 req-66f1ed46-fd38-4c21-ab1f-80cefa7354e1 service nova] Acquiring lock "14e4ba46-d39d-4163-873a-6957ce64e635-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:32:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-5885930c-2ae3-4c07-b59d-6b20f4308625 req-66f1ed46-fd38-4c21-ab1f-80cefa7354e1 service nova] Lock "14e4ba46-d39d-4163-873a-6957ce64e635-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:32:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-5885930c-2ae3-4c07-b59d-6b20f4308625 req-66f1ed46-fd38-4c21-ab1f-80cefa7354e1 service nova] Lock "14e4ba46-d39d-4163-873a-6957ce64e635-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:32:17 user nova-compute[72362]: DEBUG nova.compute.manager [req-5885930c-2ae3-4c07-b59d-6b20f4308625 req-66f1ed46-fd38-4c21-ab1f-80cefa7354e1 service nova] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] No waiting events found dispatching network-vif-plugged-96c248f7-669c-49dd-b2bb-0e8668584239 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:32:17 user nova-compute[72362]: WARNING nova.compute.manager [req-5885930c-2ae3-4c07-b59d-6b20f4308625 req-66f1ed46-fd38-4c21-ab1f-80cefa7354e1 service nova] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Received unexpected event network-vif-plugged-96c248f7-669c-49dd-b2bb-0e8668584239 for instance with vm_state building and task_state spawning.
Aug 09 10:32:17 user nova-compute[72362]: DEBUG nova.compute.manager [req-5a130ebe-486e-4f60-bcab-67d736bdb0be req-6ec42789-5bef-4fd5-8e6f-186aceda3250 service nova] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Received event network-vif-plugged-96c248f7-669c-49dd-b2bb-0e8668584239 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:32:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-5a130ebe-486e-4f60-bcab-67d736bdb0be req-6ec42789-5bef-4fd5-8e6f-186aceda3250 service nova] Acquiring lock "14e4ba46-d39d-4163-873a-6957ce64e635-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:32:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-5a130ebe-486e-4f60-bcab-67d736bdb0be req-6ec42789-5bef-4fd5-8e6f-186aceda3250 service nova] Lock "14e4ba46-d39d-4163-873a-6957ce64e635-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:32:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-5a130ebe-486e-4f60-bcab-67d736bdb0be req-6ec42789-5bef-4fd5-8e6f-186aceda3250 service nova] Lock "14e4ba46-d39d-4163-873a-6957ce64e635-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:32:17 user nova-compute[72362]: DEBUG nova.compute.manager [req-5a130ebe-486e-4f60-bcab-67d736bdb0be req-6ec42789-5bef-4fd5-8e6f-186aceda3250 service nova] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] No waiting events found dispatching network-vif-plugged-96c248f7-669c-49dd-b2bb-0e8668584239 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:32:17 user nova-compute[72362]: WARNING nova.compute.manager [req-5a130ebe-486e-4f60-bcab-67d736bdb0be req-6ec42789-5bef-4fd5-8e6f-186aceda3250 service nova] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Received unexpected event network-vif-plugged-96c248f7-669c-49dd-b2bb-0e8668584239 for instance with vm_state building and task_state spawning.
Aug 09 10:32:17 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:32:17 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:32:17 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:32:17 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:32:17 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=7308MB free_disk=24.96739959716797GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 10:32:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:32:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:32:17 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Instance spawned successfully.
Aug 09 10:32:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 10:32:17 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:32:17 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577136.8526175, 14e4ba46-d39d-4163-873a-6957ce64e635 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:32:17 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] VM Started (Lifecycle Event)
Aug 09 10:32:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Found default for hw_cdrom_bus of ide {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:32:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Found default for hw_disk_bus of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:32:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:32:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:32:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Found default for hw_video_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:32:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Found default for hw_vif_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:32:17 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:32:17 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:32:17 user nova-compute[72362]: INFO nova.compute.manager [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Took 6.73 seconds to spawn the instance on the hypervisor.
Aug 09 10:32:17 user nova-compute[72362]: DEBUG nova.compute.manager [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:32:17 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:32:17 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Applying migration context for instance 4b22a19f-300c-42fb-8175-e737eef7d531 as it has an incoming, in-progress migration 923fa5eb-be1a-447b-a6b8-eee245a0e028. Migration status is finished {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 09 10:32:17 user nova-compute[72362]: INFO nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Updating resource usage from migration 923fa5eb-be1a-447b-a6b8-eee245a0e028
Aug 09 10:32:17 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 8e055c58-a365-4f18-a6e3-377e32e2189d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:32:17 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:32:17 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 30213e67-6b1d-4d97-a971-1544335d02fb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:32:17 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 09fcf27a-c6dc-4c4a-b73c-555ea2339967 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:32:17 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance f8abc99c-b87b-4586-b9d4-7f5bcda60683 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:32:17 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance fe1804e8-2340-4868-a0ff-32d5df5fad42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:32:17 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 9268633a-36f0-4bd2-85f2-22ae7911a1f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:32:17 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance f3cdf152-da86-447b-aa7c-921b6fa87ef8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:32:17 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Migration 923fa5eb-be1a-447b-a6b8-eee245a0e028 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 09 10:32:17 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 4b22a19f-300c-42fb-8175-e737eef7d531 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:32:17 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 5502750a-6b11-4600-9363-a814a12573d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:32:17 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 14e4ba46-d39d-4163-873a-6957ce64e635 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:32:17 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 10:32:17 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 10:32:17 user nova-compute[72362]: INFO nova.compute.manager [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Took 7.62 seconds to build instance.
Aug 09 10:32:17 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Refreshing inventories for resource provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 10:32:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-de0abf15-09b6-428d-958b-3b7e808a3954 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "14e4ba46-d39d-4163-873a-6957ce64e635" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.707s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:32:17 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Updating ProviderTree inventory for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 10:32:17 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Updating inventory in ProviderTree for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 10:32:17 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Refreshing aggregate associations for resource provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d, aggregates: None {{(pid=72362) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 10:32:17 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Refreshing trait associations for resource provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE41,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=72362) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 10:32:17 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:32:17 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:32:17 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 10:32:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.684s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:32:17 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:32:17 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72362) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 10:32:18 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:21 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:23 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:33 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:34 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:43 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:48 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:48 user nova-compute[72362]: INFO nova.compute.manager [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Rescuing
Aug 09 10:32:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquiring lock "refresh_cache-f3cdf152-da86-447b-aa7c-921b6fa87ef8" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:32:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquired lock "refresh_cache-f3cdf152-da86-447b-aa7c-921b6fa87ef8" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:32:48 user nova-compute[72362]: DEBUG nova.network.neutron [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:32:49 user nova-compute[72362]: DEBUG nova.network.neutron [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Updating instance_info_cache with network_info: [{"id": "cb4bdd64-bb23-4c96-8912-377268174872", "address": "fa:16:3e:78:c7:96", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4bdd64-bb", "ovs_interfaceid": "cb4bdd64-bb23-4c96-8912-377268174872", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:32:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Releasing lock "refresh_cache-f3cdf152-da86-447b-aa7c-921b6fa87ef8" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:32:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:49 user nova-compute[72362]: DEBUG nova.compute.manager [req-4754ada6-b9e2-46c4-8b10-c734ed2e6c05 req-01497606-2be0-4c1d-831e-6a57a0e70dfb service nova] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Received event network-vif-unplugged-cb4bdd64-bb23-4c96-8912-377268174872 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:32:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-4754ada6-b9e2-46c4-8b10-c734ed2e6c05 req-01497606-2be0-4c1d-831e-6a57a0e70dfb service nova] Acquiring lock "f3cdf152-da86-447b-aa7c-921b6fa87ef8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:32:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-4754ada6-b9e2-46c4-8b10-c734ed2e6c05 req-01497606-2be0-4c1d-831e-6a57a0e70dfb service nova] Lock "f3cdf152-da86-447b-aa7c-921b6fa87ef8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:32:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-4754ada6-b9e2-46c4-8b10-c734ed2e6c05 req-01497606-2be0-4c1d-831e-6a57a0e70dfb service nova] Lock "f3cdf152-da86-447b-aa7c-921b6fa87ef8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:32:49 user nova-compute[72362]: DEBUG nova.compute.manager [req-4754ada6-b9e2-46c4-8b10-c734ed2e6c05 req-01497606-2be0-4c1d-831e-6a57a0e70dfb service nova] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] No waiting events found dispatching network-vif-unplugged-cb4bdd64-bb23-4c96-8912-377268174872 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:32:49 user nova-compute[72362]: WARNING nova.compute.manager [req-4754ada6-b9e2-46c4-8b10-c734ed2e6c05 req-01497606-2be0-4c1d-831e-6a57a0e70dfb service nova] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Received unexpected event network-vif-unplugged-cb4bdd64-bb23-4c96-8912-377268174872 for instance with vm_state active and task_state rescuing.
Aug 09 10:32:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:49 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Instance destroyed successfully.
Aug 09 10:32:49 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Attempting a stable device rescue
Aug 09 10:32:49 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72362) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 09 10:32:50 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Instance directory exists: not creating {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 10:32:50 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Creating image(s)
Aug 09 10:32:50 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquiring lock "/opt/stack/data/nova/instances/f3cdf152-da86-447b-aa7c-921b6fa87ef8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:32:50 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "/opt/stack/data/nova/instances/f3cdf152-da86-447b-aa7c-921b6fa87ef8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:32:50 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "/opt/stack/data/nova/instances/f3cdf152-da86-447b-aa7c-921b6fa87ef8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:32:50 user nova-compute[72362]: DEBUG nova.objects.instance [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lazy-loading 'trusted_certs' on Instance uuid f3cdf152-da86-447b-aa7c-921b6fa87ef8 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:32:50 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquiring lock "4247a6e5926a6adae5a036d931426b57f15c814b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:32:50 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "4247a6e5926a6adae5a036d931426b57f15c814b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:32:50 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:51 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4247a6e5926a6adae5a036d931426b57f15c814b.part --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:32:51 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4247a6e5926a6adae5a036d931426b57f15c814b.part --force-share --output=json" returned: 0 in 0.143s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:32:51 user nova-compute[72362]: DEBUG nova.virt.images [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] 9aca778a-ce74-476a-9332-0f5b9107435b was qcow2, converting to raw {{(pid=72362) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 10:32:51 user nova-compute[72362]: DEBUG nova.privsep.utils [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72362) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 10:32:51 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4247a6e5926a6adae5a036d931426b57f15c814b.part /opt/stack/data/nova/instances/_base/4247a6e5926a6adae5a036d931426b57f15c814b.converted {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:32:51 user nova-compute[72362]: DEBUG nova.compute.manager [req-379b6777-a15d-4608-8f5b-54209a9a5557 req-07c5b5d7-3e01-4b82-ba71-f8e56b29b80f service nova] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Received event network-vif-plugged-cb4bdd64-bb23-4c96-8912-377268174872 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:32:51 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-379b6777-a15d-4608-8f5b-54209a9a5557 req-07c5b5d7-3e01-4b82-ba71-f8e56b29b80f service nova] Acquiring lock "f3cdf152-da86-447b-aa7c-921b6fa87ef8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:32:51 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-379b6777-a15d-4608-8f5b-54209a9a5557 req-07c5b5d7-3e01-4b82-ba71-f8e56b29b80f service nova] Lock "f3cdf152-da86-447b-aa7c-921b6fa87ef8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:32:51 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-379b6777-a15d-4608-8f5b-54209a9a5557 req-07c5b5d7-3e01-4b82-ba71-f8e56b29b80f service nova] Lock "f3cdf152-da86-447b-aa7c-921b6fa87ef8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:32:51 user nova-compute[72362]: DEBUG nova.compute.manager [req-379b6777-a15d-4608-8f5b-54209a9a5557 req-07c5b5d7-3e01-4b82-ba71-f8e56b29b80f service nova] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] No waiting events found dispatching network-vif-plugged-cb4bdd64-bb23-4c96-8912-377268174872 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:32:51 user nova-compute[72362]: WARNING nova.compute.manager [req-379b6777-a15d-4608-8f5b-54209a9a5557 req-07c5b5d7-3e01-4b82-ba71-f8e56b29b80f service nova] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Received unexpected event network-vif-plugged-cb4bdd64-bb23-4c96-8912-377268174872 for instance with vm_state active and task_state rescuing.
Aug 09 10:32:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4247a6e5926a6adae5a036d931426b57f15c814b.part /opt/stack/data/nova/instances/_base/4247a6e5926a6adae5a036d931426b57f15c814b.converted" returned: 0 in 0.756s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4247a6e5926a6adae5a036d931426b57f15c814b.converted --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4247a6e5926a6adae5a036d931426b57f15c814b.converted --force-share --output=json" returned: 0 in 0.148s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "4247a6e5926a6adae5a036d931426b57f15c814b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.258s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquiring lock "4247a6e5926a6adae5a036d931426b57f15c814b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "4247a6e5926a6adae5a036d931426b57f15c814b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4247a6e5926a6adae5a036d931426b57f15c814b --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4247a6e5926a6adae5a036d931426b57f15c814b --force-share --output=json" returned: 0 in 0.135s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4247a6e5926a6adae5a036d931426b57f15c814b,backing_fmt=raw /opt/stack/data/nova/instances/f3cdf152-da86-447b-aa7c-921b6fa87ef8/disk.rescue {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4247a6e5926a6adae5a036d931426b57f15c814b,backing_fmt=raw /opt/stack/data/nova/instances/f3cdf152-da86-447b-aa7c-921b6fa87ef8/disk.rescue" returned: 0 in 0.050s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "4247a6e5926a6adae5a036d931426b57f15c814b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG nova.objects.instance [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lazy-loading 'migration_context' on Instance uuid f3cdf152-da86-447b-aa7c-921b6fa87ef8 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Created local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Start _get_guest_xml network_info=[{"id": "cb4bdd64-bb23-4c96-8912-377268174872", "address": "fa:16:3e:78:c7:96", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "vif_mac": "fa:16:3e:78:c7:96"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4bdd64-bb", "ovs_interfaceid": "cb4bdd64-bb23-4c96-8912-377268174872", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9aca778a-ce74-476a-9332-0f5b9107435b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '349d9b4a-56a1-43d0-b9b0-128e350c18cb', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tAiBWcaz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'f3cdf152-da86-447b-aa7c-921b6fa87ef8', 'attached_at': '', 'detached_at': '', 'volume_id': 'a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3', 'serial': 'a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3'}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG nova.objects.instance [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lazy-loading 'resources' on Instance uuid f3cdf152-da86-447b-aa7c-921b6fa87ef8 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG nova.objects.instance [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lazy-loading 'numa_topology' on Instance uuid f3cdf152-da86-447b-aa7c-921b6fa87ef8 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:32:52 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:32:52 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:32:52 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG nova.objects.instance [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lazy-loading 'vcpu_model' on Instance uuid f3cdf152-da86-447b-aa7c-921b6fa87ef8 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tAiBWcaz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:32:52 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:32:52 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:32:52 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:32:52 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:32:52 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:32:52 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c8a4dd-551d-460b-ad51-713140091659]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = tAiBWcaz\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 09 10:32:52 user nova-compute[72362]: node.name = iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3
Aug 09 10:32:52 user nova-compute[72362]: node.tpgt = -1
Aug 09 10:32:52 user nova-compute[72362]: node.startup = automatic
Aug 09 10:32:52 user nova-compute[72362]: node.leading_login = No
Aug 09 10:32:52 user nova-compute[72362]: iface.iscsi_ifacename = default
Aug 09 10:32:52 user nova-compute[72362]: iface.net_ifacename = <empty>
Aug 09 10:32:52 user nova-compute[72362]: iface.ipaddress = <empty>
Aug 09 10:32:52 user nova-compute[72362]: iface.prefix_len = 0
Aug 09 10:32:52 user nova-compute[72362]: iface.hwaddress = <empty>
Aug 09 10:32:52 user nova-compute[72362]: iface.transport_name = tcp
Aug 09 10:32:52 user nova-compute[72362]: iface.initiatorname = <empty>
Aug 09 10:32:52 user nova-compute[72362]: iface.state = <empty>
Aug 09 10:32:52 user nova-compute[72362]: iface.vlan_id = 0
Aug 09 10:32:52 user nova-compute[72362]: iface.vlan_priority = 0
Aug 09 10:32:52 user nova-compute[72362]: iface.vlan_state = <empty>
Aug 09 10:32:52 user nova-compute[72362]: iface.iface_num = 0
Aug 09 10:32:52 user nova-compute[72362]: iface.mtu = 0
Aug 09 10:32:52 user nova-compute[72362]: iface.port = 0
Aug 09 10:32:52 user nova-compute[72362]: iface.bootproto = <empty>
Aug 09 10:32:52 user nova-compute[72362]: iface.subnet_mask = <empty>
Aug 09 10:32:52 user nova-compute[72362]: iface.gateway = <empty>
Aug 09 10:32:52 user nova-compute[72362]: iface.dhcp_alt_client_id_state = <empty>
Aug 09 10:32:52 user nova-compute[72362]: iface.dhcp_alt_client_id = <empty>
Aug 09 10:32:52 user nova-compute[72362]: iface.dhcp_dns = <empty>
Aug 09 10:32:52 user nova-compute[72362]: iface.dhcp_learn_iqn = <empty>
Aug 09 10:32:52 user nova-compute[72362]: iface.dhcp_req_vendor_id_state = <empty>
Aug 09 10:32:52 user nova-compute[72362]: iface.dhcp_vendor_id_state = <empty>
Aug 09 10:32:52 user nova-compute[72362]: iface.dhcp_vendor_id = <empty>
Aug 09 10:32:52 user nova-compute[72362]: iface.dhcp_slp_da = <empty>
Aug 09 10:32:52 user nova-compute[72362]: iface.fragmentation = <empty>
Aug 09 10:32:52 user nova-compute[72362]: iface.gratuitous_arp = <empty>
Aug 09 10:32:52 user nova-compute[72362]: iface.incoming_forwarding = <empty>
Aug 09 10:32:52 user nova-compute[72362]: iface.tos_state = <empty>
Aug 09 10:32:52 user nova-compute[72362]: iface.tos = 0
Aug 09 10:32:52 user nova-compute[72362]: iface.ttl = 0
Aug 09 10:32:52 user nova-compute[72362]: iface.delayed_ack = <empty>
Aug 09 10:32:52 user nova-compute[72362]: iface.tcp_nagle = <empty>
Aug 09 10:32:52 user nova-compute[72362]: iface.tcp_wsf_state = <empty>
Aug 09 10:32:52 user nova-compute[72362]: iface.tcp_wsf = 0
Aug 09 10:32:52 user nova-compute[72362]: iface.tcp_timer_scale = 0
Aug 09 10:32:52 user nova-compute[72362]: iface.tcp_timestamp = <empty>
Aug 09 10:32:52 user nova-compute[72362]: iface.redirect = <empty>
Aug 09 10:32:52 user nova-compute[72362]: iface.def_task_mgmt_timeout = 0
Aug 09 10:32:52 user nova-compute[72362]: iface.header_digest = <empty>
Aug 09 10:32:52 user nova-compute[72362]: iface.data_digest = <empty>
Aug 09 10:32:52 user nova-compute[72362]: iface.immediate_data = <empty>
Aug 09 10:32:52 user nova-compute[72362]: iface.initial_r2t = <empty>
Aug 09 10:32:52 user nova-compute[72362]: iface.data_seq_inorder = <empty>
Aug 09 10:32:52 user nova-compute[72362]: iface.data_pdu_inorder = <empty>
Aug 09 10:32:52 user nova-compute[72362]: iface.erl = 0
Aug 09 10:32:52 user nova-compute[72362]: iface.max_receive_data_len = 0
Aug 09 10:32:52 user nova-compute[72362]: iface.first_burst_len = 0
Aug 09 10:32:52 user nova-compute[72362]: iface.max_outstanding_r2t = 0
Aug 09 10:32:52 user nova-compute[72362]: iface.max_burst_len = 0
Aug 09 10:32:52 user nova-compute[72362]: iface.chap_auth = <empty>
Aug 09 10:32:52 user nova-compute[72362]: iface.bidi_chap = <empty>
Aug 09 10:32:52 user nova-compute[72362]: iface.strict_login_compliance = <empty>
Aug 09 10:32:52 user nova-compute[72362]: iface.discovery_auth = <empty>
Aug 09 10:32:52 user nova-compute[72362]: iface.discovery_logout = <empty>
Aug 09 10:32:52 user nova-compute[72362]: node.discovery_address = <empty>
Aug 09 10:32:52 user nova-compute[72362]: node.discovery_port = 0
Aug 09 10:32:52 user nova-compute[72362]: node.discovery_type = static
Aug 09 10:32:52 user nova-compute[72362]: node.session.initial_cmdsn = 0
Aug 09 10:32:52 user nova-compute[72362]: node.session.initial_login_retry_max = 8
Aug 09 10:32:52 user nova-compute[72362]: node.session.xmit_thread_priority = -20
Aug 09 10:32:52 user nova-compute[72362]: node.session.cmds_max = 128
Aug 09 10:32:52 user nova-compute[72362]: node.session.queue_depth = 32
Aug 09 10:32:52 user nova-compute[72362]: node.session.nr_sessions = 1
Aug 09 10:32:52 user nova-compute[72362]: node.session.auth.authmethod = CHAP
Aug 09 10:32:52 user nova-compute[72362]: node.session.auth.username = tAiBWcaz
Aug 09 10:32:52 user nova-compute[72362]: node.session.auth.password = ***
Aug 09 10:32:52 user nova-compute[72362]: node.session.auth.username_in = <empty>
Aug 09 10:32:52 user nova-compute[72362]: node.session.auth.password_in = <empty>
Aug 09 10:32:52 user nova-compute[72362]: node.session.auth.chap_algs = MD5
Aug 09 10:32:52 user nova-compute[72362]: node.session.timeo.replacement_timeout = 120
Aug 09 10:32:52 user nova-compute[72362]: node.session.err_timeo.abort_timeout = 15
Aug 09 10:32:52 user nova-compute[72362]: node.session.err_timeo.lu_reset_timeout = 30
Aug 09 10:32:52 user nova-compute[72362]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 09 10:32:52 user nova-compute[72362]: node.session.err_timeo.host_reset_timeout = 60
Aug 09 10:32:52 user nova-compute[72362]: node.session.iscsi.FastAbort = Yes
Aug 09 10:32:52 user nova-compute[72362]: node.session.iscsi.InitialR2T = No
Aug 09 10:32:52 user nova-compute[72362]: node.session.iscsi.ImmediateData = Yes
Aug 09 10:32:52 user nova-compute[72362]: node.session.iscsi.FirstBurstLength = 262144
Aug 09 10:32:52 user nova-compute[72362]: node.session.iscsi.MaxBurstLength = 16776192
Aug 09 10:32:52 user nova-compute[72362]: node.session.iscsi.DefaultTime2Retain = 0
Aug 09 10:32:52 user nova-compute[72362]: node.session.iscsi.DefaultTime2Wait = 2
Aug 09 10:32:52 user nova-compute[72362]: node.session.iscsi.MaxConnections = 1
Aug 09 10:32:52 user nova-compute[72362]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 09 10:32:52 user nova-compute[72362]: node.session.iscsi.ERL = 0
Aug 09 10:32:52 user nova-compute[72362]: node.session.scan = manual
Aug 09 10:32:52 user nova-compute[72362]: node.session.reopen_max = 0
Aug 09 10:32:52 user nova-compute[72362]: node.conn[0].address = 172.16.0.220
Aug 09 10:32:52 user nova-compute[72362]: node.conn[0].port = 3260
Aug 09 10:32:52 user nova-compute[72362]: node.conn[0].startup = manual
Aug 09 10:32:52 user nova-compute[72362]: node.conn[0].tcp.window_size = 524288
Aug 09 10:32:52 user nova-compute[72362]: node.conn[0].tcp.type_of_service = 0
Aug 09 10:32:52 user nova-compute[72362]: node.conn[0].timeo.logout_timeout = 15
Aug 09 10:32:52 user nova-compute[72362]: node.conn[0].timeo.login_timeout = 15
Aug 09 10:32:52 user nova-compute[72362]: node.conn[0].timeo.auth_timeout = 45
Aug 09 10:32:52 user nova-compute[72362]: node.conn[0].timeo.noop_out_interval = 5
Aug 09 10:32:52 user nova-compute[72362]: node.conn[0].timeo.noop_out_timeout = 5
Aug 09 10:32:52 user nova-compute[72362]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 09 10:32:52 user nova-compute[72362]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 09 10:32:52 user nova-compute[72362]: node.conn[0].iscsi.HeaderDigest = None
Aug 09 10:32:52 user nova-compute[72362]: node.conn[0].iscsi.DataDigest = None
Aug 09 10:32:52 user nova-compute[72362]: node.conn[0].iscsi.IFMarker = No
Aug 09 10:32:52 user nova-compute[72362]: node.conn[0].iscsi.OFMarker = No
Aug 09 10:32:52 user nova-compute[72362]: # END RECORD
Aug 09 10:32:52 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea01831-1ba0-4471-bf36-309e1b3df829]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[7623babf-fdff-4d0f-96bf-6b20cb144a4c]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tAiBWcaz {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tAiBWcaz" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b064d0-5b85-4bc9-9f21-332ea0585c68]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tAiBWcaz'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e8ee1a-e328-43c9-83ff-d7e39d7d2b04]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab07c74f-118a-4192-8503-8bcb2a538f5b]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:32:52 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:32:52 user nova-compute[72362]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:32:52 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:32:52 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:32:52 user nova-compute[72362]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:32:52 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.145s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] HCTL ('33', '0', '0', 0) found on session 42 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3edb76e8-8899-4c02-a03a-0115ba9b2ae2]: (4, ('0 0 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Searching for a device in session 42 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tAiBWcaz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.167s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] <== connect_volume: return (169ms) {'type': 'block', 'scsi_wwn': '23566316431643836', 'path': '/dev/sdb'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566316431643836', 'path': '/dev/sdb'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:30:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2124446381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2124446381',id=32,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:31:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f206cedc59df46deb91e7ec2167c1f2b',ramdisk_id='',reservation_id='r-fmo0v4k0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1706340435',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:31:33Z,user_data=None,user_id='4a1904ffd10b4e8b959971b5e2383113',uuid=f3cdf152-da86-447b-aa7c-921b6fa87ef8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb4bdd64-bb23-4c96-8912-377268174872", "address": "fa:16:3e:78:c7:96", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "vif_mac": "fa:16:3e:78:c7:96"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4bdd64-bb", "ovs_interfaceid": "cb4bdd64-bb23-4c96-8912-377268174872", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Converting VIF {"id": "cb4bdd64-bb23-4c96-8912-377268174872", "address": "fa:16:3e:78:c7:96", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "vif_mac": "fa:16:3e:78:c7:96"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4bdd64-bb", "ovs_interfaceid": "cb4bdd64-bb23-4c96-8912-377268174872", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:c7:96,bridge_name='br-int',has_traffic_filtering=True,id=cb4bdd64-bb23-4c96-8912-377268174872,network=Network(bb852331-57aa-4911-b8ff-30f5411f65b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb4bdd64-bb') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG nova.objects.instance [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lazy-loading 'pci_devices' on Instance uuid f3cdf152-da86-447b-aa7c-921b6fa87ef8 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:32:52 user nova-compute[72362]:   <uuid>f3cdf152-da86-447b-aa7c-921b6fa87ef8</uuid>
Aug 09 10:32:52 user nova-compute[72362]:   <name>instance-00000020</name>
Aug 09 10:32:52 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:32:52 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:32:52 user nova-compute[72362]:   <metadata>
Aug 09 10:32:52 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:32:52 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:32:52 user nova-compute[72362]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2124446381</nova:name>
Aug 09 10:32:52 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:32:52</nova:creationTime>
Aug 09 10:32:52 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:32:52 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:32:52 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:32:52 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:32:52 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:32:52 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:32:52 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:32:52 user nova-compute[72362]:       <nova:owner>
Aug 09 10:32:52 user nova-compute[72362]:         <nova:user uuid="4a1904ffd10b4e8b959971b5e2383113">tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member</nova:user>
Aug 09 10:32:52 user nova-compute[72362]:         <nova:project uuid="f206cedc59df46deb91e7ec2167c1f2b">tempest-ServerBootFromVolumeStableRescueTest-1706340435</nova:project>
Aug 09 10:32:52 user nova-compute[72362]:       </nova:owner>
Aug 09 10:32:52 user nova-compute[72362]:       <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:32:52 user nova-compute[72362]:       <nova:ports>
Aug 09 10:32:52 user nova-compute[72362]:         <nova:port uuid="cb4bdd64-bb23-4c96-8912-377268174872">
Aug 09 10:32:52 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 10:32:52 user nova-compute[72362]:         </nova:port>
Aug 09 10:32:52 user nova-compute[72362]:       </nova:ports>
Aug 09 10:32:52 user nova-compute[72362]:     </nova:instance>
Aug 09 10:32:52 user nova-compute[72362]:   </metadata>
Aug 09 10:32:52 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:32:52 user nova-compute[72362]:     <system>
Aug 09 10:32:52 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:32:52 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:32:52 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:32:52 user nova-compute[72362]:       <entry name="serial">f3cdf152-da86-447b-aa7c-921b6fa87ef8</entry>
Aug 09 10:32:52 user nova-compute[72362]:       <entry name="uuid">f3cdf152-da86-447b-aa7c-921b6fa87ef8</entry>
Aug 09 10:32:52 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:32:52 user nova-compute[72362]:     </system>
Aug 09 10:32:52 user nova-compute[72362]:   </sysinfo>
Aug 09 10:32:52 user nova-compute[72362]:   <os>
Aug 09 10:32:52 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:32:52 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:32:52 user nova-compute[72362]:   </os>
Aug 09 10:32:52 user nova-compute[72362]:   <features>
Aug 09 10:32:52 user nova-compute[72362]:     <acpi/>
Aug 09 10:32:52 user nova-compute[72362]:     <apic/>
Aug 09 10:32:52 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:32:52 user nova-compute[72362]:   </features>
Aug 09 10:32:52 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:32:52 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:32:52 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:32:52 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:32:52 user nova-compute[72362]:   </clock>
Aug 09 10:32:52 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:32:52 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:32:52 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:32:52 user nova-compute[72362]:   </cpu>
Aug 09 10:32:52 user nova-compute[72362]:   <devices>
Aug 09 10:32:52 user nova-compute[72362]:     <disk type="block" device="disk">
Aug 09 10:32:52 user nova-compute[72362]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:32:52 user nova-compute[72362]:       <source dev="/dev/sdb"/>
Aug 09 10:32:52 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:32:52 user nova-compute[72362]:       <serial>a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3</serial>
Aug 09 10:32:52 user nova-compute[72362]:     </disk>
Aug 09 10:32:52 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:32:52 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:32:52 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/f3cdf152-da86-447b-aa7c-921b6fa87ef8/disk.rescue"/>
Aug 09 10:32:52 user nova-compute[72362]:       <target dev="vdb" bus="virtio"/>
Aug 09 10:32:52 user nova-compute[72362]:       <boot order="1"/>
Aug 09 10:32:52 user nova-compute[72362]:     </disk>
Aug 09 10:32:52 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:32:52 user nova-compute[72362]:       <mac address="fa:16:3e:78:c7:96"/>
Aug 09 10:32:52 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:32:52 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:32:52 user nova-compute[72362]:       <target dev="tapcb4bdd64-bb"/>
Aug 09 10:32:52 user nova-compute[72362]:     </interface>
Aug 09 10:32:52 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:32:52 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/f3cdf152-da86-447b-aa7c-921b6fa87ef8/console.log" append="off"/>
Aug 09 10:32:52 user nova-compute[72362]:     </serial>
Aug 09 10:32:52 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:32:52 user nova-compute[72362]:     <video>
Aug 09 10:32:52 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:32:52 user nova-compute[72362]:     </video>
Aug 09 10:32:52 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:32:52 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:32:52 user nova-compute[72362]:     </rng>
Aug 09 10:32:52 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:32:52 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:32:52 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:32:52 user nova-compute[72362]:     </memballoon>
Aug 09 10:32:52 user nova-compute[72362]:   </devices>
Aug 09 10:32:52 user nova-compute[72362]: </domain>
Aug 09 10:32:52 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:32:52 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Instance destroyed successfully.
Aug 09 10:32:52 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:32:52 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] No VIF found with MAC fa:16:3e:78:c7:96, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:32:53 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:54 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:54 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:54 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:54 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:54 user nova-compute[72362]: DEBUG nova.compute.manager [req-c66ae9b7-8470-44a0-bde0-923527353068 req-123d569d-e89f-466e-860b-041e4ada79c8 service nova] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Received event network-vif-plugged-cb4bdd64-bb23-4c96-8912-377268174872 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:32:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c66ae9b7-8470-44a0-bde0-923527353068 req-123d569d-e89f-466e-860b-041e4ada79c8 service nova] Acquiring lock "f3cdf152-da86-447b-aa7c-921b6fa87ef8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:32:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c66ae9b7-8470-44a0-bde0-923527353068 req-123d569d-e89f-466e-860b-041e4ada79c8 service nova] Lock "f3cdf152-da86-447b-aa7c-921b6fa87ef8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:32:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c66ae9b7-8470-44a0-bde0-923527353068 req-123d569d-e89f-466e-860b-041e4ada79c8 service nova] Lock "f3cdf152-da86-447b-aa7c-921b6fa87ef8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:32:54 user nova-compute[72362]: DEBUG nova.compute.manager [req-c66ae9b7-8470-44a0-bde0-923527353068 req-123d569d-e89f-466e-860b-041e4ada79c8 service nova] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] No waiting events found dispatching network-vif-plugged-cb4bdd64-bb23-4c96-8912-377268174872 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:32:54 user nova-compute[72362]: WARNING nova.compute.manager [req-c66ae9b7-8470-44a0-bde0-923527353068 req-123d569d-e89f-466e-860b-041e4ada79c8 service nova] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Received unexpected event network-vif-plugged-cb4bdd64-bb23-4c96-8912-377268174872 for instance with vm_state active and task_state rescuing.
Aug 09 10:32:54 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:54 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:55 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:32:55 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Triggering sync for uuid 8e055c58-a365-4f18-a6e3-377e32e2189d {{(pid=72362) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 10:32:55 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Triggering sync for uuid 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f {{(pid=72362) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 10:32:55 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Triggering sync for uuid 30213e67-6b1d-4d97-a971-1544335d02fb {{(pid=72362) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 10:32:55 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Triggering sync for uuid 09fcf27a-c6dc-4c4a-b73c-555ea2339967 {{(pid=72362) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 10:32:55 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Triggering sync for uuid f8abc99c-b87b-4586-b9d4-7f5bcda60683 {{(pid=72362) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 10:32:55 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Triggering sync for uuid fe1804e8-2340-4868-a0ff-32d5df5fad42 {{(pid=72362) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 10:32:55 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Triggering sync for uuid 4b22a19f-300c-42fb-8175-e737eef7d531 {{(pid=72362) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 10:32:55 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Triggering sync for uuid 9268633a-36f0-4bd2-85f2-22ae7911a1f9 {{(pid=72362) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 10:32:55 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Triggering sync for uuid f3cdf152-da86-447b-aa7c-921b6fa87ef8 {{(pid=72362) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 10:32:55 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Triggering sync for uuid 5502750a-6b11-4600-9363-a814a12573d2 {{(pid=72362) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 10:32:55 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Triggering sync for uuid 14e4ba46-d39d-4163-873a-6957ce64e635 {{(pid=72362) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 10:32:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "8e055c58-a365-4f18-a6e3-377e32e2189d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:32:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "8e055c58-a365-4f18-a6e3-377e32e2189d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:32:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:32:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:32:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "30213e67-6b1d-4d97-a971-1544335d02fb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:32:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "30213e67-6b1d-4d97-a971-1544335d02fb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:32:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "09fcf27a-c6dc-4c4a-b73c-555ea2339967" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:32:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "09fcf27a-c6dc-4c4a-b73c-555ea2339967" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:32:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "f8abc99c-b87b-4586-b9d4-7f5bcda60683" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:32:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "f8abc99c-b87b-4586-b9d4-7f5bcda60683" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:32:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "fe1804e8-2340-4868-a0ff-32d5df5fad42" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:32:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "fe1804e8-2340-4868-a0ff-32d5df5fad42" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:32:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "4b22a19f-300c-42fb-8175-e737eef7d531" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:32:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "4b22a19f-300c-42fb-8175-e737eef7d531" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:32:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "9268633a-36f0-4bd2-85f2-22ae7911a1f9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:32:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "9268633a-36f0-4bd2-85f2-22ae7911a1f9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:32:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "f3cdf152-da86-447b-aa7c-921b6fa87ef8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:32:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "f3cdf152-da86-447b-aa7c-921b6fa87ef8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:32:55 user nova-compute[72362]: INFO nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 10:32:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "f3cdf152-da86-447b-aa7c-921b6fa87ef8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:32:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "5502750a-6b11-4600-9363-a814a12573d2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:32:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "5502750a-6b11-4600-9363-a814a12573d2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:32:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "14e4ba46-d39d-4163-873a-6957ce64e635" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:32:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "14e4ba46-d39d-4163-873a-6957ce64e635" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:32:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "8e055c58-a365-4f18-a6e3-377e32e2189d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:32:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:32:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "f8abc99c-b87b-4586-b9d4-7f5bcda60683" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:32:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "09fcf27a-c6dc-4c4a-b73c-555ea2339967" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:32:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "30213e67-6b1d-4d97-a971-1544335d02fb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:32:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "4b22a19f-300c-42fb-8175-e737eef7d531" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:32:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "fe1804e8-2340-4868-a0ff-32d5df5fad42" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:32:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "9268633a-36f0-4bd2-85f2-22ae7911a1f9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:32:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "5502750a-6b11-4600-9363-a814a12573d2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:32:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "14e4ba46-d39d-4163-873a-6957ce64e635" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:32:56 user nova-compute[72362]: DEBUG nova.compute.manager [req-0014340d-9498-44d6-b5f0-60519fc7e11c req-33d0190d-67e0-4922-bd9d-b19bb4631098 service nova] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Received event network-changed-8f5858da-09e3-4939-8bf2-c6e8b35d8100 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:32:56 user nova-compute[72362]: DEBUG nova.compute.manager [req-0014340d-9498-44d6-b5f0-60519fc7e11c req-33d0190d-67e0-4922-bd9d-b19bb4631098 service nova] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Refreshing instance network info cache due to event network-changed-8f5858da-09e3-4939-8bf2-c6e8b35d8100. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:32:56 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-0014340d-9498-44d6-b5f0-60519fc7e11c req-33d0190d-67e0-4922-bd9d-b19bb4631098 service nova] Acquiring lock "refresh_cache-9268633a-36f0-4bd2-85f2-22ae7911a1f9" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:32:56 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-0014340d-9498-44d6-b5f0-60519fc7e11c req-33d0190d-67e0-4922-bd9d-b19bb4631098 service nova] Acquired lock "refresh_cache-9268633a-36f0-4bd2-85f2-22ae7911a1f9" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:32:56 user nova-compute[72362]: DEBUG nova.network.neutron [req-0014340d-9498-44d6-b5f0-60519fc7e11c req-33d0190d-67e0-4922-bd9d-b19bb4631098 service nova] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Refreshing network info cache for port 8f5858da-09e3-4939-8bf2-c6e8b35d8100 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:32:56 user nova-compute[72362]: DEBUG nova.compute.manager [req-c07be0f6-2a2a-4c7f-aa07-b229bd740646 req-9f99782d-1ba6-46ad-967b-96c391036818 service nova] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Received event network-vif-plugged-cb4bdd64-bb23-4c96-8912-377268174872 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:32:56 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c07be0f6-2a2a-4c7f-aa07-b229bd740646 req-9f99782d-1ba6-46ad-967b-96c391036818 service nova] Acquiring lock "f3cdf152-da86-447b-aa7c-921b6fa87ef8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:32:56 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c07be0f6-2a2a-4c7f-aa07-b229bd740646 req-9f99782d-1ba6-46ad-967b-96c391036818 service nova] Lock "f3cdf152-da86-447b-aa7c-921b6fa87ef8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:32:56 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c07be0f6-2a2a-4c7f-aa07-b229bd740646 req-9f99782d-1ba6-46ad-967b-96c391036818 service nova] Lock "f3cdf152-da86-447b-aa7c-921b6fa87ef8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:32:56 user nova-compute[72362]: DEBUG nova.compute.manager [req-c07be0f6-2a2a-4c7f-aa07-b229bd740646 req-9f99782d-1ba6-46ad-967b-96c391036818 service nova] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] No waiting events found dispatching network-vif-plugged-cb4bdd64-bb23-4c96-8912-377268174872 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:32:56 user nova-compute[72362]: WARNING nova.compute.manager [req-c07be0f6-2a2a-4c7f-aa07-b229bd740646 req-9f99782d-1ba6-46ad-967b-96c391036818 service nova] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Received unexpected event network-vif-plugged-cb4bdd64-bb23-4c96-8912-377268174872 for instance with vm_state active and task_state rescuing.
Aug 09 10:32:56 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Removed pending event for f3cdf152-da86-447b-aa7c-921b6fa87ef8 due to event {{(pid=72362) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 10:32:56 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577176.4952261, f3cdf152-da86-447b-aa7c-921b6fa87ef8 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:32:56 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] VM Resumed (Lifecycle Event)
Aug 09 10:32:56 user nova-compute[72362]: DEBUG nova.compute.manager [None req-b3ed6fc8-5351-49f3-a1e6-0f34b5e8dd4b tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:32:56 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c2e96f6e-2ba8-436d-8485-1797e25def43 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Acquiring lock "9268633a-36f0-4bd2-85f2-22ae7911a1f9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:32:56 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c2e96f6e-2ba8-436d-8485-1797e25def43 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "9268633a-36f0-4bd2-85f2-22ae7911a1f9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:32:56 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c2e96f6e-2ba8-436d-8485-1797e25def43 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Acquiring lock "9268633a-36f0-4bd2-85f2-22ae7911a1f9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:32:56 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c2e96f6e-2ba8-436d-8485-1797e25def43 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "9268633a-36f0-4bd2-85f2-22ae7911a1f9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:32:56 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c2e96f6e-2ba8-436d-8485-1797e25def43 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "9268633a-36f0-4bd2-85f2-22ae7911a1f9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:32:56 user nova-compute[72362]: INFO nova.compute.manager [None req-c2e96f6e-2ba8-436d-8485-1797e25def43 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Terminating instance
Aug 09 10:32:56 user nova-compute[72362]: DEBUG nova.compute.manager [None req-c2e96f6e-2ba8-436d-8485-1797e25def43 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Start destroying the instance on the hypervisor. {{(pid=72362) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 10:32:56 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:32:56 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:32:56 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 10:32:56 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577176.4954653, f3cdf152-da86-447b-aa7c-921b6fa87ef8 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:32:56 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] VM Started (Lifecycle Event)
Aug 09 10:32:56 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:32:56 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:32:56 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:56 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 10:32:56 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:56 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:56 user nova-compute[72362]: DEBUG nova.compute.manager [req-7f73e2b6-3cfb-446c-acd4-13d835458c81 req-bbc54f88-59cb-480a-89b0-e5e2c3eb5c15 service nova] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Received event network-vif-unplugged-8f5858da-09e3-4939-8bf2-c6e8b35d8100 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:32:56 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-7f73e2b6-3cfb-446c-acd4-13d835458c81 req-bbc54f88-59cb-480a-89b0-e5e2c3eb5c15 service nova] Acquiring lock "9268633a-36f0-4bd2-85f2-22ae7911a1f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:32:56 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-7f73e2b6-3cfb-446c-acd4-13d835458c81 req-bbc54f88-59cb-480a-89b0-e5e2c3eb5c15 service nova] Lock "9268633a-36f0-4bd2-85f2-22ae7911a1f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:32:56 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-7f73e2b6-3cfb-446c-acd4-13d835458c81 req-bbc54f88-59cb-480a-89b0-e5e2c3eb5c15 service nova] Lock "9268633a-36f0-4bd2-85f2-22ae7911a1f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:32:56 user nova-compute[72362]: DEBUG nova.compute.manager [req-7f73e2b6-3cfb-446c-acd4-13d835458c81 req-bbc54f88-59cb-480a-89b0-e5e2c3eb5c15 service nova] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] No waiting events found dispatching network-vif-unplugged-8f5858da-09e3-4939-8bf2-c6e8b35d8100 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:32:56 user nova-compute[72362]: DEBUG nova.compute.manager [req-7f73e2b6-3cfb-446c-acd4-13d835458c81 req-bbc54f88-59cb-480a-89b0-e5e2c3eb5c15 service nova] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Received event network-vif-unplugged-8f5858da-09e3-4939-8bf2-c6e8b35d8100 for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:32:57 user nova-compute[72362]: DEBUG nova.network.neutron [req-0014340d-9498-44d6-b5f0-60519fc7e11c req-33d0190d-67e0-4922-bd9d-b19bb4631098 service nova] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Updated VIF entry in instance network info cache for port 8f5858da-09e3-4939-8bf2-c6e8b35d8100. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:32:57 user nova-compute[72362]: DEBUG nova.network.neutron [req-0014340d-9498-44d6-b5f0-60519fc7e11c req-33d0190d-67e0-4922-bd9d-b19bb4631098 service nova] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Updating instance_info_cache with network_info: [{"id": "8f5858da-09e3-4939-8bf2-c6e8b35d8100", "address": "fa:16:3e:46:83:42", "network": {"id": "5fe3b8dc-aa50-4e53-bb4d-2dcb773e501e", "bridge": "br-int", "label": "tempest-TestStampPattern-205380618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bb5a3be50242059591c9cbf8cc0f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f5858da-09", "ovs_interfaceid": "8f5858da-09e3-4939-8bf2-c6e8b35d8100", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:32:57 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-0014340d-9498-44d6-b5f0-60519fc7e11c req-33d0190d-67e0-4922-bd9d-b19bb4631098 service nova] Releasing lock "refresh_cache-9268633a-36f0-4bd2-85f2-22ae7911a1f9" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:32:57 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Instance destroyed successfully.
Aug 09 10:32:57 user nova-compute[72362]: DEBUG nova.objects.instance [None req-c2e96f6e-2ba8-436d-8485-1797e25def43 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lazy-loading 'resources' on Instance uuid 9268633a-36f0-4bd2-85f2-22ae7911a1f9 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:32:57 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-c2e96f6e-2ba8-436d-8485-1797e25def43 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-2139529972',display_name='tempest-TestStampPattern-server-2139529972',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2139529972',id=31,image_ref='e1066ed9-2540-445b-bde8-8ba4f645dbb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKLVu2dFvNs/80YFheQzFf8fh5quQ6+XNPPKMAWty1o9Sg/SwStPSnUjW/MsHeKbh1Vmc8aVVjHIMDgyHJuEjaJiur5QU2xWgYQwqf957GAtOQZW38FZ3ltyAQ4vCaq5g==',key_name='tempest-TestStampPattern-2134506676',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:30:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d7bb5a3be50242059591c9cbf8cc0f9d',ramdisk_id='',reservation_id='r-opjcpk0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='09fcf27a-c6dc-4c4a-b73c-555ea2339967',image_min_disk='1',image_min_ram='0',image_owner_id='d7bb5a3be50242059591c9cbf8cc0f9d',image_owner_project_name='tempest-TestStampPattern-1731024477',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1731024477-project-member',image_user_id='8bd184d9dcf64c6fa81bf0b7fa68a9b3',owner_project_name='tempest-TestStampPattern-1731024477',owner_user_name='tempest-TestStampPattern-1731024477-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:30:09Z,user_data=None,user_id='8bd184d9dcf64c6fa81bf0b7fa68a9b3',uuid=9268633a-36f0-4bd2-85f2-22ae7911a1f9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f5858da-09e3-4939-8bf2-c6e8b35d8100", "address": "fa:16:3e:46:83:42", "network": {"id": "5fe3b8dc-aa50-4e53-bb4d-2dcb773e501e", "bridge": "br-int", "label": "tempest-TestStampPattern-205380618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bb5a3be50242059591c9cbf8cc0f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f5858da-09", "ovs_interfaceid": "8f5858da-09e3-4939-8bf2-c6e8b35d8100", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:32:57 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-c2e96f6e-2ba8-436d-8485-1797e25def43 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Converting VIF {"id": "8f5858da-09e3-4939-8bf2-c6e8b35d8100", "address": "fa:16:3e:46:83:42", "network": {"id": "5fe3b8dc-aa50-4e53-bb4d-2dcb773e501e", "bridge": "br-int", "label": "tempest-TestStampPattern-205380618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bb5a3be50242059591c9cbf8cc0f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f5858da-09", "ovs_interfaceid": "8f5858da-09e3-4939-8bf2-c6e8b35d8100", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:32:57 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-c2e96f6e-2ba8-436d-8485-1797e25def43 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:83:42,bridge_name='br-int',has_traffic_filtering=True,id=8f5858da-09e3-4939-8bf2-c6e8b35d8100,network=Network(5fe3b8dc-aa50-4e53-bb4d-2dcb773e501e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f5858da-09') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:32:57 user nova-compute[72362]: DEBUG os_vif [None req-c2e96f6e-2ba8-436d-8485-1797e25def43 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:83:42,bridge_name='br-int',has_traffic_filtering=True,id=8f5858da-09e3-4939-8bf2-c6e8b35d8100,network=Network(5fe3b8dc-aa50-4e53-bb4d-2dcb773e501e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f5858da-09') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:32:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f5858da-09, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:32:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:32:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:32:57 user nova-compute[72362]: INFO os_vif [None req-c2e96f6e-2ba8-436d-8485-1797e25def43 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:83:42,bridge_name='br-int',has_traffic_filtering=True,id=8f5858da-09e3-4939-8bf2-c6e8b35d8100,network=Network(5fe3b8dc-aa50-4e53-bb4d-2dcb773e501e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f5858da-09')
Aug 09 10:32:57 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-c2e96f6e-2ba8-436d-8485-1797e25def43 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Deleting instance files /opt/stack/data/nova/instances/9268633a-36f0-4bd2-85f2-22ae7911a1f9_del
Aug 09 10:32:57 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-c2e96f6e-2ba8-436d-8485-1797e25def43 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Deletion of /opt/stack/data/nova/instances/9268633a-36f0-4bd2-85f2-22ae7911a1f9_del complete
Aug 09 10:32:57 user nova-compute[72362]: INFO nova.compute.manager [None req-c2e96f6e-2ba8-436d-8485-1797e25def43 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 09 10:32:57 user nova-compute[72362]: DEBUG oslo.service.loopingcall [None req-c2e96f6e-2ba8-436d-8485-1797e25def43 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72362) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 10:32:57 user nova-compute[72362]: DEBUG nova.compute.manager [-] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Deallocating network for instance {{(pid=72362) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 10:32:57 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] deallocate_for_instance() {{(pid=72362) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 10:32:58 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:32:58 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Took 0.65 seconds to deallocate network for instance.
Aug 09 10:32:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c2e96f6e-2ba8-436d-8485-1797e25def43 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:32:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c2e96f6e-2ba8-436d-8485-1797e25def43 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:32:58 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-c2e96f6e-2ba8-436d-8485-1797e25def43 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:32:58 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-c2e96f6e-2ba8-436d-8485-1797e25def43 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:32:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c2e96f6e-2ba8-436d-8485-1797e25def43 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.495s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:32:58 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-c2e96f6e-2ba8-436d-8485-1797e25def43 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Deleted allocations for instance 9268633a-36f0-4bd2-85f2-22ae7911a1f9
Aug 09 10:32:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c2e96f6e-2ba8-436d-8485-1797e25def43 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "9268633a-36f0-4bd2-85f2-22ae7911a1f9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.298s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:32:58 user nova-compute[72362]: DEBUG nova.compute.manager [req-55371e54-ab75-45ae-8812-c207037e6438 req-93a17cb2-7e18-4beb-80b6-7e5700e0e1be service nova] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Received event network-vif-plugged-8f5858da-09e3-4939-8bf2-c6e8b35d8100 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:32:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-55371e54-ab75-45ae-8812-c207037e6438 req-93a17cb2-7e18-4beb-80b6-7e5700e0e1be service nova] Acquiring lock "9268633a-36f0-4bd2-85f2-22ae7911a1f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:32:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-55371e54-ab75-45ae-8812-c207037e6438 req-93a17cb2-7e18-4beb-80b6-7e5700e0e1be service nova] Lock "9268633a-36f0-4bd2-85f2-22ae7911a1f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:32:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-55371e54-ab75-45ae-8812-c207037e6438 req-93a17cb2-7e18-4beb-80b6-7e5700e0e1be service nova] Lock "9268633a-36f0-4bd2-85f2-22ae7911a1f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:32:59 user nova-compute[72362]: DEBUG nova.compute.manager [req-55371e54-ab75-45ae-8812-c207037e6438 req-93a17cb2-7e18-4beb-80b6-7e5700e0e1be service nova] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] No waiting events found dispatching network-vif-plugged-8f5858da-09e3-4939-8bf2-c6e8b35d8100 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:32:59 user nova-compute[72362]: WARNING nova.compute.manager [req-55371e54-ab75-45ae-8812-c207037e6438 req-93a17cb2-7e18-4beb-80b6-7e5700e0e1be service nova] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Received unexpected event network-vif-plugged-8f5858da-09e3-4939-8bf2-c6e8b35d8100 for instance with vm_state deleted and task_state None.
Aug 09 10:32:59 user nova-compute[72362]: DEBUG nova.compute.manager [req-55371e54-ab75-45ae-8812-c207037e6438 req-93a17cb2-7e18-4beb-80b6-7e5700e0e1be service nova] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Received event network-vif-deleted-8f5858da-09e3-4939-8bf2-c6e8b35d8100 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:33:00 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:33:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d08f70d0-a154-4709-ad14-c3a0a2532081 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Acquiring lock "fe1804e8-2340-4868-a0ff-32d5df5fad42" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:33:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d08f70d0-a154-4709-ad14-c3a0a2532081 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Lock "fe1804e8-2340-4868-a0ff-32d5df5fad42" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:33:00 user nova-compute[72362]: DEBUG nova.objects.instance [None req-d08f70d0-a154-4709-ad14-c3a0a2532081 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Lazy-loading 'flavor' on Instance uuid fe1804e8-2340-4868-a0ff-32d5df5fad42 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:33:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d08f70d0-a154-4709-ad14-c3a0a2532081 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Lock "fe1804e8-2340-4868-a0ff-32d5df5fad42" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.107s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:33:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d08f70d0-a154-4709-ad14-c3a0a2532081 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Acquiring lock "fe1804e8-2340-4868-a0ff-32d5df5fad42" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:33:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d08f70d0-a154-4709-ad14-c3a0a2532081 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Lock "fe1804e8-2340-4868-a0ff-32d5df5fad42" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:33:00 user nova-compute[72362]: INFO nova.compute.manager [None req-d08f70d0-a154-4709-ad14-c3a0a2532081 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Attaching volume 625fa618-b4a1-44bd-9c6f-d825d64285e6 to /dev/vdb
Aug 09 10:33:00 user nova-compute[72362]: DEBUG os_brick.utils [None req-d08f70d0-a154-4709-ad14-c3a0a2532081 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:33:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:00 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9452d8-90bf-48c8-bfca-315fc005cfd6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:00 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ea9b77-7e7d-4bc1-bdd8-e3b826b2fab1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:00 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e26fdc-67a6-40a1-8c5d-43e46a9af0fb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:00 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b929d5-e11b-459e-bc92-a7872ccea7b2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-d08f70d0-a154-4709-ad14-c3a0a2532081 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-d08f70d0-a154-4709-ad14-c3a0a2532081 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:33:00 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d08f70d0-a154-4709-ad14-c3a0a2532081 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:33:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:33:00 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:33:00 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e2a1fb-8746-41de-a108-a3b1cdea22c6]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:00 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-d08f70d0-a154-4709-ad14-c3a0a2532081 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:33:00 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-d08f70d0-a154-4709-ad14-c3a0a2532081 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:33:00 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-d08f70d0-a154-4709-ad14-c3a0a2532081 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:33:00 user nova-compute[72362]: DEBUG os_brick.utils [None req-d08f70d0-a154-4709-ad14-c3a0a2532081 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:33:00 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-d08f70d0-a154-4709-ad14-c3a0a2532081 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Updating existing volume attachment record: 4cfa7ef8-0aaf-47eb-9fb0-e41d1c9779e2 {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 10:33:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:33:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:33:02 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:33:02 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:33:02 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 10:33:03 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:33:04 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:33:05 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:33:05 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 10:33:06 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Didn't find any instances for network info cache update. {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 10:33:06 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:33:06 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:33:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:33:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "5907c2ff-9ac0-4104-b80b-499e200728f1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:33:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "5907c2ff-9ac0-4104-b80b-499e200728f1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:33:07 user nova-compute[72362]: DEBUG nova.compute.manager [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Starting instance... {{(pid=72362) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 10:33:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:33:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:33:07 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:33:07 user nova-compute[72362]: INFO nova.compute.claims [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Claim successful on node user
Aug 09 10:33:08 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:33:08 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:33:08 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.564s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:33:08 user nova-compute[72362]: DEBUG nova.compute.manager [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Start building networks asynchronously for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 10:33:08 user nova-compute[72362]: DEBUG nova.compute.manager [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Allocating IP information in the background. {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 10:33:08 user nova-compute[72362]: DEBUG nova.network.neutron [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] allocate_for_instance() {{(pid=72362) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 10:33:08 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 10:33:08 user nova-compute[72362]: DEBUG nova.compute.manager [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Start building block device mappings for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 10:33:08 user nova-compute[72362]: INFO nova.virt.block_device [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Booting with volume snapshot 83f278a2-4a33-4c43-b987-f7e2b8ac9848 at /dev/vda
Aug 09 10:33:08 user nova-compute[72362]: DEBUG nova.policy [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e96900e953f64d02bdb5d48f136133c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e38599de0b4b06b723f5647a7fe121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72362) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG nova.network.neutron [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Successfully created port: 8c5d102b-ab09-48b6-af7a-924afe72db9e {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d08f70d0-a154-4709-ad14-c3a0a2532081 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08f70d0-a154-4709-ad14-c3a0a2532081 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fMKXJidP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:33:09 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-d08f70d0-a154-4709-ad14-c3a0a2532081 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:33:09 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-d08f70d0-a154-4709-ad14-c3a0a2532081 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-d08f70d0-a154-4709-ad14-c3a0a2532081 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:33:09 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-d08f70d0-a154-4709-ad14-c3a0a2532081 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:33:09 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-d08f70d0-a154-4709-ad14-c3a0a2532081 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-d08f70d0-a154-4709-ad14-c3a0a2532081 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:33:09 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-d08f70d0-a154-4709-ad14-c3a0a2532081 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:33:09 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f1abf6-f242-4234-abbb-e6a6d9f571c5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08f70d0-a154-4709-ad14-c3a0a2532081 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:33:09 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3f9117-cbe8-42a4-9f7b-274164e4111a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08f70d0-a154-4709-ad14-c3a0a2532081 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6] added
Aug 09 10:33:09 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae5efa6-e9bb-4e68-95a7-9e6a423434b4]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08f70d0-a154-4709-ad14-c3a0a2532081 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc985ca3-6738-4362-8b89-4c78adecc4b3]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08f70d0-a154-4709-ad14-c3a0a2532081 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fMKXJidP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fMKXJidP" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[968c72e0-a978-4f9b-834d-d8143e87fbaa]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08f70d0-a154-4709-ad14-c3a0a2532081 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fMKXJidP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f82e40-d82b-420c-ae94-47e9fabc1e19]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08f70d0-a154-4709-ad14-c3a0a2532081 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[43db72f6-eb6b-4c2e-9ad3-321bce5dc79c]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08f70d0-a154-4709-ad14-c3a0a2532081 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:33:09 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:33:09 user nova-compute[72362]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:33:09 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08f70d0-a154-4709-ad14-c3a0a2532081 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:33:09 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:33:09 user nova-compute[72362]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:33:09 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e05231-1a86-4638-8186-87841e9d83ba]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08f70d0-a154-4709-ad14-c3a0a2532081 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6, portal: 172.16.0.220,3260]
Aug 09 10:33:09 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6, portal: 172.16.0.220,3260] successful.
Aug 09 10:33:09 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7f92b2-e664-41a7-9930-f6fdabaaf814]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08f70d0-a154-4709-ad14-c3a0a2532081 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8d65ed-658e-4c2f-8356-c0854e6a8aed]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08f70d0-a154-4709-ad14-c3a0a2532081 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:33:09 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:33:09 user nova-compute[72362]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:33:09 user nova-compute[72362]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 (non-flash)
Aug 09 10:33:09 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08f70d0-a154-4709-ad14-c3a0a2532081 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:33:09 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:33:09 user nova-compute[72362]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:33:09 user nova-compute[72362]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 (non-flash)
Aug 09 10:33:09 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-d08f70d0-a154-4709-ad14-c3a0a2532081 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08f70d0-a154-4709-ad14-c3a0a2532081 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-d08f70d0-a154-4709-ad14-c3a0a2532081 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] HCTL ('35', '-', '-', 0) found on session 45 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-d08f70d0-a154-4709-ad14-c3a0a2532081 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3191db32-3196-4742-8648-1cbb967a252e]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-d08f70d0-a154-4709-ad14-c3a0a2532081 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:33:09 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08f70d0-a154-4709-ad14-c3a0a2532081 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fMKXJidP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:33:10 user nova-compute[72362]: DEBUG nova.network.neutron [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Successfully updated port: 8c5d102b-ab09-48b6-af7a-924afe72db9e {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:33:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "refresh_cache-5907c2ff-9ac0-4104-b80b-499e200728f1" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:33:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquired lock "refresh_cache-5907c2ff-9ac0-4104-b80b-499e200728f1" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:33:10 user nova-compute[72362]: DEBUG nova.network.neutron [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:33:10 user nova-compute[72362]: DEBUG nova.compute.manager [req-dec8429d-23c0-4bcb-9ae5-60b86f71c5d8 req-9cd4cc10-6897-432f-907a-d10c1f28c878 service nova] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Received event network-changed-8c5d102b-ab09-48b6-af7a-924afe72db9e {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:33:10 user nova-compute[72362]: DEBUG nova.compute.manager [req-dec8429d-23c0-4bcb-9ae5-60b86f71c5d8 req-9cd4cc10-6897-432f-907a-d10c1f28c878 service nova] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Refreshing instance network info cache due to event network-changed-8c5d102b-ab09-48b6-af7a-924afe72db9e. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:33:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-dec8429d-23c0-4bcb-9ae5-60b86f71c5d8 req-9cd4cc10-6897-432f-907a-d10c1f28c878 service nova] Acquiring lock "refresh_cache-5907c2ff-9ac0-4104-b80b-499e200728f1" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:33:10 user nova-compute[72362]: DEBUG nova.network.neutron [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:33:10 user nova-compute[72362]: DEBUG nova.network.neutron [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Updating instance_info_cache with network_info: [{"id": "8c5d102b-ab09-48b6-af7a-924afe72db9e", "address": "fa:16:3e:de:fb:96", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c5d102b-ab", "ovs_interfaceid": "8c5d102b-ab09-48b6-af7a-924afe72db9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:33:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Releasing lock "refresh_cache-5907c2ff-9ac0-4104-b80b-499e200728f1" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:33:10 user nova-compute[72362]: DEBUG nova.compute.manager [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Instance network_info: |[{"id": "8c5d102b-ab09-48b6-af7a-924afe72db9e", "address": "fa:16:3e:de:fb:96", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c5d102b-ab", "ovs_interfaceid": "8c5d102b-ab09-48b6-af7a-924afe72db9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 10:33:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-dec8429d-23c0-4bcb-9ae5-60b86f71c5d8 req-9cd4cc10-6897-432f-907a-d10c1f28c878 service nova] Acquired lock "refresh_cache-5907c2ff-9ac0-4104-b80b-499e200728f1" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:33:10 user nova-compute[72362]: DEBUG nova.network.neutron [req-dec8429d-23c0-4bcb-9ae5-60b86f71c5d8 req-9cd4cc10-6897-432f-907a-d10c1f28c878 service nova] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Refreshing network info cache for port 8c5d102b-ab09-48b6-af7a-924afe72db9e {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:33:10 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-d08f70d0-a154-4709-ad14-c3a0a2532081 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:33:10 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08f70d0-a154-4709-ad14-c3a0a2532081 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23333306264376330', 'path': '/dev/sdd'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:33:10 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d08f70d0-a154-4709-ad14-c3a0a2532081 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333306264376330', 'path': '/dev/sdd'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:33:10 user nova-compute[72362]: DEBUG nova.objects.instance [None req-d08f70d0-a154-4709-ad14-c3a0a2532081 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Lazy-loading 'flavor' on Instance uuid fe1804e8-2340-4868-a0ff-32d5df5fad42 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:33:10 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-d08f70d0-a154-4709-ad14-c3a0a2532081 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 10:33:10 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:33:10 user nova-compute[72362]:   <source dev="/dev/sdd"/>
Aug 09 10:33:10 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:33:10 user nova-compute[72362]:   <serial>625fa618-b4a1-44bd-9c6f-d825d64285e6</serial>
Aug 09 10:33:10 user nova-compute[72362]: </disk>
Aug 09 10:33:10 user nova-compute[72362]:  {{(pid=72362) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 10:33:11 user nova-compute[72362]: DEBUG nova.network.neutron [req-dec8429d-23c0-4bcb-9ae5-60b86f71c5d8 req-9cd4cc10-6897-432f-907a-d10c1f28c878 service nova] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Updated VIF entry in instance network info cache for port 8c5d102b-ab09-48b6-af7a-924afe72db9e. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:33:11 user nova-compute[72362]: DEBUG nova.network.neutron [req-dec8429d-23c0-4bcb-9ae5-60b86f71c5d8 req-9cd4cc10-6897-432f-907a-d10c1f28c878 service nova] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Updating instance_info_cache with network_info: [{"id": "8c5d102b-ab09-48b6-af7a-924afe72db9e", "address": "fa:16:3e:de:fb:96", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c5d102b-ab", "ovs_interfaceid": "8c5d102b-ab09-48b6-af7a-924afe72db9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:33:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-dec8429d-23c0-4bcb-9ae5-60b86f71c5d8 req-9cd4cc10-6897-432f-907a-d10c1f28c878 service nova] Releasing lock "refresh_cache-5907c2ff-9ac0-4104-b80b-499e200728f1" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:33:11 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-d08f70d0-a154-4709-ad14-c3a0a2532081 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:33:11 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-d08f70d0-a154-4709-ad14-c3a0a2532081 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:33:11 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-d08f70d0-a154-4709-ad14-c3a0a2532081 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] No VIF found with MAC fa:16:3e:44:ae:dc, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:33:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d08f70d0-a154-4709-ad14-c3a0a2532081 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Lock "fe1804e8-2340-4868-a0ff-32d5df5fad42" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.955s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:33:11 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:33:11 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:33:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:33:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:33:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:33:11 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 10:33:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:12 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691577177.328531, 9268633a-36f0-4bd2-85f2-22ae7911a1f9 => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:33:12 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] VM Stopped (Lifecycle Event)
Aug 09 10:33:12 user nova-compute[72362]: DEBUG nova.compute.manager [None req-cd30869e-3c9b-412d-9392-9a1502b5037f None None] [instance: 9268633a-36f0-4bd2-85f2-22ae7911a1f9] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:33:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:33:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09fcf27a-c6dc-4c4a-b73c-555ea2339967/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09fcf27a-c6dc-4c4a-b73c-555ea2339967/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09fcf27a-c6dc-4c4a-b73c-555ea2339967/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:12 user nova-compute[72362]: INFO nova.compute.manager [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Rescuing
Aug 09 10:33:12 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Acquiring lock "refresh_cache-fe1804e8-2340-4868-a0ff-32d5df5fad42" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:33:12 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Acquired lock "refresh_cache-fe1804e8-2340-4868-a0ff-32d5df5fad42" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:33:12 user nova-compute[72362]: DEBUG nova.network.neutron [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:33:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09fcf27a-c6dc-4c4a-b73c-555ea2339967/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:12 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:33:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5502750a-6b11-4600-9363-a814a12573d2/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5502750a-6b11-4600-9363-a814a12573d2/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5502750a-6b11-4600-9363-a814a12573d2/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5502750a-6b11-4600-9363-a814a12573d2/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:13 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:33:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:13 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:33:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:13 user nova-compute[72362]: DEBUG nova.network.neutron [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Updating instance_info_cache with network_info: [{"id": "3205c4d7-d431-4127-b2a5-436df06f6c4b", "address": "fa:16:3e:44:ae:dc", "network": {"id": "322734db-2e92-4833-85a8-dc059a13b535", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-753064842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7fd45a7ce194cd4bc477f03bdebfe9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3205c4d7-d4", "ovs_interfaceid": "3205c4d7-d431-4127-b2a5-436df06f6c4b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:33:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Releasing lock "refresh_cache-fe1804e8-2340-4868-a0ff-32d5df5fad42" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:33:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e4ba46-d39d-4163-873a-6957ce64e635/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:13 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:33:13 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:33:13 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:33:14 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:33:14 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:33:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e4ba46-d39d-4163-873a-6957ce64e635/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e4ba46-d39d-4163-873a-6957ce64e635/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:14 user nova-compute[72362]: DEBUG nova.compute.manager [req-205f61d9-1f26-4c98-aea0-4bfc0c603d6f req-75a3dd4d-3099-41e3-81b7-0b001dd283ee service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Received event network-vif-unplugged-3205c4d7-d431-4127-b2a5-436df06f6c4b {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:33:14 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-205f61d9-1f26-4c98-aea0-4bfc0c603d6f req-75a3dd4d-3099-41e3-81b7-0b001dd283ee service nova] Acquiring lock "fe1804e8-2340-4868-a0ff-32d5df5fad42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:33:14 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-205f61d9-1f26-4c98-aea0-4bfc0c603d6f req-75a3dd4d-3099-41e3-81b7-0b001dd283ee service nova] Lock "fe1804e8-2340-4868-a0ff-32d5df5fad42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:33:14 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-205f61d9-1f26-4c98-aea0-4bfc0c603d6f req-75a3dd4d-3099-41e3-81b7-0b001dd283ee service nova] Lock "fe1804e8-2340-4868-a0ff-32d5df5fad42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:33:14 user nova-compute[72362]: DEBUG nova.compute.manager [req-205f61d9-1f26-4c98-aea0-4bfc0c603d6f req-75a3dd4d-3099-41e3-81b7-0b001dd283ee service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] No waiting events found dispatching network-vif-unplugged-3205c4d7-d431-4127-b2a5-436df06f6c4b {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:33:14 user nova-compute[72362]: WARNING nova.compute.manager [req-205f61d9-1f26-4c98-aea0-4bfc0c603d6f req-75a3dd4d-3099-41e3-81b7-0b001dd283ee service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Received unexpected event network-vif-unplugged-3205c4d7-d431-4127-b2a5-436df06f6c4b for instance with vm_state active and task_state rescuing.
Aug 09 10:33:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e4ba46-d39d-4163-873a-6957ce64e635/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:14 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:33:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3cdf152-da86-447b-aa7c-921b6fa87ef8/disk.rescue --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:14 user nova-compute[72362]: DEBUG os_brick.utils [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:33:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:14 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e926b6-0329-42c3-a1bf-170b104ca956]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3cdf152-da86-447b-aa7c-921b6fa87ef8/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3cdf152-da86-447b-aa7c-921b6fa87ef8/disk.rescue --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:14 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d4883e-f041-4c4e-b935-eb7fe197f63f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:14 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7b3e08-c189-47f3-b238-9e77d8800768]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:14 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[725d71db-e418-47d7-99a4-d7d07ddff513]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:33:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:33:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:33:14 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:33:14 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[800f7b9a-9e2e-4de2-b4f8-1d44b1a4f264]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:33:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:33:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:33:14 user nova-compute[72362]: DEBUG os_brick.utils [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:33:14 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Updating existing volume attachment record: bcd488a8-43a5-4658-aad7-acb9299d3a6c {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 10:33:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3cdf152-da86-447b-aa7c-921b6fa87ef8/disk.rescue --force-share --output=json" returned: 0 in 0.128s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:14 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:33:14 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:33:14 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=7514MB free_disk=24.81604766845703GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 10:33:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:33:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:33:15 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Instance destroyed successfully.
Aug 09 10:33:15 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Attempting a stable device rescue
Aug 09 10:33:15 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=72362) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 09 10:33:15 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Instance directory exists: not creating {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 10:33:15 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Creating image(s)
Aug 09 10:33:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Acquiring lock "/opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:33:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Lock "/opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:33:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Lock "/opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:33:15 user nova-compute[72362]: DEBUG nova.objects.instance [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Lazy-loading 'trusted_certs' on Instance uuid fe1804e8-2340-4868-a0ff-32d5df5fad42 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:33:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Acquiring lock "aeee70afff12b970079b47e5d5f6af18b42f60fa" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:33:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Lock "aeee70afff12b970079b47e5d5f6af18b42f60fa" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:33:15 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Applying migration context for instance 4b22a19f-300c-42fb-8175-e737eef7d531 as it has an incoming, in-progress migration 923fa5eb-be1a-447b-a6b8-eee245a0e028. Migration status is finished {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 09 10:33:15 user nova-compute[72362]: INFO nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Updating resource usage from migration 923fa5eb-be1a-447b-a6b8-eee245a0e028
Aug 09 10:33:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aeee70afff12b970079b47e5d5f6af18b42f60fa.part --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:16 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 8e055c58-a365-4f18-a6e3-377e32e2189d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:33:16 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:33:16 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 30213e67-6b1d-4d97-a971-1544335d02fb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:33:16 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 09fcf27a-c6dc-4c4a-b73c-555ea2339967 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:33:16 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance f8abc99c-b87b-4586-b9d4-7f5bcda60683 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:33:16 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance fe1804e8-2340-4868-a0ff-32d5df5fad42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:33:16 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance f3cdf152-da86-447b-aa7c-921b6fa87ef8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:33:16 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Migration 923fa5eb-be1a-447b-a6b8-eee245a0e028 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 09 10:33:16 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 4b22a19f-300c-42fb-8175-e737eef7d531 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:33:16 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 5502750a-6b11-4600-9363-a814a12573d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:33:16 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 14e4ba46-d39d-4163-873a-6957ce64e635 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:33:16 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 5907c2ff-9ac0-4104-b80b-499e200728f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:33:16 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 10:33:16 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 10:33:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aeee70afff12b970079b47e5d5f6af18b42f60fa.part --force-share --output=json" returned: 0 in 0.144s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:16 user nova-compute[72362]: DEBUG nova.virt.images [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] 1acdfa7f-d6d2-43fa-8232-93a2186cd8dd was qcow2, converting to raw {{(pid=72362) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 10:33:16 user nova-compute[72362]: DEBUG nova.privsep.utils [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72362) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 10:33:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/aeee70afff12b970079b47e5d5f6af18b42f60fa.part /opt/stack/data/nova/instances/_base/aeee70afff12b970079b47e5d5f6af18b42f60fa.converted {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:16 user nova-compute[72362]: DEBUG nova.compute.manager [req-dbd992c9-427f-4420-9f28-cc3d460d0b31 req-9bdbc1aa-6816-404e-b91c-bafac5d1705d service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Received event network-vif-plugged-3205c4d7-d431-4127-b2a5-436df06f6c4b {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:33:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-dbd992c9-427f-4420-9f28-cc3d460d0b31 req-9bdbc1aa-6816-404e-b91c-bafac5d1705d service nova] Acquiring lock "fe1804e8-2340-4868-a0ff-32d5df5fad42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:33:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-dbd992c9-427f-4420-9f28-cc3d460d0b31 req-9bdbc1aa-6816-404e-b91c-bafac5d1705d service nova] Lock "fe1804e8-2340-4868-a0ff-32d5df5fad42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:33:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-dbd992c9-427f-4420-9f28-cc3d460d0b31 req-9bdbc1aa-6816-404e-b91c-bafac5d1705d service nova] Lock "fe1804e8-2340-4868-a0ff-32d5df5fad42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:33:16 user nova-compute[72362]: DEBUG nova.compute.manager [req-dbd992c9-427f-4420-9f28-cc3d460d0b31 req-9bdbc1aa-6816-404e-b91c-bafac5d1705d service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] No waiting events found dispatching network-vif-plugged-3205c4d7-d431-4127-b2a5-436df06f6c4b {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:33:16 user nova-compute[72362]: WARNING nova.compute.manager [req-dbd992c9-427f-4420-9f28-cc3d460d0b31 req-9bdbc1aa-6816-404e-b91c-bafac5d1705d service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Received unexpected event network-vif-plugged-3205c4d7-d431-4127-b2a5-436df06f6c4b for instance with vm_state active and task_state rescuing.
Aug 09 10:33:16 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:33:16 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:33:16 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 10:33:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.543s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:33:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/aeee70afff12b970079b47e5d5f6af18b42f60fa.part /opt/stack/data/nova/instances/_base/aeee70afff12b970079b47e5d5f6af18b42f60fa.converted" returned: 0 in 0.468s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aeee70afff12b970079b47e5d5f6af18b42f60fa.converted --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aeee70afff12b970079b47e5d5f6af18b42f60fa.converted --force-share --output=json" returned: 0 in 0.134s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Lock "aeee70afff12b970079b47e5d5f6af18b42f60fa" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.650s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:33:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Acquiring lock "aeee70afff12b970079b47e5d5f6af18b42f60fa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:33:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Lock "aeee70afff12b970079b47e5d5f6af18b42f60fa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:33:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aeee70afff12b970079b47e5d5f6af18b42f60fa --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:16 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:33:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aeee70afff12b970079b47e5d5f6af18b42f60fa --force-share --output=json" returned: 0 in 0.147s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aeee70afff12b970079b47e5d5f6af18b42f60fa,backing_fmt=raw /opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/disk.rescue {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aeee70afff12b970079b47e5d5f6af18b42f60fa,backing_fmt=raw /opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/disk.rescue" returned: 0 in 0.052s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Lock "aeee70afff12b970079b47e5d5f6af18b42f60fa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:33:16 user nova-compute[72362]: DEBUG nova.objects.instance [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Lazy-loading 'migration_context' on Instance uuid fe1804e8-2340-4868-a0ff-32d5df5fad42 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:33:16 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Created local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 10:33:16 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Start _get_guest_xml network_info=[{"id": "3205c4d7-d431-4127-b2a5-436df06f6c4b", "address": "fa:16:3e:44:ae:dc", "network": {"id": "322734db-2e92-4833-85a8-dc059a13b535", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-753064842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-753064842-network", "vif_mac": "fa:16:3e:44:ae:dc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7fd45a7ce194cd4bc477f03bdebfe9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3205c4d7-d4", "ovs_interfaceid": "3205c4d7-d431-4127-b2a5-436df06f6c4b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1acdfa7f-d6d2-43fa-8232-93a2186cd8dd', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': 'a08d1a11-49eb-4212-a351-e11ee9553b95'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '4cfa7ef8-0aaf-47eb-9fb0-e41d1c9779e2', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fMKXJidP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'fe1804e8-2340-4868-a0ff-32d5df5fad42', 'attached_at': '', 'detached_at': '', 'volume_id': '625fa618-b4a1-44bd-9c6f-d825d64285e6', 'serial': '625fa618-b4a1-44bd-9c6f-d825d64285e6'}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:33:16 user nova-compute[72362]: DEBUG nova.objects.instance [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Lazy-loading 'resources' on Instance uuid fe1804e8-2340-4868-a0ff-32d5df5fad42 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:33:16 user nova-compute[72362]: DEBUG nova.objects.instance [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Lazy-loading 'numa_topology' on Instance uuid fe1804e8-2340-4868-a0ff-32d5df5fad42 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:33:17 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:33:17 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:33:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG nova.objects.instance [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Lazy-loading 'vcpu_model' on Instance uuid fe1804e8-2340-4868-a0ff-32d5df5fad42 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fMKXJidP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:33:17 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:33:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:33:17 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:33:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:33:17 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:33:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[42af5006-7f51-4a85-9702-69611a9e2e3b]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = fMKXJidP\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 09 10:33:17 user nova-compute[72362]: node.name = iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6
Aug 09 10:33:17 user nova-compute[72362]: node.tpgt = -1
Aug 09 10:33:17 user nova-compute[72362]: node.startup = automatic
Aug 09 10:33:17 user nova-compute[72362]: node.leading_login = No
Aug 09 10:33:17 user nova-compute[72362]: iface.iscsi_ifacename = default
Aug 09 10:33:17 user nova-compute[72362]: iface.net_ifacename = <empty>
Aug 09 10:33:17 user nova-compute[72362]: iface.ipaddress = <empty>
Aug 09 10:33:17 user nova-compute[72362]: iface.prefix_len = 0
Aug 09 10:33:17 user nova-compute[72362]: iface.hwaddress = <empty>
Aug 09 10:33:17 user nova-compute[72362]: iface.transport_name = tcp
Aug 09 10:33:17 user nova-compute[72362]: iface.initiatorname = <empty>
Aug 09 10:33:17 user nova-compute[72362]: iface.state = <empty>
Aug 09 10:33:17 user nova-compute[72362]: iface.vlan_id = 0
Aug 09 10:33:17 user nova-compute[72362]: iface.vlan_priority = 0
Aug 09 10:33:17 user nova-compute[72362]: iface.vlan_state = <empty>
Aug 09 10:33:17 user nova-compute[72362]: iface.iface_num = 0
Aug 09 10:33:17 user nova-compute[72362]: iface.mtu = 0
Aug 09 10:33:17 user nova-compute[72362]: iface.port = 0
Aug 09 10:33:17 user nova-compute[72362]: iface.bootproto = <empty>
Aug 09 10:33:17 user nova-compute[72362]: iface.subnet_mask = <empty>
Aug 09 10:33:17 user nova-compute[72362]: iface.gateway = <empty>
Aug 09 10:33:17 user nova-compute[72362]: iface.dhcp_alt_client_id_state = <empty>
Aug 09 10:33:17 user nova-compute[72362]: iface.dhcp_alt_client_id = <empty>
Aug 09 10:33:17 user nova-compute[72362]: iface.dhcp_dns = <empty>
Aug 09 10:33:17 user nova-compute[72362]: iface.dhcp_learn_iqn = <empty>
Aug 09 10:33:17 user nova-compute[72362]: iface.dhcp_req_vendor_id_state = <empty>
Aug 09 10:33:17 user nova-compute[72362]: iface.dhcp_vendor_id_state = <empty>
Aug 09 10:33:17 user nova-compute[72362]: iface.dhcp_vendor_id = <empty>
Aug 09 10:33:17 user nova-compute[72362]: iface.dhcp_slp_da = <empty>
Aug 09 10:33:17 user nova-compute[72362]: iface.fragmentation = <empty>
Aug 09 10:33:17 user nova-compute[72362]: iface.gratuitous_arp = <empty>
Aug 09 10:33:17 user nova-compute[72362]: iface.incoming_forwarding = <empty>
Aug 09 10:33:17 user nova-compute[72362]: iface.tos_state = <empty>
Aug 09 10:33:17 user nova-compute[72362]: iface.tos = 0
Aug 09 10:33:17 user nova-compute[72362]: iface.ttl = 0
Aug 09 10:33:17 user nova-compute[72362]: iface.delayed_ack = <empty>
Aug 09 10:33:17 user nova-compute[72362]: iface.tcp_nagle = <empty>
Aug 09 10:33:17 user nova-compute[72362]: iface.tcp_wsf_state = <empty>
Aug 09 10:33:17 user nova-compute[72362]: iface.tcp_wsf = 0
Aug 09 10:33:17 user nova-compute[72362]: iface.tcp_timer_scale = 0
Aug 09 10:33:17 user nova-compute[72362]: iface.tcp_timestamp = <empty>
Aug 09 10:33:17 user nova-compute[72362]: iface.redirect = <empty>
Aug 09 10:33:17 user nova-compute[72362]: iface.def_task_mgmt_timeout = 0
Aug 09 10:33:17 user nova-compute[72362]: iface.header_digest = <empty>
Aug 09 10:33:17 user nova-compute[72362]: iface.data_digest = <empty>
Aug 09 10:33:17 user nova-compute[72362]: iface.immediate_data = <empty>
Aug 09 10:33:17 user nova-compute[72362]: iface.initial_r2t = <empty>
Aug 09 10:33:17 user nova-compute[72362]: iface.data_seq_inorder = <empty>
Aug 09 10:33:17 user nova-compute[72362]: iface.data_pdu_inorder = <empty>
Aug 09 10:33:17 user nova-compute[72362]: iface.erl = 0
Aug 09 10:33:17 user nova-compute[72362]: iface.max_receive_data_len = 0
Aug 09 10:33:17 user nova-compute[72362]: iface.first_burst_len = 0
Aug 09 10:33:17 user nova-compute[72362]: iface.max_outstanding_r2t = 0
Aug 09 10:33:17 user nova-compute[72362]: iface.max_burst_len = 0
Aug 09 10:33:17 user nova-compute[72362]: iface.chap_auth = <empty>
Aug 09 10:33:17 user nova-compute[72362]: iface.bidi_chap = <empty>
Aug 09 10:33:17 user nova-compute[72362]: iface.strict_login_compliance = <empty>
Aug 09 10:33:17 user nova-compute[72362]: iface.discovery_auth = <empty>
Aug 09 10:33:17 user nova-compute[72362]: iface.discovery_logout = <empty>
Aug 09 10:33:17 user nova-compute[72362]: node.discovery_address = <empty>
Aug 09 10:33:17 user nova-compute[72362]: node.discovery_port = 0
Aug 09 10:33:17 user nova-compute[72362]: node.discovery_type = static
Aug 09 10:33:17 user nova-compute[72362]: node.session.initial_cmdsn = 0
Aug 09 10:33:17 user nova-compute[72362]: node.session.initial_login_retry_max = 8
Aug 09 10:33:17 user nova-compute[72362]: node.session.xmit_thread_priority = -20
Aug 09 10:33:17 user nova-compute[72362]: node.session.cmds_max = 128
Aug 09 10:33:17 user nova-compute[72362]: node.session.queue_depth = 32
Aug 09 10:33:17 user nova-compute[72362]: node.session.nr_sessions = 1
Aug 09 10:33:17 user nova-compute[72362]: node.session.auth.authmethod = CHAP
Aug 09 10:33:17 user nova-compute[72362]: node.session.auth.username = fMKXJidP
Aug 09 10:33:17 user nova-compute[72362]: node.session.auth.password = ***
Aug 09 10:33:17 user nova-compute[72362]: node.session.auth.username_in = <empty>
Aug 09 10:33:17 user nova-compute[72362]: node.session.auth.password_in = <empty>
Aug 09 10:33:17 user nova-compute[72362]: node.session.auth.chap_algs = MD5
Aug 09 10:33:17 user nova-compute[72362]: node.session.timeo.replacement_timeout = 120
Aug 09 10:33:17 user nova-compute[72362]: node.session.err_timeo.abort_timeout = 15
Aug 09 10:33:17 user nova-compute[72362]: node.session.err_timeo.lu_reset_timeout = 30
Aug 09 10:33:17 user nova-compute[72362]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 09 10:33:17 user nova-compute[72362]: node.session.err_timeo.host_reset_timeout = 60
Aug 09 10:33:17 user nova-compute[72362]: node.session.iscsi.FastAbort = Yes
Aug 09 10:33:17 user nova-compute[72362]: node.session.iscsi.InitialR2T = No
Aug 09 10:33:17 user nova-compute[72362]: node.session.iscsi.ImmediateData = Yes
Aug 09 10:33:17 user nova-compute[72362]: node.session.iscsi.FirstBurstLength = 262144
Aug 09 10:33:17 user nova-compute[72362]: node.session.iscsi.MaxBurstLength = 16776192
Aug 09 10:33:17 user nova-compute[72362]: node.session.iscsi.DefaultTime2Retain = 0
Aug 09 10:33:17 user nova-compute[72362]: node.session.iscsi.DefaultTime2Wait = 2
Aug 09 10:33:17 user nova-compute[72362]: node.session.iscsi.MaxConnections = 1
Aug 09 10:33:17 user nova-compute[72362]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 09 10:33:17 user nova-compute[72362]: node.session.iscsi.ERL = 0
Aug 09 10:33:17 user nova-compute[72362]: node.session.scan = manual
Aug 09 10:33:17 user nova-compute[72362]: node.session.reopen_max = 0
Aug 09 10:33:17 user nova-compute[72362]: node.conn[0].address = 172.16.0.220
Aug 09 10:33:17 user nova-compute[72362]: node.conn[0].port = 3260
Aug 09 10:33:17 user nova-compute[72362]: node.conn[0].startup = manual
Aug 09 10:33:17 user nova-compute[72362]: node.conn[0].tcp.window_size = 524288
Aug 09 10:33:17 user nova-compute[72362]: node.conn[0].tcp.type_of_service = 0
Aug 09 10:33:17 user nova-compute[72362]: node.conn[0].timeo.logout_timeout = 15
Aug 09 10:33:17 user nova-compute[72362]: node.conn[0].timeo.login_timeout = 15
Aug 09 10:33:17 user nova-compute[72362]: node.conn[0].timeo.auth_timeout = 45
Aug 09 10:33:17 user nova-compute[72362]: node.conn[0].timeo.noop_out_interval = 5
Aug 09 10:33:17 user nova-compute[72362]: node.conn[0].timeo.noop_out_timeout = 5
Aug 09 10:33:17 user nova-compute[72362]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 09 10:33:17 user nova-compute[72362]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 09 10:33:17 user nova-compute[72362]: node.conn[0].iscsi.HeaderDigest = None
Aug 09 10:33:17 user nova-compute[72362]: node.conn[0].iscsi.DataDigest = None
Aug 09 10:33:17 user nova-compute[72362]: node.conn[0].iscsi.IFMarker = No
Aug 09 10:33:17 user nova-compute[72362]: node.conn[0].iscsi.OFMarker = No
Aug 09 10:33:17 user nova-compute[72362]: # END RECORD
Aug 09 10:33:17 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[204f99ed-5dff-4e2a-ba88-ad61d11925e6]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9075d2-14a3-427d-add0-6e1e4ff65431]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fMKXJidP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fMKXJidP" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1fdf39-c880-451f-83ad-de97353f65c4]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fMKXJidP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f49150d-1136-4a03-a78f-69c52d3b9834]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b787be6e-847c-4de8-95bb-a7d6fb8299c1]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:33:17 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:33:17 user nova-compute[72362]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:33:17 user nova-compute[72362]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 (non-flash)
Aug 09 10:33:17 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:33:17 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:33:17 user nova-compute[72362]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:33:17 user nova-compute[72362]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 (non-flash)
Aug 09 10:33:17 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.153s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] HCTL ('35', '0', '0', 0) found on session 45 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f1bea7-edb6-45dc-9b70-1da0987b0ec6]: (4, ('0 0 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Searching for a device in session 45 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fMKXJidP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.179s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] <== connect_volume: return (180ms) {'type': 'block', 'scsi_wwn': '23333306264376330', 'path': '/dev/sdd'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333306264376330', 'path': '/dev/sdd'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:29:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1761559357',display_name='tempest-ServerStableDeviceRescueTest-server-1761559357',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1761559357',id=29,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOZ4Oer4n1DnitiHIilXA6F7pKlKFx/n4xsV/PbrQXmR8/0fskSLxaUGxc95Yb6OUuLhpJTUk+XkkpQUm2P/SNRsR8wXFgXI6C9yVCX/oYj9avRwisIFLdeBOydSQ+gRw==',key_name='tempest-keypair-2003538578',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:29:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a7fd45a7ce194cd4bc477f03bdebfe9d',ramdisk_id='',reservation_id='r-0ptipo99',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1616327339',owner_user_name='tempest-ServerStableDeviceRescueTest-1616327339-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:31:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40a78234613d42b4b3dbea339819f3ba',uuid=fe1804e8-2340-4868-a0ff-32d5df5fad42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3205c4d7-d431-4127-b2a5-436df06f6c4b", "address": "fa:16:3e:44:ae:dc", "network": {"id": "322734db-2e92-4833-85a8-dc059a13b535", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-753064842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-753064842-network", "vif_mac": "fa:16:3e:44:ae:dc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7fd45a7ce194cd4bc477f03bdebfe9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3205c4d7-d4", "ovs_interfaceid": "3205c4d7-d431-4127-b2a5-436df06f6c4b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Converting VIF {"id": "3205c4d7-d431-4127-b2a5-436df06f6c4b", "address": "fa:16:3e:44:ae:dc", "network": {"id": "322734db-2e92-4833-85a8-dc059a13b535", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-753064842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-753064842-network", "vif_mac": "fa:16:3e:44:ae:dc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7fd45a7ce194cd4bc477f03bdebfe9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3205c4d7-d4", "ovs_interfaceid": "3205c4d7-d431-4127-b2a5-436df06f6c4b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:ae:dc,bridge_name='br-int',has_traffic_filtering=True,id=3205c4d7-d431-4127-b2a5-436df06f6c4b,network=Network(322734db-2e92-4833-85a8-dc059a13b535),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3205c4d7-d4') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG nova.objects.instance [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Lazy-loading 'pci_devices' on Instance uuid fe1804e8-2340-4868-a0ff-32d5df5fad42 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:33:17 user nova-compute[72362]:   <uuid>fe1804e8-2340-4868-a0ff-32d5df5fad42</uuid>
Aug 09 10:33:17 user nova-compute[72362]:   <name>instance-0000001d</name>
Aug 09 10:33:17 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:33:17 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:33:17 user nova-compute[72362]:   <metadata>
Aug 09 10:33:17 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:33:17 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:33:17 user nova-compute[72362]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1761559357</nova:name>
Aug 09 10:33:17 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:33:17</nova:creationTime>
Aug 09 10:33:17 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:33:17 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:33:17 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:33:17 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:33:17 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:33:17 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:33:17 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:33:17 user nova-compute[72362]:       <nova:owner>
Aug 09 10:33:17 user nova-compute[72362]:         <nova:user uuid="40a78234613d42b4b3dbea339819f3ba">tempest-ServerStableDeviceRescueTest-1616327339-project-member</nova:user>
Aug 09 10:33:17 user nova-compute[72362]:         <nova:project uuid="a7fd45a7ce194cd4bc477f03bdebfe9d">tempest-ServerStableDeviceRescueTest-1616327339</nova:project>
Aug 09 10:33:17 user nova-compute[72362]:       </nova:owner>
Aug 09 10:33:17 user nova-compute[72362]:       <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:33:17 user nova-compute[72362]:       <nova:ports>
Aug 09 10:33:17 user nova-compute[72362]:         <nova:port uuid="3205c4d7-d431-4127-b2a5-436df06f6c4b">
Aug 09 10:33:17 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 10:33:17 user nova-compute[72362]:         </nova:port>
Aug 09 10:33:17 user nova-compute[72362]:       </nova:ports>
Aug 09 10:33:17 user nova-compute[72362]:     </nova:instance>
Aug 09 10:33:17 user nova-compute[72362]:   </metadata>
Aug 09 10:33:17 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:33:17 user nova-compute[72362]:     <system>
Aug 09 10:33:17 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:33:17 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:33:17 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:33:17 user nova-compute[72362]:       <entry name="serial">fe1804e8-2340-4868-a0ff-32d5df5fad42</entry>
Aug 09 10:33:17 user nova-compute[72362]:       <entry name="uuid">fe1804e8-2340-4868-a0ff-32d5df5fad42</entry>
Aug 09 10:33:17 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:33:17 user nova-compute[72362]:     </system>
Aug 09 10:33:17 user nova-compute[72362]:   </sysinfo>
Aug 09 10:33:17 user nova-compute[72362]:   <os>
Aug 09 10:33:17 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:33:17 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:33:17 user nova-compute[72362]:   </os>
Aug 09 10:33:17 user nova-compute[72362]:   <features>
Aug 09 10:33:17 user nova-compute[72362]:     <acpi/>
Aug 09 10:33:17 user nova-compute[72362]:     <apic/>
Aug 09 10:33:17 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:33:17 user nova-compute[72362]:   </features>
Aug 09 10:33:17 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:33:17 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:33:17 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:33:17 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:33:17 user nova-compute[72362]:   </clock>
Aug 09 10:33:17 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:33:17 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:33:17 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:33:17 user nova-compute[72362]:   </cpu>
Aug 09 10:33:17 user nova-compute[72362]:   <devices>
Aug 09 10:33:17 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:33:17 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:33:17 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/disk"/>
Aug 09 10:33:17 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:33:17 user nova-compute[72362]:     </disk>
Aug 09 10:33:17 user nova-compute[72362]:     <disk type="block" device="disk">
Aug 09 10:33:17 user nova-compute[72362]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:33:17 user nova-compute[72362]:       <source dev="/dev/sdd"/>
Aug 09 10:33:17 user nova-compute[72362]:       <target dev="vdb" bus="virtio"/>
Aug 09 10:33:17 user nova-compute[72362]:       <serial>625fa618-b4a1-44bd-9c6f-d825d64285e6</serial>
Aug 09 10:33:17 user nova-compute[72362]:     </disk>
Aug 09 10:33:17 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:33:17 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:33:17 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/disk.rescue"/>
Aug 09 10:33:17 user nova-compute[72362]:       <target dev="vdc" bus="virtio"/>
Aug 09 10:33:17 user nova-compute[72362]:       <boot order="1"/>
Aug 09 10:33:17 user nova-compute[72362]:     </disk>
Aug 09 10:33:17 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:33:17 user nova-compute[72362]:       <mac address="fa:16:3e:44:ae:dc"/>
Aug 09 10:33:17 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:33:17 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:33:17 user nova-compute[72362]:       <target dev="tap3205c4d7-d4"/>
Aug 09 10:33:17 user nova-compute[72362]:     </interface>
Aug 09 10:33:17 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:33:17 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/console.log" append="off"/>
Aug 09 10:33:17 user nova-compute[72362]:     </serial>
Aug 09 10:33:17 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:33:17 user nova-compute[72362]:     <video>
Aug 09 10:33:17 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:33:17 user nova-compute[72362]:     </video>
Aug 09 10:33:17 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:33:17 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:33:17 user nova-compute[72362]:     </rng>
Aug 09 10:33:17 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:33:17 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:33:17 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:33:17 user nova-compute[72362]:     </memballoon>
Aug 09 10:33:17 user nova-compute[72362]:   </devices>
Aug 09 10:33:17 user nova-compute[72362]: </domain>
Aug 09 10:33:17 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:33:17 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Instance destroyed successfully.
Aug 09 10:33:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] No VIF found with MAC fa:16:3e:44:ae:dc, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:33:17 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:33:18 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:33:18 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:33:18 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:33:18 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:33:18 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:33:18 user nova-compute[72362]: DEBUG nova.compute.manager [req-d2d67de7-35ce-458a-9b26-d275e7a39119 req-4d8330eb-23db-454e-bfee-2536edea17da service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Received event network-vif-plugged-3205c4d7-d431-4127-b2a5-436df06f6c4b {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:33:18 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-d2d67de7-35ce-458a-9b26-d275e7a39119 req-4d8330eb-23db-454e-bfee-2536edea17da service nova] Acquiring lock "fe1804e8-2340-4868-a0ff-32d5df5fad42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:33:18 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-d2d67de7-35ce-458a-9b26-d275e7a39119 req-4d8330eb-23db-454e-bfee-2536edea17da service nova] Lock "fe1804e8-2340-4868-a0ff-32d5df5fad42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:33:18 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-d2d67de7-35ce-458a-9b26-d275e7a39119 req-4d8330eb-23db-454e-bfee-2536edea17da service nova] Lock "fe1804e8-2340-4868-a0ff-32d5df5fad42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:33:18 user nova-compute[72362]: DEBUG nova.compute.manager [req-d2d67de7-35ce-458a-9b26-d275e7a39119 req-4d8330eb-23db-454e-bfee-2536edea17da service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] No waiting events found dispatching network-vif-plugged-3205c4d7-d431-4127-b2a5-436df06f6c4b {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:33:18 user nova-compute[72362]: WARNING nova.compute.manager [req-d2d67de7-35ce-458a-9b26-d275e7a39119 req-4d8330eb-23db-454e-bfee-2536edea17da service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Received unexpected event network-vif-plugged-3205c4d7-d431-4127-b2a5-436df06f6c4b for instance with vm_state active and task_state rescuing.
Aug 09 10:33:19 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:33:19 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:33:19 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:33:19 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:33:20 user nova-compute[72362]: DEBUG nova.compute.manager [req-d74f9e43-42bb-452d-8cdd-ff0f3f6cf695 req-3ab9ac53-c187-4a0d-9d23-d7b31ba564b7 service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Received event network-vif-plugged-3205c4d7-d431-4127-b2a5-436df06f6c4b {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:33:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-d74f9e43-42bb-452d-8cdd-ff0f3f6cf695 req-3ab9ac53-c187-4a0d-9d23-d7b31ba564b7 service nova] Acquiring lock "fe1804e8-2340-4868-a0ff-32d5df5fad42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:33:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-d74f9e43-42bb-452d-8cdd-ff0f3f6cf695 req-3ab9ac53-c187-4a0d-9d23-d7b31ba564b7 service nova] Lock "fe1804e8-2340-4868-a0ff-32d5df5fad42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:33:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-d74f9e43-42bb-452d-8cdd-ff0f3f6cf695 req-3ab9ac53-c187-4a0d-9d23-d7b31ba564b7 service nova] Lock "fe1804e8-2340-4868-a0ff-32d5df5fad42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:33:20 user nova-compute[72362]: DEBUG nova.compute.manager [req-d74f9e43-42bb-452d-8cdd-ff0f3f6cf695 req-3ab9ac53-c187-4a0d-9d23-d7b31ba564b7 service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] No waiting events found dispatching network-vif-plugged-3205c4d7-d431-4127-b2a5-436df06f6c4b {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:33:20 user nova-compute[72362]: WARNING nova.compute.manager [req-d74f9e43-42bb-452d-8cdd-ff0f3f6cf695 req-3ab9ac53-c187-4a0d-9d23-d7b31ba564b7 service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Received unexpected event network-vif-plugged-3205c4d7-d431-4127-b2a5-436df06f6c4b for instance with vm_state active and task_state rescuing.
Aug 09 10:33:21 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Removed pending event for fe1804e8-2340-4868-a0ff-32d5df5fad42 due to event {{(pid=72362) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 10:33:21 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577201.0282931, fe1804e8-2340-4868-a0ff-32d5df5fad42 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:33:21 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] VM Resumed (Lifecycle Event)
Aug 09 10:33:21 user nova-compute[72362]: DEBUG nova.compute.manager [None req-3d220616-56b5-4f89-9f1b-37bcb751da92 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:33:21 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:33:21 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:33:21 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 10:33:21 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577201.0361056, fe1804e8-2340-4868-a0ff-32d5df5fad42 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:33:21 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] VM Started (Lifecycle Event)
Aug 09 10:33:21 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:33:21 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:33:21 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 10:33:21 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-04840341-bd73-4c22-9d4f-2a6938db720d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Acquiring lock "4b22a19f-300c-42fb-8175-e737eef7d531" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:33:21 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-04840341-bd73-4c22-9d4f-2a6938db720d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "4b22a19f-300c-42fb-8175-e737eef7d531" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:33:21 user nova-compute[72362]: DEBUG nova.compute.manager [None req-04840341-bd73-4c22-9d4f-2a6938db720d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Going to confirm migration 2 {{(pid=72362) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 09 10:33:21 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-04840341-bd73-4c22-9d4f-2a6938db720d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Acquiring lock "refresh_cache-4b22a19f-300c-42fb-8175-e737eef7d531" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:33:21 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-04840341-bd73-4c22-9d4f-2a6938db720d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Acquired lock "refresh_cache-4b22a19f-300c-42fb-8175-e737eef7d531" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:33:21 user nova-compute[72362]: DEBUG nova.network.neutron [None req-04840341-bd73-4c22-9d4f-2a6938db720d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:33:21 user nova-compute[72362]: DEBUG nova.objects.instance [None req-04840341-bd73-4c22-9d4f-2a6938db720d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lazy-loading 'info_cache' on Instance uuid 4b22a19f-300c-42fb-8175-e737eef7d531 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:33:21 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:33:22 user nova-compute[72362]: DEBUG nova.network.neutron [None req-04840341-bd73-4c22-9d4f-2a6938db720d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Updating instance_info_cache with network_info: [{"id": "0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa", "address": "fa:16:3e:39:ad:fb", "network": {"id": "e6c54663-74e3-43e2-8f0d-61b300c1f68d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1222286883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ac22022944542c0b52dd912d3dbcce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0942f4eb-e7", "ovs_interfaceid": "0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:33:22 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-04840341-bd73-4c22-9d4f-2a6938db720d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Releasing lock "refresh_cache-4b22a19f-300c-42fb-8175-e737eef7d531" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:33:22 user nova-compute[72362]: DEBUG nova.objects.instance [None req-04840341-bd73-4c22-9d4f-2a6938db720d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lazy-loading 'migration_context' on Instance uuid 4b22a19f-300c-42fb-8175-e737eef7d531 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:33:22 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-04840341-bd73-4c22-9d4f-2a6938db720d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:33:22 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-04840341-bd73-4c22-9d4f-2a6938db720d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:33:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:33:22 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-04840341-bd73-4c22-9d4f-2a6938db720d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:33:22 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-04840341-bd73-4c22-9d4f-2a6938db720d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:33:22 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-04840341-bd73-4c22-9d4f-2a6938db720d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.499s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:33:22 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-04840341-bd73-4c22-9d4f-2a6938db720d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Deleted allocation for migration 923fa5eb-be1a-447b-a6b8-eee245a0e028
Aug 09 10:33:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-04840341-bd73-4c22-9d4f-2a6938db720d tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "4b22a19f-300c-42fb-8175-e737eef7d531" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.607s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG nova.compute.manager [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Start spawning the instance on the hypervisor. {{(pid=72362) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:33:23 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Creating image(s)
Aug 09 10:33:23 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Did not create local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Ensure instance console log exists: /opt/stack/data/nova/instances/5907c2ff-9ac0-4104-b80b-499e200728f1/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Start _get_guest_xml network_info=[{"id": "8c5d102b-ab09-48b6-af7a-924afe72db9e", "address": "fa:16:3e:de:fb:96", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c5d102b-ab", "ovs_interfaceid": "8c5d102b-ab09-48b6-af7a-924afe72db9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'bcd488a8-43a5-4658-aad7-acb9299d3a6c', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AChHcUYT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5907c2ff-9ac0-4104-b80b-499e200728f1', 'attached_at': '', 'detached_at': '', 'volume_id': '5b7e90a1-be13-48cd-9b15-b8bb87253216', 'serial': '5b7e90a1-be13-48cd-9b15-b8bb87253216'}, 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:33:23 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:33:23 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:33:23 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AChHcUYT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:33:23 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:33:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:33:23 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:33:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:33:23 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:33:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c32dcb-7638-4fba-80ae-66b8b9945981]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:33:23 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7d71e2-57d8-40d7-b663-42fd7e54683d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216] added
Aug 09 10:33:23 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d7a1f9-7925-47b7-a8be-e2e7b53df4a7]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ca7bbe-ec3c-46bd-8f99-399eb1cc3d80]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AChHcUYT {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AChHcUYT" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb243552-e0cd-4e6d-a585-6788dbb67b23]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AChHcUYT'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[79836bd7-2088-4a83-abb7-722c1fa69895]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e5591e-1736-4a10-bc38-d902f784946f]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:33:23 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:33:23 user nova-compute[72362]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:33:23 user nova-compute[72362]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 (non-flash)
Aug 09 10:33:23 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:33:23 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:33:23 user nova-compute[72362]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:33:23 user nova-compute[72362]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 (non-flash)
Aug 09 10:33:23 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51a22ce-beb4-48d8-9309-fc468956a588]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216, portal: 172.16.0.220,3260]
Aug 09 10:33:23 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216, portal: 172.16.0.220,3260] successful.
Aug 09 10:33:23 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6819ff23-6996-45aa-8ff7-7a44ae8df3f1]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c73c055-8690-426a-bb51-ffe1392b6f5d]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:33:23 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:33:23 user nova-compute[72362]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:33:23 user nova-compute[72362]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 (non-flash)
Aug 09 10:33:23 user nova-compute[72362]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 (non-flash)
Aug 09 10:33:23 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:33:23 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:33:23 user nova-compute[72362]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:33:23 user nova-compute[72362]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 (non-flash)
Aug 09 10:33:23 user nova-compute[72362]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 (non-flash)
Aug 09 10:33:23 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] HCTL ('36', '-', '-', 0) found on session 46 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[be671a7c-73fe-458c-9908-bed0e6fbe729]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:23 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Searching for a device in session 46 and hctl ['36', '*', '*', 0] yield: None {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:33:24 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Searching for a device in session 46 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:33:24 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AChHcUYT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:33:24 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:33:24 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '26435643065323432', 'path': '/dev/sde'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:33:24 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435643065323432', 'path': '/dev/sde'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:33:24 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:33:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-589296118',display_name='tempest-TestVolumeBootPattern-server-589296118',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-589296118',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26e38599de0b4b06b723f5647a7fe121',ramdisk_id='',reservation_id='r-02v00c29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1478436240',owner_user_name='tempest-TestVolumeBootPattern-1478436240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:33:08Z,user_data=None,user_id='e96900e953f64d02bdb5d48f136133c3',uuid=5907c2ff-9ac0-4104-b80b-499e200728f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c5d102b-ab09-48b6-af7a-924afe72db9e", "address": "fa:16:3e:de:fb:96", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c5d102b-ab", "ovs_interfaceid": "8c5d102b-ab09-48b6-af7a-924afe72db9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:33:24 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Converting VIF {"id": "8c5d102b-ab09-48b6-af7a-924afe72db9e", "address": "fa:16:3e:de:fb:96", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c5d102b-ab", "ovs_interfaceid": "8c5d102b-ab09-48b6-af7a-924afe72db9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:33:24 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:fb:96,bridge_name='br-int',has_traffic_filtering=True,id=8c5d102b-ab09-48b6-af7a-924afe72db9e,network=Network(b4a9e050-41f1-404a-bf5c-41421f034644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c5d102b-ab') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:33:24 user nova-compute[72362]: DEBUG nova.objects.instance [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lazy-loading 'pci_devices' on Instance uuid 5907c2ff-9ac0-4104-b80b-499e200728f1 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:33:24 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:33:24 user nova-compute[72362]:   <uuid>5907c2ff-9ac0-4104-b80b-499e200728f1</uuid>
Aug 09 10:33:24 user nova-compute[72362]:   <name>instance-00000023</name>
Aug 09 10:33:24 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:33:24 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:33:24 user nova-compute[72362]:   <metadata>
Aug 09 10:33:24 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:33:24 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:33:24 user nova-compute[72362]:       <nova:name>tempest-TestVolumeBootPattern-server-589296118</nova:name>
Aug 09 10:33:24 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:33:23</nova:creationTime>
Aug 09 10:33:24 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:33:24 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:33:24 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:33:24 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:33:24 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:33:24 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:33:24 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:33:24 user nova-compute[72362]:       <nova:owner>
Aug 09 10:33:24 user nova-compute[72362]:         <nova:user uuid="e96900e953f64d02bdb5d48f136133c3">tempest-TestVolumeBootPattern-1478436240-project-member</nova:user>
Aug 09 10:33:24 user nova-compute[72362]:         <nova:project uuid="26e38599de0b4b06b723f5647a7fe121">tempest-TestVolumeBootPattern-1478436240</nova:project>
Aug 09 10:33:24 user nova-compute[72362]:       </nova:owner>
Aug 09 10:33:24 user nova-compute[72362]:       <nova:ports>
Aug 09 10:33:24 user nova-compute[72362]:         <nova:port uuid="8c5d102b-ab09-48b6-af7a-924afe72db9e">
Aug 09 10:33:24 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 09 10:33:24 user nova-compute[72362]:         </nova:port>
Aug 09 10:33:24 user nova-compute[72362]:       </nova:ports>
Aug 09 10:33:24 user nova-compute[72362]:     </nova:instance>
Aug 09 10:33:24 user nova-compute[72362]:   </metadata>
Aug 09 10:33:24 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:33:24 user nova-compute[72362]:     <system>
Aug 09 10:33:24 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:33:24 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:33:24 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:33:24 user nova-compute[72362]:       <entry name="serial">5907c2ff-9ac0-4104-b80b-499e200728f1</entry>
Aug 09 10:33:24 user nova-compute[72362]:       <entry name="uuid">5907c2ff-9ac0-4104-b80b-499e200728f1</entry>
Aug 09 10:33:24 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:33:24 user nova-compute[72362]:     </system>
Aug 09 10:33:24 user nova-compute[72362]:   </sysinfo>
Aug 09 10:33:24 user nova-compute[72362]:   <os>
Aug 09 10:33:24 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:33:24 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:33:24 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:33:24 user nova-compute[72362]:   </os>
Aug 09 10:33:24 user nova-compute[72362]:   <features>
Aug 09 10:33:24 user nova-compute[72362]:     <acpi/>
Aug 09 10:33:24 user nova-compute[72362]:     <apic/>
Aug 09 10:33:24 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:33:24 user nova-compute[72362]:   </features>
Aug 09 10:33:24 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:33:24 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:33:24 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:33:24 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:33:24 user nova-compute[72362]:   </clock>
Aug 09 10:33:24 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:33:24 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:33:24 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:33:24 user nova-compute[72362]:   </cpu>
Aug 09 10:33:24 user nova-compute[72362]:   <devices>
Aug 09 10:33:24 user nova-compute[72362]:     <disk type="block" device="disk">
Aug 09 10:33:24 user nova-compute[72362]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:33:24 user nova-compute[72362]:       <source dev="/dev/sde"/>
Aug 09 10:33:24 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:33:24 user nova-compute[72362]:       <serial>5b7e90a1-be13-48cd-9b15-b8bb87253216</serial>
Aug 09 10:33:24 user nova-compute[72362]:     </disk>
Aug 09 10:33:24 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:33:24 user nova-compute[72362]:       <mac address="fa:16:3e:de:fb:96"/>
Aug 09 10:33:24 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:33:24 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:33:24 user nova-compute[72362]:       <target dev="tap8c5d102b-ab"/>
Aug 09 10:33:24 user nova-compute[72362]:     </interface>
Aug 09 10:33:24 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:33:24 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/5907c2ff-9ac0-4104-b80b-499e200728f1/console.log" append="off"/>
Aug 09 10:33:24 user nova-compute[72362]:     </serial>
Aug 09 10:33:24 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:33:24 user nova-compute[72362]:     <video>
Aug 09 10:33:24 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:33:24 user nova-compute[72362]:     </video>
Aug 09 10:33:24 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:33:24 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:33:24 user nova-compute[72362]:     </rng>
Aug 09 10:33:24 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:33:24 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:33:24 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:33:24 user nova-compute[72362]:     </memballoon>
Aug 09 10:33:24 user nova-compute[72362]:   </devices>
Aug 09 10:33:24 user nova-compute[72362]: </domain>
Aug 09 10:33:24 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:33:24 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:33:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-589296118',display_name='tempest-TestVolumeBootPattern-server-589296118',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-589296118',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26e38599de0b4b06b723f5647a7fe121',ramdisk_id='',reservation_id='r-02v00c29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1478436240',owner_user_name='tempest-TestVolumeBootPattern-1478436240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:33:08Z,user_data=None,user_id='e96900e953f64d02bdb5d48f136133c3',uuid=5907c2ff-9ac0-4104-b80b-499e200728f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c5d102b-ab09-48b6-af7a-924afe72db9e", "address": "fa:16:3e:de:fb:96", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c5d102b-ab", "ovs_interfaceid": "8c5d102b-ab09-48b6-af7a-924afe72db9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:33:24 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Converting VIF {"id": "8c5d102b-ab09-48b6-af7a-924afe72db9e", "address": "fa:16:3e:de:fb:96", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c5d102b-ab", "ovs_interfaceid": "8c5d102b-ab09-48b6-af7a-924afe72db9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:33:24 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:fb:96,bridge_name='br-int',has_traffic_filtering=True,id=8c5d102b-ab09-48b6-af7a-924afe72db9e,network=Network(b4a9e050-41f1-404a-bf5c-41421f034644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c5d102b-ab') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:33:24 user nova-compute[72362]: DEBUG os_vif [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:fb:96,bridge_name='br-int',has_traffic_filtering=True,id=8c5d102b-ab09-48b6-af7a-924afe72db9e,network=Network(b4a9e050-41f1-404a-bf5c-41421f034644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c5d102b-ab') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:33:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:33:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:33:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:33:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:33:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c5d102b-ab, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:33:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8c5d102b-ab, col_values=(('external_ids', {'iface-id': '8c5d102b-ab09-48b6-af7a-924afe72db9e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:fb:96', 'vm-uuid': '5907c2ff-9ac0-4104-b80b-499e200728f1'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:33:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:33:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:33:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:33:24 user nova-compute[72362]: INFO os_vif [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:fb:96,bridge_name='br-int',has_traffic_filtering=True,id=8c5d102b-ab09-48b6-af7a-924afe72db9e,network=Network(b4a9e050-41f1-404a-bf5c-41421f034644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c5d102b-ab')
Aug 09 10:33:25 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:33:25 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] No VIF found with MAC fa:16:3e:de:fb:96, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:33:25 user nova-compute[72362]: DEBUG nova.compute.manager [req-64a1ecf8-3c05-42da-9c9e-838217b3e660 req-58780b3c-c941-41bd-84ad-a8a15dd4a0bc service nova] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Received event network-changed-8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:33:25 user nova-compute[72362]: DEBUG nova.compute.manager [req-64a1ecf8-3c05-42da-9c9e-838217b3e660 req-58780b3c-c941-41bd-84ad-a8a15dd4a0bc service nova] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Refreshing instance network info cache due to event network-changed-8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:33:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-64a1ecf8-3c05-42da-9c9e-838217b3e660 req-58780b3c-c941-41bd-84ad-a8a15dd4a0bc service nova] Acquiring lock "refresh_cache-5502750a-6b11-4600-9363-a814a12573d2" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:33:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-64a1ecf8-3c05-42da-9c9e-838217b3e660 req-58780b3c-c941-41bd-84ad-a8a15dd4a0bc service nova] Acquired lock "refresh_cache-5502750a-6b11-4600-9363-a814a12573d2" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:33:25 user nova-compute[72362]: DEBUG nova.network.neutron [req-64a1ecf8-3c05-42da-9c9e-838217b3e660 req-58780b3c-c941-41bd-84ad-a8a15dd4a0bc service nova] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Refreshing network info cache for port 8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:33:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-237bfee3-d2a1-4797-96f1-f466b824ec39 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Acquiring lock "5502750a-6b11-4600-9363-a814a12573d2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:33:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-237bfee3-d2a1-4797-96f1-f466b824ec39 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "5502750a-6b11-4600-9363-a814a12573d2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:33:25 user nova-compute[72362]: DEBUG nova.objects.instance [None req-237bfee3-d2a1-4797-96f1-f466b824ec39 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lazy-loading 'flavor' on Instance uuid 5502750a-6b11-4600-9363-a814a12573d2 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:33:25 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-237bfee3-d2a1-4797-96f1-f466b824ec39 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Ignoring supplied device name: /dev/vdb
Aug 09 10:33:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-237bfee3-d2a1-4797-96f1-f466b824ec39 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "5502750a-6b11-4600-9363-a814a12573d2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:33:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-237bfee3-d2a1-4797-96f1-f466b824ec39 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Acquiring lock "5502750a-6b11-4600-9363-a814a12573d2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:33:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-237bfee3-d2a1-4797-96f1-f466b824ec39 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "5502750a-6b11-4600-9363-a814a12573d2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:33:25 user nova-compute[72362]: INFO nova.compute.manager [None req-237bfee3-d2a1-4797-96f1-f466b824ec39 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Attaching volume 2cfc2c05-95b1-4133-8f5b-d5e49bffa59c to /dev/vdb
Aug 09 10:33:25 user nova-compute[72362]: DEBUG os_brick.utils [None req-237bfee3-d2a1-4797-96f1-f466b824ec39 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:33:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:25 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94214d7-c4b2-4c39-8e00-6e5be6ce7394]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:25 user nova-compute[72362]: DEBUG nova.network.neutron [req-64a1ecf8-3c05-42da-9c9e-838217b3e660 req-58780b3c-c941-41bd-84ad-a8a15dd4a0bc service nova] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Updated VIF entry in instance network info cache for port 8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:33:25 user nova-compute[72362]: DEBUG nova.network.neutron [req-64a1ecf8-3c05-42da-9c9e-838217b3e660 req-58780b3c-c941-41bd-84ad-a8a15dd4a0bc service nova] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Updating instance_info_cache with network_info: [{"id": "8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249", "address": "fa:16:3e:9f:29:a6", "network": {"id": "f9878e3c-f52a-4f3a-933d-b9c534dd3a59", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-797945070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc046adc7984378983895400e2b5e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4b73e7-3e", "ovs_interfaceid": "8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:33:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:25 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab76b5a5-bce4-4fde-97fc-21bf0a99d51d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-64a1ecf8-3c05-42da-9c9e-838217b3e660 req-58780b3c-c941-41bd-84ad-a8a15dd4a0bc service nova] Releasing lock "refresh_cache-5502750a-6b11-4600-9363-a814a12573d2" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:33:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:25 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd287b5-eb4c-4e43-a3ff-9a68d61dfa0e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:25 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[899504f7-d3fc-4164-a3a6-f1ac49826db4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-237bfee3-d2a1-4797-96f1-f466b824ec39 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-237bfee3-d2a1-4797-96f1-f466b824ec39 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:33:25 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-237bfee3-d2a1-4797-96f1-f466b824ec39 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:33:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:33:25 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:33:25 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc3a355-40fc-496d-8f06-046caeb21e7f]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:25 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-237bfee3-d2a1-4797-96f1-f466b824ec39 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:33:25 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-237bfee3-d2a1-4797-96f1-f466b824ec39 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:33:25 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-237bfee3-d2a1-4797-96f1-f466b824ec39 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:33:25 user nova-compute[72362]: DEBUG os_brick.utils [None req-237bfee3-d2a1-4797-96f1-f466b824ec39 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:33:25 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-237bfee3-d2a1-4797-96f1-f466b824ec39 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Updating existing volume attachment record: 415a4c45-93c9-442e-969c-7ba58aa7365f {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 10:33:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:33:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:33:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:33:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:33:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:33:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:33:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:33:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:33:27 user nova-compute[72362]: DEBUG nova.compute.manager [req-af78416b-2ada-46de-92f1-6ac2c435fb5c req-c2fc5d23-a3f6-4a4b-8475-07a8c7e707d1 service nova] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Received event network-vif-plugged-8c5d102b-ab09-48b6-af7a-924afe72db9e {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:33:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-af78416b-2ada-46de-92f1-6ac2c435fb5c req-c2fc5d23-a3f6-4a4b-8475-07a8c7e707d1 service nova] Acquiring lock "5907c2ff-9ac0-4104-b80b-499e200728f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:33:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-af78416b-2ada-46de-92f1-6ac2c435fb5c req-c2fc5d23-a3f6-4a4b-8475-07a8c7e707d1 service nova] Lock "5907c2ff-9ac0-4104-b80b-499e200728f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:33:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-af78416b-2ada-46de-92f1-6ac2c435fb5c req-c2fc5d23-a3f6-4a4b-8475-07a8c7e707d1 service nova] Lock "5907c2ff-9ac0-4104-b80b-499e200728f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:33:27 user nova-compute[72362]: DEBUG nova.compute.manager [req-af78416b-2ada-46de-92f1-6ac2c435fb5c req-c2fc5d23-a3f6-4a4b-8475-07a8c7e707d1 service nova] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] No waiting events found dispatching network-vif-plugged-8c5d102b-ab09-48b6-af7a-924afe72db9e {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:33:27 user nova-compute[72362]: WARNING nova.compute.manager [req-af78416b-2ada-46de-92f1-6ac2c435fb5c req-c2fc5d23-a3f6-4a4b-8475-07a8c7e707d1 service nova] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Received unexpected event network-vif-plugged-8c5d102b-ab09-48b6-af7a-924afe72db9e for instance with vm_state building and task_state spawning.
Aug 09 10:33:27 user nova-compute[72362]: DEBUG nova.compute.manager [req-af78416b-2ada-46de-92f1-6ac2c435fb5c req-c2fc5d23-a3f6-4a4b-8475-07a8c7e707d1 service nova] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Received event network-vif-plugged-8c5d102b-ab09-48b6-af7a-924afe72db9e {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:33:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-af78416b-2ada-46de-92f1-6ac2c435fb5c req-c2fc5d23-a3f6-4a4b-8475-07a8c7e707d1 service nova] Acquiring lock "5907c2ff-9ac0-4104-b80b-499e200728f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:33:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-af78416b-2ada-46de-92f1-6ac2c435fb5c req-c2fc5d23-a3f6-4a4b-8475-07a8c7e707d1 service nova] Lock "5907c2ff-9ac0-4104-b80b-499e200728f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:33:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-af78416b-2ada-46de-92f1-6ac2c435fb5c req-c2fc5d23-a3f6-4a4b-8475-07a8c7e707d1 service nova] Lock "5907c2ff-9ac0-4104-b80b-499e200728f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:33:27 user nova-compute[72362]: DEBUG nova.compute.manager [req-af78416b-2ada-46de-92f1-6ac2c435fb5c req-c2fc5d23-a3f6-4a4b-8475-07a8c7e707d1 service nova] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] No waiting events found dispatching network-vif-plugged-8c5d102b-ab09-48b6-af7a-924afe72db9e {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:33:27 user nova-compute[72362]: WARNING nova.compute.manager [req-af78416b-2ada-46de-92f1-6ac2c435fb5c req-c2fc5d23-a3f6-4a4b-8475-07a8c7e707d1 service nova] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Received unexpected event network-vif-plugged-8c5d102b-ab09-48b6-af7a-924afe72db9e for instance with vm_state building and task_state spawning.
Aug 09 10:33:28 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577208.5604138, 5907c2ff-9ac0-4104-b80b-499e200728f1 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:33:28 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] VM Resumed (Lifecycle Event)
Aug 09 10:33:28 user nova-compute[72362]: DEBUG nova.compute.manager [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:33:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:33:28 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Instance spawned successfully.
Aug 09 10:33:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 10:33:28 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:33:28 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:33:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Found default for hw_cdrom_bus of ide {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:33:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Found default for hw_disk_bus of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:33:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:33:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:33:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Found default for hw_video_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:33:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Found default for hw_vif_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:33:28 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:33:28 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577208.5609975, 5907c2ff-9ac0-4104-b80b-499e200728f1 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:33:28 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] VM Started (Lifecycle Event)
Aug 09 10:33:28 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:33:28 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:33:28 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:33:28 user nova-compute[72362]: INFO nova.compute.manager [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Took 5.17 seconds to spawn the instance on the hypervisor.
Aug 09 10:33:28 user nova-compute[72362]: DEBUG nova.compute.manager [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:33:28 user nova-compute[72362]: INFO nova.compute.manager [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Took 21.01 seconds to build instance.
Aug 09 10:33:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e1a10e7d-9dfd-4fad-b1a7-ab708ee5e413 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "5907c2ff-9ac0-4104-b80b-499e200728f1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.127s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:33:29 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:33:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:33:34 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-237bfee3-d2a1-4797-96f1-f466b824ec39 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:33:34 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-237bfee3-d2a1-4797-96f1-f466b824ec39 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2cfc2c05-95b1-4133-8f5b-d5e49bffa59c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UMCPmLlO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:33:34 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-237bfee3-d2a1-4797-96f1-f466b824ec39 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:33:34 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-237bfee3-d2a1-4797-96f1-f466b824ec39 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:33:34 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-237bfee3-d2a1-4797-96f1-f466b824ec39 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:33:34 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-237bfee3-d2a1-4797-96f1-f466b824ec39 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:33:34 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-237bfee3-d2a1-4797-96f1-f466b824ec39 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2cfc2c05-95b1-4133-8f5b-d5e49bffa59c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:33:34 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-237bfee3-d2a1-4797-96f1-f466b824ec39 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2cfc2c05-95b1-4133-8f5b-d5e49bffa59c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:33:34 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-237bfee3-d2a1-4797-96f1-f466b824ec39 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:33:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cfc2c05-95b1-4133-8f5b-d5e49bffa59c -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:34 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:33:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cfc2c05-95b1-4133-8f5b-d5e49bffa59c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:34 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b145b21-7dee-482c-99b1-69c1c82d7d52]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:34 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-237bfee3-d2a1-4797-96f1-f466b824ec39 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:33:34 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:33:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cfc2c05-95b1-4133-8f5b-d5e49bffa59c -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cfc2c05-95b1-4133-8f5b-d5e49bffa59c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:35 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b28902-bf9b-4b49-87c2-0b6c91ec3865]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2cfc2c05-95b1-4133-8f5b-d5e49bffa59c] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:35 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-237bfee3-d2a1-4797-96f1-f466b824ec39 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2cfc2c05-95b1-4133-8f5b-d5e49bffa59c] added
Aug 09 10:33:35 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:33:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cfc2c05-95b1-4133-8f5b-d5e49bffa59c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cfc2c05-95b1-4133-8f5b-d5e49bffa59c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:35 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[598a07cd-48a3-4cf4-bb7a-995423700382]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:35 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-237bfee3-d2a1-4797-96f1-f466b824ec39 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:33:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cfc2c05-95b1-4133-8f5b-d5e49bffa59c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cfc2c05-95b1-4133-8f5b-d5e49bffa59c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:35 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff26ef57-97c0-4fd1-8c4e-979fab398dd9]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:35 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-237bfee3-d2a1-4797-96f1-f466b824ec39 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:33:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cfc2c05-95b1-4133-8f5b-d5e49bffa59c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UMCPmLlO {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cfc2c05-95b1-4133-8f5b-d5e49bffa59c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UMCPmLlO" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:35 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a5b427-81c0-45de-a3f2-49cc760ec570]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:35 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-237bfee3-d2a1-4797-96f1-f466b824ec39 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UMCPmLlO'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:33:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cfc2c05-95b1-4133-8f5b-d5e49bffa59c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cfc2c05-95b1-4133-8f5b-d5e49bffa59c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:35 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[404c7deb-4ec7-4e23-a7fd-83c7e233848e]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:35 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-237bfee3-d2a1-4797-96f1-f466b824ec39 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:33:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:35 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c7db99-b078-45f2-9c9e-57689845da5e]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:35 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-237bfee3-d2a1-4797-96f1-f466b824ec39 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:33:35 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:33:35 user nova-compute[72362]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:33:35 user nova-compute[72362]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 (non-flash)
Aug 09 10:33:35 user nova-compute[72362]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 (non-flash)
Aug 09 10:33:35 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:33:35 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-237bfee3-d2a1-4797-96f1-f466b824ec39 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:33:35 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:33:35 user nova-compute[72362]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:33:35 user nova-compute[72362]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 (non-flash)
Aug 09 10:33:35 user nova-compute[72362]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 (non-flash)
Aug 09 10:33:35 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:33:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cfc2c05-95b1-4133-8f5b-d5e49bffa59c -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cfc2c05-95b1-4133-8f5b-d5e49bffa59c -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:35 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7bf100b-0ff7-4436-86ea-59edfb8f51a3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2cfc2c05-95b1-4133-8f5b-d5e49bffa59c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2cfc2c05-95b1-4133-8f5b-d5e49bffa59c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:35 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-237bfee3-d2a1-4797-96f1-f466b824ec39 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2cfc2c05-95b1-4133-8f5b-d5e49bffa59c, portal: 172.16.0.220,3260]
Aug 09 10:33:35 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:2cfc2c05-95b1-4133-8f5b-d5e49bffa59c, portal: 172.16.0.220,3260] successful.
Aug 09 10:33:35 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:33:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cfc2c05-95b1-4133-8f5b-d5e49bffa59c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cfc2c05-95b1-4133-8f5b-d5e49bffa59c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.050s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:35 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[db21faff-7568-4473-8223-08e2ce2d20b2]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:35 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-237bfee3-d2a1-4797-96f1-f466b824ec39 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:33:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:35 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7411a71-4f4f-4ec4-b307-ecb61af69d80]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cfc2c05-95b1-4133-8f5b-d5e49bffa59c (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:35 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-237bfee3-d2a1-4797-96f1-f466b824ec39 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:33:35 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:33:35 user nova-compute[72362]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:33:35 user nova-compute[72362]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 (non-flash)
Aug 09 10:33:35 user nova-compute[72362]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 (non-flash)
Aug 09 10:33:35 user nova-compute[72362]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cfc2c05-95b1-4133-8f5b-d5e49bffa59c (non-flash)
Aug 09 10:33:35 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:33:35 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-237bfee3-d2a1-4797-96f1-f466b824ec39 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:33:35 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:33:35 user nova-compute[72362]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:33:35 user nova-compute[72362]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 (non-flash)
Aug 09 10:33:35 user nova-compute[72362]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 (non-flash)
Aug 09 10:33:35 user nova-compute[72362]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cfc2c05-95b1-4133-8f5b-d5e49bffa59c (non-flash)
Aug 09 10:33:35 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:33:35 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-237bfee3-d2a1-4797-96f1-f466b824ec39 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2cfc2c05-95b1-4133-8f5b-d5e49bffa59c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:33:35 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-237bfee3-d2a1-4797-96f1-f466b824ec39 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:33:35 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-237bfee3-d2a1-4797-96f1-f466b824ec39 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] HCTL ('37', '-', '-', 0) found on session 47 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:33:35 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-237bfee3-d2a1-4797-96f1-f466b824ec39 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:33:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:33:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:33:35 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b51d5e-5f76-4c62-8666-c47b59fd69d0]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:33:35 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-237bfee3-d2a1-4797-96f1-f466b824ec39 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Searching for a device in session 47 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:33:35 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-237bfee3-d2a1-4797-96f1-f466b824ec39 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UMCPmLlO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:33:36 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-237bfee3-d2a1-4797-96f1-f466b824ec39 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:33:36 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-237bfee3-d2a1-4797-96f1-f466b824ec39 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '26236303935643736', 'path': '/dev/sdf'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:33:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-237bfee3-d2a1-4797-96f1-f466b824ec39 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236303935643736', 'path': '/dev/sdf'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:33:36 user nova-compute[72362]: DEBUG nova.objects.instance [None req-237bfee3-d2a1-4797-96f1-f466b824ec39 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lazy-loading 'flavor' on Instance uuid 5502750a-6b11-4600-9363-a814a12573d2 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:33:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-237bfee3-d2a1-4797-96f1-f466b824ec39 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 10:33:36 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:33:36 user nova-compute[72362]:   <source dev="/dev/sdf"/>
Aug 09 10:33:36 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:33:36 user nova-compute[72362]:   <serial>2cfc2c05-95b1-4133-8f5b-d5e49bffa59c</serial>
Aug 09 10:33:36 user nova-compute[72362]: </disk>
Aug 09 10:33:36 user nova-compute[72362]:  {{(pid=72362) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 10:33:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-237bfee3-d2a1-4797-96f1-f466b824ec39 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:33:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-237bfee3-d2a1-4797-96f1-f466b824ec39 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:33:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-237bfee3-d2a1-4797-96f1-f466b824ec39 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] No VIF found with MAC fa:16:3e:9f:29:a6, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:33:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:33:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-237bfee3-d2a1-4797-96f1-f466b824ec39 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "5502750a-6b11-4600-9363-a814a12573d2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.122s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:33:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:33:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:33:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:33:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:33:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:33:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:33:54 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:33:56 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:33:58 user nova-compute[72362]: DEBUG nova.compute.manager [req-f9b600d0-496c-40ba-99d9-14c19e1aa7f6 req-044f249b-83be-4daf-b4c0-9c05ffac7ee2 service nova] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Received event network-changed-f99044c7-fa30-4e74-b2f3-0e937c17b02e {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:33:58 user nova-compute[72362]: DEBUG nova.compute.manager [req-f9b600d0-496c-40ba-99d9-14c19e1aa7f6 req-044f249b-83be-4daf-b4c0-9c05ffac7ee2 service nova] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Refreshing instance network info cache due to event network-changed-f99044c7-fa30-4e74-b2f3-0e937c17b02e. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:33:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f9b600d0-496c-40ba-99d9-14c19e1aa7f6 req-044f249b-83be-4daf-b4c0-9c05ffac7ee2 service nova] Acquiring lock "refresh_cache-09fcf27a-c6dc-4c4a-b73c-555ea2339967" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:33:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f9b600d0-496c-40ba-99d9-14c19e1aa7f6 req-044f249b-83be-4daf-b4c0-9c05ffac7ee2 service nova] Acquired lock "refresh_cache-09fcf27a-c6dc-4c4a-b73c-555ea2339967" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:33:58 user nova-compute[72362]: DEBUG nova.network.neutron [req-f9b600d0-496c-40ba-99d9-14c19e1aa7f6 req-044f249b-83be-4daf-b4c0-9c05ffac7ee2 service nova] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Refreshing network info cache for port f99044c7-fa30-4e74-b2f3-0e937c17b02e {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:33:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-503242e7-3250-4faa-801c-770744322769 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Acquiring lock "09fcf27a-c6dc-4c4a-b73c-555ea2339967" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:33:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-503242e7-3250-4faa-801c-770744322769 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "09fcf27a-c6dc-4c4a-b73c-555ea2339967" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:33:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-503242e7-3250-4faa-801c-770744322769 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Acquiring lock "09fcf27a-c6dc-4c4a-b73c-555ea2339967-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:33:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-503242e7-3250-4faa-801c-770744322769 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "09fcf27a-c6dc-4c4a-b73c-555ea2339967-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:33:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-503242e7-3250-4faa-801c-770744322769 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "09fcf27a-c6dc-4c4a-b73c-555ea2339967-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:33:58 user nova-compute[72362]: INFO nova.compute.manager [None req-503242e7-3250-4faa-801c-770744322769 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Terminating instance
Aug 09 10:33:58 user nova-compute[72362]: DEBUG nova.compute.manager [None req-503242e7-3250-4faa-801c-770744322769 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Start destroying the instance on the hypervisor. {{(pid=72362) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 10:33:58 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:33:58 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:33:58 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:33:58 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:33:58 user nova-compute[72362]: DEBUG nova.compute.manager [req-b1a1c093-2f8c-4b6f-9146-684de364fa15 req-fa7ad2e3-3865-452d-a42d-53abe7d60d55 service nova] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Received event network-vif-unplugged-f99044c7-fa30-4e74-b2f3-0e937c17b02e {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:33:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b1a1c093-2f8c-4b6f-9146-684de364fa15 req-fa7ad2e3-3865-452d-a42d-53abe7d60d55 service nova] Acquiring lock "09fcf27a-c6dc-4c4a-b73c-555ea2339967-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:33:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b1a1c093-2f8c-4b6f-9146-684de364fa15 req-fa7ad2e3-3865-452d-a42d-53abe7d60d55 service nova] Lock "09fcf27a-c6dc-4c4a-b73c-555ea2339967-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:33:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b1a1c093-2f8c-4b6f-9146-684de364fa15 req-fa7ad2e3-3865-452d-a42d-53abe7d60d55 service nova] Lock "09fcf27a-c6dc-4c4a-b73c-555ea2339967-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:33:58 user nova-compute[72362]: DEBUG nova.compute.manager [req-b1a1c093-2f8c-4b6f-9146-684de364fa15 req-fa7ad2e3-3865-452d-a42d-53abe7d60d55 service nova] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] No waiting events found dispatching network-vif-unplugged-f99044c7-fa30-4e74-b2f3-0e937c17b02e {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:33:58 user nova-compute[72362]: DEBUG nova.compute.manager [req-b1a1c093-2f8c-4b6f-9146-684de364fa15 req-fa7ad2e3-3865-452d-a42d-53abe7d60d55 service nova] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Received event network-vif-unplugged-f99044c7-fa30-4e74-b2f3-0e937c17b02e for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:33:58 user nova-compute[72362]: DEBUG nova.network.neutron [req-f9b600d0-496c-40ba-99d9-14c19e1aa7f6 req-044f249b-83be-4daf-b4c0-9c05ffac7ee2 service nova] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Updated VIF entry in instance network info cache for port f99044c7-fa30-4e74-b2f3-0e937c17b02e. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:33:58 user nova-compute[72362]: DEBUG nova.network.neutron [req-f9b600d0-496c-40ba-99d9-14c19e1aa7f6 req-044f249b-83be-4daf-b4c0-9c05ffac7ee2 service nova] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Updating instance_info_cache with network_info: [{"id": "f99044c7-fa30-4e74-b2f3-0e937c17b02e", "address": "fa:16:3e:40:57:6c", "network": {"id": "5fe3b8dc-aa50-4e53-bb4d-2dcb773e501e", "bridge": "br-int", "label": "tempest-TestStampPattern-205380618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bb5a3be50242059591c9cbf8cc0f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf99044c7-fa", "ovs_interfaceid": "f99044c7-fa30-4e74-b2f3-0e937c17b02e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:33:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f9b600d0-496c-40ba-99d9-14c19e1aa7f6 req-044f249b-83be-4daf-b4c0-9c05ffac7ee2 service nova] Releasing lock "refresh_cache-09fcf27a-c6dc-4c4a-b73c-555ea2339967" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:33:58 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Instance destroyed successfully.
Aug 09 10:33:58 user nova-compute[72362]: DEBUG nova.objects.instance [None req-503242e7-3250-4faa-801c-770744322769 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lazy-loading 'resources' on Instance uuid 09fcf27a-c6dc-4c4a-b73c-555ea2339967 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:33:58 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-503242e7-3250-4faa-801c-770744322769 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:26:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-317416098',display_name='tempest-TestStampPattern-server-317416098',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-317416098',id=24,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKLVu2dFvNs/80YFheQzFf8fh5quQ6+XNPPKMAWty1o9Sg/SwStPSnUjW/MsHeKbh1Vmc8aVVjHIMDgyHJuEjaJiur5QU2xWgYQwqf957GAtOQZW38FZ3ltyAQ4vCaq5g==',key_name='tempest-TestStampPattern-2134506676',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:26:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d7bb5a3be50242059591c9cbf8cc0f9d',ramdisk_id='',reservation_id='r-ax8392lz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1731024477',owner_user_name='tempest-TestStampPattern-1731024477-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:29:57Z,user_data=None,user_id='8bd184d9dcf64c6fa81bf0b7fa68a9b3',uuid=09fcf27a-c6dc-4c4a-b73c-555ea2339967,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f99044c7-fa30-4e74-b2f3-0e937c17b02e", "address": "fa:16:3e:40:57:6c", "network": {"id": "5fe3b8dc-aa50-4e53-bb4d-2dcb773e501e", "bridge": "br-int", "label": "tempest-TestStampPattern-205380618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bb5a3be50242059591c9cbf8cc0f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf99044c7-fa", "ovs_interfaceid": "f99044c7-fa30-4e74-b2f3-0e937c17b02e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:33:58 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-503242e7-3250-4faa-801c-770744322769 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Converting VIF {"id": "f99044c7-fa30-4e74-b2f3-0e937c17b02e", "address": "fa:16:3e:40:57:6c", "network": {"id": "5fe3b8dc-aa50-4e53-bb4d-2dcb773e501e", "bridge": "br-int", "label": "tempest-TestStampPattern-205380618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bb5a3be50242059591c9cbf8cc0f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf99044c7-fa", "ovs_interfaceid": "f99044c7-fa30-4e74-b2f3-0e937c17b02e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:33:58 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-503242e7-3250-4faa-801c-770744322769 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:57:6c,bridge_name='br-int',has_traffic_filtering=True,id=f99044c7-fa30-4e74-b2f3-0e937c17b02e,network=Network(5fe3b8dc-aa50-4e53-bb4d-2dcb773e501e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf99044c7-fa') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:33:58 user nova-compute[72362]: DEBUG os_vif [None req-503242e7-3250-4faa-801c-770744322769 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:57:6c,bridge_name='br-int',has_traffic_filtering=True,id=f99044c7-fa30-4e74-b2f3-0e937c17b02e,network=Network(5fe3b8dc-aa50-4e53-bb4d-2dcb773e501e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf99044c7-fa') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:33:58 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:33:58 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf99044c7-fa, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:33:58 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:33:58 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:33:59 user nova-compute[72362]: INFO os_vif [None req-503242e7-3250-4faa-801c-770744322769 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:57:6c,bridge_name='br-int',has_traffic_filtering=True,id=f99044c7-fa30-4e74-b2f3-0e937c17b02e,network=Network(5fe3b8dc-aa50-4e53-bb4d-2dcb773e501e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf99044c7-fa')
Aug 09 10:33:59 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-503242e7-3250-4faa-801c-770744322769 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Deleting instance files /opt/stack/data/nova/instances/09fcf27a-c6dc-4c4a-b73c-555ea2339967_del
Aug 09 10:33:59 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-503242e7-3250-4faa-801c-770744322769 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Deletion of /opt/stack/data/nova/instances/09fcf27a-c6dc-4c4a-b73c-555ea2339967_del complete
Aug 09 10:33:59 user nova-compute[72362]: INFO nova.compute.manager [None req-503242e7-3250-4faa-801c-770744322769 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 09 10:33:59 user nova-compute[72362]: DEBUG oslo.service.loopingcall [None req-503242e7-3250-4faa-801c-770744322769 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72362) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 10:33:59 user nova-compute[72362]: DEBUG nova.compute.manager [-] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Deallocating network for instance {{(pid=72362) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 10:33:59 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] deallocate_for_instance() {{(pid=72362) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 10:33:59 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:33:59 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Took 0.56 seconds to deallocate network for instance.
Aug 09 10:33:59 user nova-compute[72362]: DEBUG nova.compute.manager [req-47d079f0-472b-4f7a-af49-8baa2975e5ca req-8ba57316-b45c-4a3d-adfd-35fbd731134b service nova] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Received event network-vif-deleted-f99044c7-fa30-4e74-b2f3-0e937c17b02e {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:33:59 user nova-compute[72362]: INFO nova.compute.manager [req-47d079f0-472b-4f7a-af49-8baa2975e5ca req-8ba57316-b45c-4a3d-adfd-35fbd731134b service nova] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Neutron deleted interface f99044c7-fa30-4e74-b2f3-0e937c17b02e; detaching it from the instance and deleting it from the info cache
Aug 09 10:33:59 user nova-compute[72362]: DEBUG nova.network.neutron [req-47d079f0-472b-4f7a-af49-8baa2975e5ca req-8ba57316-b45c-4a3d-adfd-35fbd731134b service nova] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:33:59 user nova-compute[72362]: DEBUG nova.compute.manager [req-47d079f0-472b-4f7a-af49-8baa2975e5ca req-8ba57316-b45c-4a3d-adfd-35fbd731134b service nova] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Detach interface failed, port_id=f99044c7-fa30-4e74-b2f3-0e937c17b02e, reason: Instance 09fcf27a-c6dc-4c4a-b73c-555ea2339967 could not be found. {{(pid=72362) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 10:33:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-503242e7-3250-4faa-801c-770744322769 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:33:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-503242e7-3250-4faa-801c-770744322769 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:34:00 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-503242e7-3250-4faa-801c-770744322769 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:34:00 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-503242e7-3250-4faa-801c-770744322769 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:34:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-503242e7-3250-4faa-801c-770744322769 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.370s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:34:00 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-503242e7-3250-4faa-801c-770744322769 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Deleted allocations for instance 09fcf27a-c6dc-4c4a-b73c-555ea2339967
Aug 09 10:34:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-503242e7-3250-4faa-801c-770744322769 tempest-TestStampPattern-1731024477 tempest-TestStampPattern-1731024477-project-member] Lock "09fcf27a-c6dc-4c4a-b73c-555ea2339967" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.133s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:34:00 user nova-compute[72362]: DEBUG nova.compute.manager [req-de2357c2-36aa-4ffd-8152-70a9a7697a0e req-2073c616-7482-46a7-8049-8f4b866446ca service nova] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Received event network-vif-plugged-f99044c7-fa30-4e74-b2f3-0e937c17b02e {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:34:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-de2357c2-36aa-4ffd-8152-70a9a7697a0e req-2073c616-7482-46a7-8049-8f4b866446ca service nova] Acquiring lock "09fcf27a-c6dc-4c4a-b73c-555ea2339967-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:34:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-de2357c2-36aa-4ffd-8152-70a9a7697a0e req-2073c616-7482-46a7-8049-8f4b866446ca service nova] Lock "09fcf27a-c6dc-4c4a-b73c-555ea2339967-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:34:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-de2357c2-36aa-4ffd-8152-70a9a7697a0e req-2073c616-7482-46a7-8049-8f4b866446ca service nova] Lock "09fcf27a-c6dc-4c4a-b73c-555ea2339967-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:34:00 user nova-compute[72362]: DEBUG nova.compute.manager [req-de2357c2-36aa-4ffd-8152-70a9a7697a0e req-2073c616-7482-46a7-8049-8f4b866446ca service nova] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] No waiting events found dispatching network-vif-plugged-f99044c7-fa30-4e74-b2f3-0e937c17b02e {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:34:00 user nova-compute[72362]: WARNING nova.compute.manager [req-de2357c2-36aa-4ffd-8152-70a9a7697a0e req-2073c616-7482-46a7-8049-8f4b866446ca service nova] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Received unexpected event network-vif-plugged-f99044c7-fa30-4e74-b2f3-0e937c17b02e for instance with vm_state deleted and task_state None.
Aug 09 10:34:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:34:02 user nova-compute[72362]: DEBUG nova.compute.manager [req-cb7cd414-7963-4d3a-8604-6db924f61198 req-09d7d824-a2da-445f-835f-7d481dd19867 service nova] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Received event network-changed-96c248f7-669c-49dd-b2bb-0e8668584239 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:34:02 user nova-compute[72362]: DEBUG nova.compute.manager [req-cb7cd414-7963-4d3a-8604-6db924f61198 req-09d7d824-a2da-445f-835f-7d481dd19867 service nova] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Refreshing instance network info cache due to event network-changed-96c248f7-669c-49dd-b2bb-0e8668584239. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:34:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-cb7cd414-7963-4d3a-8604-6db924f61198 req-09d7d824-a2da-445f-835f-7d481dd19867 service nova] Acquiring lock "refresh_cache-14e4ba46-d39d-4163-873a-6957ce64e635" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:34:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-cb7cd414-7963-4d3a-8604-6db924f61198 req-09d7d824-a2da-445f-835f-7d481dd19867 service nova] Acquired lock "refresh_cache-14e4ba46-d39d-4163-873a-6957ce64e635" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:34:02 user nova-compute[72362]: DEBUG nova.network.neutron [req-cb7cd414-7963-4d3a-8604-6db924f61198 req-09d7d824-a2da-445f-835f-7d481dd19867 service nova] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Refreshing network info cache for port 96c248f7-669c-49dd-b2bb-0e8668584239 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:34:03 user nova-compute[72362]: DEBUG nova.network.neutron [req-cb7cd414-7963-4d3a-8604-6db924f61198 req-09d7d824-a2da-445f-835f-7d481dd19867 service nova] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Updated VIF entry in instance network info cache for port 96c248f7-669c-49dd-b2bb-0e8668584239. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:34:03 user nova-compute[72362]: DEBUG nova.network.neutron [req-cb7cd414-7963-4d3a-8604-6db924f61198 req-09d7d824-a2da-445f-835f-7d481dd19867 service nova] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Updating instance_info_cache with network_info: [{"id": "96c248f7-669c-49dd-b2bb-0e8668584239", "address": "fa:16:3e:89:4b:4e", "network": {"id": "7358b925-3211-4419-84eb-df6967f5ea8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1360753488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dac04663e2f45378cc0e466740342d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96c248f7-66", "ovs_interfaceid": "96c248f7-669c-49dd-b2bb-0e8668584239", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:34:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-cb7cd414-7963-4d3a-8604-6db924f61198 req-09d7d824-a2da-445f-835f-7d481dd19867 service nova] Releasing lock "refresh_cache-14e4ba46-d39d-4163-873a-6957ce64e635" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:34:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-04a6fd0f-de52-4d54-83c0-a1ea8d91cd85 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Acquiring lock "5502750a-6b11-4600-9363-a814a12573d2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:34:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-04a6fd0f-de52-4d54-83c0-a1ea8d91cd85 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "5502750a-6b11-4600-9363-a814a12573d2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:34:03 user nova-compute[72362]: INFO nova.compute.manager [None req-04a6fd0f-de52-4d54-83c0-a1ea8d91cd85 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Detaching volume 2cfc2c05-95b1-4133-8f5b-d5e49bffa59c
Aug 09 10:34:03 user nova-compute[72362]: INFO nova.virt.block_device [None req-04a6fd0f-de52-4d54-83c0-a1ea8d91cd85 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Attempting to driver detach volume 2cfc2c05-95b1-4133-8f5b-d5e49bffa59c from mountpoint /dev/vdb
Aug 09 10:34:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-04a6fd0f-de52-4d54-83c0-a1ea8d91cd85 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Attempting to detach device vdb from instance 5502750a-6b11-4600-9363-a814a12573d2 from the persistent domain config. {{(pid=72362) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 10:34:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-04a6fd0f-de52-4d54-83c0-a1ea8d91cd85 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 10:34:03 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:34:03 user nova-compute[72362]:   <source dev="/dev/sdf"/>
Aug 09 10:34:03 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:34:03 user nova-compute[72362]:   <serial>2cfc2c05-95b1-4133-8f5b-d5e49bffa59c</serial>
Aug 09 10:34:03 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 10:34:03 user nova-compute[72362]: </disk>
Aug 09 10:34:03 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:34:03 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-04a6fd0f-de52-4d54-83c0-a1ea8d91cd85 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Successfully detached device vdb from instance 5502750a-6b11-4600-9363-a814a12573d2 from the persistent domain config.
Aug 09 10:34:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-04a6fd0f-de52-4d54-83c0-a1ea8d91cd85 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5502750a-6b11-4600-9363-a814a12573d2 from the live domain config. {{(pid=72362) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 10:34:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-04a6fd0f-de52-4d54-83c0-a1ea8d91cd85 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 10:34:03 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:34:03 user nova-compute[72362]:   <source dev="/dev/sdf"/>
Aug 09 10:34:03 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:34:03 user nova-compute[72362]:   <serial>2cfc2c05-95b1-4133-8f5b-d5e49bffa59c</serial>
Aug 09 10:34:03 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 10:34:03 user nova-compute[72362]: </disk>
Aug 09 10:34:03 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:34:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5a445fcc-578d-401a-9794-43345c80a601 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Acquiring lock "5502750a-6b11-4600-9363-a814a12573d2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:34:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Received event <DeviceRemovedEvent: 1691577243.862645, 5502750a-6b11-4600-9363-a814a12573d2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72362) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 10:34:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-04a6fd0f-de52-4d54-83c0-a1ea8d91cd85 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5502750a-6b11-4600-9363-a814a12573d2 {{(pid=72362) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 10:34:03 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-04a6fd0f-de52-4d54-83c0-a1ea8d91cd85 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Successfully detached device vdb from instance 5502750a-6b11-4600-9363-a814a12573d2 from the live domain config.
Aug 09 10:34:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04a6fd0f-de52-4d54-83c0-a1ea8d91cd85 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 5502750a-6b11-4600-9363-a814a12573d2] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:34:03 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a6fd0f-de52-4d54-83c0-a1ea8d91cd85 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:2cfc2c05-95b1-4133-8f5b-d5e49bffa59c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UMCPmLlO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:34:03 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-04a6fd0f-de52-4d54-83c0-a1ea8d91cd85 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:34:03 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-04a6fd0f-de52-4d54-83c0-a1ea8d91cd85 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:34:03 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-04a6fd0f-de52-4d54-83c0-a1ea8d91cd85 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:34:03 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a6fd0f-de52-4d54-83c0-a1ea8d91cd85 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2cfc2c05-95b1-4133-8f5b-d5e49bffa59c', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:34:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:03 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[649e6b7a-306f-44ac-baf4-a6e230fcc9cf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2cfc2c05-95b1-4133-8f5b-d5e49bffa59c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:03 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0609c566-b583-4b24-bd13-5fca461b97f3]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cfc2c05-95b1-4133-8f5b-d5e49bffa59c (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:03 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a6fd0f-de52-4d54-83c0-a1ea8d91cd85 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:34:03 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:34:03 user nova-compute[72362]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:34:03 user nova-compute[72362]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 (non-flash)
Aug 09 10:34:03 user nova-compute[72362]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 (non-flash)
Aug 09 10:34:03 user nova-compute[72362]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cfc2c05-95b1-4133-8f5b-d5e49bffa59c (non-flash)
Aug 09 10:34:03 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:34:03 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a6fd0f-de52-4d54-83c0-a1ea8d91cd85 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:34:03 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:34:03 user nova-compute[72362]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:34:03 user nova-compute[72362]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 (non-flash)
Aug 09 10:34:03 user nova-compute[72362]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 (non-flash)
Aug 09 10:34:03 user nova-compute[72362]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cfc2c05-95b1-4133-8f5b-d5e49bffa59c (non-flash)
Aug 09 10:34:03 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:34:03 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a6fd0f-de52-4d54-83c0-a1ea8d91cd85 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e43065f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2cfc2c05-95b1-4133-8f5b-d5e49bffa59c'): ({'sdf'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:34:03 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-04a6fd0f-de52-4d54-83c0-a1ea8d91cd85 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Removing single pathed devices sdf {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:34:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:03 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54d6902-027a-4e64-80f8-ed482538a4d7]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:03 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2c49bf-a911-4b03-8b8c-e08aad20e9a9]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:03 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-04a6fd0f-de52-4d54-83c0-a1ea8d91cd85 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Flushing IO for device /dev/sdf {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:34:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:03 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:34:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:03 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[304f41bd-70d3-49c2-88ff-9e90d2c63aa6]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:03 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-04a6fd0f-de52-4d54-83c0-a1ea8d91cd85 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:34:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.038s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:04 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15e6f7b-e294-48c9-9677-f108913725e5]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:04 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-04a6fd0f-de52-4d54-83c0-a1ea8d91cd85 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:34:04 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-04a6fd0f-de52-4d54-83c0-a1ea8d91cd85 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] SCSI volumes sdf have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:34:04 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a6fd0f-de52-4d54-83c0-a1ea8d91cd85 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2cfc2c05-95b1-4133-8f5b-d5e49bffa59c')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:34:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cfc2c05-95b1-4133-8f5b-d5e49bffa59c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cfc2c05-95b1-4133-8f5b-d5e49bffa59c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:04 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbac7156-b130-4607-bb2b-4ea13fe39a3b]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:04 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a6fd0f-de52-4d54-83c0-a1ea8d91cd85 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:34:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cfc2c05-95b1-4133-8f5b-d5e49bffa59c -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cfc2c05-95b1-4133-8f5b-d5e49bffa59c -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:04 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[154b52e3-ac20-4249-b589-d8e60df444d6]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:2cfc2c05-95b1-4133-8f5b-d5e49bffa59c, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:2cfc2c05-95b1-4133-8f5b-d5e49bffa59c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:04 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a6fd0f-de52-4d54-83c0-a1ea8d91cd85 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:2cfc2c05-95b1-4133-8f5b-d5e49bffa59c, portal: 172.16.0.220,3260]
Aug 09 10:34:04 user nova-compute[72362]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:2cfc2c05-95b1-4133-8f5b-d5e49bffa59c, portal: 172.16.0.220,3260] successful.
Aug 09 10:34:04 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:34:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cfc2c05-95b1-4133-8f5b-d5e49bffa59c -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cfc2c05-95b1-4133-8f5b-d5e49bffa59c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:04 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b9a469-c3e1-4dad-b724-7b5c80da8a0e]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:04 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a6fd0f-de52-4d54-83c0-a1ea8d91cd85 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:34:04 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-04a6fd0f-de52-4d54-83c0-a1ea8d91cd85 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:34:04 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a6fd0f-de52-4d54-83c0-a1ea8d91cd85 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] <== disconnect_volume: return (302ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:34:04 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04a6fd0f-de52-4d54-83c0-a1ea8d91cd85 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:34:04 user nova-compute[72362]: DEBUG nova.objects.instance [None req-04a6fd0f-de52-4d54-83c0-a1ea8d91cd85 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lazy-loading 'flavor' on Instance uuid 5502750a-6b11-4600-9363-a814a12573d2 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:34:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-04a6fd0f-de52-4d54-83c0-a1ea8d91cd85 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "5502750a-6b11-4600-9363-a814a12573d2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.585s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:34:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5a445fcc-578d-401a-9794-43345c80a601 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "5502750a-6b11-4600-9363-a814a12573d2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.456s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:34:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5a445fcc-578d-401a-9794-43345c80a601 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Acquiring lock "5502750a-6b11-4600-9363-a814a12573d2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:34:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5a445fcc-578d-401a-9794-43345c80a601 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "5502750a-6b11-4600-9363-a814a12573d2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:34:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5a445fcc-578d-401a-9794-43345c80a601 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "5502750a-6b11-4600-9363-a814a12573d2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:34:04 user nova-compute[72362]: INFO nova.compute.manager [None req-5a445fcc-578d-401a-9794-43345c80a601 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Terminating instance
Aug 09 10:34:04 user nova-compute[72362]: DEBUG nova.compute.manager [None req-5a445fcc-578d-401a-9794-43345c80a601 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Start destroying the instance on the hypervisor. {{(pid=72362) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 10:34:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-be527589-7fe8-4e9a-b03f-f7e7dbc76d78 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Acquiring lock "14e4ba46-d39d-4163-873a-6957ce64e635" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:34:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-be527589-7fe8-4e9a-b03f-f7e7dbc76d78 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "14e4ba46-d39d-4163-873a-6957ce64e635" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG nova.objects.instance [None req-be527589-7fe8-4e9a-b03f-f7e7dbc76d78 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lazy-loading 'flavor' on Instance uuid 14e4ba46-d39d-4163-873a-6957ce64e635 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-be527589-7fe8-4e9a-b03f-f7e7dbc76d78 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "14e4ba46-d39d-4163-873a-6957ce64e635" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-be527589-7fe8-4e9a-b03f-f7e7dbc76d78 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Acquiring lock "14e4ba46-d39d-4163-873a-6957ce64e635" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-be527589-7fe8-4e9a-b03f-f7e7dbc76d78 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "14e4ba46-d39d-4163-873a-6957ce64e635" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:34:05 user nova-compute[72362]: INFO nova.compute.manager [None req-be527589-7fe8-4e9a-b03f-f7e7dbc76d78 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Attaching volume bf97fddb-c983-4c45-bcd5-a927d5c586d8 to /dev/vdb
Aug 09 10:34:05 user nova-compute[72362]: DEBUG nova.compute.manager [req-c9711a07-73dc-470f-8a10-f5ce9540fc9b req-ef93bb8c-592d-400d-8f69-0b2ddaba6dc8 service nova] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Received event network-vif-unplugged-8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c9711a07-73dc-470f-8a10-f5ce9540fc9b req-ef93bb8c-592d-400d-8f69-0b2ddaba6dc8 service nova] Acquiring lock "5502750a-6b11-4600-9363-a814a12573d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c9711a07-73dc-470f-8a10-f5ce9540fc9b req-ef93bb8c-592d-400d-8f69-0b2ddaba6dc8 service nova] Lock "5502750a-6b11-4600-9363-a814a12573d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c9711a07-73dc-470f-8a10-f5ce9540fc9b req-ef93bb8c-592d-400d-8f69-0b2ddaba6dc8 service nova] Lock "5502750a-6b11-4600-9363-a814a12573d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG nova.compute.manager [req-c9711a07-73dc-470f-8a10-f5ce9540fc9b req-ef93bb8c-592d-400d-8f69-0b2ddaba6dc8 service nova] [instance: 5502750a-6b11-4600-9363-a814a12573d2] No waiting events found dispatching network-vif-unplugged-8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG nova.compute.manager [req-c9711a07-73dc-470f-8a10-f5ce9540fc9b req-ef93bb8c-592d-400d-8f69-0b2ddaba6dc8 service nova] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Received event network-vif-unplugged-8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249 for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG os_brick.utils [None req-be527589-7fe8-4e9a-b03f-f7e7dbc76d78 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8638bd-3f9e-4d7d-bd2b-55f47506fedb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b56efa-f9dc-49e1-aee5-2419a47c0e86]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[626cbb1d-4db3-4744-a40c-6ca68690d4a7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[553f5b02-f1db-4c84-89bb-c7f277b38645]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-be527589-7fe8-4e9a-b03f-f7e7dbc76d78 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-be527589-7fe8-4e9a-b03f-f7e7dbc76d78 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-be527589-7fe8-4e9a-b03f-f7e7dbc76d78 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:34:05 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:34:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39c1451-253c-415a-b0bc-e88a182ad4cc]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-be527589-7fe8-4e9a-b03f-f7e7dbc76d78 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-be527589-7fe8-4e9a-b03f-f7e7dbc76d78 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-be527589-7fe8-4e9a-b03f-f7e7dbc76d78 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG os_brick.utils [None req-be527589-7fe8-4e9a-b03f-f7e7dbc76d78 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-be527589-7fe8-4e9a-b03f-f7e7dbc76d78 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Updating existing volume attachment record: 083619ff-79f1-4fa5-944a-8dcd92852397 {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 10:34:05 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Instance destroyed successfully.
Aug 09 10:34:05 user nova-compute[72362]: DEBUG nova.objects.instance [None req-5a445fcc-578d-401a-9794-43345c80a601 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lazy-loading 'resources' on Instance uuid 5502750a-6b11-4600-9363-a814a12573d2 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-5a445fcc-578d-401a-9794-43345c80a601 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:31:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1911527310',display_name='tempest-VolumesSnapshotTestJSON-instance-1911527310',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1911527310',id=33,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvp1G8Sq7NTtefSVQmgix95Wjwbvo+/ezkIPRrKPwplEFxrtQ1QwXWKuKOOF47Gg987ptaLDKzBqaUaWGqOX/zp3EiwEOaDwS7EBo+2KcefyR/MJgE8q5OnUx2txNDX/Q==',key_name='tempest-keypair-1119633726',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:31:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4fc046adc7984378983895400e2b5e04',ramdisk_id='',reservation_id='r-ta7kbahi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1214114448',owner_user_name='tempest-VolumesSnapshotTestJSON-1214114448-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:31:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='755ef9806a264f15bb80d2cd5db55d9b',uuid=5502750a-6b11-4600-9363-a814a12573d2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249", "address": "fa:16:3e:9f:29:a6", "network": {"id": "f9878e3c-f52a-4f3a-933d-b9c534dd3a59", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-797945070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc046adc7984378983895400e2b5e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4b73e7-3e", "ovs_interfaceid": "8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-5a445fcc-578d-401a-9794-43345c80a601 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Converting VIF {"id": "8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249", "address": "fa:16:3e:9f:29:a6", "network": {"id": "f9878e3c-f52a-4f3a-933d-b9c534dd3a59", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-797945070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc046adc7984378983895400e2b5e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4b73e7-3e", "ovs_interfaceid": "8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-5a445fcc-578d-401a-9794-43345c80a601 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9f:29:a6,bridge_name='br-int',has_traffic_filtering=True,id=8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249,network=Network(f9878e3c-f52a-4f3a-933d-b9c534dd3a59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e4b73e7-3e') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG os_vif [None req-5a445fcc-578d-401a-9794-43345c80a601 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:29:a6,bridge_name='br-int',has_traffic_filtering=True,id=8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249,network=Network(f9878e3c-f52a-4f3a-933d-b9c534dd3a59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e4b73e7-3e') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e4b73e7-3e, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:34:05 user nova-compute[72362]: INFO os_vif [None req-5a445fcc-578d-401a-9794-43345c80a601 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:29:a6,bridge_name='br-int',has_traffic_filtering=True,id=8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249,network=Network(f9878e3c-f52a-4f3a-933d-b9c534dd3a59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e4b73e7-3e')
Aug 09 10:34:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a445fcc-578d-401a-9794-43345c80a601 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 5502750a-6b11-4600-9363-a814a12573d2] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a445fcc-578d-401a-9794-43345c80a601 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:2cfc2c05-95b1-4133-8f5b-d5e49bffa59c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UMCPmLlO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:34:05 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-5a445fcc-578d-401a-9794-43345c80a601 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:34:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-5a445fcc-578d-401a-9794-43345c80a601 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-5a445fcc-578d-401a-9794-43345c80a601 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a445fcc-578d-401a-9794-43345c80a601 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2cfc2c05-95b1-4133-8f5b-d5e49bffa59c', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29fdb5d-3c7c-43c4-b033-7ffbeb10237c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[235482bb-b654-4038-9946-366e487ca3cf]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a445fcc-578d-401a-9794-43345c80a601 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:34:05 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:34:05 user nova-compute[72362]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:34:05 user nova-compute[72362]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 (non-flash)
Aug 09 10:34:05 user nova-compute[72362]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 (non-flash)
Aug 09 10:34:05 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a445fcc-578d-401a-9794-43345c80a601 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:34:05 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:34:05 user nova-compute[72362]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:34:05 user nova-compute[72362]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 (non-flash)
Aug 09 10:34:05 user nova-compute[72362]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 (non-flash)
Aug 09 10:34:05 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a445fcc-578d-401a-9794-43345c80a601 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e41bc790>, {}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a445fcc-578d-401a-9794-43345c80a601 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Disconnecting from: [] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-5a445fcc-578d-401a-9794-43345c80a601 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.051s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a445fcc-578d-401a-9794-43345c80a601 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] <== disconnect_volume: return (53ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a445fcc-578d-401a-9794-43345c80a601 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:34:05 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-5a445fcc-578d-401a-9794-43345c80a601 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Deleting instance files /opt/stack/data/nova/instances/5502750a-6b11-4600-9363-a814a12573d2_del
Aug 09 10:34:05 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-5a445fcc-578d-401a-9794-43345c80a601 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Deletion of /opt/stack/data/nova/instances/5502750a-6b11-4600-9363-a814a12573d2_del complete
Aug 09 10:34:05 user nova-compute[72362]: INFO nova.compute.manager [None req-5a445fcc-578d-401a-9794-43345c80a601 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 09 10:34:05 user nova-compute[72362]: DEBUG oslo.service.loopingcall [None req-5a445fcc-578d-401a-9794-43345c80a601 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72362) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG nova.compute.manager [-] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Deallocating network for instance {{(pid=72362) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 10:34:05 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 5502750a-6b11-4600-9363-a814a12573d2] deallocate_for_instance() {{(pid=72362) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 10:34:06 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:34:06 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:34:06 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:34:06 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:34:06 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:34:06 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:34:06 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 10:34:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:34:06 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:34:06 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Took 1.00 seconds to deallocate network for instance.
Aug 09 10:34:06 user nova-compute[72362]: WARNING nova.volume.cinder [None req-5a445fcc-578d-401a-9794-43345c80a601 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Attachment 415a4c45-93c9-442e-969c-7ba58aa7365f does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 415a4c45-93c9-442e-969c-7ba58aa7365f. (HTTP 404) (Request-ID: req-50c1ef4f-1725-4127-a5ee-8a884bf468ba)
Aug 09 10:34:06 user nova-compute[72362]: INFO nova.compute.manager [None req-5a445fcc-578d-401a-9794-43345c80a601 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Took 0.02 seconds to detach 1 volumes for instance.
Aug 09 10:34:06 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:34:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5a445fcc-578d-401a-9794-43345c80a601 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:34:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5a445fcc-578d-401a-9794-43345c80a601 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:34:07 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-5a445fcc-578d-401a-9794-43345c80a601 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:34:07 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-5a445fcc-578d-401a-9794-43345c80a601 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:34:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5a445fcc-578d-401a-9794-43345c80a601 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.310s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:34:07 user nova-compute[72362]: DEBUG nova.compute.manager [req-29164bb9-f7c1-4bd1-a5b9-58e7ab9adca5 req-20ee67c1-cb98-4d2b-866c-578c2311ccef service nova] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Received event network-vif-plugged-8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:34:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-29164bb9-f7c1-4bd1-a5b9-58e7ab9adca5 req-20ee67c1-cb98-4d2b-866c-578c2311ccef service nova] Acquiring lock "5502750a-6b11-4600-9363-a814a12573d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:34:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-29164bb9-f7c1-4bd1-a5b9-58e7ab9adca5 req-20ee67c1-cb98-4d2b-866c-578c2311ccef service nova] Lock "5502750a-6b11-4600-9363-a814a12573d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:34:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-29164bb9-f7c1-4bd1-a5b9-58e7ab9adca5 req-20ee67c1-cb98-4d2b-866c-578c2311ccef service nova] Lock "5502750a-6b11-4600-9363-a814a12573d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:34:07 user nova-compute[72362]: DEBUG nova.compute.manager [req-29164bb9-f7c1-4bd1-a5b9-58e7ab9adca5 req-20ee67c1-cb98-4d2b-866c-578c2311ccef service nova] [instance: 5502750a-6b11-4600-9363-a814a12573d2] No waiting events found dispatching network-vif-plugged-8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:34:07 user nova-compute[72362]: WARNING nova.compute.manager [req-29164bb9-f7c1-4bd1-a5b9-58e7ab9adca5 req-20ee67c1-cb98-4d2b-866c-578c2311ccef service nova] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Received unexpected event network-vif-plugged-8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249 for instance with vm_state deleted and task_state None.
Aug 09 10:34:07 user nova-compute[72362]: DEBUG nova.compute.manager [req-29164bb9-f7c1-4bd1-a5b9-58e7ab9adca5 req-20ee67c1-cb98-4d2b-866c-578c2311ccef service nova] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Received event network-vif-deleted-8e4b73e7-3e62-4f89-9f87-5ad7ef1a3249 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:34:07 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-5a445fcc-578d-401a-9794-43345c80a601 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Deleted allocations for instance 5502750a-6b11-4600-9363-a814a12573d2
Aug 09 10:34:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5a445fcc-578d-401a-9794-43345c80a601 tempest-VolumesSnapshotTestJSON-1214114448 tempest-VolumesSnapshotTestJSON-1214114448-project-member] Lock "5502750a-6b11-4600-9363-a814a12573d2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.426s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:34:07 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:34:07 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 10:34:07 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Rebuilding the list of instances to heal {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 10:34:08 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "refresh_cache-8e055c58-a365-4f18-a6e3-377e32e2189d" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:34:08 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquired lock "refresh_cache-8e055c58-a365-4f18-a6e3-377e32e2189d" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:34:08 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Forcefully refreshing network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 10:34:08 user nova-compute[72362]: DEBUG nova.objects.instance [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lazy-loading 'info_cache' on Instance uuid 8e055c58-a365-4f18-a6e3-377e32e2189d {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:34:08 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Updating instance_info_cache with network_info: [{"id": "f1a870b6-1d3b-4567-b165-8f2571edf9bd", "address": "fa:16:3e:d7:84:09", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a870b6-1d", "ovs_interfaceid": "f1a870b6-1d3b-4567-b165-8f2571edf9bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:34:08 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Releasing lock "refresh_cache-8e055c58-a365-4f18-a6e3-377e32e2189d" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:34:08 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Updated the network info_cache for instance {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 10:34:08 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:34:10 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:34:11 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:34:13 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691577238.9619386, 09fcf27a-c6dc-4c4a-b73c-555ea2339967 => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:34:13 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] VM Stopped (Lifecycle Event)
Aug 09 10:34:13 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:34:13 user nova-compute[72362]: DEBUG nova.compute.manager [None req-98fca1df-729a-498e-aa4c-ae650d391685 None None] [instance: 09fcf27a-c6dc-4c4a-b73c-555ea2339967] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:34:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:34:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:34:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:34:13 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be527589-7fe8-4e9a-b03f-f7e7dbc76d78 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-be527589-7fe8-4e9a-b03f-f7e7dbc76d78 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bf97fddb-c983-4c45-bcd5-a927d5c586d8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XjELkAdu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:34:14 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-be527589-7fe8-4e9a-b03f-f7e7dbc76d78 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:34:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-be527589-7fe8-4e9a-b03f-f7e7dbc76d78 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-be527589-7fe8-4e9a-b03f-f7e7dbc76d78 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:34:14 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-be527589-7fe8-4e9a-b03f-f7e7dbc76d78 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:34:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-be527589-7fe8-4e9a-b03f-f7e7dbc76d78 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf97fddb-c983-4c45-bcd5-a927d5c586d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-be527589-7fe8-4e9a-b03f-f7e7dbc76d78 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf97fddb-c983-4c45-bcd5-a927d5c586d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:34:14 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-be527589-7fe8-4e9a-b03f-f7e7dbc76d78 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:34:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf97fddb-c983-4c45-bcd5-a927d5c586d8 -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf97fddb-c983-4c45-bcd5-a927d5c586d8 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b829a2-2186-4016-8773-4485e749c7ad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-be527589-7fe8-4e9a-b03f-f7e7dbc76d78 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:34:14 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf97fddb-c983-4c45-bcd5-a927d5c586d8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf97fddb-c983-4c45-bcd5-a927d5c586d8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b7d482-7d61-4ca4-ba7b-ad15303e74f7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf97fddb-c983-4c45-bcd5-a927d5c586d8] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-be527589-7fe8-4e9a-b03f-f7e7dbc76d78 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf97fddb-c983-4c45-bcd5-a927d5c586d8] added
Aug 09 10:34:14 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf97fddb-c983-4c45-bcd5-a927d5c586d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf97fddb-c983-4c45-bcd5-a927d5c586d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19d8760-b34e-408c-b03f-1086c0ebbf3a]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-be527589-7fe8-4e9a-b03f-f7e7dbc76d78 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf97fddb-c983-4c45-bcd5-a927d5c586d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf97fddb-c983-4c45-bcd5-a927d5c586d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e713e888-025e-4064-8707-b0979a020c88]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-be527589-7fe8-4e9a-b03f-f7e7dbc76d78 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf97fddb-c983-4c45-bcd5-a927d5c586d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XjELkAdu {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf97fddb-c983-4c45-bcd5-a927d5c586d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XjELkAdu" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[974a517b-d292-4035-8e8b-0cef5da11ac7]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-be527589-7fe8-4e9a-b03f-f7e7dbc76d78 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XjELkAdu'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf97fddb-c983-4c45-bcd5-a927d5c586d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf97fddb-c983-4c45-bcd5-a927d5c586d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2fc820-56ca-437d-a8d2-cb79f543a3fd]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-be527589-7fe8-4e9a-b03f-f7e7dbc76d78 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d25544-c22d-48d5-8987-cf4c7ebcf202]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-be527589-7fe8-4e9a-b03f-f7e7dbc76d78 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:34:14 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:34:14 user nova-compute[72362]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:34:14 user nova-compute[72362]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 (non-flash)
Aug 09 10:34:14 user nova-compute[72362]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 (non-flash)
Aug 09 10:34:14 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-be527589-7fe8-4e9a-b03f-f7e7dbc76d78 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:34:14 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:34:14 user nova-compute[72362]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:34:14 user nova-compute[72362]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 (non-flash)
Aug 09 10:34:14 user nova-compute[72362]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 (non-flash)
Aug 09 10:34:14 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf97fddb-c983-4c45-bcd5-a927d5c586d8 -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf97fddb-c983-4c45-bcd5-a927d5c586d8 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1653c43-9094-419d-a771-1d2c058aed98]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf97fddb-c983-4c45-bcd5-a927d5c586d8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bf97fddb-c983-4c45-bcd5-a927d5c586d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-be527589-7fe8-4e9a-b03f-f7e7dbc76d78 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf97fddb-c983-4c45-bcd5-a927d5c586d8, portal: 172.16.0.220,3260]
Aug 09 10:34:14 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:bf97fddb-c983-4c45-bcd5-a927d5c586d8, portal: 172.16.0.220,3260] successful.
Aug 09 10:34:14 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf97fddb-c983-4c45-bcd5-a927d5c586d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf97fddb-c983-4c45-bcd5-a927d5c586d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac1e243-f109-4c1b-86d9-f94ec2a80242]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-be527589-7fe8-4e9a-b03f-f7e7dbc76d78 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c070789-419e-43eb-a268-b74272dfb447]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf97fddb-c983-4c45-bcd5-a927d5c586d8 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-be527589-7fe8-4e9a-b03f-f7e7dbc76d78 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:34:14 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:34:14 user nova-compute[72362]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:34:14 user nova-compute[72362]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 (non-flash)
Aug 09 10:34:14 user nova-compute[72362]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 (non-flash)
Aug 09 10:34:14 user nova-compute[72362]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf97fddb-c983-4c45-bcd5-a927d5c586d8 (non-flash)
Aug 09 10:34:14 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-be527589-7fe8-4e9a-b03f-f7e7dbc76d78 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:34:14 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:34:14 user nova-compute[72362]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:34:14 user nova-compute[72362]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 (non-flash)
Aug 09 10:34:14 user nova-compute[72362]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 (non-flash)
Aug 09 10:34:14 user nova-compute[72362]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf97fddb-c983-4c45-bcd5-a927d5c586d8 (non-flash)
Aug 09 10:34:14 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-be527589-7fe8-4e9a-b03f-f7e7dbc76d78 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf97fddb-c983-4c45-bcd5-a927d5c586d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-be527589-7fe8-4e9a-b03f-f7e7dbc76d78 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-be527589-7fe8-4e9a-b03f-f7e7dbc76d78 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] HCTL ('37', '-', '-', 0) found on session 48 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-be527589-7fe8-4e9a-b03f-f7e7dbc76d78 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1356fc-fd02-4a58-858d-abbda0850bc9]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-be527589-7fe8-4e9a-b03f-f7e7dbc76d78 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Searching for a device in session 48 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-be527589-7fe8-4e9a-b03f-f7e7dbc76d78 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XjELkAdu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:15 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:34:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/disk.rescue --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/disk.rescue --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:15 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-be527589-7fe8-4e9a-b03f-f7e7dbc76d78 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.388s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:34:15 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-be527589-7fe8-4e9a-b03f-f7e7dbc76d78 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '26563353830366632', 'path': '/dev/sdf'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:34:15 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be527589-7fe8-4e9a-b03f-f7e7dbc76d78 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563353830366632', 'path': '/dev/sdf'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:34:15 user nova-compute[72362]: DEBUG nova.objects.instance [None req-be527589-7fe8-4e9a-b03f-f7e7dbc76d78 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lazy-loading 'flavor' on Instance uuid 14e4ba46-d39d-4163-873a-6957ce64e635 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:34:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:15 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-be527589-7fe8-4e9a-b03f-f7e7dbc76d78 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 10:34:15 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:34:15 user nova-compute[72362]:   <source dev="/dev/sdf"/>
Aug 09 10:34:15 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:34:15 user nova-compute[72362]:   <serial>bf97fddb-c983-4c45-bcd5-a927d5c586d8</serial>
Aug 09 10:34:15 user nova-compute[72362]: </disk>
Aug 09 10:34:15 user nova-compute[72362]:  {{(pid=72362) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 10:34:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:15 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:34:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e4ba46-d39d-4163-873a-6957ce64e635/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:15 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-be527589-7fe8-4e9a-b03f-f7e7dbc76d78 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:34:15 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-be527589-7fe8-4e9a-b03f-f7e7dbc76d78 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:34:15 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-be527589-7fe8-4e9a-b03f-f7e7dbc76d78 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] No VIF found with MAC fa:16:3e:89:4b:4e, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:34:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e4ba46-d39d-4163-873a-6957ce64e635/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e4ba46-d39d-4163-873a-6957ce64e635/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-be527589-7fe8-4e9a-b03f-f7e7dbc76d78 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "14e4ba46-d39d-4163-873a-6957ce64e635" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.874s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:34:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e4ba46-d39d-4163-873a-6957ce64e635/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:16 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:34:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3cdf152-da86-447b-aa7c-921b6fa87ef8/disk.rescue --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3cdf152-da86-447b-aa7c-921b6fa87ef8/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3cdf152-da86-447b-aa7c-921b6fa87ef8/disk.rescue --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3cdf152-da86-447b-aa7c-921b6fa87ef8/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:16 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:34:16 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:34:16 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:34:16 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=7604MB free_disk=24.861801147460938GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 10:34:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:34:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:34:16 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:34:16 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 8e055c58-a365-4f18-a6e3-377e32e2189d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:34:16 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:34:16 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 30213e67-6b1d-4d97-a971-1544335d02fb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:34:16 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance f8abc99c-b87b-4586-b9d4-7f5bcda60683 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:34:16 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance fe1804e8-2340-4868-a0ff-32d5df5fad42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:34:16 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance f3cdf152-da86-447b-aa7c-921b6fa87ef8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:34:16 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 4b22a19f-300c-42fb-8175-e737eef7d531 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:34:16 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 14e4ba46-d39d-4163-873a-6957ce64e635 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:34:16 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 5907c2ff-9ac0-4104-b80b-499e200728f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:34:16 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 10:34:16 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 10:34:17 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:34:17 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:34:17 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 10:34:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.401s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:34:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-99d7b7d7-3b32-4544-b0ea-6745a043d81d tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Acquiring lock "14e4ba46-d39d-4163-873a-6957ce64e635" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:34:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-99d7b7d7-3b32-4544-b0ea-6745a043d81d tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "14e4ba46-d39d-4163-873a-6957ce64e635" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:34:20 user nova-compute[72362]: DEBUG nova.objects.instance [None req-99d7b7d7-3b32-4544-b0ea-6745a043d81d tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lazy-loading 'flavor' on Instance uuid 14e4ba46-d39d-4163-873a-6957ce64e635 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:34:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-99d7b7d7-3b32-4544-b0ea-6745a043d81d tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "14e4ba46-d39d-4163-873a-6957ce64e635" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:34:20 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691577245.7299104, 5502750a-6b11-4600-9363-a814a12573d2 => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:34:20 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 5502750a-6b11-4600-9363-a814a12573d2] VM Stopped (Lifecycle Event)
Aug 09 10:34:20 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7fe79f9f-5c7c-4d33-ac3d-c038d7154833 None None] [instance: 5502750a-6b11-4600-9363-a814a12573d2] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:34:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:34:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-99d7b7d7-3b32-4544-b0ea-6745a043d81d tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Acquiring lock "14e4ba46-d39d-4163-873a-6957ce64e635" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:34:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-99d7b7d7-3b32-4544-b0ea-6745a043d81d tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "14e4ba46-d39d-4163-873a-6957ce64e635" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:34:20 user nova-compute[72362]: INFO nova.compute.manager [None req-99d7b7d7-3b32-4544-b0ea-6745a043d81d tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Attaching volume 6660da02-3bbd-4179-a0ce-17bb66816c56 to /dev/vdc
Aug 09 10:34:20 user nova-compute[72362]: DEBUG os_brick.utils [None req-99d7b7d7-3b32-4544-b0ea-6745a043d81d tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:34:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:20 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a946fc40-1300-4200-8078-9edb429d8a0e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:20 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a2b873-98d3-4211-b2d0-430e877ce070]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:21 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e02ba0-728f-494c-b425-a795cfd88c4f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:21 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca87850-3666-4657-b34f-afbe0b622e5a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-99d7b7d7-3b32-4544-b0ea-6745a043d81d tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-99d7b7d7-3b32-4544-b0ea-6745a043d81d tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:34:21 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-99d7b7d7-3b32-4544-b0ea-6745a043d81d tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:34:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:34:21 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:34:21 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[117e57c3-e002-421e-88a0-a12a4da61f33]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:21 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-99d7b7d7-3b32-4544-b0ea-6745a043d81d tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:34:21 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-99d7b7d7-3b32-4544-b0ea-6745a043d81d tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:34:21 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-99d7b7d7-3b32-4544-b0ea-6745a043d81d tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:34:21 user nova-compute[72362]: DEBUG os_brick.utils [None req-99d7b7d7-3b32-4544-b0ea-6745a043d81d tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:34:21 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-99d7b7d7-3b32-4544-b0ea-6745a043d81d tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Updating existing volume attachment record: 82ca59cd-f72d-41f1-931d-bc09e40634d0 {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 10:34:25 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:34:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99d7b7d7-3b32-4544-b0ea-6745a043d81d tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:34:29 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7b7d7-3b32-4544-b0ea-6745a043d81d tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6660da02-3bbd-4179-a0ce-17bb66816c56'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'opZeHkdq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:34:29 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-99d7b7d7-3b32-4544-b0ea-6745a043d81d tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:34:29 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-99d7b7d7-3b32-4544-b0ea-6745a043d81d tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:34:29 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-99d7b7d7-3b32-4544-b0ea-6745a043d81d tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:34:29 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-99d7b7d7-3b32-4544-b0ea-6745a043d81d tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:34:29 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-99d7b7d7-3b32-4544-b0ea-6745a043d81d tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6660da02-3bbd-4179-a0ce-17bb66816c56" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:34:29 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-99d7b7d7-3b32-4544-b0ea-6745a043d81d tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6660da02-3bbd-4179-a0ce-17bb66816c56" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:34:29 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-99d7b7d7-3b32-4544-b0ea-6745a043d81d tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:34:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6660da02-3bbd-4179-a0ce-17bb66816c56 -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6660da02-3bbd-4179-a0ce-17bb66816c56 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:29 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9718f21-bede-4170-99e2-6bbf9e6b64ed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:29 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7b7d7-3b32-4544-b0ea-6745a043d81d tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:34:29 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:34:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6660da02-3bbd-4179-a0ce-17bb66816c56 -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6660da02-3bbd-4179-a0ce-17bb66816c56 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:29 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e9eaa3-c3c5-4911-a228-5ddb16671a95]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6660da02-3bbd-4179-a0ce-17bb66816c56] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:29 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7b7d7-3b32-4544-b0ea-6745a043d81d tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6660da02-3bbd-4179-a0ce-17bb66816c56] added
Aug 09 10:34:29 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:34:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6660da02-3bbd-4179-a0ce-17bb66816c56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6660da02-3bbd-4179-a0ce-17bb66816c56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:29 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f87b779-5170-4580-b07f-5ce0cd428baf]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:29 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7b7d7-3b32-4544-b0ea-6745a043d81d tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:34:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6660da02-3bbd-4179-a0ce-17bb66816c56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6660da02-3bbd-4179-a0ce-17bb66816c56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:29 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a918e39-2e79-4bb2-bd9a-0ae08ffc47f9]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:29 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7b7d7-3b32-4544-b0ea-6745a043d81d tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:34:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6660da02-3bbd-4179-a0ce-17bb66816c56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v opZeHkdq {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6660da02-3bbd-4179-a0ce-17bb66816c56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v opZeHkdq" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:29 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[da23819c-9d2a-4772-b88c-41d4e83ad8c1]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:29 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7b7d7-3b32-4544-b0ea-6745a043d81d tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'opZeHkdq'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:34:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6660da02-3bbd-4179-a0ce-17bb66816c56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6660da02-3bbd-4179-a0ce-17bb66816c56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:29 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[7329f2b5-d946-4481-a805-175fad4bbdf7]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:29 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7b7d7-3b32-4544-b0ea-6745a043d81d tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:34:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:29 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2eb2239-2774-4436-b38d-b7d6490ac59b]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf97fddb-c983-4c45-bcd5-a927d5c586d8 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:29 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7b7d7-3b32-4544-b0ea-6745a043d81d tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:34:29 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:34:29 user nova-compute[72362]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:34:29 user nova-compute[72362]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 (non-flash)
Aug 09 10:34:29 user nova-compute[72362]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 (non-flash)
Aug 09 10:34:29 user nova-compute[72362]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf97fddb-c983-4c45-bcd5-a927d5c586d8 (non-flash)
Aug 09 10:34:29 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:34:29 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7b7d7-3b32-4544-b0ea-6745a043d81d tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:34:29 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:34:29 user nova-compute[72362]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:34:29 user nova-compute[72362]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 (non-flash)
Aug 09 10:34:29 user nova-compute[72362]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 (non-flash)
Aug 09 10:34:29 user nova-compute[72362]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf97fddb-c983-4c45-bcd5-a927d5c586d8 (non-flash)
Aug 09 10:34:29 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:34:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6660da02-3bbd-4179-a0ce-17bb66816c56 -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6660da02-3bbd-4179-a0ce-17bb66816c56 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:30 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba155b4-3c77-490c-95c3-d3986a1be988]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6660da02-3bbd-4179-a0ce-17bb66816c56, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6660da02-3bbd-4179-a0ce-17bb66816c56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:30 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7b7d7-3b32-4544-b0ea-6745a043d81d tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6660da02-3bbd-4179-a0ce-17bb66816c56, portal: 172.16.0.220,3260]
Aug 09 10:34:30 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:6660da02-3bbd-4179-a0ce-17bb66816c56, portal: 172.16.0.220,3260] successful.
Aug 09 10:34:30 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:34:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6660da02-3bbd-4179-a0ce-17bb66816c56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6660da02-3bbd-4179-a0ce-17bb66816c56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:30 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[87cc532b-b490-403f-8ab1-bc1cc2796163]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:30 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7b7d7-3b32-4544-b0ea-6745a043d81d tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:34:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:30 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[90668551-3e94-48eb-a3a6-7f8483841f14]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf97fddb-c983-4c45-bcd5-a927d5c586d8 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6660da02-3bbd-4179-a0ce-17bb66816c56 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:30 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7b7d7-3b32-4544-b0ea-6745a043d81d tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:34:30 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:34:30 user nova-compute[72362]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:34:30 user nova-compute[72362]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 (non-flash)
Aug 09 10:34:30 user nova-compute[72362]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 (non-flash)
Aug 09 10:34:30 user nova-compute[72362]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf97fddb-c983-4c45-bcd5-a927d5c586d8 (non-flash)
Aug 09 10:34:30 user nova-compute[72362]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6660da02-3bbd-4179-a0ce-17bb66816c56 (non-flash)
Aug 09 10:34:30 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:34:30 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7b7d7-3b32-4544-b0ea-6745a043d81d tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:34:30 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:34:30 user nova-compute[72362]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:34:30 user nova-compute[72362]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 (non-flash)
Aug 09 10:34:30 user nova-compute[72362]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 (non-flash)
Aug 09 10:34:30 user nova-compute[72362]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf97fddb-c983-4c45-bcd5-a927d5c586d8 (non-flash)
Aug 09 10:34:30 user nova-compute[72362]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6660da02-3bbd-4179-a0ce-17bb66816c56 (non-flash)
Aug 09 10:34:30 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:34:30 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-99d7b7d7-3b32-4544-b0ea-6745a043d81d tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6660da02-3bbd-4179-a0ce-17bb66816c56" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:34:30 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7b7d7-3b32-4544-b0ea-6745a043d81d tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:34:30 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-99d7b7d7-3b32-4544-b0ea-6745a043d81d tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] HCTL ('38', '-', '-', 0) found on session 49 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:34:30 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-99d7b7d7-3b32-4544-b0ea-6745a043d81d tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:34:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:30 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d0df2f-8d47-44d8-a34c-4715104ba2ef]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:30 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-99d7b7d7-3b32-4544-b0ea-6745a043d81d tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Searching for a device in session 49 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:34:30 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7b7d7-3b32-4544-b0ea-6745a043d81d tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'opZeHkdq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:34:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:34:31 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-99d7b7d7-3b32-4544-b0ea-6745a043d81d tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:34:31 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7b7d7-3b32-4544-b0ea-6745a043d81d tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23734393635623239', 'path': '/dev/sdg'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:34:31 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99d7b7d7-3b32-4544-b0ea-6745a043d81d tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734393635623239', 'path': '/dev/sdg'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:34:31 user nova-compute[72362]: DEBUG nova.objects.instance [None req-99d7b7d7-3b32-4544-b0ea-6745a043d81d tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lazy-loading 'flavor' on Instance uuid 14e4ba46-d39d-4163-873a-6957ce64e635 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:34:31 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-99d7b7d7-3b32-4544-b0ea-6745a043d81d tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 10:34:31 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:34:31 user nova-compute[72362]:   <source dev="/dev/sdg"/>
Aug 09 10:34:31 user nova-compute[72362]:   <target dev="vdc" bus="virtio"/>
Aug 09 10:34:31 user nova-compute[72362]:   <serial>6660da02-3bbd-4179-a0ce-17bb66816c56</serial>
Aug 09 10:34:31 user nova-compute[72362]: </disk>
Aug 09 10:34:31 user nova-compute[72362]:  {{(pid=72362) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 10:34:31 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-99d7b7d7-3b32-4544-b0ea-6745a043d81d tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:34:31 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-99d7b7d7-3b32-4544-b0ea-6745a043d81d tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:34:31 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-99d7b7d7-3b32-4544-b0ea-6745a043d81d tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:34:31 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-99d7b7d7-3b32-4544-b0ea-6745a043d81d tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] No VIF found with MAC fa:16:3e:89:4b:4e, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:34:31 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-99d7b7d7-3b32-4544-b0ea-6745a043d81d tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "14e4ba46-d39d-4163-873a-6957ce64e635" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.761s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:34:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:34:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-612b507d-5da8-432e-9c4e-d721144c660b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Acquiring lock "14e4ba46-d39d-4163-873a-6957ce64e635" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:34:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-612b507d-5da8-432e-9c4e-d721144c660b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "14e4ba46-d39d-4163-873a-6957ce64e635" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:34:33 user nova-compute[72362]: INFO nova.compute.manager [None req-612b507d-5da8-432e-9c4e-d721144c660b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Detaching volume bf97fddb-c983-4c45-bcd5-a927d5c586d8
Aug 09 10:34:33 user nova-compute[72362]: INFO nova.virt.block_device [None req-612b507d-5da8-432e-9c4e-d721144c660b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Attempting to driver detach volume bf97fddb-c983-4c45-bcd5-a927d5c586d8 from mountpoint /dev/vdb
Aug 09 10:34:33 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-612b507d-5da8-432e-9c4e-d721144c660b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Attempting to detach device vdb from instance 14e4ba46-d39d-4163-873a-6957ce64e635 from the persistent domain config. {{(pid=72362) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 10:34:33 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-612b507d-5da8-432e-9c4e-d721144c660b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 10:34:33 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:34:33 user nova-compute[72362]:   <source dev="/dev/sdf"/>
Aug 09 10:34:33 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:34:33 user nova-compute[72362]:   <serial>bf97fddb-c983-4c45-bcd5-a927d5c586d8</serial>
Aug 09 10:34:33 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 10:34:33 user nova-compute[72362]: </disk>
Aug 09 10:34:33 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:34:33 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-612b507d-5da8-432e-9c4e-d721144c660b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Successfully detached device vdb from instance 14e4ba46-d39d-4163-873a-6957ce64e635 from the persistent domain config.
Aug 09 10:34:33 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-612b507d-5da8-432e-9c4e-d721144c660b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 14e4ba46-d39d-4163-873a-6957ce64e635 from the live domain config. {{(pid=72362) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 10:34:33 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-612b507d-5da8-432e-9c4e-d721144c660b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 10:34:33 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:34:33 user nova-compute[72362]:   <source dev="/dev/sdf"/>
Aug 09 10:34:33 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:34:33 user nova-compute[72362]:   <serial>bf97fddb-c983-4c45-bcd5-a927d5c586d8</serial>
Aug 09 10:34:33 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 10:34:33 user nova-compute[72362]: </disk>
Aug 09 10:34:33 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:34:33 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Received event <DeviceRemovedEvent: 1691577273.694225, 14e4ba46-d39d-4163-873a-6957ce64e635 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72362) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 10:34:33 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-612b507d-5da8-432e-9c4e-d721144c660b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 14e4ba46-d39d-4163-873a-6957ce64e635 {{(pid=72362) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 10:34:33 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-612b507d-5da8-432e-9c4e-d721144c660b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Successfully detached device vdb from instance 14e4ba46-d39d-4163-873a-6957ce64e635 from the live domain config.
Aug 09 10:34:33 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-612b507d-5da8-432e-9c4e-d721144c660b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:34:33 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-612b507d-5da8-432e-9c4e-d721144c660b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:bf97fddb-c983-4c45-bcd5-a927d5c586d8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XjELkAdu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:34:33 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-612b507d-5da8-432e-9c4e-d721144c660b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:34:33 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-612b507d-5da8-432e-9c4e-d721144c660b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:34:33 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-612b507d-5da8-432e-9c4e-d721144c660b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:34:33 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-612b507d-5da8-432e-9c4e-d721144c660b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf97fddb-c983-4c45-bcd5-a927d5c586d8', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:34:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:33 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec43bec6-0fd4-47ff-85ef-0d9a5bd2f785]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6660da02-3bbd-4179-a0ce-17bb66816c56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf97fddb-c983-4c45-bcd5-a927d5c586d8\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:33 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[118a146d-6a53-4284-a829-62d74cc4baa5]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf97fddb-c983-4c45-bcd5-a927d5c586d8 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6660da02-3bbd-4179-a0ce-17bb66816c56 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:33 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-612b507d-5da8-432e-9c4e-d721144c660b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:34:33 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:34:33 user nova-compute[72362]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:34:33 user nova-compute[72362]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 (non-flash)
Aug 09 10:34:33 user nova-compute[72362]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 (non-flash)
Aug 09 10:34:33 user nova-compute[72362]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf97fddb-c983-4c45-bcd5-a927d5c586d8 (non-flash)
Aug 09 10:34:33 user nova-compute[72362]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6660da02-3bbd-4179-a0ce-17bb66816c56 (non-flash)
Aug 09 10:34:33 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:34:33 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-612b507d-5da8-432e-9c4e-d721144c660b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:34:33 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:34:33 user nova-compute[72362]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:34:33 user nova-compute[72362]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 (non-flash)
Aug 09 10:34:33 user nova-compute[72362]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 (non-flash)
Aug 09 10:34:33 user nova-compute[72362]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf97fddb-c983-4c45-bcd5-a927d5c586d8 (non-flash)
Aug 09 10:34:33 user nova-compute[72362]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6660da02-3bbd-4179-a0ce-17bb66816c56 (non-flash)
Aug 09 10:34:33 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:34:33 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-612b507d-5da8-432e-9c4e-d721144c660b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e41bc700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf97fddb-c983-4c45-bcd5-a927d5c586d8'): ({'sdf'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:34:33 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-612b507d-5da8-432e-9c4e-d721144c660b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Removing single pathed devices sdf {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:34:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:33 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3250eb6-5784-45f0-82f4-3dad9f00fd6f]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:33 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa3bbdd-9239-4c93-b1ea-362cd8dcc0a6]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:33 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-612b507d-5da8-432e-9c4e-d721144c660b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Flushing IO for device /dev/sdf {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:34:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:33 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff59ae5-a924-4362-9c5b-e646dfe8b918]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:33 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-612b507d-5da8-432e-9c4e-d721144c660b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:34:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:33 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cb94fe-82d5-4cbb-b9cf-eb49458089ab]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:33 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-612b507d-5da8-432e-9c4e-d721144c660b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:34:33 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-612b507d-5da8-432e-9c4e-d721144c660b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] SCSI volumes sdf have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:34:33 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-612b507d-5da8-432e-9c4e-d721144c660b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf97fddb-c983-4c45-bcd5-a927d5c586d8')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:34:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf97fddb-c983-4c45-bcd5-a927d5c586d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf97fddb-c983-4c45-bcd5-a927d5c586d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:33 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[de08da7a-f1da-4c46-9aed-d2ec6c46be4f]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:33 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-612b507d-5da8-432e-9c4e-d721144c660b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:34:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf97fddb-c983-4c45-bcd5-a927d5c586d8 -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf97fddb-c983-4c45-bcd5-a927d5c586d8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:33 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c649e9-8e2b-4bf8-8863-4eafd7b1f741]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:bf97fddb-c983-4c45-bcd5-a927d5c586d8, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:bf97fddb-c983-4c45-bcd5-a927d5c586d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:33 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-612b507d-5da8-432e-9c4e-d721144c660b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:bf97fddb-c983-4c45-bcd5-a927d5c586d8, portal: 172.16.0.220,3260]
Aug 09 10:34:33 user nova-compute[72362]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:bf97fddb-c983-4c45-bcd5-a927d5c586d8, portal: 172.16.0.220,3260] successful.
Aug 09 10:34:33 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:34:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf97fddb-c983-4c45-bcd5-a927d5c586d8 -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf97fddb-c983-4c45-bcd5-a927d5c586d8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:34 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f338b42d-0463-4f2e-9ea9-9048025c6b8c]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:34 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-612b507d-5da8-432e-9c4e-d721144c660b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:34:34 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-612b507d-5da8-432e-9c4e-d721144c660b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:34:34 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-612b507d-5da8-432e-9c4e-d721144c660b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] <== disconnect_volume: return (313ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:34:34 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-612b507d-5da8-432e-9c4e-d721144c660b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:34:34 user nova-compute[72362]: DEBUG nova.objects.instance [None req-612b507d-5da8-432e-9c4e-d721144c660b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lazy-loading 'flavor' on Instance uuid 14e4ba46-d39d-4163-873a-6957ce64e635 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:34:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-612b507d-5da8-432e-9c4e-d721144c660b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "14e4ba46-d39d-4163-873a-6957ce64e635" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.772s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:34:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-9e9e6ea2-ca51-4e36-ab7a-e4193bf18114 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Acquiring lock "14e4ba46-d39d-4163-873a-6957ce64e635" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:34:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-9e9e6ea2-ca51-4e36-ab7a-e4193bf18114 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "14e4ba46-d39d-4163-873a-6957ce64e635" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:34:35 user nova-compute[72362]: INFO nova.compute.manager [None req-9e9e6ea2-ca51-4e36-ab7a-e4193bf18114 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Detaching volume 6660da02-3bbd-4179-a0ce-17bb66816c56
Aug 09 10:34:35 user nova-compute[72362]: INFO nova.virt.block_device [None req-9e9e6ea2-ca51-4e36-ab7a-e4193bf18114 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Attempting to driver detach volume 6660da02-3bbd-4179-a0ce-17bb66816c56 from mountpoint /dev/vdc
Aug 09 10:34:35 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-9e9e6ea2-ca51-4e36-ab7a-e4193bf18114 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Attempting to detach device vdc from instance 14e4ba46-d39d-4163-873a-6957ce64e635 from the persistent domain config. {{(pid=72362) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 10:34:35 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-9e9e6ea2-ca51-4e36-ab7a-e4193bf18114 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 10:34:35 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:34:35 user nova-compute[72362]:   <source dev="/dev/sdg"/>
Aug 09 10:34:35 user nova-compute[72362]:   <target dev="vdc" bus="virtio"/>
Aug 09 10:34:35 user nova-compute[72362]:   <serial>6660da02-3bbd-4179-a0ce-17bb66816c56</serial>
Aug 09 10:34:35 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 10:34:35 user nova-compute[72362]: </disk>
Aug 09 10:34:35 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:34:35 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-9e9e6ea2-ca51-4e36-ab7a-e4193bf18114 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Successfully detached device vdc from instance 14e4ba46-d39d-4163-873a-6957ce64e635 from the persistent domain config.
Aug 09 10:34:35 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-9e9e6ea2-ca51-4e36-ab7a-e4193bf18114 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 14e4ba46-d39d-4163-873a-6957ce64e635 from the live domain config. {{(pid=72362) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 10:34:35 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-9e9e6ea2-ca51-4e36-ab7a-e4193bf18114 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 10:34:35 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:34:35 user nova-compute[72362]:   <source dev="/dev/sdg"/>
Aug 09 10:34:35 user nova-compute[72362]:   <target dev="vdc" bus="virtio"/>
Aug 09 10:34:35 user nova-compute[72362]:   <serial>6660da02-3bbd-4179-a0ce-17bb66816c56</serial>
Aug 09 10:34:35 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 10:34:35 user nova-compute[72362]: </disk>
Aug 09 10:34:35 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:34:35 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:34:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Received event <DeviceRemovedEvent: 1691577276.113603, 14e4ba46-d39d-4163-873a-6957ce64e635 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72362) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 10:34:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-9e9e6ea2-ca51-4e36-ab7a-e4193bf18114 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 14e4ba46-d39d-4163-873a-6957ce64e635 {{(pid=72362) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 10:34:36 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-9e9e6ea2-ca51-4e36-ab7a-e4193bf18114 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Successfully detached device vdc from instance 14e4ba46-d39d-4163-873a-6957ce64e635 from the live domain config.
Aug 09 10:34:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e9e6ea2-ca51-4e36-ab7a-e4193bf18114 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:34:36 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9e6ea2-ca51-4e36-ab7a-e4193bf18114 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:6660da02-3bbd-4179-a0ce-17bb66816c56'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'opZeHkdq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:34:36 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-9e9e6ea2-ca51-4e36-ab7a-e4193bf18114 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:34:36 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-9e9e6ea2-ca51-4e36-ab7a-e4193bf18114 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:34:36 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-9e9e6ea2-ca51-4e36-ab7a-e4193bf18114 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:34:36 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9e6ea2-ca51-4e36-ab7a-e4193bf18114 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6660da02-3bbd-4179-a0ce-17bb66816c56', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:34:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:36 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e8aea4-577a-4b7b-88fc-db15391b3822]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6660da02-3bbd-4179-a0ce-17bb66816c56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:36 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4325c6d1-7668-4a0b-9858-4ff55415ac26]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6660da02-3bbd-4179-a0ce-17bb66816c56 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:36 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9e6ea2-ca51-4e36-ab7a-e4193bf18114 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:34:36 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:34:36 user nova-compute[72362]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:34:36 user nova-compute[72362]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 (non-flash)
Aug 09 10:34:36 user nova-compute[72362]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 (non-flash)
Aug 09 10:34:36 user nova-compute[72362]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6660da02-3bbd-4179-a0ce-17bb66816c56 (non-flash)
Aug 09 10:34:36 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:34:36 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9e6ea2-ca51-4e36-ab7a-e4193bf18114 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:34:36 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:34:36 user nova-compute[72362]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:34:36 user nova-compute[72362]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 (non-flash)
Aug 09 10:34:36 user nova-compute[72362]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 (non-flash)
Aug 09 10:34:36 user nova-compute[72362]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6660da02-3bbd-4179-a0ce-17bb66816c56 (non-flash)
Aug 09 10:34:36 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:34:36 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9e6ea2-ca51-4e36-ab7a-e4193bf18114 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34dc6daf80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6660da02-3bbd-4179-a0ce-17bb66816c56'): ({'sdg'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:34:36 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-9e9e6ea2-ca51-4e36-ab7a-e4193bf18114 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Removing single pathed devices sdg {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:34:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:36 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[709d0edd-2b9c-4c32-a51a-8bcaf964ec6f]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:36 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9e0a62-8df3-46b4-b8fc-3415e2918202]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:36 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-9e9e6ea2-ca51-4e36-ab7a-e4193bf18114 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Flushing IO for device /dev/sdg {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:34:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:36 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[8142da8a-7f01-4fff-bb95-fb77c578857a]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:36 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-9e9e6ea2-ca51-4e36-ab7a-e4193bf18114 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:34:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.047s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:36 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[97bc851f-a0aa-4906-bdf7-9b27f5414a4f]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:36 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-9e9e6ea2-ca51-4e36-ab7a-e4193bf18114 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:34:36 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-9e9e6ea2-ca51-4e36-ab7a-e4193bf18114 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] SCSI volumes sdg have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:34:36 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9e6ea2-ca51-4e36-ab7a-e4193bf18114 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6660da02-3bbd-4179-a0ce-17bb66816c56')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:34:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6660da02-3bbd-4179-a0ce-17bb66816c56 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6660da02-3bbd-4179-a0ce-17bb66816c56 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:36 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cadafc7-6551-4873-bd71-e61a7bf41021]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:36 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9e6ea2-ca51-4e36-ab7a-e4193bf18114 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:34:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6660da02-3bbd-4179-a0ce-17bb66816c56 -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6660da02-3bbd-4179-a0ce-17bb66816c56 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:36 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[748c1a32-90a2-4c32-be7c-8007c47761a3]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:6660da02-3bbd-4179-a0ce-17bb66816c56, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:6660da02-3bbd-4179-a0ce-17bb66816c56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:36 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9e6ea2-ca51-4e36-ab7a-e4193bf18114 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:6660da02-3bbd-4179-a0ce-17bb66816c56, portal: 172.16.0.220,3260]
Aug 09 10:34:36 user nova-compute[72362]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:6660da02-3bbd-4179-a0ce-17bb66816c56, portal: 172.16.0.220,3260] successful.
Aug 09 10:34:36 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:34:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6660da02-3bbd-4179-a0ce-17bb66816c56 -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6660da02-3bbd-4179-a0ce-17bb66816c56 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:36 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b804ae-9d3a-4aa3-9a89-2adf505189bb]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:36 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9e6ea2-ca51-4e36-ab7a-e4193bf18114 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:34:36 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-9e9e6ea2-ca51-4e36-ab7a-e4193bf18114 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:34:36 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9e6ea2-ca51-4e36-ab7a-e4193bf18114 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] <== disconnect_volume: return (310ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:34:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e9e6ea2-ca51-4e36-ab7a-e4193bf18114 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:34:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:34:37 user nova-compute[72362]: DEBUG nova.objects.instance [None req-9e9e6ea2-ca51-4e36-ab7a-e4193bf18114 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lazy-loading 'flavor' on Instance uuid 14e4ba46-d39d-4163-873a-6957ce64e635 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:34:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-9e9e6ea2-ca51-4e36-ab7a-e4193bf18114 tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "14e4ba46-d39d-4163-873a-6957ce64e635" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.623s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:34:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2942b0c5-cd5a-4101-a2a3-a273550ad21b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Acquiring lock "14e4ba46-d39d-4163-873a-6957ce64e635" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:34:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2942b0c5-cd5a-4101-a2a3-a273550ad21b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "14e4ba46-d39d-4163-873a-6957ce64e635" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:34:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2942b0c5-cd5a-4101-a2a3-a273550ad21b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Acquiring lock "14e4ba46-d39d-4163-873a-6957ce64e635-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:34:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2942b0c5-cd5a-4101-a2a3-a273550ad21b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "14e4ba46-d39d-4163-873a-6957ce64e635-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:34:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2942b0c5-cd5a-4101-a2a3-a273550ad21b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "14e4ba46-d39d-4163-873a-6957ce64e635-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:34:38 user nova-compute[72362]: INFO nova.compute.manager [None req-2942b0c5-cd5a-4101-a2a3-a273550ad21b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Terminating instance
Aug 09 10:34:38 user nova-compute[72362]: DEBUG nova.compute.manager [None req-2942b0c5-cd5a-4101-a2a3-a273550ad21b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Start destroying the instance on the hypervisor. {{(pid=72362) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 10:34:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:34:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:34:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:34:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:34:38 user nova-compute[72362]: DEBUG nova.compute.manager [req-571556e7-9e0d-45c1-8b6f-8b534b7a0a78 req-ba4bddca-4b03-419c-90cd-7324f049d010 service nova] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Received event network-vif-unplugged-96c248f7-669c-49dd-b2bb-0e8668584239 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:34:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-571556e7-9e0d-45c1-8b6f-8b534b7a0a78 req-ba4bddca-4b03-419c-90cd-7324f049d010 service nova] Acquiring lock "14e4ba46-d39d-4163-873a-6957ce64e635-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:34:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-571556e7-9e0d-45c1-8b6f-8b534b7a0a78 req-ba4bddca-4b03-419c-90cd-7324f049d010 service nova] Lock "14e4ba46-d39d-4163-873a-6957ce64e635-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:34:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-571556e7-9e0d-45c1-8b6f-8b534b7a0a78 req-ba4bddca-4b03-419c-90cd-7324f049d010 service nova] Lock "14e4ba46-d39d-4163-873a-6957ce64e635-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:34:38 user nova-compute[72362]: DEBUG nova.compute.manager [req-571556e7-9e0d-45c1-8b6f-8b534b7a0a78 req-ba4bddca-4b03-419c-90cd-7324f049d010 service nova] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] No waiting events found dispatching network-vif-unplugged-96c248f7-669c-49dd-b2bb-0e8668584239 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:34:38 user nova-compute[72362]: DEBUG nova.compute.manager [req-571556e7-9e0d-45c1-8b6f-8b534b7a0a78 req-ba4bddca-4b03-419c-90cd-7324f049d010 service nova] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Received event network-vif-unplugged-96c248f7-669c-49dd-b2bb-0e8668584239 for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:34:39 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Instance destroyed successfully.
Aug 09 10:34:39 user nova-compute[72362]: DEBUG nova.objects.instance [None req-2942b0c5-cd5a-4101-a2a3-a273550ad21b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lazy-loading 'resources' on Instance uuid 14e4ba46-d39d-4163-873a-6957ce64e635 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:34:39 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-2942b0c5-cd5a-4101-a2a3-a273550ad21b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:32:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1121390700',display_name='tempest-AttachVolumeTestJSON-server-1121390700',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1121390700',id=34,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMiZQd3dVSmASREC4D1H6EW44d+FKdFRNgU6bF/OpKJKtiz2F3bHAClk8luDZaJpv/lIwGiezALNov6NlNhdeBWeXfA2dxHRY7PogRnhQZzW7iJflXqMSSfMoQs3MldtEw==',key_name='tempest-keypair-1881273753',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:32:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9dac04663e2f45378cc0e466740342d2',ramdisk_id='',reservation_id='r-p16xclaa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-986857971',owner_user_name='tempest-AttachVolumeTestJSON-986857971-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:32:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec007d0aa3c144f5a24a4913cc336ebb',uuid=14e4ba46-d39d-4163-873a-6957ce64e635,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96c248f7-669c-49dd-b2bb-0e8668584239", "address": "fa:16:3e:89:4b:4e", "network": {"id": "7358b925-3211-4419-84eb-df6967f5ea8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1360753488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dac04663e2f45378cc0e466740342d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96c248f7-66", "ovs_interfaceid": "96c248f7-669c-49dd-b2bb-0e8668584239", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:34:39 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-2942b0c5-cd5a-4101-a2a3-a273550ad21b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Converting VIF {"id": "96c248f7-669c-49dd-b2bb-0e8668584239", "address": "fa:16:3e:89:4b:4e", "network": {"id": "7358b925-3211-4419-84eb-df6967f5ea8e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1360753488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dac04663e2f45378cc0e466740342d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96c248f7-66", "ovs_interfaceid": "96c248f7-669c-49dd-b2bb-0e8668584239", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:34:39 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-2942b0c5-cd5a-4101-a2a3-a273550ad21b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:4b:4e,bridge_name='br-int',has_traffic_filtering=True,id=96c248f7-669c-49dd-b2bb-0e8668584239,network=Network(7358b925-3211-4419-84eb-df6967f5ea8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96c248f7-66') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:34:39 user nova-compute[72362]: DEBUG os_vif [None req-2942b0c5-cd5a-4101-a2a3-a273550ad21b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:4b:4e,bridge_name='br-int',has_traffic_filtering=True,id=96c248f7-669c-49dd-b2bb-0e8668584239,network=Network(7358b925-3211-4419-84eb-df6967f5ea8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96c248f7-66') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:34:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:34:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96c248f7-66, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:34:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:34:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:34:39 user nova-compute[72362]: INFO os_vif [None req-2942b0c5-cd5a-4101-a2a3-a273550ad21b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:4b:4e,bridge_name='br-int',has_traffic_filtering=True,id=96c248f7-669c-49dd-b2bb-0e8668584239,network=Network(7358b925-3211-4419-84eb-df6967f5ea8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96c248f7-66')
Aug 09 10:34:39 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-2942b0c5-cd5a-4101-a2a3-a273550ad21b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Deleting instance files /opt/stack/data/nova/instances/14e4ba46-d39d-4163-873a-6957ce64e635_del
Aug 09 10:34:39 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-2942b0c5-cd5a-4101-a2a3-a273550ad21b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Deletion of /opt/stack/data/nova/instances/14e4ba46-d39d-4163-873a-6957ce64e635_del complete
Aug 09 10:34:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:34:39 user nova-compute[72362]: INFO nova.compute.manager [None req-2942b0c5-cd5a-4101-a2a3-a273550ad21b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 09 10:34:39 user nova-compute[72362]: DEBUG oslo.service.loopingcall [None req-2942b0c5-cd5a-4101-a2a3-a273550ad21b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72362) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 10:34:39 user nova-compute[72362]: DEBUG nova.compute.manager [-] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Deallocating network for instance {{(pid=72362) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 10:34:39 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] deallocate_for_instance() {{(pid=72362) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 10:34:39 user nova-compute[72362]: INFO nova.compute.manager [None req-a916d7ae-4151-4953-b2bd-954a1fc2411e tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Unrescuing
Aug 09 10:34:39 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a916d7ae-4151-4953-b2bd-954a1fc2411e tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquiring lock "refresh_cache-f3cdf152-da86-447b-aa7c-921b6fa87ef8" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:34:39 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a916d7ae-4151-4953-b2bd-954a1fc2411e tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquired lock "refresh_cache-f3cdf152-da86-447b-aa7c-921b6fa87ef8" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:34:39 user nova-compute[72362]: DEBUG nova.network.neutron [None req-a916d7ae-4151-4953-b2bd-954a1fc2411e tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:34:40 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:34:40 user nova-compute[72362]: DEBUG nova.network.neutron [None req-a916d7ae-4151-4953-b2bd-954a1fc2411e tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Updating instance_info_cache with network_info: [{"id": "cb4bdd64-bb23-4c96-8912-377268174872", "address": "fa:16:3e:78:c7:96", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4bdd64-bb", "ovs_interfaceid": "cb4bdd64-bb23-4c96-8912-377268174872", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:34:40 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Took 1.46 seconds to deallocate network for instance.
Aug 09 10:34:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a916d7ae-4151-4953-b2bd-954a1fc2411e tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Releasing lock "refresh_cache-f3cdf152-da86-447b-aa7c-921b6fa87ef8" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:34:40 user nova-compute[72362]: DEBUG nova.objects.instance [None req-a916d7ae-4151-4953-b2bd-954a1fc2411e tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lazy-loading 'flavor' on Instance uuid f3cdf152-da86-447b-aa7c-921b6fa87ef8 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:34:40 user nova-compute[72362]: DEBUG nova.compute.manager [req-0c13b20c-01d4-4b8a-adf6-b4e7f33f136c req-13eed2d9-a8d9-4061-b334-f72f9d2822bb service nova] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Received event network-vif-deleted-96c248f7-669c-49dd-b2bb-0e8668584239 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:34:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2942b0c5-cd5a-4101-a2a3-a273550ad21b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:34:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2942b0c5-cd5a-4101-a2a3-a273550ad21b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:34:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:34:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:34:40 user nova-compute[72362]: DEBUG nova.compute.manager [req-fe88f351-06ca-45f6-b14d-28f31bd3c03d req-819bfb9b-db73-4c32-9934-79ef6a4b53c8 service nova] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Received event network-vif-plugged-96c248f7-669c-49dd-b2bb-0e8668584239 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:34:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-fe88f351-06ca-45f6-b14d-28f31bd3c03d req-819bfb9b-db73-4c32-9934-79ef6a4b53c8 service nova] Acquiring lock "14e4ba46-d39d-4163-873a-6957ce64e635-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:34:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-fe88f351-06ca-45f6-b14d-28f31bd3c03d req-819bfb9b-db73-4c32-9934-79ef6a4b53c8 service nova] Lock "14e4ba46-d39d-4163-873a-6957ce64e635-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:34:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-fe88f351-06ca-45f6-b14d-28f31bd3c03d req-819bfb9b-db73-4c32-9934-79ef6a4b53c8 service nova] Lock "14e4ba46-d39d-4163-873a-6957ce64e635-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:34:40 user nova-compute[72362]: DEBUG nova.compute.manager [req-fe88f351-06ca-45f6-b14d-28f31bd3c03d req-819bfb9b-db73-4c32-9934-79ef6a4b53c8 service nova] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] No waiting events found dispatching network-vif-plugged-96c248f7-669c-49dd-b2bb-0e8668584239 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:34:40 user nova-compute[72362]: WARNING nova.compute.manager [req-fe88f351-06ca-45f6-b14d-28f31bd3c03d req-819bfb9b-db73-4c32-9934-79ef6a4b53c8 service nova] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Received unexpected event network-vif-plugged-96c248f7-669c-49dd-b2bb-0e8668584239 for instance with vm_state deleted and task_state None.
Aug 09 10:34:40 user nova-compute[72362]: DEBUG nova.compute.manager [req-cd5b4db9-5232-44de-a8d8-326690efc225 req-141b72c4-6c16-4cac-95c3-bc2b047a6c2c service nova] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Received event network-vif-unplugged-cb4bdd64-bb23-4c96-8912-377268174872 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:34:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-cd5b4db9-5232-44de-a8d8-326690efc225 req-141b72c4-6c16-4cac-95c3-bc2b047a6c2c service nova] Acquiring lock "f3cdf152-da86-447b-aa7c-921b6fa87ef8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:34:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-cd5b4db9-5232-44de-a8d8-326690efc225 req-141b72c4-6c16-4cac-95c3-bc2b047a6c2c service nova] Lock "f3cdf152-da86-447b-aa7c-921b6fa87ef8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:34:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-cd5b4db9-5232-44de-a8d8-326690efc225 req-141b72c4-6c16-4cac-95c3-bc2b047a6c2c service nova] Lock "f3cdf152-da86-447b-aa7c-921b6fa87ef8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:34:40 user nova-compute[72362]: DEBUG nova.compute.manager [req-cd5b4db9-5232-44de-a8d8-326690efc225 req-141b72c4-6c16-4cac-95c3-bc2b047a6c2c service nova] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] No waiting events found dispatching network-vif-unplugged-cb4bdd64-bb23-4c96-8912-377268174872 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:34:40 user nova-compute[72362]: WARNING nova.compute.manager [req-cd5b4db9-5232-44de-a8d8-326690efc225 req-141b72c4-6c16-4cac-95c3-bc2b047a6c2c service nova] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Received unexpected event network-vif-unplugged-cb4bdd64-bb23-4c96-8912-377268174872 for instance with vm_state rescued and task_state unrescuing.
Aug 09 10:34:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:34:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:34:41 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-2942b0c5-cd5a-4101-a2a3-a273550ad21b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:34:41 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-2942b0c5-cd5a-4101-a2a3-a273550ad21b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:34:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2942b0c5-cd5a-4101-a2a3-a273550ad21b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.413s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:34:41 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-2942b0c5-cd5a-4101-a2a3-a273550ad21b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Deleted allocations for instance 14e4ba46-d39d-4163-873a-6957ce64e635
Aug 09 10:34:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2942b0c5-cd5a-4101-a2a3-a273550ad21b tempest-AttachVolumeTestJSON-986857971 tempest-AttachVolumeTestJSON-986857971-project-member] Lock "14e4ba46-d39d-4163-873a-6957ce64e635" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.093s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:34:41 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Instance destroyed successfully.
Aug 09 10:34:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:34:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:34:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:34:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:34:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:34:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:34:43 user nova-compute[72362]: DEBUG nova.compute.manager [req-e151fab5-6aaf-42d3-aea3-c494cbc82d5e req-38c0941d-e258-4e19-bbd1-30d8166da011 service nova] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Received event network-vif-plugged-cb4bdd64-bb23-4c96-8912-377268174872 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:34:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e151fab5-6aaf-42d3-aea3-c494cbc82d5e req-38c0941d-e258-4e19-bbd1-30d8166da011 service nova] Acquiring lock "f3cdf152-da86-447b-aa7c-921b6fa87ef8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:34:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e151fab5-6aaf-42d3-aea3-c494cbc82d5e req-38c0941d-e258-4e19-bbd1-30d8166da011 service nova] Lock "f3cdf152-da86-447b-aa7c-921b6fa87ef8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:34:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e151fab5-6aaf-42d3-aea3-c494cbc82d5e req-38c0941d-e258-4e19-bbd1-30d8166da011 service nova] Lock "f3cdf152-da86-447b-aa7c-921b6fa87ef8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:34:43 user nova-compute[72362]: DEBUG nova.compute.manager [req-e151fab5-6aaf-42d3-aea3-c494cbc82d5e req-38c0941d-e258-4e19-bbd1-30d8166da011 service nova] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] No waiting events found dispatching network-vif-plugged-cb4bdd64-bb23-4c96-8912-377268174872 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:34:43 user nova-compute[72362]: WARNING nova.compute.manager [req-e151fab5-6aaf-42d3-aea3-c494cbc82d5e req-38c0941d-e258-4e19-bbd1-30d8166da011 service nova] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Received unexpected event network-vif-plugged-cb4bdd64-bb23-4c96-8912-377268174872 for instance with vm_state rescued and task_state unrescuing.
Aug 09 10:34:43 user nova-compute[72362]: DEBUG nova.compute.manager [req-e151fab5-6aaf-42d3-aea3-c494cbc82d5e req-38c0941d-e258-4e19-bbd1-30d8166da011 service nova] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Received event network-vif-plugged-cb4bdd64-bb23-4c96-8912-377268174872 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:34:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e151fab5-6aaf-42d3-aea3-c494cbc82d5e req-38c0941d-e258-4e19-bbd1-30d8166da011 service nova] Acquiring lock "f3cdf152-da86-447b-aa7c-921b6fa87ef8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:34:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e151fab5-6aaf-42d3-aea3-c494cbc82d5e req-38c0941d-e258-4e19-bbd1-30d8166da011 service nova] Lock "f3cdf152-da86-447b-aa7c-921b6fa87ef8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:34:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e151fab5-6aaf-42d3-aea3-c494cbc82d5e req-38c0941d-e258-4e19-bbd1-30d8166da011 service nova] Lock "f3cdf152-da86-447b-aa7c-921b6fa87ef8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:34:43 user nova-compute[72362]: DEBUG nova.compute.manager [req-e151fab5-6aaf-42d3-aea3-c494cbc82d5e req-38c0941d-e258-4e19-bbd1-30d8166da011 service nova] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] No waiting events found dispatching network-vif-plugged-cb4bdd64-bb23-4c96-8912-377268174872 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:34:43 user nova-compute[72362]: WARNING nova.compute.manager [req-e151fab5-6aaf-42d3-aea3-c494cbc82d5e req-38c0941d-e258-4e19-bbd1-30d8166da011 service nova] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Received unexpected event network-vif-plugged-cb4bdd64-bb23-4c96-8912-377268174872 for instance with vm_state rescued and task_state unrescuing.
Aug 09 10:34:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:34:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Removed pending event for f3cdf152-da86-447b-aa7c-921b6fa87ef8 due to event {{(pid=72362) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 10:34:44 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577284.7169468, f3cdf152-da86-447b-aa7c-921b6fa87ef8 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:34:44 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] VM Resumed (Lifecycle Event)
Aug 09 10:34:44 user nova-compute[72362]: DEBUG nova.compute.manager [None req-a916d7ae-4151-4953-b2bd-954a1fc2411e tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:34:44 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:34:44 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:34:44 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 09 10:34:44 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577284.7193806, f3cdf152-da86-447b-aa7c-921b6fa87ef8 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:34:44 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] VM Started (Lifecycle Event)
Aug 09 10:34:44 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:34:44 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:34:45 user nova-compute[72362]: DEBUG nova.compute.manager [req-11ce7578-f9b1-4192-a62a-7468c99fc527 req-66ec2dac-6be2-4af3-be22-a8d5df108caf service nova] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Received event network-vif-plugged-cb4bdd64-bb23-4c96-8912-377268174872 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:34:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-11ce7578-f9b1-4192-a62a-7468c99fc527 req-66ec2dac-6be2-4af3-be22-a8d5df108caf service nova] Acquiring lock "f3cdf152-da86-447b-aa7c-921b6fa87ef8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:34:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-11ce7578-f9b1-4192-a62a-7468c99fc527 req-66ec2dac-6be2-4af3-be22-a8d5df108caf service nova] Lock "f3cdf152-da86-447b-aa7c-921b6fa87ef8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:34:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-11ce7578-f9b1-4192-a62a-7468c99fc527 req-66ec2dac-6be2-4af3-be22-a8d5df108caf service nova] Lock "f3cdf152-da86-447b-aa7c-921b6fa87ef8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:34:45 user nova-compute[72362]: DEBUG nova.compute.manager [req-11ce7578-f9b1-4192-a62a-7468c99fc527 req-66ec2dac-6be2-4af3-be22-a8d5df108caf service nova] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] No waiting events found dispatching network-vif-plugged-cb4bdd64-bb23-4c96-8912-377268174872 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:34:45 user nova-compute[72362]: WARNING nova.compute.manager [req-11ce7578-f9b1-4192-a62a-7468c99fc527 req-66ec2dac-6be2-4af3-be22-a8d5df108caf service nova] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Received unexpected event network-vif-plugged-cb4bdd64-bb23-4c96-8912-377268174872 for instance with vm_state active and task_state None.
Aug 09 10:34:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:34:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:34:54 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691577279.0244143, 14e4ba46-d39d-4163-873a-6957ce64e635 => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:34:54 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] VM Stopped (Lifecycle Event)
Aug 09 10:34:54 user nova-compute[72362]: DEBUG nova.compute.manager [None req-63954f4f-7759-4154-b90c-f0e571e05244 None None] [instance: 14e4ba46-d39d-4163-873a-6957ce64e635] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:34:54 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:34:58 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:34:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-46e64934-e396-4634-a4a9-0a949eece1d8 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "5907c2ff-9ac0-4104-b80b-499e200728f1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:34:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-46e64934-e396-4634-a4a9-0a949eece1d8 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "5907c2ff-9ac0-4104-b80b-499e200728f1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:34:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-46e64934-e396-4634-a4a9-0a949eece1d8 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "5907c2ff-9ac0-4104-b80b-499e200728f1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:34:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-46e64934-e396-4634-a4a9-0a949eece1d8 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "5907c2ff-9ac0-4104-b80b-499e200728f1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:34:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-46e64934-e396-4634-a4a9-0a949eece1d8 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "5907c2ff-9ac0-4104-b80b-499e200728f1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:34:58 user nova-compute[72362]: INFO nova.compute.manager [None req-46e64934-e396-4634-a4a9-0a949eece1d8 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Terminating instance
Aug 09 10:34:58 user nova-compute[72362]: DEBUG nova.compute.manager [None req-46e64934-e396-4634-a4a9-0a949eece1d8 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Start destroying the instance on the hypervisor. {{(pid=72362) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 10:34:58 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:34:58 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:34:58 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:34:58 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG nova.compute.manager [req-b0720389-739f-47ab-b029-100c24590d18 req-a1c50ef1-ef44-4111-ac52-005951d05b9c service nova] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Received event network-vif-unplugged-8c5d102b-ab09-48b6-af7a-924afe72db9e {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b0720389-739f-47ab-b029-100c24590d18 req-a1c50ef1-ef44-4111-ac52-005951d05b9c service nova] Acquiring lock "5907c2ff-9ac0-4104-b80b-499e200728f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b0720389-739f-47ab-b029-100c24590d18 req-a1c50ef1-ef44-4111-ac52-005951d05b9c service nova] Lock "5907c2ff-9ac0-4104-b80b-499e200728f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b0720389-739f-47ab-b029-100c24590d18 req-a1c50ef1-ef44-4111-ac52-005951d05b9c service nova] Lock "5907c2ff-9ac0-4104-b80b-499e200728f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG nova.compute.manager [req-b0720389-739f-47ab-b029-100c24590d18 req-a1c50ef1-ef44-4111-ac52-005951d05b9c service nova] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] No waiting events found dispatching network-vif-unplugged-8c5d102b-ab09-48b6-af7a-924afe72db9e {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG nova.compute.manager [req-b0720389-739f-47ab-b029-100c24590d18 req-a1c50ef1-ef44-4111-ac52-005951d05b9c service nova] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Received event network-vif-unplugged-8c5d102b-ab09-48b6-af7a-924afe72db9e for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:34:59 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Instance destroyed successfully.
Aug 09 10:34:59 user nova-compute[72362]: DEBUG nova.objects.instance [None req-46e64934-e396-4634-a4a9-0a949eece1d8 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lazy-loading 'resources' on Instance uuid 5907c2ff-9ac0-4104-b80b-499e200728f1 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-46e64934-e396-4634-a4a9-0a949eece1d8 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:33:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-589296118',display_name='tempest-TestVolumeBootPattern-server-589296118',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-589296118',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:33:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='26e38599de0b4b06b723f5647a7fe121',ramdisk_id='',reservation_id='r-02v00c29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1478436240',owner_user_name='tempest-TestVolumeBootPattern-1478436240-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:33:29Z,user_data=None,user_id='e96900e953f64d02bdb5d48f136133c3',uuid=5907c2ff-9ac0-4104-b80b-499e200728f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c5d102b-ab09-48b6-af7a-924afe72db9e", "address": "fa:16:3e:de:fb:96", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c5d102b-ab", "ovs_interfaceid": "8c5d102b-ab09-48b6-af7a-924afe72db9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-46e64934-e396-4634-a4a9-0a949eece1d8 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Converting VIF {"id": "8c5d102b-ab09-48b6-af7a-924afe72db9e", "address": "fa:16:3e:de:fb:96", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c5d102b-ab", "ovs_interfaceid": "8c5d102b-ab09-48b6-af7a-924afe72db9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-46e64934-e396-4634-a4a9-0a949eece1d8 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:fb:96,bridge_name='br-int',has_traffic_filtering=True,id=8c5d102b-ab09-48b6-af7a-924afe72db9e,network=Network(b4a9e050-41f1-404a-bf5c-41421f034644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c5d102b-ab') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG os_vif [None req-46e64934-e396-4634-a4a9-0a949eece1d8 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:fb:96,bridge_name='br-int',has_traffic_filtering=True,id=8c5d102b-ab09-48b6-af7a-924afe72db9e,network=Network(b4a9e050-41f1-404a-bf5c-41421f034644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c5d102b-ab') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c5d102b-ab, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:34:59 user nova-compute[72362]: INFO os_vif [None req-46e64934-e396-4634-a4a9-0a949eece1d8 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:fb:96,bridge_name='br-int',has_traffic_filtering=True,id=8c5d102b-ab09-48b6-af7a-924afe72db9e,network=Network(b4a9e050-41f1-404a-bf5c-41421f034644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c5d102b-ab')
Aug 09 10:34:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46e64934-e396-4634-a4a9-0a949eece1d8 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e64934-e396-4634-a4a9-0a949eece1d8 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AChHcUYT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:34:59 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-46e64934-e396-4634-a4a9-0a949eece1d8 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:34:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-46e64934-e396-4634-a4a9-0a949eece1d8 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-46e64934-e396-4634-a4a9-0a949eece1d8 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e64934-e396-4634-a4a9-0a949eece1d8 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7562b93-3f9e-404a-83ea-d2f76448f31d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9aaf149-17b0-4be2-877e-687b873b9f0d]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e64934-e396-4634-a4a9-0a949eece1d8 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:34:59 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:34:59 user nova-compute[72362]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:34:59 user nova-compute[72362]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 (non-flash)
Aug 09 10:34:59 user nova-compute[72362]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 (non-flash)
Aug 09 10:34:59 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e64934-e396-4634-a4a9-0a949eece1d8 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:34:59 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:34:59 user nova-compute[72362]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:34:59 user nova-compute[72362]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 (non-flash)
Aug 09 10:34:59 user nova-compute[72362]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 (non-flash)
Aug 09 10:34:59 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e64934-e396-4634-a4a9-0a949eece1d8 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e41bce50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216'): ({'sde'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-46e64934-e396-4634-a4a9-0a949eece1d8 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Removing single pathed devices sde {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[46901cd2-8d79-4af6-b182-347da73b8ad2]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65d6048-90a4-4e26-aff5-003c6ab51fa3]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-46e64934-e396-4634-a4a9-0a949eece1d8 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Flushing IO for device /dev/sde {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b210d1e5-1283-46a4-9bcb-4b144313fe38]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-46e64934-e396-4634-a4a9-0a949eece1d8 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[64849eb9-9e89-4931-961c-b1a6573ff540]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-46e64934-e396-4634-a4a9-0a949eece1d8 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-46e64934-e396-4634-a4a9-0a949eece1d8 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] SCSI volumes sde have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26435643065323432', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_5d35ff8f', '/dev/disk/by-id/scsi-1SCST_BIO5d35ff8f-d5d0e242d95c33ad') {{(pid=84003) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[16512593-20b9-49d6-97e9-05c6d3c9454c]: (4, None) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e64934-e396-4634-a4a9-0a949eece1d8 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[173a04d8-c963-4775-a1ef-4b174d2676be]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e64934-e396-4634-a4a9-0a949eece1d8 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[03eddd68-ffe7-40af-823c-5844b5ccc824]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e64934-e396-4634-a4a9-0a949eece1d8 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216, portal: 172.16.0.220,3260]
Aug 09 10:34:59 user nova-compute[72362]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216, portal: 172.16.0.220,3260] successful.
Aug 09 10:34:59 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b7e90a1-be13-48cd-9b15-b8bb87253216 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb1da77-92ee-42f5-b279-a8ee1ec92642]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e64934-e396-4634-a4a9-0a949eece1d8 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-46e64934-e396-4634-a4a9-0a949eece1d8 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e64934-e396-4634-a4a9-0a949eece1d8 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] <== disconnect_volume: return (331ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46e64934-e396-4634-a4a9-0a949eece1d8 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:34:59 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-46e64934-e396-4634-a4a9-0a949eece1d8 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Deleting instance files /opt/stack/data/nova/instances/5907c2ff-9ac0-4104-b80b-499e200728f1_del
Aug 09 10:34:59 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-46e64934-e396-4634-a4a9-0a949eece1d8 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Deletion of /opt/stack/data/nova/instances/5907c2ff-9ac0-4104-b80b-499e200728f1_del complete
Aug 09 10:34:59 user nova-compute[72362]: INFO nova.compute.manager [None req-46e64934-e396-4634-a4a9-0a949eece1d8 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Took 1.25 seconds to destroy the instance on the hypervisor.
Aug 09 10:34:59 user nova-compute[72362]: DEBUG oslo.service.loopingcall [None req-46e64934-e396-4634-a4a9-0a949eece1d8 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72362) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG nova.compute.manager [-] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Deallocating network for instance {{(pid=72362) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 10:34:59 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] deallocate_for_instance() {{(pid=72362) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 10:35:00 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:35:00 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Took 0.66 seconds to deallocate network for instance.
Aug 09 10:35:01 user nova-compute[72362]: INFO nova.compute.manager [None req-46e64934-e396-4634-a4a9-0a949eece1d8 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Took 0.75 seconds to detach 1 volumes for instance.
Aug 09 10:35:01 user nova-compute[72362]: DEBUG nova.compute.manager [None req-46e64934-e396-4634-a4a9-0a949eece1d8 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Deleting volume: 5b7e90a1-be13-48cd-9b15-b8bb87253216 {{(pid=72362) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 09 10:35:01 user nova-compute[72362]: DEBUG nova.compute.manager [req-3dae320b-a9e1-4d4a-8c4a-00e452e2160c req-dc8e19e1-1afd-4aa5-be76-5ccd8e6eb136 service nova] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Received event network-vif-plugged-8c5d102b-ab09-48b6-af7a-924afe72db9e {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:35:01 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3dae320b-a9e1-4d4a-8c4a-00e452e2160c req-dc8e19e1-1afd-4aa5-be76-5ccd8e6eb136 service nova] Acquiring lock "5907c2ff-9ac0-4104-b80b-499e200728f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:35:01 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3dae320b-a9e1-4d4a-8c4a-00e452e2160c req-dc8e19e1-1afd-4aa5-be76-5ccd8e6eb136 service nova] Lock "5907c2ff-9ac0-4104-b80b-499e200728f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:35:01 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3dae320b-a9e1-4d4a-8c4a-00e452e2160c req-dc8e19e1-1afd-4aa5-be76-5ccd8e6eb136 service nova] Lock "5907c2ff-9ac0-4104-b80b-499e200728f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:35:01 user nova-compute[72362]: DEBUG nova.compute.manager [req-3dae320b-a9e1-4d4a-8c4a-00e452e2160c req-dc8e19e1-1afd-4aa5-be76-5ccd8e6eb136 service nova] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] No waiting events found dispatching network-vif-plugged-8c5d102b-ab09-48b6-af7a-924afe72db9e {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:35:01 user nova-compute[72362]: WARNING nova.compute.manager [req-3dae320b-a9e1-4d4a-8c4a-00e452e2160c req-dc8e19e1-1afd-4aa5-be76-5ccd8e6eb136 service nova] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Received unexpected event network-vif-plugged-8c5d102b-ab09-48b6-af7a-924afe72db9e for instance with vm_state active and task_state deleting.
Aug 09 10:35:01 user nova-compute[72362]: DEBUG nova.compute.manager [req-3dae320b-a9e1-4d4a-8c4a-00e452e2160c req-dc8e19e1-1afd-4aa5-be76-5ccd8e6eb136 service nova] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Received event network-vif-deleted-8c5d102b-ab09-48b6-af7a-924afe72db9e {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:35:01 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-46e64934-e396-4634-a4a9-0a949eece1d8 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:35:01 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-46e64934-e396-4634-a4a9-0a949eece1d8 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:35:01 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-46e64934-e396-4634-a4a9-0a949eece1d8 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:35:01 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-46e64934-e396-4634-a4a9-0a949eece1d8 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:35:01 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-46e64934-e396-4634-a4a9-0a949eece1d8 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.319s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:35:01 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-46e64934-e396-4634-a4a9-0a949eece1d8 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Deleted allocations for instance 5907c2ff-9ac0-4104-b80b-499e200728f1
Aug 09 10:35:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:35:01 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-46e64934-e396-4634-a4a9-0a949eece1d8 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "5907c2ff-9ac0-4104-b80b-499e200728f1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.245s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:35:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:35:03 user nova-compute[72362]: INFO nova.compute.manager [None req-dbb755bd-69eb-4802-b0ee-fe6ebf1c2427 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Unrescuing
Aug 09 10:35:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-dbb755bd-69eb-4802-b0ee-fe6ebf1c2427 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Acquiring lock "refresh_cache-fe1804e8-2340-4868-a0ff-32d5df5fad42" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:35:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-dbb755bd-69eb-4802-b0ee-fe6ebf1c2427 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Acquired lock "refresh_cache-fe1804e8-2340-4868-a0ff-32d5df5fad42" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:35:03 user nova-compute[72362]: DEBUG nova.network.neutron [None req-dbb755bd-69eb-4802-b0ee-fe6ebf1c2427 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:35:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:35:04 user nova-compute[72362]: DEBUG nova.network.neutron [None req-dbb755bd-69eb-4802-b0ee-fe6ebf1c2427 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Updating instance_info_cache with network_info: [{"id": "3205c4d7-d431-4127-b2a5-436df06f6c4b", "address": "fa:16:3e:44:ae:dc", "network": {"id": "322734db-2e92-4833-85a8-dc059a13b535", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-753064842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7fd45a7ce194cd4bc477f03bdebfe9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3205c4d7-d4", "ovs_interfaceid": "3205c4d7-d431-4127-b2a5-436df06f6c4b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:35:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-dbb755bd-69eb-4802-b0ee-fe6ebf1c2427 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Releasing lock "refresh_cache-fe1804e8-2340-4868-a0ff-32d5df5fad42" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:35:04 user nova-compute[72362]: DEBUG nova.objects.instance [None req-dbb755bd-69eb-4802-b0ee-fe6ebf1c2427 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Lazy-loading 'flavor' on Instance uuid fe1804e8-2340-4868-a0ff-32d5df5fad42 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:35:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:35:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:35:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:35:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:35:04 user nova-compute[72362]: DEBUG nova.compute.manager [req-32df389a-1c4c-4056-a746-8bcde336f2aa req-6902a6e0-2e68-4197-8f82-243834e1e076 service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Received event network-changed-3205c4d7-d431-4127-b2a5-436df06f6c4b {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:35:04 user nova-compute[72362]: DEBUG nova.compute.manager [req-32df389a-1c4c-4056-a746-8bcde336f2aa req-6902a6e0-2e68-4197-8f82-243834e1e076 service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Refreshing instance network info cache due to event network-changed-3205c4d7-d431-4127-b2a5-436df06f6c4b. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:35:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-32df389a-1c4c-4056-a746-8bcde336f2aa req-6902a6e0-2e68-4197-8f82-243834e1e076 service nova] Acquiring lock "refresh_cache-fe1804e8-2340-4868-a0ff-32d5df5fad42" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:35:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-32df389a-1c4c-4056-a746-8bcde336f2aa req-6902a6e0-2e68-4197-8f82-243834e1e076 service nova] Acquired lock "refresh_cache-fe1804e8-2340-4868-a0ff-32d5df5fad42" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:35:04 user nova-compute[72362]: DEBUG nova.network.neutron [req-32df389a-1c4c-4056-a746-8bcde336f2aa req-6902a6e0-2e68-4197-8f82-243834e1e076 service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Refreshing network info cache for port 3205c4d7-d431-4127-b2a5-436df06f6c4b {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:35:04 user nova-compute[72362]: DEBUG nova.compute.manager [req-aa265cb3-cbc4-4563-af2c-6b0b8cb8d676 req-688f8830-6d87-48c1-b8ef-c81c7672b8a6 service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Received event network-vif-unplugged-3205c4d7-d431-4127-b2a5-436df06f6c4b {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:35:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-aa265cb3-cbc4-4563-af2c-6b0b8cb8d676 req-688f8830-6d87-48c1-b8ef-c81c7672b8a6 service nova] Acquiring lock "fe1804e8-2340-4868-a0ff-32d5df5fad42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:35:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-aa265cb3-cbc4-4563-af2c-6b0b8cb8d676 req-688f8830-6d87-48c1-b8ef-c81c7672b8a6 service nova] Lock "fe1804e8-2340-4868-a0ff-32d5df5fad42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:35:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-aa265cb3-cbc4-4563-af2c-6b0b8cb8d676 req-688f8830-6d87-48c1-b8ef-c81c7672b8a6 service nova] Lock "fe1804e8-2340-4868-a0ff-32d5df5fad42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:35:04 user nova-compute[72362]: DEBUG nova.compute.manager [req-aa265cb3-cbc4-4563-af2c-6b0b8cb8d676 req-688f8830-6d87-48c1-b8ef-c81c7672b8a6 service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] No waiting events found dispatching network-vif-unplugged-3205c4d7-d431-4127-b2a5-436df06f6c4b {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:35:04 user nova-compute[72362]: WARNING nova.compute.manager [req-aa265cb3-cbc4-4563-af2c-6b0b8cb8d676 req-688f8830-6d87-48c1-b8ef-c81c7672b8a6 service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Received unexpected event network-vif-unplugged-3205c4d7-d431-4127-b2a5-436df06f6c4b for instance with vm_state rescued and task_state unrescuing.
Aug 09 10:35:05 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:35:05 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:35:05 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:35:05 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 10:35:05 user nova-compute[72362]: DEBUG nova.network.neutron [req-32df389a-1c4c-4056-a746-8bcde336f2aa req-6902a6e0-2e68-4197-8f82-243834e1e076 service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Updated VIF entry in instance network info cache for port 3205c4d7-d431-4127-b2a5-436df06f6c4b. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:35:05 user nova-compute[72362]: DEBUG nova.network.neutron [req-32df389a-1c4c-4056-a746-8bcde336f2aa req-6902a6e0-2e68-4197-8f82-243834e1e076 service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Updating instance_info_cache with network_info: [{"id": "3205c4d7-d431-4127-b2a5-436df06f6c4b", "address": "fa:16:3e:44:ae:dc", "network": {"id": "322734db-2e92-4833-85a8-dc059a13b535", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-753064842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7fd45a7ce194cd4bc477f03bdebfe9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3205c4d7-d4", "ovs_interfaceid": "3205c4d7-d431-4127-b2a5-436df06f6c4b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:35:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-32df389a-1c4c-4056-a746-8bcde336f2aa req-6902a6e0-2e68-4197-8f82-243834e1e076 service nova] Releasing lock "refresh_cache-fe1804e8-2340-4868-a0ff-32d5df5fad42" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:35:05 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Instance destroyed successfully.
Aug 09 10:35:05 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:35:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:35:06 user nova-compute[72362]: DEBUG nova.compute.manager [req-b31d8582-a25d-422a-b0cf-fa9a6deb5ec9 req-d55063ef-a13b-4802-bfd9-466194039328 service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Received event network-changed-3205c4d7-d431-4127-b2a5-436df06f6c4b {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:35:06 user nova-compute[72362]: DEBUG nova.compute.manager [req-b31d8582-a25d-422a-b0cf-fa9a6deb5ec9 req-d55063ef-a13b-4802-bfd9-466194039328 service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Refreshing instance network info cache due to event network-changed-3205c4d7-d431-4127-b2a5-436df06f6c4b. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:35:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b31d8582-a25d-422a-b0cf-fa9a6deb5ec9 req-d55063ef-a13b-4802-bfd9-466194039328 service nova] Acquiring lock "refresh_cache-fe1804e8-2340-4868-a0ff-32d5df5fad42" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:35:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b31d8582-a25d-422a-b0cf-fa9a6deb5ec9 req-d55063ef-a13b-4802-bfd9-466194039328 service nova] Acquired lock "refresh_cache-fe1804e8-2340-4868-a0ff-32d5df5fad42" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:35:06 user nova-compute[72362]: DEBUG nova.network.neutron [req-b31d8582-a25d-422a-b0cf-fa9a6deb5ec9 req-d55063ef-a13b-4802-bfd9-466194039328 service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Refreshing network info cache for port 3205c4d7-d431-4127-b2a5-436df06f6c4b {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:35:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:35:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:35:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:35:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:35:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:35:07 user nova-compute[72362]: DEBUG nova.compute.manager [req-02c0b867-d1e5-4379-adcf-58ef1f3d473a req-0c8884bc-afd1-488b-aa77-49c920e5a165 service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Received event network-vif-plugged-3205c4d7-d431-4127-b2a5-436df06f6c4b {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:35:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-02c0b867-d1e5-4379-adcf-58ef1f3d473a req-0c8884bc-afd1-488b-aa77-49c920e5a165 service nova] Acquiring lock "fe1804e8-2340-4868-a0ff-32d5df5fad42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:35:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-02c0b867-d1e5-4379-adcf-58ef1f3d473a req-0c8884bc-afd1-488b-aa77-49c920e5a165 service nova] Lock "fe1804e8-2340-4868-a0ff-32d5df5fad42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:35:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-02c0b867-d1e5-4379-adcf-58ef1f3d473a req-0c8884bc-afd1-488b-aa77-49c920e5a165 service nova] Lock "fe1804e8-2340-4868-a0ff-32d5df5fad42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:35:07 user nova-compute[72362]: DEBUG nova.compute.manager [req-02c0b867-d1e5-4379-adcf-58ef1f3d473a req-0c8884bc-afd1-488b-aa77-49c920e5a165 service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] No waiting events found dispatching network-vif-plugged-3205c4d7-d431-4127-b2a5-436df06f6c4b {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:35:07 user nova-compute[72362]: WARNING nova.compute.manager [req-02c0b867-d1e5-4379-adcf-58ef1f3d473a req-0c8884bc-afd1-488b-aa77-49c920e5a165 service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Received unexpected event network-vif-plugged-3205c4d7-d431-4127-b2a5-436df06f6c4b for instance with vm_state rescued and task_state unrescuing.
Aug 09 10:35:07 user nova-compute[72362]: DEBUG nova.network.neutron [req-b31d8582-a25d-422a-b0cf-fa9a6deb5ec9 req-d55063ef-a13b-4802-bfd9-466194039328 service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Updated VIF entry in instance network info cache for port 3205c4d7-d431-4127-b2a5-436df06f6c4b. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:35:07 user nova-compute[72362]: DEBUG nova.network.neutron [req-b31d8582-a25d-422a-b0cf-fa9a6deb5ec9 req-d55063ef-a13b-4802-bfd9-466194039328 service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Updating instance_info_cache with network_info: [{"id": "3205c4d7-d431-4127-b2a5-436df06f6c4b", "address": "fa:16:3e:44:ae:dc", "network": {"id": "322734db-2e92-4833-85a8-dc059a13b535", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-753064842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7fd45a7ce194cd4bc477f03bdebfe9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3205c4d7-d4", "ovs_interfaceid": "3205c4d7-d431-4127-b2a5-436df06f6c4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:35:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b31d8582-a25d-422a-b0cf-fa9a6deb5ec9 req-d55063ef-a13b-4802-bfd9-466194039328 service nova] Releasing lock "refresh_cache-fe1804e8-2340-4868-a0ff-32d5df5fad42" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:35:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:35:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:35:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:35:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:35:07 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:35:07 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 10:35:08 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "refresh_cache-3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:35:08 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquired lock "refresh_cache-3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:35:08 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Forcefully refreshing network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 10:35:08 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Updating instance_info_cache with network_info: [{"id": "9735e8ce-a2bd-49c8-adcf-846c05b7427e", "address": "fa:16:3e:91:34:e3", "network": {"id": "e6c54663-74e3-43e2-8f0d-61b300c1f68d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1222286883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ac22022944542c0b52dd912d3dbcce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9735e8ce-a2", "ovs_interfaceid": "9735e8ce-a2bd-49c8-adcf-846c05b7427e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:35:08 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Releasing lock "refresh_cache-3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:35:08 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Updated the network info_cache for instance {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 10:35:08 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:35:08 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:35:09 user nova-compute[72362]: DEBUG nova.compute.manager [req-4f1c5635-f905-4049-b119-1ef5fe8d17c0 req-db9c327c-3457-4cba-9236-990e1633272f service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Received event network-vif-plugged-3205c4d7-d431-4127-b2a5-436df06f6c4b {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:35:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-4f1c5635-f905-4049-b119-1ef5fe8d17c0 req-db9c327c-3457-4cba-9236-990e1633272f service nova] Acquiring lock "fe1804e8-2340-4868-a0ff-32d5df5fad42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:35:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-4f1c5635-f905-4049-b119-1ef5fe8d17c0 req-db9c327c-3457-4cba-9236-990e1633272f service nova] Lock "fe1804e8-2340-4868-a0ff-32d5df5fad42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:35:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-4f1c5635-f905-4049-b119-1ef5fe8d17c0 req-db9c327c-3457-4cba-9236-990e1633272f service nova] Lock "fe1804e8-2340-4868-a0ff-32d5df5fad42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:35:09 user nova-compute[72362]: DEBUG nova.compute.manager [req-4f1c5635-f905-4049-b119-1ef5fe8d17c0 req-db9c327c-3457-4cba-9236-990e1633272f service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] No waiting events found dispatching network-vif-plugged-3205c4d7-d431-4127-b2a5-436df06f6c4b {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:35:09 user nova-compute[72362]: WARNING nova.compute.manager [req-4f1c5635-f905-4049-b119-1ef5fe8d17c0 req-db9c327c-3457-4cba-9236-990e1633272f service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Received unexpected event network-vif-plugged-3205c4d7-d431-4127-b2a5-436df06f6c4b for instance with vm_state rescued and task_state unrescuing.
Aug 09 10:35:09 user nova-compute[72362]: DEBUG nova.compute.manager [req-4f1c5635-f905-4049-b119-1ef5fe8d17c0 req-db9c327c-3457-4cba-9236-990e1633272f service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Received event network-vif-plugged-3205c4d7-d431-4127-b2a5-436df06f6c4b {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:35:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-4f1c5635-f905-4049-b119-1ef5fe8d17c0 req-db9c327c-3457-4cba-9236-990e1633272f service nova] Acquiring lock "fe1804e8-2340-4868-a0ff-32d5df5fad42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:35:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-4f1c5635-f905-4049-b119-1ef5fe8d17c0 req-db9c327c-3457-4cba-9236-990e1633272f service nova] Lock "fe1804e8-2340-4868-a0ff-32d5df5fad42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:35:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-4f1c5635-f905-4049-b119-1ef5fe8d17c0 req-db9c327c-3457-4cba-9236-990e1633272f service nova] Lock "fe1804e8-2340-4868-a0ff-32d5df5fad42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:35:09 user nova-compute[72362]: DEBUG nova.compute.manager [req-4f1c5635-f905-4049-b119-1ef5fe8d17c0 req-db9c327c-3457-4cba-9236-990e1633272f service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] No waiting events found dispatching network-vif-plugged-3205c4d7-d431-4127-b2a5-436df06f6c4b {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:35:09 user nova-compute[72362]: WARNING nova.compute.manager [req-4f1c5635-f905-4049-b119-1ef5fe8d17c0 req-db9c327c-3457-4cba-9236-990e1633272f service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Received unexpected event network-vif-plugged-3205c4d7-d431-4127-b2a5-436df06f6c4b for instance with vm_state rescued and task_state unrescuing.
Aug 09 10:35:09 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Removed pending event for fe1804e8-2340-4868-a0ff-32d5df5fad42 due to event {{(pid=72362) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 10:35:09 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577309.2726927, fe1804e8-2340-4868-a0ff-32d5df5fad42 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:35:09 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] VM Resumed (Lifecycle Event)
Aug 09 10:35:09 user nova-compute[72362]: DEBUG nova.compute.manager [None req-dbb755bd-69eb-4802-b0ee-fe6ebf1c2427 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:35:09 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:35:09 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:35:09 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 09 10:35:09 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577309.276104, fe1804e8-2340-4868-a0ff-32d5df5fad42 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:35:09 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] VM Started (Lifecycle Event)
Aug 09 10:35:09 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:35:09 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:35:09 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:35:09 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:35:11 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:35:12 user nova-compute[72362]: INFO nova.compute.manager [None req-4722a292-dd16-4a10-971e-ff694acb1852 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Get console output
Aug 09 10:35:12 user nova-compute[72362]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 09 10:35:14 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691577299.4982011, 5907c2ff-9ac0-4104-b80b-499e200728f1 => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:35:14 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] VM Stopped (Lifecycle Event)
Aug 09 10:35:14 user nova-compute[72362]: DEBUG nova.compute.manager [None req-84f9a899-be86-48ff-bbe4-3b5b60e8bbb1 None None] [instance: 5907c2ff-9ac0-4104-b80b-499e200728f1] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:35:14 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:35:15 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:35:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:35:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:35:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:35:16 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 10:35:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:35:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:35:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:35:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:35:16 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:35:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:35:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:35:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:35:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:35:16 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:35:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:35:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:35:16 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:35:16 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:35:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:35:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:35:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:35:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:35:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:35:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:35:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:35:17 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:35:17 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:35:17 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=7970MB free_disk=24.888248443603516GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 10:35:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:35:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:35:17 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 8e055c58-a365-4f18-a6e3-377e32e2189d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:35:17 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:35:17 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 30213e67-6b1d-4d97-a971-1544335d02fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:35:17 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance f8abc99c-b87b-4586-b9d4-7f5bcda60683 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:35:17 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance fe1804e8-2340-4868-a0ff-32d5df5fad42 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:35:17 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance f3cdf152-da86-447b-aa7c-921b6fa87ef8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:35:17 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 4b22a19f-300c-42fb-8175-e737eef7d531 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:35:17 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 10:35:17 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 10:35:18 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:35:18 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:35:18 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 10:35:18 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.384s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:35:19 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:35:21 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:35:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:35:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:35:29 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:35:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:35:34 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:35:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5cff087f-fe27-43b5-8874-d86dd0417fd7 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Acquiring lock "fe1804e8-2340-4868-a0ff-32d5df5fad42" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:35:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5cff087f-fe27-43b5-8874-d86dd0417fd7 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Lock "fe1804e8-2340-4868-a0ff-32d5df5fad42" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:35:36 user nova-compute[72362]: INFO nova.compute.manager [None req-5cff087f-fe27-43b5-8874-d86dd0417fd7 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Detaching volume 625fa618-b4a1-44bd-9c6f-d825d64285e6
Aug 09 10:35:36 user nova-compute[72362]: INFO nova.virt.block_device [None req-5cff087f-fe27-43b5-8874-d86dd0417fd7 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Attempting to driver detach volume 625fa618-b4a1-44bd-9c6f-d825d64285e6 from mountpoint /dev/vdb
Aug 09 10:35:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:35:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-5cff087f-fe27-43b5-8874-d86dd0417fd7 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Attempting to detach device vdb from instance fe1804e8-2340-4868-a0ff-32d5df5fad42 from the persistent domain config. {{(pid=72362) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 10:35:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-5cff087f-fe27-43b5-8874-d86dd0417fd7 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 10:35:36 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:35:36 user nova-compute[72362]:   <source dev="/dev/sdd"/>
Aug 09 10:35:36 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:35:36 user nova-compute[72362]:   <serial>625fa618-b4a1-44bd-9c6f-d825d64285e6</serial>
Aug 09 10:35:36 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 10:35:36 user nova-compute[72362]: </disk>
Aug 09 10:35:36 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:35:36 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-5cff087f-fe27-43b5-8874-d86dd0417fd7 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Successfully detached device vdb from instance fe1804e8-2340-4868-a0ff-32d5df5fad42 from the persistent domain config.
Aug 09 10:35:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-5cff087f-fe27-43b5-8874-d86dd0417fd7 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fe1804e8-2340-4868-a0ff-32d5df5fad42 from the live domain config. {{(pid=72362) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 10:35:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-5cff087f-fe27-43b5-8874-d86dd0417fd7 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 10:35:36 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:35:36 user nova-compute[72362]:   <source dev="/dev/sdd"/>
Aug 09 10:35:36 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:35:36 user nova-compute[72362]:   <serial>625fa618-b4a1-44bd-9c6f-d825d64285e6</serial>
Aug 09 10:35:36 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 10:35:36 user nova-compute[72362]: </disk>
Aug 09 10:35:36 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:35:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Received event <DeviceRemovedEvent: 1691577337.358647, fe1804e8-2340-4868-a0ff-32d5df5fad42 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72362) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 10:35:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-5cff087f-fe27-43b5-8874-d86dd0417fd7 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fe1804e8-2340-4868-a0ff-32d5df5fad42 {{(pid=72362) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 10:35:37 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-5cff087f-fe27-43b5-8874-d86dd0417fd7 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Successfully detached device vdb from instance fe1804e8-2340-4868-a0ff-32d5df5fad42 from the live domain config.
Aug 09 10:35:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cff087f-fe27-43b5-8874-d86dd0417fd7 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:35:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cff087f-fe27-43b5-8874-d86dd0417fd7 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fMKXJidP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:35:37 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-5cff087f-fe27-43b5-8874-d86dd0417fd7 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:35:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-5cff087f-fe27-43b5-8874-d86dd0417fd7 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:35:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-5cff087f-fe27-43b5-8874-d86dd0417fd7 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:35:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cff087f-fe27-43b5-8874-d86dd0417fd7 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:35:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:35:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:35:37 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8111d4c-594c-4c72-8865-22bbceab9a1a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:35:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:35:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:35:37 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b320c375-3e75-416d-bb3b-150396a4d9cd]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:35:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cff087f-fe27-43b5-8874-d86dd0417fd7 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:35:37 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:35:37 user nova-compute[72362]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:35:37 user nova-compute[72362]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 (non-flash)
Aug 09 10:35:37 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:35:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cff087f-fe27-43b5-8874-d86dd0417fd7 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:35:37 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:35:37 user nova-compute[72362]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:35:37 user nova-compute[72362]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 (non-flash)
Aug 09 10:35:37 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:35:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cff087f-fe27-43b5-8874-d86dd0417fd7 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34f3d80ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6'): ({'sdd'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:35:37 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-5cff087f-fe27-43b5-8874-d86dd0417fd7 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Removing single pathed devices sdd {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:35:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:35:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:35:37 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3fd33aa-7fa0-47fc-8e69-f1de1a5d1a7e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:35:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:35:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:35:37 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ca0b61-86c3-4f57-8bf2-ea2c34d414b4]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:35:37 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-5cff087f-fe27-43b5-8874-d86dd0417fd7 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Flushing IO for device /dev/sdd {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:35:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:35:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:35:37 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbde973a-4bb2-400f-848b-dd06865425f6]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:35:37 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-5cff087f-fe27-43b5-8874-d86dd0417fd7 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:35:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:35:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:35:37 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e708b177-c648-4fed-b498-ed2cd8c81104]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:35:37 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-5cff087f-fe27-43b5-8874-d86dd0417fd7 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:35:37 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-5cff087f-fe27-43b5-8874-d86dd0417fd7 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] SCSI volumes sdd have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:35:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cff087f-fe27-43b5-8874-d86dd0417fd7 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:35:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:35:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:35:37 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6c09e8-4747-4247-b816-dec82a7f2d4f]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:35:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cff087f-fe27-43b5-8874-d86dd0417fd7 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:35:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:35:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:35:37 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[206c7a20-f18e-4da0-b7b1-3768fa5da506]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:35:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cff087f-fe27-43b5-8874-d86dd0417fd7 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6, portal: 172.16.0.220,3260]
Aug 09 10:35:37 user nova-compute[72362]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6, portal: 172.16.0.220,3260] successful.
Aug 09 10:35:37 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:35:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:35:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625fa618-b4a1-44bd-9c6f-d825d64285e6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:35:37 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6e014b-da65-4c4b-be08-abff07d7b88e]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:35:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cff087f-fe27-43b5-8874-d86dd0417fd7 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:35:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-5cff087f-fe27-43b5-8874-d86dd0417fd7 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:35:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cff087f-fe27-43b5-8874-d86dd0417fd7 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] <== disconnect_volume: return (301ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:35:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cff087f-fe27-43b5-8874-d86dd0417fd7 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:35:38 user nova-compute[72362]: DEBUG nova.objects.instance [None req-5cff087f-fe27-43b5-8874-d86dd0417fd7 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Lazy-loading 'flavor' on Instance uuid fe1804e8-2340-4868-a0ff-32d5df5fad42 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:35:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5cff087f-fe27-43b5-8874-d86dd0417fd7 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Lock "fe1804e8-2340-4868-a0ff-32d5df5fad42" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.766s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:35:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:35:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:35:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:35:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:35:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:35:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 10:35:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 10:35:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 10:35:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:35:50 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:35:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:35:54 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:35:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:35:59 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:35:59 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:03 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "be231c58-3e84-4b0f-bbbd-c44246954c47" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:36:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "be231c58-3e84-4b0f-bbbd-c44246954c47" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:36:03 user nova-compute[72362]: DEBUG nova.compute.manager [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Starting instance... {{(pid=72362) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 10:36:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:36:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:36:03 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:36:03 user nova-compute[72362]: INFO nova.compute.claims [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Claim successful on node user
Aug 09 10:36:04 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:36:04 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:36:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.562s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:36:04 user nova-compute[72362]: DEBUG nova.compute.manager [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Start building networks asynchronously for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 10:36:04 user nova-compute[72362]: DEBUG nova.compute.manager [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Allocating IP information in the background. {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 10:36:04 user nova-compute[72362]: DEBUG nova.network.neutron [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] allocate_for_instance() {{(pid=72362) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 10:36:04 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 10:36:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:04 user nova-compute[72362]: DEBUG nova.compute.manager [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Start building block device mappings for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 10:36:04 user nova-compute[72362]: DEBUG nova.compute.manager [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Start spawning the instance on the hypervisor. {{(pid=72362) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 10:36:04 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:36:04 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Creating image(s)
Aug 09 10:36:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "/opt/stack/data/nova/instances/be231c58-3e84-4b0f-bbbd-c44246954c47/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:36:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "/opt/stack/data/nova/instances/be231c58-3e84-4b0f-bbbd-c44246954c47/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:36:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "/opt/stack/data/nova/instances/be231c58-3e84-4b0f-bbbd-c44246954c47/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:36:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:36:04 user nova-compute[72362]: DEBUG nova.policy [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bed469ff9d954891905c98bdf238c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980f1c36cab0449b949419cf495c16d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72362) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 10:36:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.144s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:36:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:36:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:36:04 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:36:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.164s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:36:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/be231c58-3e84-4b0f-bbbd-c44246954c47/disk 1073741824 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:36:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/be231c58-3e84-4b0f-bbbd-c44246954c47/disk 1073741824" returned: 0 in 0.049s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:36:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.218s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:36:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:36:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.135s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:36:05 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Checking if we can resize image /opt/stack/data/nova/instances/be231c58-3e84-4b0f-bbbd-c44246954c47/disk. size=1073741824 {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 10:36:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be231c58-3e84-4b0f-bbbd-c44246954c47/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:36:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be231c58-3e84-4b0f-bbbd-c44246954c47/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:36:05 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Cannot resize image /opt/stack/data/nova/instances/be231c58-3e84-4b0f-bbbd-c44246954c47/disk to a smaller size. {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 10:36:05 user nova-compute[72362]: DEBUG nova.objects.instance [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lazy-loading 'migration_context' on Instance uuid be231c58-3e84-4b0f-bbbd-c44246954c47 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:36:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Created local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 10:36:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Ensure instance console log exists: /opt/stack/data/nova/instances/be231c58-3e84-4b0f-bbbd-c44246954c47/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:36:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:36:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:36:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:36:05 user nova-compute[72362]: DEBUG nova.network.neutron [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Successfully created port: 4c907e79-d540-4521-bc58-ebc624c13456 {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:36:06 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:36:06 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:36:06 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:36:06 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 10:36:06 user nova-compute[72362]: DEBUG nova.network.neutron [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Successfully updated port: 4c907e79-d540-4521-bc58-ebc624c13456 {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:36:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "refresh_cache-be231c58-3e84-4b0f-bbbd-c44246954c47" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:36:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquired lock "refresh_cache-be231c58-3e84-4b0f-bbbd-c44246954c47" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:36:06 user nova-compute[72362]: DEBUG nova.network.neutron [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:36:06 user nova-compute[72362]: DEBUG nova.compute.manager [req-aaade99c-f30d-4967-b6a2-52a5968879c7 req-bc011cb7-fc60-4b2a-b2d0-c45cb6066aef service nova] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Received event network-changed-4c907e79-d540-4521-bc58-ebc624c13456 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:36:06 user nova-compute[72362]: DEBUG nova.compute.manager [req-aaade99c-f30d-4967-b6a2-52a5968879c7 req-bc011cb7-fc60-4b2a-b2d0-c45cb6066aef service nova] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Refreshing instance network info cache due to event network-changed-4c907e79-d540-4521-bc58-ebc624c13456. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:36:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-aaade99c-f30d-4967-b6a2-52a5968879c7 req-bc011cb7-fc60-4b2a-b2d0-c45cb6066aef service nova] Acquiring lock "refresh_cache-be231c58-3e84-4b0f-bbbd-c44246954c47" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:36:06 user nova-compute[72362]: DEBUG nova.network.neutron [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:36:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:07 user nova-compute[72362]: DEBUG nova.network.neutron [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Updating instance_info_cache with network_info: [{"id": "4c907e79-d540-4521-bc58-ebc624c13456", "address": "fa:16:3e:ea:97:51", "network": {"id": "e56e2a0a-0a6d-4546-86ef-7bb333e829ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1495216341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980f1c36cab0449b949419cf495c16d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c907e79-d5", "ovs_interfaceid": "4c907e79-d540-4521-bc58-ebc624c13456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:36:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Releasing lock "refresh_cache-be231c58-3e84-4b0f-bbbd-c44246954c47" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:36:07 user nova-compute[72362]: DEBUG nova.compute.manager [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Instance network_info: |[{"id": "4c907e79-d540-4521-bc58-ebc624c13456", "address": "fa:16:3e:ea:97:51", "network": {"id": "e56e2a0a-0a6d-4546-86ef-7bb333e829ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1495216341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980f1c36cab0449b949419cf495c16d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c907e79-d5", "ovs_interfaceid": "4c907e79-d540-4521-bc58-ebc624c13456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 10:36:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-aaade99c-f30d-4967-b6a2-52a5968879c7 req-bc011cb7-fc60-4b2a-b2d0-c45cb6066aef service nova] Acquired lock "refresh_cache-be231c58-3e84-4b0f-bbbd-c44246954c47" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:36:07 user nova-compute[72362]: DEBUG nova.network.neutron [req-aaade99c-f30d-4967-b6a2-52a5968879c7 req-bc011cb7-fc60-4b2a-b2d0-c45cb6066aef service nova] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Refreshing network info cache for port 4c907e79-d540-4521-bc58-ebc624c13456 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:36:07 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Start _get_guest_xml network_info=[{"id": "4c907e79-d540-4521-bc58-ebc624c13456", "address": "fa:16:3e:ea:97:51", "network": {"id": "e56e2a0a-0a6d-4546-86ef-7bb333e829ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1495216341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980f1c36cab0449b949419cf495c16d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c907e79-d5", "ovs_interfaceid": "4c907e79-d540-4521-bc58-ebc624c13456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': 'a08d1a11-49eb-4212-a351-e11ee9553b95'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:36:07 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:36:07 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:36:07 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:36:07 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:36:07 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:36:07 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:36:07 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:36:07 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:36:07 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:36:07 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:36:07 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:36:07 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:36:07 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:36:07 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:36:07 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:36:07 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:36:07 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:36:07 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:36:07 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:36:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1258122356',display_name='tempest-AttachVolumeNegativeTest-server-1258122356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1258122356',id=36,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiNoPm3w8o+Zwj9sH88wknolYrxNlUoTqg5cMzzCV9zhvLWcW1SX3WjO4m2DuhM6E92ds+smyuFs9AJXD9ugzw76cPsChq0OQtdtqB2xjnkuk76sxfKBFB2mVVs3jQLyw==',key_name='tempest-keypair-1348046424',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='980f1c36cab0449b949419cf495c16d5',ramdisk_id='',reservation_id='r-is960l10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-486756066',owner_user_name='tempest-AttachVolumeNegativeTest-486756066-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:36:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bed469ff9d954891905c98bdf238c097',uuid=be231c58-3e84-4b0f-bbbd-c44246954c47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c907e79-d540-4521-bc58-ebc624c13456", "address": "fa:16:3e:ea:97:51", "network": {"id": "e56e2a0a-0a6d-4546-86ef-7bb333e829ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1495216341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980f1c36cab0449b949419cf495c16d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c907e79-d5", "ovs_interfaceid": "4c907e79-d540-4521-bc58-ebc624c13456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:36:07 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Converting VIF {"id": "4c907e79-d540-4521-bc58-ebc624c13456", "address": "fa:16:3e:ea:97:51", "network": {"id": "e56e2a0a-0a6d-4546-86ef-7bb333e829ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1495216341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980f1c36cab0449b949419cf495c16d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c907e79-d5", "ovs_interfaceid": "4c907e79-d540-4521-bc58-ebc624c13456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:36:07 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:97:51,bridge_name='br-int',has_traffic_filtering=True,id=4c907e79-d540-4521-bc58-ebc624c13456,network=Network(e56e2a0a-0a6d-4546-86ef-7bb333e829ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c907e79-d5') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:36:07 user nova-compute[72362]: DEBUG nova.objects.instance [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lazy-loading 'pci_devices' on Instance uuid be231c58-3e84-4b0f-bbbd-c44246954c47 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:36:07 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:36:07 user nova-compute[72362]:   <uuid>be231c58-3e84-4b0f-bbbd-c44246954c47</uuid>
Aug 09 10:36:07 user nova-compute[72362]:   <name>instance-00000024</name>
Aug 09 10:36:07 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:36:07 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:36:07 user nova-compute[72362]:   <metadata>
Aug 09 10:36:07 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:36:07 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:36:07 user nova-compute[72362]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1258122356</nova:name>
Aug 09 10:36:07 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:36:07</nova:creationTime>
Aug 09 10:36:07 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:36:07 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:36:07 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:36:07 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:36:07 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:36:07 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:36:07 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:36:07 user nova-compute[72362]:       <nova:owner>
Aug 09 10:36:07 user nova-compute[72362]:         <nova:user uuid="bed469ff9d954891905c98bdf238c097">tempest-AttachVolumeNegativeTest-486756066-project-member</nova:user>
Aug 09 10:36:07 user nova-compute[72362]:         <nova:project uuid="980f1c36cab0449b949419cf495c16d5">tempest-AttachVolumeNegativeTest-486756066</nova:project>
Aug 09 10:36:07 user nova-compute[72362]:       </nova:owner>
Aug 09 10:36:07 user nova-compute[72362]:       <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:36:07 user nova-compute[72362]:       <nova:ports>
Aug 09 10:36:07 user nova-compute[72362]:         <nova:port uuid="4c907e79-d540-4521-bc58-ebc624c13456">
Aug 09 10:36:07 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 10:36:07 user nova-compute[72362]:         </nova:port>
Aug 09 10:36:07 user nova-compute[72362]:       </nova:ports>
Aug 09 10:36:07 user nova-compute[72362]:     </nova:instance>
Aug 09 10:36:07 user nova-compute[72362]:   </metadata>
Aug 09 10:36:07 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:36:07 user nova-compute[72362]:     <system>
Aug 09 10:36:07 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:36:07 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:36:07 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:36:07 user nova-compute[72362]:       <entry name="serial">be231c58-3e84-4b0f-bbbd-c44246954c47</entry>
Aug 09 10:36:07 user nova-compute[72362]:       <entry name="uuid">be231c58-3e84-4b0f-bbbd-c44246954c47</entry>
Aug 09 10:36:07 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:36:07 user nova-compute[72362]:     </system>
Aug 09 10:36:07 user nova-compute[72362]:   </sysinfo>
Aug 09 10:36:07 user nova-compute[72362]:   <os>
Aug 09 10:36:07 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:36:07 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:36:07 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:36:07 user nova-compute[72362]:   </os>
Aug 09 10:36:07 user nova-compute[72362]:   <features>
Aug 09 10:36:07 user nova-compute[72362]:     <acpi/>
Aug 09 10:36:07 user nova-compute[72362]:     <apic/>
Aug 09 10:36:07 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:36:07 user nova-compute[72362]:   </features>
Aug 09 10:36:07 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:36:07 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:36:07 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:36:07 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:36:07 user nova-compute[72362]:   </clock>
Aug 09 10:36:07 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:36:07 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:36:07 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:36:07 user nova-compute[72362]:   </cpu>
Aug 09 10:36:07 user nova-compute[72362]:   <devices>
Aug 09 10:36:07 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:36:07 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:36:07 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/be231c58-3e84-4b0f-bbbd-c44246954c47/disk"/>
Aug 09 10:36:07 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:36:07 user nova-compute[72362]:     </disk>
Aug 09 10:36:07 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:36:07 user nova-compute[72362]:       <mac address="fa:16:3e:ea:97:51"/>
Aug 09 10:36:07 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:36:07 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:36:07 user nova-compute[72362]:       <target dev="tap4c907e79-d5"/>
Aug 09 10:36:07 user nova-compute[72362]:     </interface>
Aug 09 10:36:07 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:36:07 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/be231c58-3e84-4b0f-bbbd-c44246954c47/console.log" append="off"/>
Aug 09 10:36:07 user nova-compute[72362]:     </serial>
Aug 09 10:36:07 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:36:07 user nova-compute[72362]:     <video>
Aug 09 10:36:07 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:36:07 user nova-compute[72362]:     </video>
Aug 09 10:36:07 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:36:07 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:36:07 user nova-compute[72362]:     </rng>
Aug 09 10:36:07 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:36:07 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:36:07 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:36:07 user nova-compute[72362]:     </memballoon>
Aug 09 10:36:07 user nova-compute[72362]:   </devices>
Aug 09 10:36:07 user nova-compute[72362]: </domain>
Aug 09 10:36:07 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:36:07 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:36:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1258122356',display_name='tempest-AttachVolumeNegativeTest-server-1258122356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1258122356',id=36,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiNoPm3w8o+Zwj9sH88wknolYrxNlUoTqg5cMzzCV9zhvLWcW1SX3WjO4m2DuhM6E92ds+smyuFs9AJXD9ugzw76cPsChq0OQtdtqB2xjnkuk76sxfKBFB2mVVs3jQLyw==',key_name='tempest-keypair-1348046424',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='980f1c36cab0449b949419cf495c16d5',ramdisk_id='',reservation_id='r-is960l10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-486756066',owner_user_name='tempest-AttachVolumeNegativeTest-486756066-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:36:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bed469ff9d954891905c98bdf238c097',uuid=be231c58-3e84-4b0f-bbbd-c44246954c47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c907e79-d540-4521-bc58-ebc624c13456", "address": "fa:16:3e:ea:97:51", "network": {"id": "e56e2a0a-0a6d-4546-86ef-7bb333e829ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1495216341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980f1c36cab0449b949419cf495c16d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c907e79-d5", "ovs_interfaceid": "4c907e79-d540-4521-bc58-ebc624c13456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:36:07 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Converting VIF {"id": "4c907e79-d540-4521-bc58-ebc624c13456", "address": "fa:16:3e:ea:97:51", "network": {"id": "e56e2a0a-0a6d-4546-86ef-7bb333e829ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1495216341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980f1c36cab0449b949419cf495c16d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c907e79-d5", "ovs_interfaceid": "4c907e79-d540-4521-bc58-ebc624c13456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:36:07 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:97:51,bridge_name='br-int',has_traffic_filtering=True,id=4c907e79-d540-4521-bc58-ebc624c13456,network=Network(e56e2a0a-0a6d-4546-86ef-7bb333e829ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c907e79-d5') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:36:07 user nova-compute[72362]: DEBUG os_vif [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:97:51,bridge_name='br-int',has_traffic_filtering=True,id=4c907e79-d540-4521-bc58-ebc624c13456,network=Network(e56e2a0a-0a6d-4546-86ef-7bb333e829ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c907e79-d5') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:36:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:36:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:36:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c907e79-d5, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:36:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4c907e79-d5, col_values=(('external_ids', {'iface-id': '4c907e79-d540-4521-bc58-ebc624c13456', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:97:51', 'vm-uuid': 'be231c58-3e84-4b0f-bbbd-c44246954c47'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:36:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:36:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:07 user nova-compute[72362]: INFO os_vif [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:97:51,bridge_name='br-int',has_traffic_filtering=True,id=4c907e79-d540-4521-bc58-ebc624c13456,network=Network(e56e2a0a-0a6d-4546-86ef-7bb333e829ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c907e79-d5')
Aug 09 10:36:07 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:36:07 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] No VIF found with MAC fa:16:3e:ea:97:51, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:36:07 user nova-compute[72362]: DEBUG nova.network.neutron [req-aaade99c-f30d-4967-b6a2-52a5968879c7 req-bc011cb7-fc60-4b2a-b2d0-c45cb6066aef service nova] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Updated VIF entry in instance network info cache for port 4c907e79-d540-4521-bc58-ebc624c13456. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:36:07 user nova-compute[72362]: DEBUG nova.network.neutron [req-aaade99c-f30d-4967-b6a2-52a5968879c7 req-bc011cb7-fc60-4b2a-b2d0-c45cb6066aef service nova] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Updating instance_info_cache with network_info: [{"id": "4c907e79-d540-4521-bc58-ebc624c13456", "address": "fa:16:3e:ea:97:51", "network": {"id": "e56e2a0a-0a6d-4546-86ef-7bb333e829ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1495216341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980f1c36cab0449b949419cf495c16d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c907e79-d5", "ovs_interfaceid": "4c907e79-d540-4521-bc58-ebc624c13456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:36:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-aaade99c-f30d-4967-b6a2-52a5968879c7 req-bc011cb7-fc60-4b2a-b2d0-c45cb6066aef service nova] Releasing lock "refresh_cache-be231c58-3e84-4b0f-bbbd-c44246954c47" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:36:07 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:36:07 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 10:36:08 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "refresh_cache-30213e67-6b1d-4d97-a971-1544335d02fb" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:36:08 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquired lock "refresh_cache-30213e67-6b1d-4d97-a971-1544335d02fb" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:36:08 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Forcefully refreshing network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 10:36:08 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:08 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:08 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:08 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Updating instance_info_cache with network_info: [{"id": "86a5b4ed-c891-4322-9ed4-4ddb3795148c", "address": "fa:16:3e:7b:56:f2", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a5b4ed-c8", "ovs_interfaceid": "86a5b4ed-c891-4322-9ed4-4ddb3795148c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:36:08 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Releasing lock "refresh_cache-30213e67-6b1d-4d97-a971-1544335d02fb" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:36:08 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Updated the network info_cache for instance {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 10:36:08 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:36:08 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:36:08 user nova-compute[72362]: DEBUG nova.compute.manager [req-73ee2935-2eb3-431c-90bc-b80e38a628a7 req-311f2e10-9f3b-4a69-94d0-c4cf79ba7f76 service nova] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Received event network-vif-plugged-4c907e79-d540-4521-bc58-ebc624c13456 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:36:08 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-73ee2935-2eb3-431c-90bc-b80e38a628a7 req-311f2e10-9f3b-4a69-94d0-c4cf79ba7f76 service nova] Acquiring lock "be231c58-3e84-4b0f-bbbd-c44246954c47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:36:08 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-73ee2935-2eb3-431c-90bc-b80e38a628a7 req-311f2e10-9f3b-4a69-94d0-c4cf79ba7f76 service nova] Lock "be231c58-3e84-4b0f-bbbd-c44246954c47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:36:08 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-73ee2935-2eb3-431c-90bc-b80e38a628a7 req-311f2e10-9f3b-4a69-94d0-c4cf79ba7f76 service nova] Lock "be231c58-3e84-4b0f-bbbd-c44246954c47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:36:08 user nova-compute[72362]: DEBUG nova.compute.manager [req-73ee2935-2eb3-431c-90bc-b80e38a628a7 req-311f2e10-9f3b-4a69-94d0-c4cf79ba7f76 service nova] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] No waiting events found dispatching network-vif-plugged-4c907e79-d540-4521-bc58-ebc624c13456 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:36:08 user nova-compute[72362]: WARNING nova.compute.manager [req-73ee2935-2eb3-431c-90bc-b80e38a628a7 req-311f2e10-9f3b-4a69-94d0-c4cf79ba7f76 service nova] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Received unexpected event network-vif-plugged-4c907e79-d540-4521-bc58-ebc624c13456 for instance with vm_state building and task_state spawning.
Aug 09 10:36:09 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:09 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:09 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:09 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:36:09 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:36:09 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:36:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "1da4edf1-dce6-4411-8494-8c3f7c7b8ea1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:36:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "1da4edf1-dce6-4411-8494-8c3f7c7b8ea1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:36:10 user nova-compute[72362]: DEBUG nova.compute.manager [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:36:10 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:36:10 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577370.8609927, be231c58-3e84-4b0f-bbbd-c44246954c47 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:36:10 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] VM Resumed (Lifecycle Event)
Aug 09 10:36:10 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Instance spawned successfully.
Aug 09 10:36:10 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 10:36:10 user nova-compute[72362]: DEBUG nova.compute.manager [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Starting instance... {{(pid=72362) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 10:36:10 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:36:10 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:36:10 user nova-compute[72362]: DEBUG nova.compute.manager [req-6f238b58-fb0b-4227-b828-295b51c6bdc7 req-78f436c9-ceb1-45e9-ab02-2f5d63576a1d service nova] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Received event network-vif-plugged-4c907e79-d540-4521-bc58-ebc624c13456 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:36:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-6f238b58-fb0b-4227-b828-295b51c6bdc7 req-78f436c9-ceb1-45e9-ab02-2f5d63576a1d service nova] Acquiring lock "be231c58-3e84-4b0f-bbbd-c44246954c47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:36:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-6f238b58-fb0b-4227-b828-295b51c6bdc7 req-78f436c9-ceb1-45e9-ab02-2f5d63576a1d service nova] Lock "be231c58-3e84-4b0f-bbbd-c44246954c47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:36:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-6f238b58-fb0b-4227-b828-295b51c6bdc7 req-78f436c9-ceb1-45e9-ab02-2f5d63576a1d service nova] Lock "be231c58-3e84-4b0f-bbbd-c44246954c47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:36:10 user nova-compute[72362]: DEBUG nova.compute.manager [req-6f238b58-fb0b-4227-b828-295b51c6bdc7 req-78f436c9-ceb1-45e9-ab02-2f5d63576a1d service nova] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] No waiting events found dispatching network-vif-plugged-4c907e79-d540-4521-bc58-ebc624c13456 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:36:10 user nova-compute[72362]: WARNING nova.compute.manager [req-6f238b58-fb0b-4227-b828-295b51c6bdc7 req-78f436c9-ceb1-45e9-ab02-2f5d63576a1d service nova] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Received unexpected event network-vif-plugged-4c907e79-d540-4521-bc58-ebc624c13456 for instance with vm_state building and task_state spawning.
Aug 09 10:36:10 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Found default for hw_cdrom_bus of ide {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:36:10 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Found default for hw_disk_bus of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:36:10 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:36:10 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:36:10 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Found default for hw_video_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:36:10 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Found default for hw_vif_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:36:10 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:36:10 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577370.8671966, be231c58-3e84-4b0f-bbbd-c44246954c47 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:36:10 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] VM Started (Lifecycle Event)
Aug 09 10:36:10 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:36:10 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:36:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:36:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:36:10 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:36:10 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:36:10 user nova-compute[72362]: INFO nova.compute.claims [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Claim successful on node user
Aug 09 10:36:10 user nova-compute[72362]: INFO nova.compute.manager [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Took 6.28 seconds to spawn the instance on the hypervisor.
Aug 09 10:36:10 user nova-compute[72362]: DEBUG nova.compute.manager [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:36:11 user nova-compute[72362]: INFO nova.compute.manager [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Took 7.20 seconds to build instance.
Aug 09 10:36:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3ae883cd-fa49-4e64-adf8-adae5c8e59c3 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "be231c58-3e84-4b0f-bbbd-c44246954c47" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.313s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:36:11 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:36:11 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:36:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.401s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:36:11 user nova-compute[72362]: DEBUG nova.compute.manager [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Start building networks asynchronously for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 10:36:11 user nova-compute[72362]: DEBUG nova.compute.manager [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Allocating IP information in the background. {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 10:36:11 user nova-compute[72362]: DEBUG nova.network.neutron [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] allocate_for_instance() {{(pid=72362) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 10:36:11 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 10:36:11 user nova-compute[72362]: DEBUG nova.compute.manager [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Start building block device mappings for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 10:36:11 user nova-compute[72362]: INFO nova.virt.block_device [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Booting with volume f3c41411-1beb-46e3-b0a4-888734995247 at /dev/vda
Aug 09 10:36:11 user nova-compute[72362]: DEBUG nova.policy [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e96900e953f64d02bdb5d48f136133c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e38599de0b4b06b723f5647a7fe121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72362) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 10:36:11 user nova-compute[72362]: DEBUG os_brick.utils [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:36:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:36:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:36:11 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[296b0d71-b660-451c-adbe-372af19abb8d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:36:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:36:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:36:11 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[497a9156-a0a1-472a-bb4f-bbb5899fc7d6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:36:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:36:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:36:11 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc69c7b3-2fdd-434b-93f4-521189df75e0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:36:11 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cefba16-3bc5-43fd-ba2d-39a8d5f6dc74]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:36:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:36:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:36:11 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:36:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:36:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:36:11 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:36:11 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d17023-e9b1-401c-a401-19ccab0cd52a]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:36:11 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:36:11 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:36:11 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:36:11 user nova-compute[72362]: DEBUG os_brick.utils [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:36:11 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Updating existing volume attachment record: b1e8ed69-f4ba-4f4d-8d7e-c5d770d8b56b {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 10:36:11 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:12 user nova-compute[72362]: DEBUG nova.network.neutron [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Successfully created port: 6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606 {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:36:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ee5aeeab-0636-4d08-8a3a-a3ec440d8643 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Acquiring lock "4b22a19f-300c-42fb-8175-e737eef7d531" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:36:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ee5aeeab-0636-4d08-8a3a-a3ec440d8643 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "4b22a19f-300c-42fb-8175-e737eef7d531" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:36:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ee5aeeab-0636-4d08-8a3a-a3ec440d8643 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Acquiring lock "4b22a19f-300c-42fb-8175-e737eef7d531-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:36:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ee5aeeab-0636-4d08-8a3a-a3ec440d8643 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "4b22a19f-300c-42fb-8175-e737eef7d531-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:36:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ee5aeeab-0636-4d08-8a3a-a3ec440d8643 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "4b22a19f-300c-42fb-8175-e737eef7d531-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:36:13 user nova-compute[72362]: INFO nova.compute.manager [None req-ee5aeeab-0636-4d08-8a3a-a3ec440d8643 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Terminating instance
Aug 09 10:36:13 user nova-compute[72362]: DEBUG nova.compute.manager [None req-ee5aeeab-0636-4d08-8a3a-a3ec440d8643 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Start destroying the instance on the hypervisor. {{(pid=72362) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 10:36:13 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:13 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:13 user nova-compute[72362]: DEBUG nova.compute.manager [req-be3c19f1-da83-4212-9978-320bb35525d1 req-6ab3cb56-0a53-4f3f-bc07-f7e2bae735e1 service nova] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Received event network-vif-unplugged-0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:36:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-be3c19f1-da83-4212-9978-320bb35525d1 req-6ab3cb56-0a53-4f3f-bc07-f7e2bae735e1 service nova] Acquiring lock "4b22a19f-300c-42fb-8175-e737eef7d531-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:36:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-be3c19f1-da83-4212-9978-320bb35525d1 req-6ab3cb56-0a53-4f3f-bc07-f7e2bae735e1 service nova] Lock "4b22a19f-300c-42fb-8175-e737eef7d531-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:36:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-be3c19f1-da83-4212-9978-320bb35525d1 req-6ab3cb56-0a53-4f3f-bc07-f7e2bae735e1 service nova] Lock "4b22a19f-300c-42fb-8175-e737eef7d531-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:36:13 user nova-compute[72362]: DEBUG nova.compute.manager [req-be3c19f1-da83-4212-9978-320bb35525d1 req-6ab3cb56-0a53-4f3f-bc07-f7e2bae735e1 service nova] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] No waiting events found dispatching network-vif-unplugged-0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:36:13 user nova-compute[72362]: DEBUG nova.compute.manager [req-be3c19f1-da83-4212-9978-320bb35525d1 req-6ab3cb56-0a53-4f3f-bc07-f7e2bae735e1 service nova] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Received event network-vif-unplugged-0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:36:13 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:13 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG nova.network.neutron [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Successfully updated port: 6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606 {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:36:14 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Instance destroyed successfully.
Aug 09 10:36:14 user nova-compute[72362]: DEBUG nova.objects.instance [None req-ee5aeeab-0636-4d08-8a3a-a3ec440d8643 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lazy-loading 'resources' on Instance uuid 4b22a19f-300c-42fb-8175-e737eef7d531 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "refresh_cache-1da4edf1-dce6-4411-8494-8c3f7c7b8ea1" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquired lock "refresh_cache-1da4edf1-dce6-4411-8494-8c3f7c7b8ea1" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG nova.network.neutron [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-ee5aeeab-0636-4d08-8a3a-a3ec440d8643 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:29:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1888482065',display_name='tempest-ServerActionsTestOtherA-server-1888482065',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1888482065',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwSFF251eQti/qkoXtJtG/hsB95elMyv8iaeRUjgcdf3ZQpb25r9rbEB2fGNjqP3pvOqQxJNR/NqVUD62omNMx/akMv5+i7VAu1R/GqhP2vqtVAvdiRNee4z2ROG7Jd8w==',key_name='tempest-keypair-122703468',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:31:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8ac22022944542c0b52dd912d3dbcce2',ramdisk_id='',reservation_id='r-08r15keq',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2101881579',owner_user_name='tempest-ServerActionsTestOtherA-2101881579-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:33:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='990e2d160fdc4c599cee9f65d6d4e41d',uuid=4b22a19f-300c-42fb-8175-e737eef7d531,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa", "address": "fa:16:3e:39:ad:fb", "network": {"id": "e6c54663-74e3-43e2-8f0d-61b300c1f68d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1222286883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ac22022944542c0b52dd912d3dbcce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0942f4eb-e7", "ovs_interfaceid": "0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-ee5aeeab-0636-4d08-8a3a-a3ec440d8643 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Converting VIF {"id": "0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa", "address": "fa:16:3e:39:ad:fb", "network": {"id": "e6c54663-74e3-43e2-8f0d-61b300c1f68d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1222286883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ac22022944542c0b52dd912d3dbcce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0942f4eb-e7", "ovs_interfaceid": "0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-ee5aeeab-0636-4d08-8a3a-a3ec440d8643 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:ad:fb,bridge_name='br-int',has_traffic_filtering=True,id=0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa,network=Network(e6c54663-74e3-43e2-8f0d-61b300c1f68d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0942f4eb-e7') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG os_vif [None req-ee5aeeab-0636-4d08-8a3a-a3ec440d8643 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:ad:fb,bridge_name='br-int',has_traffic_filtering=True,id=0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa,network=Network(e6c54663-74e3-43e2-8f0d-61b300c1f68d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0942f4eb-e7') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0942f4eb-e7, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:36:14 user nova-compute[72362]: INFO os_vif [None req-ee5aeeab-0636-4d08-8a3a-a3ec440d8643 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:ad:fb,bridge_name='br-int',has_traffic_filtering=True,id=0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa,network=Network(e6c54663-74e3-43e2-8f0d-61b300c1f68d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0942f4eb-e7')
Aug 09 10:36:14 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee5aeeab-0636-4d08-8a3a-a3ec440d8643 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5aeeab-0636-4d08-8a3a-a3ec440d8643 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IfUGAoaD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:36:14 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-ee5aeeab-0636-4d08-8a3a-a3ec440d8643 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:36:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-ee5aeeab-0636-4d08-8a3a-a3ec440d8643 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-ee5aeeab-0636-4d08-8a3a-a3ec440d8643 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5aeeab-0636-4d08-8a3a-a3ec440d8643 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG nova.compute.manager [req-e71e26ec-20dd-4231-b972-bbd0a4f047eb req-3d327236-eeb9-496f-a1c1-ed2b65ab45c4 service nova] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Received event network-changed-6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG nova.compute.manager [req-e71e26ec-20dd-4231-b972-bbd0a4f047eb req-3d327236-eeb9-496f-a1c1-ed2b65ab45c4 service nova] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Refreshing instance network info cache due to event network-changed-6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e71e26ec-20dd-4231-b972-bbd0a4f047eb req-3d327236-eeb9-496f-a1c1-ed2b65ab45c4 service nova] Acquiring lock "refresh_cache-1da4edf1-dce6-4411-8494-8c3f7c7b8ea1" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0f3c6b-03f4-450c-93ca-98fc8ee96e13]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG nova.network.neutron [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4072572f-7c1d-4a52-a22c-c60234bd8417]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5aeeab-0636-4d08-8a3a-a3ec440d8643 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:36:14 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:36:14 user nova-compute[72362]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:36:14 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5aeeab-0636-4d08-8a3a-a3ec440d8643 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:36:14 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:36:14 user nova-compute[72362]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f (non-flash)
Aug 09 10:36:14 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5aeeab-0636-4d08-8a3a-a3ec440d8643 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34dc2ef9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f'): ({'sdc'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-ee5aeeab-0636-4d08-8a3a-a3ec440d8643 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Removing single pathed devices sdc {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[57504465-0830-4155-bf02-993c6de5e0ed]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[59365fca-b2ba-452f-bb06-7661bf4c1c8c]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-ee5aeeab-0636-4d08-8a3a-a3ec440d8643 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Flushing IO for device /dev/sdc {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fdaa27-4736-4278-96a5-f7b72583c0f6]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-ee5aeeab-0636-4d08-8a3a-a3ec440d8643 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae92df21-0b72-41c1-a7d3-dbd6ae0afab2]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-ee5aeeab-0636-4d08-8a3a-a3ec440d8643 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-ee5aeeab-0636-4d08-8a3a-a3ec440d8643 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] SCSI volumes sdc have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23963623563653539', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d9c261bf', '/dev/disk/by-id/scsi-1SCST_BIOd9c261bf-9cb5ce597a822674') {{(pid=84003) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[52756f7b-e8ea-41f7-a1d5-8553b5800ba1]: (4, None) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5aeeab-0636-4d08-8a3a-a3ec440d8643 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fbd5d92-c837-440c-abbc-a7507ddb4ea1]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5aeeab-0636-4d08-8a3a-a3ec440d8643 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9d6837-98f7-44cd-9c56-7247415e8267]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5aeeab-0636-4d08-8a3a-a3ec440d8643 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f, portal: 172.16.0.220,3260]
Aug 09 10:36:14 user nova-compute[72362]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f, portal: 172.16.0.220,3260] successful.
Aug 09 10:36:14 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31aca44a-c500-4972-873a-bb902c63755f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe3584a-a252-431f-8184-569678edf444]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5aeeab-0636-4d08-8a3a-a3ec440d8643 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-ee5aeeab-0636-4d08-8a3a-a3ec440d8643 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5aeeab-0636-4d08-8a3a-a3ec440d8643 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] <== disconnect_volume: return (334ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee5aeeab-0636-4d08-8a3a-a3ec440d8643 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:36:14 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-ee5aeeab-0636-4d08-8a3a-a3ec440d8643 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Deleting instance files /opt/stack/data/nova/instances/4b22a19f-300c-42fb-8175-e737eef7d531_del
Aug 09 10:36:14 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-ee5aeeab-0636-4d08-8a3a-a3ec440d8643 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Deletion of /opt/stack/data/nova/instances/4b22a19f-300c-42fb-8175-e737eef7d531_del complete
Aug 09 10:36:14 user nova-compute[72362]: INFO nova.compute.manager [None req-ee5aeeab-0636-4d08-8a3a-a3ec440d8643 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Took 1.47 seconds to destroy the instance on the hypervisor.
Aug 09 10:36:14 user nova-compute[72362]: DEBUG oslo.service.loopingcall [None req-ee5aeeab-0636-4d08-8a3a-a3ec440d8643 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72362) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG nova.compute.manager [-] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Deallocating network for instance {{(pid=72362) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] deallocate_for_instance() {{(pid=72362) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG nova.network.neutron [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Updating instance_info_cache with network_info: [{"id": "6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606", "address": "fa:16:3e:04:13:a4", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9e1aa0-d1", "ovs_interfaceid": "6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Releasing lock "refresh_cache-1da4edf1-dce6-4411-8494-8c3f7c7b8ea1" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG nova.compute.manager [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Instance network_info: |[{"id": "6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606", "address": "fa:16:3e:04:13:a4", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9e1aa0-d1", "ovs_interfaceid": "6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e71e26ec-20dd-4231-b972-bbd0a4f047eb req-3d327236-eeb9-496f-a1c1-ed2b65ab45c4 service nova] Acquired lock "refresh_cache-1da4edf1-dce6-4411-8494-8c3f7c7b8ea1" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:36:14 user nova-compute[72362]: DEBUG nova.network.neutron [req-e71e26ec-20dd-4231-b972-bbd0a4f047eb req-3d327236-eeb9-496f-a1c1-ed2b65ab45c4 service nova] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Refreshing network info cache for port 6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:36:15 user nova-compute[72362]: DEBUG nova.network.neutron [req-e71e26ec-20dd-4231-b972-bbd0a4f047eb req-3d327236-eeb9-496f-a1c1-ed2b65ab45c4 service nova] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Updated VIF entry in instance network info cache for port 6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:36:15 user nova-compute[72362]: DEBUG nova.network.neutron [req-e71e26ec-20dd-4231-b972-bbd0a4f047eb req-3d327236-eeb9-496f-a1c1-ed2b65ab45c4 service nova] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Updating instance_info_cache with network_info: [{"id": "6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606", "address": "fa:16:3e:04:13:a4", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9e1aa0-d1", "ovs_interfaceid": "6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:36:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e71e26ec-20dd-4231-b972-bbd0a4f047eb req-3d327236-eeb9-496f-a1c1-ed2b65ab45c4 service nova] Releasing lock "refresh_cache-1da4edf1-dce6-4411-8494-8c3f7c7b8ea1" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:36:15 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:36:15 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Took 0.98 seconds to deallocate network for instance.
Aug 09 10:36:15 user nova-compute[72362]: DEBUG nova.compute.manager [req-0ebca432-18c5-4911-8498-2a377376bada req-f32bf4fa-8b0d-49a9-aa9c-2c50e274896c service nova] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Received event network-vif-plugged-0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:36:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-0ebca432-18c5-4911-8498-2a377376bada req-f32bf4fa-8b0d-49a9-aa9c-2c50e274896c service nova] Acquiring lock "4b22a19f-300c-42fb-8175-e737eef7d531-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:36:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-0ebca432-18c5-4911-8498-2a377376bada req-f32bf4fa-8b0d-49a9-aa9c-2c50e274896c service nova] Lock "4b22a19f-300c-42fb-8175-e737eef7d531-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:36:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-0ebca432-18c5-4911-8498-2a377376bada req-f32bf4fa-8b0d-49a9-aa9c-2c50e274896c service nova] Lock "4b22a19f-300c-42fb-8175-e737eef7d531-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:36:15 user nova-compute[72362]: DEBUG nova.compute.manager [req-0ebca432-18c5-4911-8498-2a377376bada req-f32bf4fa-8b0d-49a9-aa9c-2c50e274896c service nova] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] No waiting events found dispatching network-vif-plugged-0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:36:15 user nova-compute[72362]: WARNING nova.compute.manager [req-0ebca432-18c5-4911-8498-2a377376bada req-f32bf4fa-8b0d-49a9-aa9c-2c50e274896c service nova] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Received unexpected event network-vif-plugged-0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa for instance with vm_state active and task_state deleting.
Aug 09 10:36:15 user nova-compute[72362]: DEBUG nova.compute.manager [req-0ebca432-18c5-4911-8498-2a377376bada req-f32bf4fa-8b0d-49a9-aa9c-2c50e274896c service nova] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Received event network-vif-deleted-0942f4eb-e7ca-4ec1-a2ac-69bfb62928aa {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:36:16 user nova-compute[72362]: INFO nova.compute.manager [None req-ee5aeeab-0636-4d08-8a3a-a3ec440d8643 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Took 0.83 seconds to detach 1 volumes for instance.
Aug 09 10:36:16 user nova-compute[72362]: DEBUG nova.compute.manager [None req-ee5aeeab-0636-4d08-8a3a-a3ec440d8643 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Deleting volume: 31aca44a-c500-4972-873a-bb902c63755f {{(pid=72362) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 09 10:36:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ee5aeeab-0636-4d08-8a3a-a3ec440d8643 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:36:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ee5aeeab-0636-4d08-8a3a-a3ec440d8643 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:36:16 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-ee5aeeab-0636-4d08-8a3a-a3ec440d8643 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:36:16 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-ee5aeeab-0636-4d08-8a3a-a3ec440d8643 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:36:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ee5aeeab-0636-4d08-8a3a-a3ec440d8643 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:36:16 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-ee5aeeab-0636-4d08-8a3a-a3ec440d8643 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Deleted allocations for instance 4b22a19f-300c-42fb-8175-e737eef7d531
Aug 09 10:36:16 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-ee5aeeab-0636-4d08-8a3a-a3ec440d8643 tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "4b22a19f-300c-42fb-8175-e737eef7d531" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.952s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:36:17 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:36:18 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:36:18 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:36:18 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:36:18 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 10:36:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:36:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:36:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:36:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:36:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be231c58-3e84-4b0f-bbbd-c44246954c47/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:36:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be231c58-3e84-4b0f-bbbd-c44246954c47/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:36:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be231c58-3e84-4b0f-bbbd-c44246954c47/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:36:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be231c58-3e84-4b0f-bbbd-c44246954c47/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:36:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:36:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:36:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:36:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:36:19 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:36:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:36:19 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:36:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:36:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:36:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:36:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:36:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:36:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:36:19 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:36:20 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:36:20 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:36:20 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=8088MB free_disk=24.87523651123047GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 8e055c58-a365-4f18-a6e3-377e32e2189d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 30213e67-6b1d-4d97-a971-1544335d02fb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance f8abc99c-b87b-4586-b9d4-7f5bcda60683 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance fe1804e8-2340-4868-a0ff-32d5df5fad42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance f3cdf152-da86-447b-aa7c-921b6fa87ef8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance be231c58-3e84-4b0f-bbbd-c44246954c47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.505s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG nova.compute.manager [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Start spawning the instance on the hypervisor. {{(pid=72362) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:36:20 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Creating image(s)
Aug 09 10:36:20 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Did not create local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Ensure instance console log exists: /opt/stack/data/nova/instances/1da4edf1-dce6-4411-8494-8c3f7c7b8ea1/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Start _get_guest_xml network_info=[{"id": "6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606", "address": "fa:16:3e:04:13:a4", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9e1aa0-d1", "ovs_interfaceid": "6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'b1e8ed69-f4ba-4f4d-8d7e-c5d770d8b56b', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gNewnOMj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1da4edf1-dce6-4411-8494-8c3f7c7b8ea1', 'attached_at': '', 'detached_at': '', 'volume_id': 'f3c41411-1beb-46e3-b0a4-888734995247', 'serial': 'f3c41411-1beb-46e3-b0a4-888734995247'}, 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:36:20 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:36:20 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:36:20 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gNewnOMj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:36:20 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:36:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:36:20 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:36:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:36:20 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:36:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247 -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c76279-0572-46b0-8a91-0f6d5d50366d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:36:20 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247 -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a49021-4723-4279-a272-778db8bb159d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247] added
Aug 09 10:36:20 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c97351-ac82-44d0-b9f1-021298ce38bb]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00fe4a3-e087-441b-af54-ed7cd5d3105e]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gNewnOMj {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gNewnOMj" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[987880d6-ec80-421a-8c3f-8217e375b4ca]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gNewnOMj'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[122b3ec0-17a9-4916-aafa-d36daff82c05]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:36:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:36:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:36:21 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[89336445-3a6e-4eeb-9df3-8fc9f63ad0b9]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:36:21 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:36:21 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:36:21 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:36:21 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:36:21 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:36:21 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:36:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247 -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:36:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:36:21 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9c78d7-666f-40e6-a522-36ff1f08e711]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:36:21 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247, portal: 172.16.0.220,3260]
Aug 09 10:36:21 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247, portal: 172.16.0.220,3260] successful.
Aug 09 10:36:21 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:36:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:36:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:36:21 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d889332-43f5-418a-bb31-d6cf49f8a59e]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:36:21 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:36:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:36:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:36:21 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d16be5a-e8c1-48af-98f4-31a25dc8725b]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:36:21 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:36:21 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:36:21 user nova-compute[72362]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247 (non-flash)
Aug 09 10:36:21 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:36:21 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:36:21 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:36:21 user nova-compute[72362]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247 (non-flash)
Aug 09 10:36:21 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:36:21 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:36:21 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:36:21 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:36:21 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:36:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:36:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:36:21 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5697ad08-80b4-400f-a98f-e79a6edb8897]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:36:21 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:36:21 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gNewnOMj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:36:22 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:36:22 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '26463343163333666', 'path': '/dev/sdc'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:36:22 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463343163333666', 'path': '/dev/sdc'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:36:22 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:36:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-544578261',display_name='tempest-TestVolumeBootPattern-volume-backed-server-544578261',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-544578261',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6em6mSBf/2CQokZlzlCDY2qxGLE4Izc6Xt2X3SSZ2GDtNUPa1CBOgrNLxUgqZpaX/KHdbN4EcomYXdEIwVfIxEbDy1gNcHh8xtF1XXiURvlNf6J4M1BXUQ10OZ3GdzRQ==',key_name='tempest-keypair-1354713331',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26e38599de0b4b06b723f5647a7fe121',ramdisk_id='',reservation_id='r-6t0a404a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1478436240',owner_user_name='tempest-TestVolumeBootPattern-1478436240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:36:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e96900e953f64d02bdb5d48f136133c3',uuid=1da4edf1-dce6-4411-8494-8c3f7c7b8ea1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606", "address": "fa:16:3e:04:13:a4", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9e1aa0-d1", "ovs_interfaceid": "6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:36:22 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Converting VIF {"id": "6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606", "address": "fa:16:3e:04:13:a4", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9e1aa0-d1", "ovs_interfaceid": "6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:36:22 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:13:a4,bridge_name='br-int',has_traffic_filtering=True,id=6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606,network=Network(b4a9e050-41f1-404a-bf5c-41421f034644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9e1aa0-d1') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:36:22 user nova-compute[72362]: DEBUG nova.objects.instance [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lazy-loading 'pci_devices' on Instance uuid 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:36:22 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:36:22 user nova-compute[72362]:   <uuid>1da4edf1-dce6-4411-8494-8c3f7c7b8ea1</uuid>
Aug 09 10:36:22 user nova-compute[72362]:   <name>instance-00000025</name>
Aug 09 10:36:22 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:36:22 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:36:22 user nova-compute[72362]:   <metadata>
Aug 09 10:36:22 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:36:22 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:36:22 user nova-compute[72362]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-544578261</nova:name>
Aug 09 10:36:22 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:36:20</nova:creationTime>
Aug 09 10:36:22 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:36:22 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:36:22 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:36:22 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:36:22 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:36:22 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:36:22 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:36:22 user nova-compute[72362]:       <nova:owner>
Aug 09 10:36:22 user nova-compute[72362]:         <nova:user uuid="e96900e953f64d02bdb5d48f136133c3">tempest-TestVolumeBootPattern-1478436240-project-member</nova:user>
Aug 09 10:36:22 user nova-compute[72362]:         <nova:project uuid="26e38599de0b4b06b723f5647a7fe121">tempest-TestVolumeBootPattern-1478436240</nova:project>
Aug 09 10:36:22 user nova-compute[72362]:       </nova:owner>
Aug 09 10:36:22 user nova-compute[72362]:       <nova:ports>
Aug 09 10:36:22 user nova-compute[72362]:         <nova:port uuid="6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606">
Aug 09 10:36:22 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 10:36:22 user nova-compute[72362]:         </nova:port>
Aug 09 10:36:22 user nova-compute[72362]:       </nova:ports>
Aug 09 10:36:22 user nova-compute[72362]:     </nova:instance>
Aug 09 10:36:22 user nova-compute[72362]:   </metadata>
Aug 09 10:36:22 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:36:22 user nova-compute[72362]:     <system>
Aug 09 10:36:22 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:36:22 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:36:22 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:36:22 user nova-compute[72362]:       <entry name="serial">1da4edf1-dce6-4411-8494-8c3f7c7b8ea1</entry>
Aug 09 10:36:22 user nova-compute[72362]:       <entry name="uuid">1da4edf1-dce6-4411-8494-8c3f7c7b8ea1</entry>
Aug 09 10:36:22 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:36:22 user nova-compute[72362]:     </system>
Aug 09 10:36:22 user nova-compute[72362]:   </sysinfo>
Aug 09 10:36:22 user nova-compute[72362]:   <os>
Aug 09 10:36:22 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:36:22 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:36:22 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:36:22 user nova-compute[72362]:   </os>
Aug 09 10:36:22 user nova-compute[72362]:   <features>
Aug 09 10:36:22 user nova-compute[72362]:     <acpi/>
Aug 09 10:36:22 user nova-compute[72362]:     <apic/>
Aug 09 10:36:22 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:36:22 user nova-compute[72362]:   </features>
Aug 09 10:36:22 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:36:22 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:36:22 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:36:22 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:36:22 user nova-compute[72362]:   </clock>
Aug 09 10:36:22 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:36:22 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:36:22 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:36:22 user nova-compute[72362]:   </cpu>
Aug 09 10:36:22 user nova-compute[72362]:   <devices>
Aug 09 10:36:22 user nova-compute[72362]:     <disk type="block" device="disk">
Aug 09 10:36:22 user nova-compute[72362]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:36:22 user nova-compute[72362]:       <source dev="/dev/sdc"/>
Aug 09 10:36:22 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:36:22 user nova-compute[72362]:       <serial>f3c41411-1beb-46e3-b0a4-888734995247</serial>
Aug 09 10:36:22 user nova-compute[72362]:     </disk>
Aug 09 10:36:22 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:36:22 user nova-compute[72362]:       <mac address="fa:16:3e:04:13:a4"/>
Aug 09 10:36:22 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:36:22 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:36:22 user nova-compute[72362]:       <target dev="tap6e9e1aa0-d1"/>
Aug 09 10:36:22 user nova-compute[72362]:     </interface>
Aug 09 10:36:22 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:36:22 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/1da4edf1-dce6-4411-8494-8c3f7c7b8ea1/console.log" append="off"/>
Aug 09 10:36:22 user nova-compute[72362]:     </serial>
Aug 09 10:36:22 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:36:22 user nova-compute[72362]:     <video>
Aug 09 10:36:22 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:36:22 user nova-compute[72362]:     </video>
Aug 09 10:36:22 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:36:22 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:36:22 user nova-compute[72362]:     </rng>
Aug 09 10:36:22 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:36:22 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:36:22 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:36:22 user nova-compute[72362]:     </memballoon>
Aug 09 10:36:22 user nova-compute[72362]:   </devices>
Aug 09 10:36:22 user nova-compute[72362]: </domain>
Aug 09 10:36:22 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:36:22 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:36:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-544578261',display_name='tempest-TestVolumeBootPattern-volume-backed-server-544578261',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-544578261',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6em6mSBf/2CQokZlzlCDY2qxGLE4Izc6Xt2X3SSZ2GDtNUPa1CBOgrNLxUgqZpaX/KHdbN4EcomYXdEIwVfIxEbDy1gNcHh8xtF1XXiURvlNf6J4M1BXUQ10OZ3GdzRQ==',key_name='tempest-keypair-1354713331',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26e38599de0b4b06b723f5647a7fe121',ramdisk_id='',reservation_id='r-6t0a404a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1478436240',owner_user_name='tempest-TestVolumeBootPattern-1478436240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:36:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e96900e953f64d02bdb5d48f136133c3',uuid=1da4edf1-dce6-4411-8494-8c3f7c7b8ea1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606", "address": "fa:16:3e:04:13:a4", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9e1aa0-d1", "ovs_interfaceid": "6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:36:22 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Converting VIF {"id": "6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606", "address": "fa:16:3e:04:13:a4", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9e1aa0-d1", "ovs_interfaceid": "6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:36:22 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:13:a4,bridge_name='br-int',has_traffic_filtering=True,id=6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606,network=Network(b4a9e050-41f1-404a-bf5c-41421f034644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9e1aa0-d1') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:36:22 user nova-compute[72362]: DEBUG os_vif [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:13:a4,bridge_name='br-int',has_traffic_filtering=True,id=6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606,network=Network(b4a9e050-41f1-404a-bf5c-41421f034644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9e1aa0-d1') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:36:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:36:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:36:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e9e1aa0-d1, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:36:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6e9e1aa0-d1, col_values=(('external_ids', {'iface-id': '6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:13:a4', 'vm-uuid': '1da4edf1-dce6-4411-8494-8c3f7c7b8ea1'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:36:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:36:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:22 user nova-compute[72362]: INFO os_vif [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:13:a4,bridge_name='br-int',has_traffic_filtering=True,id=6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606,network=Network(b4a9e050-41f1-404a-bf5c-41421f034644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9e1aa0-d1')
Aug 09 10:36:22 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:36:22 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] No VIF found with MAC fa:16:3e:04:13:a4, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:36:23 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:23 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:23 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:23 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:23 user nova-compute[72362]: DEBUG nova.compute.manager [req-c903f3d9-fcbd-4424-892e-106d42502de7 req-70fb3225-6fbf-40be-8c6d-d9095df84590 service nova] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Received event network-vif-plugged-6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:36:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c903f3d9-fcbd-4424-892e-106d42502de7 req-70fb3225-6fbf-40be-8c6d-d9095df84590 service nova] Acquiring lock "1da4edf1-dce6-4411-8494-8c3f7c7b8ea1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:36:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c903f3d9-fcbd-4424-892e-106d42502de7 req-70fb3225-6fbf-40be-8c6d-d9095df84590 service nova] Lock "1da4edf1-dce6-4411-8494-8c3f7c7b8ea1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:36:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c903f3d9-fcbd-4424-892e-106d42502de7 req-70fb3225-6fbf-40be-8c6d-d9095df84590 service nova] Lock "1da4edf1-dce6-4411-8494-8c3f7c7b8ea1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:36:23 user nova-compute[72362]: DEBUG nova.compute.manager [req-c903f3d9-fcbd-4424-892e-106d42502de7 req-70fb3225-6fbf-40be-8c6d-d9095df84590 service nova] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] No waiting events found dispatching network-vif-plugged-6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:36:23 user nova-compute[72362]: WARNING nova.compute.manager [req-c903f3d9-fcbd-4424-892e-106d42502de7 req-70fb3225-6fbf-40be-8c6d-d9095df84590 service nova] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Received unexpected event network-vif-plugged-6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606 for instance with vm_state building and task_state spawning.
Aug 09 10:36:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:25 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577385.7244, 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:36:25 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] VM Resumed (Lifecycle Event)
Aug 09 10:36:25 user nova-compute[72362]: DEBUG nova.compute.manager [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:36:25 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:36:25 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Instance spawned successfully.
Aug 09 10:36:25 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 10:36:25 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:36:25 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Found default for hw_cdrom_bus of ide {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:36:25 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Found default for hw_disk_bus of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:36:25 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:36:25 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:36:25 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Found default for hw_video_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:36:25 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Found default for hw_vif_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:36:25 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:36:25 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:36:25 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577385.7255478, 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:36:25 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] VM Started (Lifecycle Event)
Aug 09 10:36:25 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:36:25 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:36:25 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:36:25 user nova-compute[72362]: INFO nova.compute.manager [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Took 5.04 seconds to spawn the instance on the hypervisor.
Aug 09 10:36:25 user nova-compute[72362]: DEBUG nova.compute.manager [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:36:25 user nova-compute[72362]: DEBUG nova.compute.manager [req-49f35ac8-f5e2-45be-9c57-d1b1a07a0ed8 req-9cffecae-7048-418a-9e09-61481a2e849e service nova] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Received event network-vif-plugged-6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:36:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-49f35ac8-f5e2-45be-9c57-d1b1a07a0ed8 req-9cffecae-7048-418a-9e09-61481a2e849e service nova] Acquiring lock "1da4edf1-dce6-4411-8494-8c3f7c7b8ea1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:36:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-49f35ac8-f5e2-45be-9c57-d1b1a07a0ed8 req-9cffecae-7048-418a-9e09-61481a2e849e service nova] Lock "1da4edf1-dce6-4411-8494-8c3f7c7b8ea1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:36:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-49f35ac8-f5e2-45be-9c57-d1b1a07a0ed8 req-9cffecae-7048-418a-9e09-61481a2e849e service nova] Lock "1da4edf1-dce6-4411-8494-8c3f7c7b8ea1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:36:25 user nova-compute[72362]: DEBUG nova.compute.manager [req-49f35ac8-f5e2-45be-9c57-d1b1a07a0ed8 req-9cffecae-7048-418a-9e09-61481a2e849e service nova] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] No waiting events found dispatching network-vif-plugged-6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:36:25 user nova-compute[72362]: WARNING nova.compute.manager [req-49f35ac8-f5e2-45be-9c57-d1b1a07a0ed8 req-9cffecae-7048-418a-9e09-61481a2e849e service nova] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Received unexpected event network-vif-plugged-6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606 for instance with vm_state building and task_state spawning.
Aug 09 10:36:25 user nova-compute[72362]: INFO nova.compute.manager [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Took 14.98 seconds to build instance.
Aug 09 10:36:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-05adafe0-ba71-41c2-a3ff-267120da3a03 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "1da4edf1-dce6-4411-8494-8c3f7c7b8ea1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.085s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:36:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3c853dd4-133c-4891-acb0-e16a54368504 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Acquiring lock "fe1804e8-2340-4868-a0ff-32d5df5fad42" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:36:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3c853dd4-133c-4891-acb0-e16a54368504 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Lock "fe1804e8-2340-4868-a0ff-32d5df5fad42" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:36:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3c853dd4-133c-4891-acb0-e16a54368504 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Acquiring lock "fe1804e8-2340-4868-a0ff-32d5df5fad42-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:36:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3c853dd4-133c-4891-acb0-e16a54368504 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Lock "fe1804e8-2340-4868-a0ff-32d5df5fad42-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:36:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3c853dd4-133c-4891-acb0-e16a54368504 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Lock "fe1804e8-2340-4868-a0ff-32d5df5fad42-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:36:27 user nova-compute[72362]: INFO nova.compute.manager [None req-3c853dd4-133c-4891-acb0-e16a54368504 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Terminating instance
Aug 09 10:36:27 user nova-compute[72362]: DEBUG nova.compute.manager [None req-3c853dd4-133c-4891-acb0-e16a54368504 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Start destroying the instance on the hypervisor. {{(pid=72362) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 10:36:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:27 user nova-compute[72362]: DEBUG nova.compute.manager [req-06385d61-7e86-4797-935f-4c8eb640c12b req-3dc1908b-f7ca-49b8-b27d-9bc50393c46a service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Received event network-vif-unplugged-3205c4d7-d431-4127-b2a5-436df06f6c4b {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:36:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-06385d61-7e86-4797-935f-4c8eb640c12b req-3dc1908b-f7ca-49b8-b27d-9bc50393c46a service nova] Acquiring lock "fe1804e8-2340-4868-a0ff-32d5df5fad42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:36:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-06385d61-7e86-4797-935f-4c8eb640c12b req-3dc1908b-f7ca-49b8-b27d-9bc50393c46a service nova] Lock "fe1804e8-2340-4868-a0ff-32d5df5fad42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:36:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-06385d61-7e86-4797-935f-4c8eb640c12b req-3dc1908b-f7ca-49b8-b27d-9bc50393c46a service nova] Lock "fe1804e8-2340-4868-a0ff-32d5df5fad42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:36:27 user nova-compute[72362]: DEBUG nova.compute.manager [req-06385d61-7e86-4797-935f-4c8eb640c12b req-3dc1908b-f7ca-49b8-b27d-9bc50393c46a service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] No waiting events found dispatching network-vif-unplugged-3205c4d7-d431-4127-b2a5-436df06f6c4b {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:36:27 user nova-compute[72362]: DEBUG nova.compute.manager [req-06385d61-7e86-4797-935f-4c8eb640c12b req-3dc1908b-f7ca-49b8-b27d-9bc50393c46a service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Received event network-vif-unplugged-3205c4d7-d431-4127-b2a5-436df06f6c4b for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:36:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:28 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Instance destroyed successfully.
Aug 09 10:36:28 user nova-compute[72362]: DEBUG nova.objects.instance [None req-3c853dd4-133c-4891-acb0-e16a54368504 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Lazy-loading 'resources' on Instance uuid fe1804e8-2340-4868-a0ff-32d5df5fad42 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:36:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-3c853dd4-133c-4891-acb0-e16a54368504 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:29:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1761559357',display_name='tempest-ServerStableDeviceRescueTest-server-1761559357',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1761559357',id=29,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOZ4Oer4n1DnitiHIilXA6F7pKlKFx/n4xsV/PbrQXmR8/0fskSLxaUGxc95Yb6OUuLhpJTUk+XkkpQUm2P/SNRsR8wXFgXI6C9yVCX/oYj9avRwisIFLdeBOydSQ+gRw==',key_name='tempest-keypair-2003538578',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:33:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a7fd45a7ce194cd4bc477f03bdebfe9d',ramdisk_id='',reservation_id='r-0ptipo99',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1616327339',owner_user_name='tempest-ServerStableDeviceRescueTest-1616327339-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:35:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40a78234613d42b4b3dbea339819f3ba',uuid=fe1804e8-2340-4868-a0ff-32d5df5fad42,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3205c4d7-d431-4127-b2a5-436df06f6c4b", "address": "fa:16:3e:44:ae:dc", "network": {"id": "322734db-2e92-4833-85a8-dc059a13b535", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-753064842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7fd45a7ce194cd4bc477f03bdebfe9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3205c4d7-d4", "ovs_interfaceid": "3205c4d7-d431-4127-b2a5-436df06f6c4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:36:28 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-3c853dd4-133c-4891-acb0-e16a54368504 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Converting VIF {"id": "3205c4d7-d431-4127-b2a5-436df06f6c4b", "address": "fa:16:3e:44:ae:dc", "network": {"id": "322734db-2e92-4833-85a8-dc059a13b535", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-753064842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7fd45a7ce194cd4bc477f03bdebfe9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3205c4d7-d4", "ovs_interfaceid": "3205c4d7-d431-4127-b2a5-436df06f6c4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:36:28 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-3c853dd4-133c-4891-acb0-e16a54368504 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:ae:dc,bridge_name='br-int',has_traffic_filtering=True,id=3205c4d7-d431-4127-b2a5-436df06f6c4b,network=Network(322734db-2e92-4833-85a8-dc059a13b535),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3205c4d7-d4') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:36:28 user nova-compute[72362]: DEBUG os_vif [None req-3c853dd4-133c-4891-acb0-e16a54368504 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:ae:dc,bridge_name='br-int',has_traffic_filtering=True,id=3205c4d7-d431-4127-b2a5-436df06f6c4b,network=Network(322734db-2e92-4833-85a8-dc059a13b535),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3205c4d7-d4') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:36:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3205c4d7-d4, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:36:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:36:28 user nova-compute[72362]: INFO os_vif [None req-3c853dd4-133c-4891-acb0-e16a54368504 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:ae:dc,bridge_name='br-int',has_traffic_filtering=True,id=3205c4d7-d431-4127-b2a5-436df06f6c4b,network=Network(322734db-2e92-4833-85a8-dc059a13b535),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3205c4d7-d4')
Aug 09 10:36:28 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-3c853dd4-133c-4891-acb0-e16a54368504 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Deleting instance files /opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42_del
Aug 09 10:36:28 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-3c853dd4-133c-4891-acb0-e16a54368504 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Deletion of /opt/stack/data/nova/instances/fe1804e8-2340-4868-a0ff-32d5df5fad42_del complete
Aug 09 10:36:28 user nova-compute[72362]: INFO nova.compute.manager [None req-3c853dd4-133c-4891-acb0-e16a54368504 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 09 10:36:28 user nova-compute[72362]: DEBUG oslo.service.loopingcall [None req-3c853dd4-133c-4891-acb0-e16a54368504 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72362) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 10:36:28 user nova-compute[72362]: DEBUG nova.compute.manager [-] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Deallocating network for instance {{(pid=72362) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 10:36:28 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] deallocate_for_instance() {{(pid=72362) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 10:36:29 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691577374.0579686, 4b22a19f-300c-42fb-8175-e737eef7d531 => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:36:29 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] VM Stopped (Lifecycle Event)
Aug 09 10:36:29 user nova-compute[72362]: DEBUG nova.compute.manager [None req-960092a8-a084-42d3-a823-4d2bf7bbe042 None None] [instance: 4b22a19f-300c-42fb-8175-e737eef7d531] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:36:29 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:36:29 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Took 1.12 seconds to deallocate network for instance.
Aug 09 10:36:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3c853dd4-133c-4891-acb0-e16a54368504 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:36:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3c853dd4-133c-4891-acb0-e16a54368504 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:36:29 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-3c853dd4-133c-4891-acb0-e16a54368504 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:36:29 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-3c853dd4-133c-4891-acb0-e16a54368504 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:36:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3c853dd4-133c-4891-acb0-e16a54368504 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.252s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:36:29 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-3c853dd4-133c-4891-acb0-e16a54368504 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Deleted allocations for instance fe1804e8-2340-4868-a0ff-32d5df5fad42
Aug 09 10:36:29 user nova-compute[72362]: DEBUG nova.compute.manager [req-81652244-4456-495c-a7e1-d2cbcae4feb4 req-fc1169af-f70e-4832-8c05-3c7ac2e3f990 service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Received event network-vif-plugged-3205c4d7-d431-4127-b2a5-436df06f6c4b {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:36:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-81652244-4456-495c-a7e1-d2cbcae4feb4 req-fc1169af-f70e-4832-8c05-3c7ac2e3f990 service nova] Acquiring lock "fe1804e8-2340-4868-a0ff-32d5df5fad42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:36:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-81652244-4456-495c-a7e1-d2cbcae4feb4 req-fc1169af-f70e-4832-8c05-3c7ac2e3f990 service nova] Lock "fe1804e8-2340-4868-a0ff-32d5df5fad42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:36:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-81652244-4456-495c-a7e1-d2cbcae4feb4 req-fc1169af-f70e-4832-8c05-3c7ac2e3f990 service nova] Lock "fe1804e8-2340-4868-a0ff-32d5df5fad42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:36:29 user nova-compute[72362]: DEBUG nova.compute.manager [req-81652244-4456-495c-a7e1-d2cbcae4feb4 req-fc1169af-f70e-4832-8c05-3c7ac2e3f990 service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] No waiting events found dispatching network-vif-plugged-3205c4d7-d431-4127-b2a5-436df06f6c4b {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:36:29 user nova-compute[72362]: WARNING nova.compute.manager [req-81652244-4456-495c-a7e1-d2cbcae4feb4 req-fc1169af-f70e-4832-8c05-3c7ac2e3f990 service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Received unexpected event network-vif-plugged-3205c4d7-d431-4127-b2a5-436df06f6c4b for instance with vm_state deleted and task_state None.
Aug 09 10:36:29 user nova-compute[72362]: DEBUG nova.compute.manager [req-81652244-4456-495c-a7e1-d2cbcae4feb4 req-fc1169af-f70e-4832-8c05-3c7ac2e3f990 service nova] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Received event network-vif-deleted-3205c4d7-d431-4127-b2a5-436df06f6c4b {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:36:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3c853dd4-133c-4891-acb0-e16a54368504 tempest-ServerStableDeviceRescueTest-1616327339 tempest-ServerStableDeviceRescueTest-1616327339-project-member] Lock "fe1804e8-2340-4868-a0ff-32d5df5fad42" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.424s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:36:31 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d297bdfb-46fb-4bca-95fd-0436b58e2f90 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquiring lock "f3cdf152-da86-447b-aa7c-921b6fa87ef8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:36:31 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d297bdfb-46fb-4bca-95fd-0436b58e2f90 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "f3cdf152-da86-447b-aa7c-921b6fa87ef8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:36:31 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d297bdfb-46fb-4bca-95fd-0436b58e2f90 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquiring lock "f3cdf152-da86-447b-aa7c-921b6fa87ef8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:36:31 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d297bdfb-46fb-4bca-95fd-0436b58e2f90 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "f3cdf152-da86-447b-aa7c-921b6fa87ef8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:36:31 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d297bdfb-46fb-4bca-95fd-0436b58e2f90 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "f3cdf152-da86-447b-aa7c-921b6fa87ef8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:36:31 user nova-compute[72362]: INFO nova.compute.manager [None req-d297bdfb-46fb-4bca-95fd-0436b58e2f90 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Terminating instance
Aug 09 10:36:31 user nova-compute[72362]: DEBUG nova.compute.manager [None req-d297bdfb-46fb-4bca-95fd-0436b58e2f90 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Start destroying the instance on the hypervisor. {{(pid=72362) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 10:36:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:31 user nova-compute[72362]: DEBUG nova.compute.manager [req-cd0207a4-4000-41ad-b187-06a6067d8923 req-a30cb140-dd97-4b0e-a60a-e0bef9795f76 service nova] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Received event network-vif-unplugged-cb4bdd64-bb23-4c96-8912-377268174872 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:36:31 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-cd0207a4-4000-41ad-b187-06a6067d8923 req-a30cb140-dd97-4b0e-a60a-e0bef9795f76 service nova] Acquiring lock "f3cdf152-da86-447b-aa7c-921b6fa87ef8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:36:31 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-cd0207a4-4000-41ad-b187-06a6067d8923 req-a30cb140-dd97-4b0e-a60a-e0bef9795f76 service nova] Lock "f3cdf152-da86-447b-aa7c-921b6fa87ef8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:36:31 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-cd0207a4-4000-41ad-b187-06a6067d8923 req-a30cb140-dd97-4b0e-a60a-e0bef9795f76 service nova] Lock "f3cdf152-da86-447b-aa7c-921b6fa87ef8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:36:31 user nova-compute[72362]: DEBUG nova.compute.manager [req-cd0207a4-4000-41ad-b187-06a6067d8923 req-a30cb140-dd97-4b0e-a60a-e0bef9795f76 service nova] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] No waiting events found dispatching network-vif-unplugged-cb4bdd64-bb23-4c96-8912-377268174872 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:36:31 user nova-compute[72362]: DEBUG nova.compute.manager [req-cd0207a4-4000-41ad-b187-06a6067d8923 req-a30cb140-dd97-4b0e-a60a-e0bef9795f76 service nova] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Received event network-vif-unplugged-cb4bdd64-bb23-4c96-8912-377268174872 for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:36:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:31 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Instance destroyed successfully.
Aug 09 10:36:31 user nova-compute[72362]: DEBUG nova.objects.instance [None req-d297bdfb-46fb-4bca-95fd-0436b58e2f90 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lazy-loading 'resources' on Instance uuid f3cdf152-da86-447b-aa7c-921b6fa87ef8 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:36:31 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-d297bdfb-46fb-4bca-95fd-0436b58e2f90 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:30:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2124446381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2124446381',id=32,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:32:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f206cedc59df46deb91e7ec2167c1f2b',ramdisk_id='',reservation_id='r-fmo0v4k0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1706340435',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:34:45Z,user_data=None,user_id='4a1904ffd10b4e8b959971b5e2383113',uuid=f3cdf152-da86-447b-aa7c-921b6fa87ef8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb4bdd64-bb23-4c96-8912-377268174872", "address": "fa:16:3e:78:c7:96", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4bdd64-bb", "ovs_interfaceid": "cb4bdd64-bb23-4c96-8912-377268174872", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:36:31 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-d297bdfb-46fb-4bca-95fd-0436b58e2f90 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Converting VIF {"id": "cb4bdd64-bb23-4c96-8912-377268174872", "address": "fa:16:3e:78:c7:96", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4bdd64-bb", "ovs_interfaceid": "cb4bdd64-bb23-4c96-8912-377268174872", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:36:31 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-d297bdfb-46fb-4bca-95fd-0436b58e2f90 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:c7:96,bridge_name='br-int',has_traffic_filtering=True,id=cb4bdd64-bb23-4c96-8912-377268174872,network=Network(bb852331-57aa-4911-b8ff-30f5411f65b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb4bdd64-bb') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:36:31 user nova-compute[72362]: DEBUG os_vif [None req-d297bdfb-46fb-4bca-95fd-0436b58e2f90 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:c7:96,bridge_name='br-int',has_traffic_filtering=True,id=cb4bdd64-bb23-4c96-8912-377268174872,network=Network(bb852331-57aa-4911-b8ff-30f5411f65b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb4bdd64-bb') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:36:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb4bdd64-bb, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:36:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:36:31 user nova-compute[72362]: INFO os_vif [None req-d297bdfb-46fb-4bca-95fd-0436b58e2f90 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:c7:96,bridge_name='br-int',has_traffic_filtering=True,id=cb4bdd64-bb23-4c96-8912-377268174872,network=Network(bb852331-57aa-4911-b8ff-30f5411f65b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb4bdd64-bb')
Aug 09 10:36:31 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d297bdfb-46fb-4bca-95fd-0436b58e2f90 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:36:31 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d297bdfb-46fb-4bca-95fd-0436b58e2f90 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tAiBWcaz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:36:31 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-d297bdfb-46fb-4bca-95fd-0436b58e2f90 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:36:31 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-d297bdfb-46fb-4bca-95fd-0436b58e2f90 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:36:31 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-d297bdfb-46fb-4bca-95fd-0436b58e2f90 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:36:31 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d297bdfb-46fb-4bca-95fd-0436b58e2f90 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:36:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:36:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:36:31 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5019b4-8251-462e-8add-4358e6995eda]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:36:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:36:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:36:31 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[392b926f-0e53-4a4b-a698-5e6685206233]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:36:31 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d297bdfb-46fb-4bca-95fd-0436b58e2f90 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:36:31 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:36:31 user nova-compute[72362]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247 (non-flash)
Aug 09 10:36:31 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:36:31 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d297bdfb-46fb-4bca-95fd-0436b58e2f90 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:36:31 user nova-compute[72362]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 (non-flash)
Aug 09 10:36:31 user nova-compute[72362]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247 (non-flash)
Aug 09 10:36:31 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:36:31 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d297bdfb-46fb-4bca-95fd-0436b58e2f90 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e42763b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3'): ({'sdb'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:36:31 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-d297bdfb-46fb-4bca-95fd-0436b58e2f90 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Removing single pathed devices sdb {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:36:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:36:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:36:31 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[66633ff2-0685-4042-a8f0-0c84f34d0051]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:36:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:36:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:36:31 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01d4768-7124-4691-a91d-3eb582779834]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:36:31 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-d297bdfb-46fb-4bca-95fd-0436b58e2f90 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Flushing IO for device /dev/sdb {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:36:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:36:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:36:31 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df38f6a-0f61-4325-a128-918690b9134a]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:36:31 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-d297bdfb-46fb-4bca-95fd-0436b58e2f90 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:36:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:36:32 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:36:32 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[27682c8d-fa7d-4097-97c2-1ccf3028f48b]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:36:32 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-d297bdfb-46fb-4bca-95fd-0436b58e2f90 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:36:32 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-d297bdfb-46fb-4bca-95fd-0436b58e2f90 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] SCSI volumes sdb have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:36:32 user nova-compute[72362]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23566316431643836', '/dev/disk/by-id/scsi-1SCST_BIO5e93ecc7-5f1d1d865053a55b', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_5e93ecc7') {{(pid=84003) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 10:36:32 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[408905e3-987d-4f8f-b9b1-0bbc14ffa302]: (4, None) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:36:32 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d297bdfb-46fb-4bca-95fd-0436b58e2f90 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:36:32 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:36:32 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:36:32 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c906e2-389b-424c-a4a0-a7f5e214e7ff]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:36:32 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d297bdfb-46fb-4bca-95fd-0436b58e2f90 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:36:32 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:36:32 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:36:32 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1337489-87b3-4564-bb12-7b0a2ea32fc1]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:36:32 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d297bdfb-46fb-4bca-95fd-0436b58e2f90 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3, portal: 172.16.0.220,3260]
Aug 09 10:36:32 user nova-compute[72362]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3, portal: 172.16.0.220,3260] successful.
Aug 09 10:36:32 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:36:32 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:36:32 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8bad6bf-95e0-406b-bab8-9e83ebd3f1d3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:36:32 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5918a6bb-23ef-44cc-b967-4f60679db056]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:36:32 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d297bdfb-46fb-4bca-95fd-0436b58e2f90 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:36:32 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-d297bdfb-46fb-4bca-95fd-0436b58e2f90 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:36:32 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d297bdfb-46fb-4bca-95fd-0436b58e2f90 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] <== disconnect_volume: return (308ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:36:32 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d297bdfb-46fb-4bca-95fd-0436b58e2f90 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:36:32 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-d297bdfb-46fb-4bca-95fd-0436b58e2f90 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Deleting instance files /opt/stack/data/nova/instances/f3cdf152-da86-447b-aa7c-921b6fa87ef8_del
Aug 09 10:36:32 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-d297bdfb-46fb-4bca-95fd-0436b58e2f90 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Deletion of /opt/stack/data/nova/instances/f3cdf152-da86-447b-aa7c-921b6fa87ef8_del complete
Aug 09 10:36:32 user nova-compute[72362]: INFO nova.compute.manager [None req-d297bdfb-46fb-4bca-95fd-0436b58e2f90 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Took 1.21 seconds to destroy the instance on the hypervisor.
Aug 09 10:36:32 user nova-compute[72362]: DEBUG oslo.service.loopingcall [None req-d297bdfb-46fb-4bca-95fd-0436b58e2f90 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72362) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 10:36:32 user nova-compute[72362]: DEBUG nova.compute.manager [-] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Deallocating network for instance {{(pid=72362) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 10:36:32 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] deallocate_for_instance() {{(pid=72362) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 10:36:32 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:36:32 user nova-compute[72362]: DEBUG nova.compute.manager [req-dfb0a6c8-a8d0-4ad7-b190-bef9a53bd260 req-661ea3b3-17f1-4265-982c-ab92af31d652 service nova] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Received event network-vif-deleted-cb4bdd64-bb23-4c96-8912-377268174872 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:36:32 user nova-compute[72362]: INFO nova.compute.manager [req-dfb0a6c8-a8d0-4ad7-b190-bef9a53bd260 req-661ea3b3-17f1-4265-982c-ab92af31d652 service nova] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Neutron deleted interface cb4bdd64-bb23-4c96-8912-377268174872; detaching it from the instance and deleting it from the info cache
Aug 09 10:36:32 user nova-compute[72362]: DEBUG nova.network.neutron [req-dfb0a6c8-a8d0-4ad7-b190-bef9a53bd260 req-661ea3b3-17f1-4265-982c-ab92af31d652 service nova] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:36:32 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Took 0.54 seconds to deallocate network for instance.
Aug 09 10:36:32 user nova-compute[72362]: DEBUG nova.compute.manager [req-dfb0a6c8-a8d0-4ad7-b190-bef9a53bd260 req-661ea3b3-17f1-4265-982c-ab92af31d652 service nova] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Detach interface failed, port_id=cb4bdd64-bb23-4c96-8912-377268174872, reason: Instance f3cdf152-da86-447b-aa7c-921b6fa87ef8 could not be found. {{(pid=72362) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 10:36:33 user nova-compute[72362]: DEBUG nova.compute.manager [req-8c82c60a-e70b-48fd-b7cb-4a4801a52131 req-7152f6a7-82ce-4559-8c60-8fe01f6d56c3 service nova] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Received event network-vif-plugged-cb4bdd64-bb23-4c96-8912-377268174872 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:36:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8c82c60a-e70b-48fd-b7cb-4a4801a52131 req-7152f6a7-82ce-4559-8c60-8fe01f6d56c3 service nova] Acquiring lock "f3cdf152-da86-447b-aa7c-921b6fa87ef8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:36:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8c82c60a-e70b-48fd-b7cb-4a4801a52131 req-7152f6a7-82ce-4559-8c60-8fe01f6d56c3 service nova] Lock "f3cdf152-da86-447b-aa7c-921b6fa87ef8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:36:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8c82c60a-e70b-48fd-b7cb-4a4801a52131 req-7152f6a7-82ce-4559-8c60-8fe01f6d56c3 service nova] Lock "f3cdf152-da86-447b-aa7c-921b6fa87ef8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:36:33 user nova-compute[72362]: DEBUG nova.compute.manager [req-8c82c60a-e70b-48fd-b7cb-4a4801a52131 req-7152f6a7-82ce-4559-8c60-8fe01f6d56c3 service nova] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] No waiting events found dispatching network-vif-plugged-cb4bdd64-bb23-4c96-8912-377268174872 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:36:33 user nova-compute[72362]: WARNING nova.compute.manager [req-8c82c60a-e70b-48fd-b7cb-4a4801a52131 req-7152f6a7-82ce-4559-8c60-8fe01f6d56c3 service nova] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Received unexpected event network-vif-plugged-cb4bdd64-bb23-4c96-8912-377268174872 for instance with vm_state active and task_state deleting.
Aug 09 10:36:33 user nova-compute[72362]: INFO nova.compute.manager [None req-d297bdfb-46fb-4bca-95fd-0436b58e2f90 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Took 0.74 seconds to detach 1 volumes for instance.
Aug 09 10:36:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d297bdfb-46fb-4bca-95fd-0436b58e2f90 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:36:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d297bdfb-46fb-4bca-95fd-0436b58e2f90 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:36:33 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-d297bdfb-46fb-4bca-95fd-0436b58e2f90 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:36:33 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-d297bdfb-46fb-4bca-95fd-0436b58e2f90 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:36:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d297bdfb-46fb-4bca-95fd-0436b58e2f90 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.266s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:36:33 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-d297bdfb-46fb-4bca-95fd-0436b58e2f90 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Deleted allocations for instance f3cdf152-da86-447b-aa7c-921b6fa87ef8
Aug 09 10:36:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d297bdfb-46fb-4bca-95fd-0436b58e2f90 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "f3cdf152-da86-447b-aa7c-921b6fa87ef8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.932s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:36:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:43 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691577388.2405553, fe1804e8-2340-4868-a0ff-32d5df5fad42 => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:36:43 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] VM Stopped (Lifecycle Event)
Aug 09 10:36:43 user nova-compute[72362]: DEBUG nova.compute.manager [None req-0b86b468-18d6-46fa-907f-5b346dc6ec96 None None] [instance: fe1804e8-2340-4868-a0ff-32d5df5fad42] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:36:46 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691577391.7827826, f3cdf152-da86-447b-aa7c-921b6fa87ef8 => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:36:46 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] VM Stopped (Lifecycle Event)
Aug 09 10:36:46 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7bb62018-8276-4e54-8549-664e88087c03 None None] [instance: f3cdf152-da86-447b-aa7c-921b6fa87ef8] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:36:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:56 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:36:56 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:01 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:37:03 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:37:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:37:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 10:37:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 10:37:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 10:37:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:06 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:37:06 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:37:06 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 10:37:07 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:37:07 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 10:37:08 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "refresh_cache-f8abc99c-b87b-4586-b9d4-7f5bcda60683" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:37:08 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquired lock "refresh_cache-f8abc99c-b87b-4586-b9d4-7f5bcda60683" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:37:08 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Forcefully refreshing network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 10:37:08 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Updating instance_info_cache with network_info: [{"id": "1415f63e-af2e-4e87-aca2-8b360176adb7", "address": "fa:16:3e:c9:ab:0b", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1415f63e-af", "ovs_interfaceid": "1415f63e-af2e-4e87-aca2-8b360176adb7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:37:08 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Releasing lock "refresh_cache-f8abc99c-b87b-4586-b9d4-7f5bcda60683" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:37:08 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Updated the network info_cache for instance {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 10:37:08 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:37:08 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:37:08 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:37:08 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Cleaning up deleted instances {{(pid=72362) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 10:37:08 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] There are 0 instances to clean {{(pid=72362) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 10:37:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-dee8d29c-42e9-4054-9c94-672c1f4a1eaa tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Acquiring lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:37:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-dee8d29c-42e9-4054-9c94-672c1f4a1eaa tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:37:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-dee8d29c-42e9-4054-9c94-672c1f4a1eaa tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Acquiring lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:37:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-dee8d29c-42e9-4054-9c94-672c1f4a1eaa tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:37:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-dee8d29c-42e9-4054-9c94-672c1f4a1eaa tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:37:09 user nova-compute[72362]: INFO nova.compute.manager [None req-dee8d29c-42e9-4054-9c94-672c1f4a1eaa tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Terminating instance
Aug 09 10:37:09 user nova-compute[72362]: DEBUG nova.compute.manager [None req-dee8d29c-42e9-4054-9c94-672c1f4a1eaa tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Start destroying the instance on the hypervisor. {{(pid=72362) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 10:37:09 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:09 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:09 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:09 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:09 user nova-compute[72362]: DEBUG nova.compute.manager [req-651083cb-6d5e-4d63-8d70-2b75890fc375 req-baee93a7-b942-4794-aa8d-1309ef57820b service nova] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Received event network-vif-unplugged-9735e8ce-a2bd-49c8-adcf-846c05b7427e {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:37:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-651083cb-6d5e-4d63-8d70-2b75890fc375 req-baee93a7-b942-4794-aa8d-1309ef57820b service nova] Acquiring lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:37:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-651083cb-6d5e-4d63-8d70-2b75890fc375 req-baee93a7-b942-4794-aa8d-1309ef57820b service nova] Lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:37:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-651083cb-6d5e-4d63-8d70-2b75890fc375 req-baee93a7-b942-4794-aa8d-1309ef57820b service nova] Lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:37:09 user nova-compute[72362]: DEBUG nova.compute.manager [req-651083cb-6d5e-4d63-8d70-2b75890fc375 req-baee93a7-b942-4794-aa8d-1309ef57820b service nova] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] No waiting events found dispatching network-vif-unplugged-9735e8ce-a2bd-49c8-adcf-846c05b7427e {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:37:09 user nova-compute[72362]: DEBUG nova.compute.manager [req-651083cb-6d5e-4d63-8d70-2b75890fc375 req-baee93a7-b942-4794-aa8d-1309ef57820b service nova] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Received event network-vif-unplugged-9735e8ce-a2bd-49c8-adcf-846c05b7427e for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:37:09 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:37:09 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:37:10 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:10 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:10 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:10 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:10 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Instance destroyed successfully.
Aug 09 10:37:10 user nova-compute[72362]: DEBUG nova.objects.instance [None req-dee8d29c-42e9-4054-9c94-672c1f4a1eaa tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lazy-loading 'resources' on Instance uuid 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:37:10 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-dee8d29c-42e9-4054-9c94-672c1f4a1eaa tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T10:20:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-992323535',display_name='tempest-ServerActionsTestOtherA-server-1403657354',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-992323535',id=15,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwSFF251eQti/qkoXtJtG/hsB95elMyv8iaeRUjgcdf3ZQpb25r9rbEB2fGNjqP3pvOqQxJNR/NqVUD62omNMx/akMv5+i7VAu1R/GqhP2vqtVAvdiRNee4z2ROG7Jd8w==',key_name='tempest-keypair-122703468',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:25:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8ac22022944542c0b52dd912d3dbcce2',ramdisk_id='',reservation_id='r-aza1h2p7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2101881579',owner_user_name='tempest-ServerActionsTestOtherA-2101881579-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:25:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='990e2d160fdc4c599cee9f65d6d4e41d',uuid=3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9735e8ce-a2bd-49c8-adcf-846c05b7427e", "address": "fa:16:3e:91:34:e3", "network": {"id": "e6c54663-74e3-43e2-8f0d-61b300c1f68d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1222286883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ac22022944542c0b52dd912d3dbcce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9735e8ce-a2", "ovs_interfaceid": "9735e8ce-a2bd-49c8-adcf-846c05b7427e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:37:10 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-dee8d29c-42e9-4054-9c94-672c1f4a1eaa tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Converting VIF {"id": "9735e8ce-a2bd-49c8-adcf-846c05b7427e", "address": "fa:16:3e:91:34:e3", "network": {"id": "e6c54663-74e3-43e2-8f0d-61b300c1f68d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1222286883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ac22022944542c0b52dd912d3dbcce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9735e8ce-a2", "ovs_interfaceid": "9735e8ce-a2bd-49c8-adcf-846c05b7427e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:37:10 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-dee8d29c-42e9-4054-9c94-672c1f4a1eaa tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:34:e3,bridge_name='br-int',has_traffic_filtering=True,id=9735e8ce-a2bd-49c8-adcf-846c05b7427e,network=Network(e6c54663-74e3-43e2-8f0d-61b300c1f68d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9735e8ce-a2') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:37:10 user nova-compute[72362]: DEBUG os_vif [None req-dee8d29c-42e9-4054-9c94-672c1f4a1eaa tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:34:e3,bridge_name='br-int',has_traffic_filtering=True,id=9735e8ce-a2bd-49c8-adcf-846c05b7427e,network=Network(e6c54663-74e3-43e2-8f0d-61b300c1f68d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9735e8ce-a2') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:37:10 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:10 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9735e8ce-a2, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:37:10 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:10 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:37:10 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:10 user nova-compute[72362]: INFO os_vif [None req-dee8d29c-42e9-4054-9c94-672c1f4a1eaa tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:34:e3,bridge_name='br-int',has_traffic_filtering=True,id=9735e8ce-a2bd-49c8-adcf-846c05b7427e,network=Network(e6c54663-74e3-43e2-8f0d-61b300c1f68d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9735e8ce-a2')
Aug 09 10:37:10 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-dee8d29c-42e9-4054-9c94-672c1f4a1eaa tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Deleting instance files /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f_del
Aug 09 10:37:10 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-dee8d29c-42e9-4054-9c94-672c1f4a1eaa tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Deletion of /opt/stack/data/nova/instances/3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f_del complete
Aug 09 10:37:10 user nova-compute[72362]: INFO nova.compute.manager [None req-dee8d29c-42e9-4054-9c94-672c1f4a1eaa tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 09 10:37:10 user nova-compute[72362]: DEBUG oslo.service.loopingcall [None req-dee8d29c-42e9-4054-9c94-672c1f4a1eaa tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72362) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 10:37:10 user nova-compute[72362]: DEBUG nova.compute.manager [-] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Deallocating network for instance {{(pid=72362) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 10:37:10 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] deallocate_for_instance() {{(pid=72362) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 10:37:10 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:10 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:10 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:10 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:10 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:11 user nova-compute[72362]: DEBUG nova.compute.manager [req-3a79e9f5-56ba-4310-87b0-17fa6a53ecae req-638818fd-0f24-4fd5-8885-dbc4bd7bcec1 service nova] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Received event network-vif-plugged-9735e8ce-a2bd-49c8-adcf-846c05b7427e {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:37:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3a79e9f5-56ba-4310-87b0-17fa6a53ecae req-638818fd-0f24-4fd5-8885-dbc4bd7bcec1 service nova] Acquiring lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:37:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3a79e9f5-56ba-4310-87b0-17fa6a53ecae req-638818fd-0f24-4fd5-8885-dbc4bd7bcec1 service nova] Lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:37:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3a79e9f5-56ba-4310-87b0-17fa6a53ecae req-638818fd-0f24-4fd5-8885-dbc4bd7bcec1 service nova] Lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:37:11 user nova-compute[72362]: DEBUG nova.compute.manager [req-3a79e9f5-56ba-4310-87b0-17fa6a53ecae req-638818fd-0f24-4fd5-8885-dbc4bd7bcec1 service nova] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] No waiting events found dispatching network-vif-plugged-9735e8ce-a2bd-49c8-adcf-846c05b7427e {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:37:11 user nova-compute[72362]: WARNING nova.compute.manager [req-3a79e9f5-56ba-4310-87b0-17fa6a53ecae req-638818fd-0f24-4fd5-8885-dbc4bd7bcec1 service nova] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Received unexpected event network-vif-plugged-9735e8ce-a2bd-49c8-adcf-846c05b7427e for instance with vm_state active and task_state deleting.
Aug 09 10:37:11 user nova-compute[72362]: DEBUG nova.compute.manager [req-3a79e9f5-56ba-4310-87b0-17fa6a53ecae req-638818fd-0f24-4fd5-8885-dbc4bd7bcec1 service nova] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Received event network-vif-plugged-9735e8ce-a2bd-49c8-adcf-846c05b7427e {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:37:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3a79e9f5-56ba-4310-87b0-17fa6a53ecae req-638818fd-0f24-4fd5-8885-dbc4bd7bcec1 service nova] Acquiring lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:37:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3a79e9f5-56ba-4310-87b0-17fa6a53ecae req-638818fd-0f24-4fd5-8885-dbc4bd7bcec1 service nova] Lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:37:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3a79e9f5-56ba-4310-87b0-17fa6a53ecae req-638818fd-0f24-4fd5-8885-dbc4bd7bcec1 service nova] Lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:37:11 user nova-compute[72362]: DEBUG nova.compute.manager [req-3a79e9f5-56ba-4310-87b0-17fa6a53ecae req-638818fd-0f24-4fd5-8885-dbc4bd7bcec1 service nova] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] No waiting events found dispatching network-vif-plugged-9735e8ce-a2bd-49c8-adcf-846c05b7427e {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:37:11 user nova-compute[72362]: WARNING nova.compute.manager [req-3a79e9f5-56ba-4310-87b0-17fa6a53ecae req-638818fd-0f24-4fd5-8885-dbc4bd7bcec1 service nova] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Received unexpected event network-vif-plugged-9735e8ce-a2bd-49c8-adcf-846c05b7427e for instance with vm_state active and task_state deleting.
Aug 09 10:37:11 user nova-compute[72362]: DEBUG nova.compute.manager [req-3a79e9f5-56ba-4310-87b0-17fa6a53ecae req-638818fd-0f24-4fd5-8885-dbc4bd7bcec1 service nova] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Received event network-vif-plugged-9735e8ce-a2bd-49c8-adcf-846c05b7427e {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:37:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3a79e9f5-56ba-4310-87b0-17fa6a53ecae req-638818fd-0f24-4fd5-8885-dbc4bd7bcec1 service nova] Acquiring lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:37:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3a79e9f5-56ba-4310-87b0-17fa6a53ecae req-638818fd-0f24-4fd5-8885-dbc4bd7bcec1 service nova] Lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:37:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3a79e9f5-56ba-4310-87b0-17fa6a53ecae req-638818fd-0f24-4fd5-8885-dbc4bd7bcec1 service nova] Lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:37:11 user nova-compute[72362]: DEBUG nova.compute.manager [req-3a79e9f5-56ba-4310-87b0-17fa6a53ecae req-638818fd-0f24-4fd5-8885-dbc4bd7bcec1 service nova] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] No waiting events found dispatching network-vif-plugged-9735e8ce-a2bd-49c8-adcf-846c05b7427e {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:37:11 user nova-compute[72362]: WARNING nova.compute.manager [req-3a79e9f5-56ba-4310-87b0-17fa6a53ecae req-638818fd-0f24-4fd5-8885-dbc4bd7bcec1 service nova] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Received unexpected event network-vif-plugged-9735e8ce-a2bd-49c8-adcf-846c05b7427e for instance with vm_state active and task_state deleting.
Aug 09 10:37:11 user nova-compute[72362]: DEBUG nova.compute.manager [req-3a79e9f5-56ba-4310-87b0-17fa6a53ecae req-638818fd-0f24-4fd5-8885-dbc4bd7bcec1 service nova] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Received event network-vif-unplugged-9735e8ce-a2bd-49c8-adcf-846c05b7427e {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:37:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3a79e9f5-56ba-4310-87b0-17fa6a53ecae req-638818fd-0f24-4fd5-8885-dbc4bd7bcec1 service nova] Acquiring lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:37:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3a79e9f5-56ba-4310-87b0-17fa6a53ecae req-638818fd-0f24-4fd5-8885-dbc4bd7bcec1 service nova] Lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:37:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3a79e9f5-56ba-4310-87b0-17fa6a53ecae req-638818fd-0f24-4fd5-8885-dbc4bd7bcec1 service nova] Lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:37:11 user nova-compute[72362]: DEBUG nova.compute.manager [req-3a79e9f5-56ba-4310-87b0-17fa6a53ecae req-638818fd-0f24-4fd5-8885-dbc4bd7bcec1 service nova] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] No waiting events found dispatching network-vif-unplugged-9735e8ce-a2bd-49c8-adcf-846c05b7427e {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:37:11 user nova-compute[72362]: DEBUG nova.compute.manager [req-3a79e9f5-56ba-4310-87b0-17fa6a53ecae req-638818fd-0f24-4fd5-8885-dbc4bd7bcec1 service nova] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Received event network-vif-unplugged-9735e8ce-a2bd-49c8-adcf-846c05b7427e for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:37:12 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:37:12 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Took 2.09 seconds to deallocate network for instance.
Aug 09 10:37:12 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-dee8d29c-42e9-4054-9c94-672c1f4a1eaa tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:37:12 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-dee8d29c-42e9-4054-9c94-672c1f4a1eaa tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:37:12 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-dee8d29c-42e9-4054-9c94-672c1f4a1eaa tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:37:12 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-dee8d29c-42e9-4054-9c94-672c1f4a1eaa tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:37:12 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-dee8d29c-42e9-4054-9c94-672c1f4a1eaa tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.371s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:37:12 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-dee8d29c-42e9-4054-9c94-672c1f4a1eaa tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Deleted allocations for instance 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f
Aug 09 10:37:12 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-dee8d29c-42e9-4054-9c94-672c1f4a1eaa tempest-ServerActionsTestOtherA-2101881579 tempest-ServerActionsTestOtherA-2101881579-project-member] Lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.565s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:37:13 user nova-compute[72362]: DEBUG nova.compute.manager [req-7fc31d01-67f1-46bd-9103-5616a2156f9b req-5da7735d-d796-464b-be1d-b7fe0560be8d service nova] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Received event network-vif-plugged-9735e8ce-a2bd-49c8-adcf-846c05b7427e {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:37:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-7fc31d01-67f1-46bd-9103-5616a2156f9b req-5da7735d-d796-464b-be1d-b7fe0560be8d service nova] Acquiring lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:37:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-7fc31d01-67f1-46bd-9103-5616a2156f9b req-5da7735d-d796-464b-be1d-b7fe0560be8d service nova] Lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:37:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-7fc31d01-67f1-46bd-9103-5616a2156f9b req-5da7735d-d796-464b-be1d-b7fe0560be8d service nova] Lock "3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:37:13 user nova-compute[72362]: DEBUG nova.compute.manager [req-7fc31d01-67f1-46bd-9103-5616a2156f9b req-5da7735d-d796-464b-be1d-b7fe0560be8d service nova] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] No waiting events found dispatching network-vif-plugged-9735e8ce-a2bd-49c8-adcf-846c05b7427e {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:37:13 user nova-compute[72362]: WARNING nova.compute.manager [req-7fc31d01-67f1-46bd-9103-5616a2156f9b req-5da7735d-d796-464b-be1d-b7fe0560be8d service nova] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Received unexpected event network-vif-plugged-9735e8ce-a2bd-49c8-adcf-846c05b7427e for instance with vm_state deleted and task_state None.
Aug 09 10:37:13 user nova-compute[72362]: DEBUG nova.compute.manager [req-7fc31d01-67f1-46bd-9103-5616a2156f9b req-5da7735d-d796-464b-be1d-b7fe0560be8d service nova] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Received event network-vif-deleted-9735e8ce-a2bd-49c8-adcf-846c05b7427e {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:37:15 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:18 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:18 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:37:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:37:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:37:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:37:19 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 10:37:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:37:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:37:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:37:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:37:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be231c58-3e84-4b0f-bbbd-c44246954c47/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:37:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be231c58-3e84-4b0f-bbbd-c44246954c47/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:37:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be231c58-3e84-4b0f-bbbd-c44246954c47/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:37:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be231c58-3e84-4b0f-bbbd-c44246954c47/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:37:19 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:37:19 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:37:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:37:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:37:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:37:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:37:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:20 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:37:20 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:37:20 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=8302MB free_disk=24.998512268066406GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 10:37:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:37:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:37:20 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 8e055c58-a365-4f18-a6e3-377e32e2189d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:37:20 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 30213e67-6b1d-4d97-a971-1544335d02fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:37:20 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance f8abc99c-b87b-4586-b9d4-7f5bcda60683 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:37:20 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance be231c58-3e84-4b0f-bbbd-c44246954c47 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:37:20 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:37:20 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 10:37:20 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 10:37:20 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Refreshing inventories for resource provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 10:37:20 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Updating ProviderTree inventory for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 10:37:20 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Updating inventory in ProviderTree for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 10:37:20 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Refreshing aggregate associations for resource provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d, aggregates: None {{(pid=72362) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 10:37:20 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Refreshing trait associations for resource provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE41,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=72362) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 10:37:20 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:37:20 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:37:20 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 10:37:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.481s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:37:21 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b280c9b4-4baf-4ac9-97f4-7f844c1f46da tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquiring lock "f8abc99c-b87b-4586-b9d4-7f5bcda60683" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:37:21 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b280c9b4-4baf-4ac9-97f4-7f844c1f46da tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "f8abc99c-b87b-4586-b9d4-7f5bcda60683" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:37:21 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b280c9b4-4baf-4ac9-97f4-7f844c1f46da tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquiring lock "f8abc99c-b87b-4586-b9d4-7f5bcda60683-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:37:21 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b280c9b4-4baf-4ac9-97f4-7f844c1f46da tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "f8abc99c-b87b-4586-b9d4-7f5bcda60683-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:37:21 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b280c9b4-4baf-4ac9-97f4-7f844c1f46da tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "f8abc99c-b87b-4586-b9d4-7f5bcda60683-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:37:21 user nova-compute[72362]: INFO nova.compute.manager [None req-b280c9b4-4baf-4ac9-97f4-7f844c1f46da tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Terminating instance
Aug 09 10:37:21 user nova-compute[72362]: DEBUG nova.compute.manager [None req-b280c9b4-4baf-4ac9-97f4-7f844c1f46da tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Start destroying the instance on the hypervisor. {{(pid=72362) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 10:37:21 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:21 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:22 user nova-compute[72362]: DEBUG nova.compute.manager [req-62036c5b-9bef-4411-b78b-96062f1464ce req-32b87d53-e135-401e-a749-57b49a4ef07c service nova] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Received event network-vif-unplugged-1415f63e-af2e-4e87-aca2-8b360176adb7 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:37:22 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-62036c5b-9bef-4411-b78b-96062f1464ce req-32b87d53-e135-401e-a749-57b49a4ef07c service nova] Acquiring lock "f8abc99c-b87b-4586-b9d4-7f5bcda60683-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:37:22 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-62036c5b-9bef-4411-b78b-96062f1464ce req-32b87d53-e135-401e-a749-57b49a4ef07c service nova] Lock "f8abc99c-b87b-4586-b9d4-7f5bcda60683-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:37:22 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-62036c5b-9bef-4411-b78b-96062f1464ce req-32b87d53-e135-401e-a749-57b49a4ef07c service nova] Lock "f8abc99c-b87b-4586-b9d4-7f5bcda60683-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:37:22 user nova-compute[72362]: DEBUG nova.compute.manager [req-62036c5b-9bef-4411-b78b-96062f1464ce req-32b87d53-e135-401e-a749-57b49a4ef07c service nova] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] No waiting events found dispatching network-vif-unplugged-1415f63e-af2e-4e87-aca2-8b360176adb7 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:37:22 user nova-compute[72362]: DEBUG nova.compute.manager [req-62036c5b-9bef-4411-b78b-96062f1464ce req-32b87d53-e135-401e-a749-57b49a4ef07c service nova] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Received event network-vif-unplugged-1415f63e-af2e-4e87-aca2-8b360176adb7 for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:37:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:22 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Instance destroyed successfully.
Aug 09 10:37:22 user nova-compute[72362]: DEBUG nova.objects.instance [None req-b280c9b4-4baf-4ac9-97f4-7f844c1f46da tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lazy-loading 'resources' on Instance uuid f8abc99c-b87b-4586-b9d4-7f5bcda60683 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:37:22 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-b280c9b4-4baf-4ac9-97f4-7f844c1f46da tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:27:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1593462953',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1593462953',id=27,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:28:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f206cedc59df46deb91e7ec2167c1f2b',ramdisk_id='',reservation_id='r-xyl8w71h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1706340435',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:29:56Z,user_data=None,user_id='4a1904ffd10b4e8b959971b5e2383113',uuid=f8abc99c-b87b-4586-b9d4-7f5bcda60683,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1415f63e-af2e-4e87-aca2-8b360176adb7", "address": "fa:16:3e:c9:ab:0b", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1415f63e-af", "ovs_interfaceid": "1415f63e-af2e-4e87-aca2-8b360176adb7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:37:22 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-b280c9b4-4baf-4ac9-97f4-7f844c1f46da tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Converting VIF {"id": "1415f63e-af2e-4e87-aca2-8b360176adb7", "address": "fa:16:3e:c9:ab:0b", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1415f63e-af", "ovs_interfaceid": "1415f63e-af2e-4e87-aca2-8b360176adb7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:37:22 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-b280c9b4-4baf-4ac9-97f4-7f844c1f46da tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:ab:0b,bridge_name='br-int',has_traffic_filtering=True,id=1415f63e-af2e-4e87-aca2-8b360176adb7,network=Network(bb852331-57aa-4911-b8ff-30f5411f65b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1415f63e-af') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:37:22 user nova-compute[72362]: DEBUG os_vif [None req-b280c9b4-4baf-4ac9-97f4-7f844c1f46da tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:ab:0b,bridge_name='br-int',has_traffic_filtering=True,id=1415f63e-af2e-4e87-aca2-8b360176adb7,network=Network(bb852331-57aa-4911-b8ff-30f5411f65b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1415f63e-af') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:37:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1415f63e-af, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:37:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:37:22 user nova-compute[72362]: INFO os_vif [None req-b280c9b4-4baf-4ac9-97f4-7f844c1f46da tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:ab:0b,bridge_name='br-int',has_traffic_filtering=True,id=1415f63e-af2e-4e87-aca2-8b360176adb7,network=Network(bb852331-57aa-4911-b8ff-30f5411f65b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1415f63e-af')
Aug 09 10:37:22 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-b280c9b4-4baf-4ac9-97f4-7f844c1f46da tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Deleting instance files /opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683_del
Aug 09 10:37:22 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-b280c9b4-4baf-4ac9-97f4-7f844c1f46da tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Deletion of /opt/stack/data/nova/instances/f8abc99c-b87b-4586-b9d4-7f5bcda60683_del complete
Aug 09 10:37:22 user nova-compute[72362]: INFO nova.compute.manager [None req-b280c9b4-4baf-4ac9-97f4-7f844c1f46da tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Took 0.65 seconds to destroy the instance on the hypervisor.
Aug 09 10:37:22 user nova-compute[72362]: DEBUG oslo.service.loopingcall [None req-b280c9b4-4baf-4ac9-97f4-7f844c1f46da tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72362) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 10:37:22 user nova-compute[72362]: DEBUG nova.compute.manager [-] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Deallocating network for instance {{(pid=72362) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 10:37:22 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] deallocate_for_instance() {{(pid=72362) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 10:37:23 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:37:23 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Took 0.53 seconds to deallocate network for instance.
Aug 09 10:37:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b280c9b4-4baf-4ac9-97f4-7f844c1f46da tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:37:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b280c9b4-4baf-4ac9-97f4-7f844c1f46da tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:37:23 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-b280c9b4-4baf-4ac9-97f4-7f844c1f46da tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:37:23 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-b280c9b4-4baf-4ac9-97f4-7f844c1f46da tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:37:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b280c9b4-4baf-4ac9-97f4-7f844c1f46da tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.208s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:37:23 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-b280c9b4-4baf-4ac9-97f4-7f844c1f46da tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Deleted allocations for instance f8abc99c-b87b-4586-b9d4-7f5bcda60683
Aug 09 10:37:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b280c9b4-4baf-4ac9-97f4-7f844c1f46da tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "f8abc99c-b87b-4586-b9d4-7f5bcda60683" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.621s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:37:23 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:37:23 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72362) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 10:37:24 user nova-compute[72362]: DEBUG nova.compute.manager [req-d96ad115-7657-4999-9f9d-7c8c138515a0 req-4779f7e9-c2a0-44c1-be6b-7a32126cffbd service nova] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Received event network-vif-plugged-1415f63e-af2e-4e87-aca2-8b360176adb7 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:37:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-d96ad115-7657-4999-9f9d-7c8c138515a0 req-4779f7e9-c2a0-44c1-be6b-7a32126cffbd service nova] Acquiring lock "f8abc99c-b87b-4586-b9d4-7f5bcda60683-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:37:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-d96ad115-7657-4999-9f9d-7c8c138515a0 req-4779f7e9-c2a0-44c1-be6b-7a32126cffbd service nova] Lock "f8abc99c-b87b-4586-b9d4-7f5bcda60683-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:37:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-d96ad115-7657-4999-9f9d-7c8c138515a0 req-4779f7e9-c2a0-44c1-be6b-7a32126cffbd service nova] Lock "f8abc99c-b87b-4586-b9d4-7f5bcda60683-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:37:24 user nova-compute[72362]: DEBUG nova.compute.manager [req-d96ad115-7657-4999-9f9d-7c8c138515a0 req-4779f7e9-c2a0-44c1-be6b-7a32126cffbd service nova] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] No waiting events found dispatching network-vif-plugged-1415f63e-af2e-4e87-aca2-8b360176adb7 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:37:24 user nova-compute[72362]: WARNING nova.compute.manager [req-d96ad115-7657-4999-9f9d-7c8c138515a0 req-4779f7e9-c2a0-44c1-be6b-7a32126cffbd service nova] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Received unexpected event network-vif-plugged-1415f63e-af2e-4e87-aca2-8b360176adb7 for instance with vm_state deleted and task_state None.
Aug 09 10:37:24 user nova-compute[72362]: DEBUG nova.compute.manager [req-d96ad115-7657-4999-9f9d-7c8c138515a0 req-4779f7e9-c2a0-44c1-be6b-7a32126cffbd service nova] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Received event network-vif-deleted-1415f63e-af2e-4e87-aca2-8b360176adb7 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:37:25 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691577430.1607888, 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:37:25 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] VM Stopped (Lifecycle Event)
Aug 09 10:37:25 user nova-compute[72362]: DEBUG nova.compute.manager [None req-5be15baf-1594-4193-8506-417afef7ec82 None None] [instance: 3a4abe02-1ebf-4e3a-9d6d-c9ecc625d59f] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:37:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:37:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:35 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Acquiring lock "cefe383b-978f-4391-baf6-3b3ad17e0083" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:37:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "cefe383b-978f-4391-baf6-3b3ad17e0083" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:37:36 user nova-compute[72362]: DEBUG nova.compute.manager [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Starting instance... {{(pid=72362) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 10:37:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:37:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:37:36 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:37:36 user nova-compute[72362]: INFO nova.compute.claims [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Claim successful on node user
Aug 09 10:37:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:37 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:37:37 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:37:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.278s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:37:37 user nova-compute[72362]: DEBUG nova.compute.manager [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Start building networks asynchronously for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 10:37:37 user nova-compute[72362]: DEBUG nova.compute.manager [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Allocating IP information in the background. {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 10:37:37 user nova-compute[72362]: DEBUG nova.network.neutron [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] allocate_for_instance() {{(pid=72362) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 10:37:37 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 10:37:37 user nova-compute[72362]: DEBUG nova.compute.manager [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Start building block device mappings for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 10:37:37 user nova-compute[72362]: DEBUG nova.policy [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1f5cb1727c864652a6873a38ec1f7bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac17209f912a4f248dd642be32a75ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72362) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 10:37:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Acquiring lock "4296ca4c-1e3e-474f-98ba-9f947d333b8d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:37:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "4296ca4c-1e3e-474f-98ba-9f947d333b8d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:37:37 user nova-compute[72362]: DEBUG nova.compute.manager [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Starting instance... {{(pid=72362) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 10:37:37 user nova-compute[72362]: DEBUG nova.compute.manager [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Start spawning the instance on the hypervisor. {{(pid=72362) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 10:37:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:37:37 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Creating image(s)
Aug 09 10:37:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Acquiring lock "/opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:37:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "/opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:37:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "/opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:37:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:37:37 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691577442.4383805, f8abc99c-b87b-4586-b9d4-7f5bcda60683 => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:37:37 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] VM Stopped (Lifecycle Event)
Aug 09 10:37:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:37:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:37:37 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:37:37 user nova-compute[72362]: INFO nova.compute.claims [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Claim successful on node user
Aug 09 10:37:37 user nova-compute[72362]: DEBUG nova.compute.manager [None req-c02d9deb-f3e1-453f-9a06-bd3126ceecb6 None None] [instance: f8abc99c-b87b-4586-b9d4-7f5bcda60683] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:37:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.149s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:37:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Acquiring lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:37:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:37:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:37:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.149s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:37:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk 1073741824 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:37:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk 1073741824" returned: 0 in 0.060s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:37:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:37:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:37:37 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:37:37 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:37:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.147s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:37:37 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk. size=1073741824 {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 10:37:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:37:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.472s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:37:37 user nova-compute[72362]: DEBUG nova.compute.manager [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Start building networks asynchronously for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 10:37:38 user nova-compute[72362]: DEBUG nova.compute.manager [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Allocating IP information in the background. {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 10:37:38 user nova-compute[72362]: DEBUG nova.network.neutron [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] allocate_for_instance() {{(pid=72362) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 10:37:38 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 10:37:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:37:38 user nova-compute[72362]: DEBUG nova.network.neutron [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Successfully created port: 1d14bbdf-8802-42b5-bd22-c6bd03a53761 {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:37:38 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Cannot resize image /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk to a smaller size. {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 10:37:38 user nova-compute[72362]: DEBUG nova.objects.instance [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lazy-loading 'migration_context' on Instance uuid cefe383b-978f-4391-baf6-3b3ad17e0083 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:37:38 user nova-compute[72362]: DEBUG nova.compute.manager [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Start building block device mappings for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 10:37:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Created local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 10:37:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Ensure instance console log exists: /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:37:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:37:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:37:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:37:38 user nova-compute[72362]: DEBUG nova.policy [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1f5cb1727c864652a6873a38ec1f7bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac17209f912a4f248dd642be32a75ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72362) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 10:37:38 user nova-compute[72362]: DEBUG nova.compute.manager [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Start spawning the instance on the hypervisor. {{(pid=72362) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 10:37:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:37:38 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Creating image(s)
Aug 09 10:37:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Acquiring lock "/opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:37:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "/opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:37:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "/opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:37:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:37:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.141s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:37:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Acquiring lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:37:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:37:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:37:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.133s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:37:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk 1073741824 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:37:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk 1073741824" returned: 0 in 0.065s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:37:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:37:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:37:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.182s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:37:38 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk. size=1073741824 {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 10:37:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:37:38 user nova-compute[72362]: DEBUG nova.network.neutron [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Successfully created port: 434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9 {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:37:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:37:38 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Cannot resize image /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk to a smaller size. {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 10:37:38 user nova-compute[72362]: DEBUG nova.objects.instance [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lazy-loading 'migration_context' on Instance uuid 4296ca4c-1e3e-474f-98ba-9f947d333b8d {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:37:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Created local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 10:37:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Ensure instance console log exists: /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:37:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:37:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:37:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:37:38 user nova-compute[72362]: DEBUG nova.network.neutron [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Successfully updated port: 1d14bbdf-8802-42b5-bd22-c6bd03a53761 {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Acquiring lock "refresh_cache-cefe383b-978f-4391-baf6-3b3ad17e0083" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Acquired lock "refresh_cache-cefe383b-978f-4391-baf6-3b3ad17e0083" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG nova.network.neutron [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG nova.compute.manager [req-d402ba14-4695-413a-9276-45be91e7c1e6 req-2dff7ccc-55fa-47f9-bafc-9b0573a0fad3 service nova] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Received event network-changed-1d14bbdf-8802-42b5-bd22-c6bd03a53761 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG nova.compute.manager [req-d402ba14-4695-413a-9276-45be91e7c1e6 req-2dff7ccc-55fa-47f9-bafc-9b0573a0fad3 service nova] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Refreshing instance network info cache due to event network-changed-1d14bbdf-8802-42b5-bd22-c6bd03a53761. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-d402ba14-4695-413a-9276-45be91e7c1e6 req-2dff7ccc-55fa-47f9-bafc-9b0573a0fad3 service nova] Acquiring lock "refresh_cache-cefe383b-978f-4391-baf6-3b3ad17e0083" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG nova.network.neutron [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG nova.network.neutron [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Updating instance_info_cache with network_info: [{"id": "1d14bbdf-8802-42b5-bd22-c6bd03a53761", "address": "fa:16:3e:fe:ee:4f", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d14bbdf-88", "ovs_interfaceid": "1d14bbdf-8802-42b5-bd22-c6bd03a53761", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Releasing lock "refresh_cache-cefe383b-978f-4391-baf6-3b3ad17e0083" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG nova.compute.manager [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Instance network_info: |[{"id": "1d14bbdf-8802-42b5-bd22-c6bd03a53761", "address": "fa:16:3e:fe:ee:4f", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d14bbdf-88", "ovs_interfaceid": "1d14bbdf-8802-42b5-bd22-c6bd03a53761", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-d402ba14-4695-413a-9276-45be91e7c1e6 req-2dff7ccc-55fa-47f9-bafc-9b0573a0fad3 service nova] Acquired lock "refresh_cache-cefe383b-978f-4391-baf6-3b3ad17e0083" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG nova.network.neutron [req-d402ba14-4695-413a-9276-45be91e7c1e6 req-2dff7ccc-55fa-47f9-bafc-9b0573a0fad3 service nova] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Refreshing network info cache for port 1d14bbdf-8802-42b5-bd22-c6bd03a53761 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Start _get_guest_xml network_info=[{"id": "1d14bbdf-8802-42b5-bd22-c6bd03a53761", "address": "fa:16:3e:fe:ee:4f", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d14bbdf-88", "ovs_interfaceid": "1d14bbdf-8802-42b5-bd22-c6bd03a53761", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': 'a08d1a11-49eb-4212-a351-e11ee9553b95'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:37:39 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:37:39 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:37:39 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:37:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1691599130',display_name='tempest-ServerRescueNegativeTestJSON-server-1691599130',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1691599130',id=38,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac17209f912a4f248dd642be32a75ede',ramdisk_id='',reservation_id='r-ofb1zx0f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1453574557',owner_user_name='tempest-ServerRescueNegativeTestJSON-1453574557-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:37:37Z,user_data=None,user_id='1f5cb1727c864652a6873a38ec1f7bf7',uuid=cefe383b-978f-4391-baf6-3b3ad17e0083,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d14bbdf-8802-42b5-bd22-c6bd03a53761", "address": "fa:16:3e:fe:ee:4f", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d14bbdf-88", "ovs_interfaceid": "1d14bbdf-8802-42b5-bd22-c6bd03a53761", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Converting VIF {"id": "1d14bbdf-8802-42b5-bd22-c6bd03a53761", "address": "fa:16:3e:fe:ee:4f", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d14bbdf-88", "ovs_interfaceid": "1d14bbdf-8802-42b5-bd22-c6bd03a53761", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:ee:4f,bridge_name='br-int',has_traffic_filtering=True,id=1d14bbdf-8802-42b5-bd22-c6bd03a53761,network=Network(2f70b9cc-bc8f-46d8-9633-542cd881c89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d14bbdf-88') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG nova.objects.instance [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lazy-loading 'pci_devices' on Instance uuid cefe383b-978f-4391-baf6-3b3ad17e0083 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:37:39 user nova-compute[72362]:   <uuid>cefe383b-978f-4391-baf6-3b3ad17e0083</uuid>
Aug 09 10:37:39 user nova-compute[72362]:   <name>instance-00000026</name>
Aug 09 10:37:39 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:37:39 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:37:39 user nova-compute[72362]:   <metadata>
Aug 09 10:37:39 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:37:39 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:37:39 user nova-compute[72362]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1691599130</nova:name>
Aug 09 10:37:39 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:37:39</nova:creationTime>
Aug 09 10:37:39 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:37:39 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:37:39 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:37:39 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:37:39 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:37:39 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:37:39 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:37:39 user nova-compute[72362]:       <nova:owner>
Aug 09 10:37:39 user nova-compute[72362]:         <nova:user uuid="1f5cb1727c864652a6873a38ec1f7bf7">tempest-ServerRescueNegativeTestJSON-1453574557-project-member</nova:user>
Aug 09 10:37:39 user nova-compute[72362]:         <nova:project uuid="ac17209f912a4f248dd642be32a75ede">tempest-ServerRescueNegativeTestJSON-1453574557</nova:project>
Aug 09 10:37:39 user nova-compute[72362]:       </nova:owner>
Aug 09 10:37:39 user nova-compute[72362]:       <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:37:39 user nova-compute[72362]:       <nova:ports>
Aug 09 10:37:39 user nova-compute[72362]:         <nova:port uuid="1d14bbdf-8802-42b5-bd22-c6bd03a53761">
Aug 09 10:37:39 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 09 10:37:39 user nova-compute[72362]:         </nova:port>
Aug 09 10:37:39 user nova-compute[72362]:       </nova:ports>
Aug 09 10:37:39 user nova-compute[72362]:     </nova:instance>
Aug 09 10:37:39 user nova-compute[72362]:   </metadata>
Aug 09 10:37:39 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:37:39 user nova-compute[72362]:     <system>
Aug 09 10:37:39 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:37:39 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:37:39 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:37:39 user nova-compute[72362]:       <entry name="serial">cefe383b-978f-4391-baf6-3b3ad17e0083</entry>
Aug 09 10:37:39 user nova-compute[72362]:       <entry name="uuid">cefe383b-978f-4391-baf6-3b3ad17e0083</entry>
Aug 09 10:37:39 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:37:39 user nova-compute[72362]:     </system>
Aug 09 10:37:39 user nova-compute[72362]:   </sysinfo>
Aug 09 10:37:39 user nova-compute[72362]:   <os>
Aug 09 10:37:39 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:37:39 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:37:39 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:37:39 user nova-compute[72362]:   </os>
Aug 09 10:37:39 user nova-compute[72362]:   <features>
Aug 09 10:37:39 user nova-compute[72362]:     <acpi/>
Aug 09 10:37:39 user nova-compute[72362]:     <apic/>
Aug 09 10:37:39 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:37:39 user nova-compute[72362]:   </features>
Aug 09 10:37:39 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:37:39 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:37:39 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:37:39 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:37:39 user nova-compute[72362]:   </clock>
Aug 09 10:37:39 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:37:39 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:37:39 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:37:39 user nova-compute[72362]:   </cpu>
Aug 09 10:37:39 user nova-compute[72362]:   <devices>
Aug 09 10:37:39 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:37:39 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:37:39 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk"/>
Aug 09 10:37:39 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:37:39 user nova-compute[72362]:     </disk>
Aug 09 10:37:39 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:37:39 user nova-compute[72362]:       <mac address="fa:16:3e:fe:ee:4f"/>
Aug 09 10:37:39 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:37:39 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:37:39 user nova-compute[72362]:       <target dev="tap1d14bbdf-88"/>
Aug 09 10:37:39 user nova-compute[72362]:     </interface>
Aug 09 10:37:39 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:37:39 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/console.log" append="off"/>
Aug 09 10:37:39 user nova-compute[72362]:     </serial>
Aug 09 10:37:39 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:37:39 user nova-compute[72362]:     <video>
Aug 09 10:37:39 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:37:39 user nova-compute[72362]:     </video>
Aug 09 10:37:39 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:37:39 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:37:39 user nova-compute[72362]:     </rng>
Aug 09 10:37:39 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:37:39 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:37:39 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:37:39 user nova-compute[72362]:     </memballoon>
Aug 09 10:37:39 user nova-compute[72362]:   </devices>
Aug 09 10:37:39 user nova-compute[72362]: </domain>
Aug 09 10:37:39 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:37:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1691599130',display_name='tempest-ServerRescueNegativeTestJSON-server-1691599130',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1691599130',id=38,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac17209f912a4f248dd642be32a75ede',ramdisk_id='',reservation_id='r-ofb1zx0f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1453574557',owner_user_name='tempest-ServerRescueNegativeTestJSON-1453574557-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:37:37Z,user_data=None,user_id='1f5cb1727c864652a6873a38ec1f7bf7',uuid=cefe383b-978f-4391-baf6-3b3ad17e0083,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d14bbdf-8802-42b5-bd22-c6bd03a53761", "address": "fa:16:3e:fe:ee:4f", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d14bbdf-88", "ovs_interfaceid": "1d14bbdf-8802-42b5-bd22-c6bd03a53761", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Converting VIF {"id": "1d14bbdf-8802-42b5-bd22-c6bd03a53761", "address": "fa:16:3e:fe:ee:4f", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d14bbdf-88", "ovs_interfaceid": "1d14bbdf-8802-42b5-bd22-c6bd03a53761", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:ee:4f,bridge_name='br-int',has_traffic_filtering=True,id=1d14bbdf-8802-42b5-bd22-c6bd03a53761,network=Network(2f70b9cc-bc8f-46d8-9633-542cd881c89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d14bbdf-88') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG os_vif [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:ee:4f,bridge_name='br-int',has_traffic_filtering=True,id=1d14bbdf-8802-42b5-bd22-c6bd03a53761,network=Network(2f70b9cc-bc8f-46d8-9633-542cd881c89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d14bbdf-88') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d14bbdf-88, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1d14bbdf-88, col_values=(('external_ids', {'iface-id': '1d14bbdf-8802-42b5-bd22-c6bd03a53761', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:ee:4f', 'vm-uuid': 'cefe383b-978f-4391-baf6-3b3ad17e0083'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:39 user nova-compute[72362]: INFO os_vif [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:ee:4f,bridge_name='br-int',has_traffic_filtering=True,id=1d14bbdf-8802-42b5-bd22-c6bd03a53761,network=Network(2f70b9cc-bc8f-46d8-9633-542cd881c89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d14bbdf-88')
Aug 09 10:37:39 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] No VIF found with MAC fa:16:3e:fe:ee:4f, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG nova.network.neutron [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Successfully updated port: 434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9 {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Acquiring lock "refresh_cache-4296ca4c-1e3e-474f-98ba-9f947d333b8d" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Acquired lock "refresh_cache-4296ca4c-1e3e-474f-98ba-9f947d333b8d" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG nova.network.neutron [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG nova.network.neutron [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG nova.compute.manager [req-048a0b78-23d6-44d8-b85a-cce8afe0e5b3 req-d85d5cc1-e6ed-4227-b6ac-247e412c551f service nova] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Received event network-changed-434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG nova.compute.manager [req-048a0b78-23d6-44d8-b85a-cce8afe0e5b3 req-d85d5cc1-e6ed-4227-b6ac-247e412c551f service nova] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Refreshing instance network info cache due to event network-changed-434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:37:39 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-048a0b78-23d6-44d8-b85a-cce8afe0e5b3 req-d85d5cc1-e6ed-4227-b6ac-247e412c551f service nova] Acquiring lock "refresh_cache-4296ca4c-1e3e-474f-98ba-9f947d333b8d" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:37:40 user nova-compute[72362]: DEBUG nova.network.neutron [req-d402ba14-4695-413a-9276-45be91e7c1e6 req-2dff7ccc-55fa-47f9-bafc-9b0573a0fad3 service nova] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Updated VIF entry in instance network info cache for port 1d14bbdf-8802-42b5-bd22-c6bd03a53761. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:37:40 user nova-compute[72362]: DEBUG nova.network.neutron [req-d402ba14-4695-413a-9276-45be91e7c1e6 req-2dff7ccc-55fa-47f9-bafc-9b0573a0fad3 service nova] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Updating instance_info_cache with network_info: [{"id": "1d14bbdf-8802-42b5-bd22-c6bd03a53761", "address": "fa:16:3e:fe:ee:4f", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d14bbdf-88", "ovs_interfaceid": "1d14bbdf-8802-42b5-bd22-c6bd03a53761", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:37:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-d402ba14-4695-413a-9276-45be91e7c1e6 req-2dff7ccc-55fa-47f9-bafc-9b0573a0fad3 service nova] Releasing lock "refresh_cache-cefe383b-978f-4391-baf6-3b3ad17e0083" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:37:40 user nova-compute[72362]: DEBUG nova.network.neutron [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Updating instance_info_cache with network_info: [{"id": "434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9", "address": "fa:16:3e:09:7c:97", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434ea21d-d4", "ovs_interfaceid": "434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:37:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Releasing lock "refresh_cache-4296ca4c-1e3e-474f-98ba-9f947d333b8d" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:37:40 user nova-compute[72362]: DEBUG nova.compute.manager [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Instance network_info: |[{"id": "434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9", "address": "fa:16:3e:09:7c:97", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434ea21d-d4", "ovs_interfaceid": "434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 10:37:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-048a0b78-23d6-44d8-b85a-cce8afe0e5b3 req-d85d5cc1-e6ed-4227-b6ac-247e412c551f service nova] Acquired lock "refresh_cache-4296ca4c-1e3e-474f-98ba-9f947d333b8d" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:37:40 user nova-compute[72362]: DEBUG nova.network.neutron [req-048a0b78-23d6-44d8-b85a-cce8afe0e5b3 req-d85d5cc1-e6ed-4227-b6ac-247e412c551f service nova] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Refreshing network info cache for port 434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:37:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Start _get_guest_xml network_info=[{"id": "434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9", "address": "fa:16:3e:09:7c:97", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434ea21d-d4", "ovs_interfaceid": "434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': 'a08d1a11-49eb-4212-a351-e11ee9553b95'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:37:40 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:37:40 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:37:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:37:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:37:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:37:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:37:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:37:40 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:37:40 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:37:40 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:37:40 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:37:40 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:37:40 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:37:40 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:37:40 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:37:40 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:37:40 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:37:40 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:37:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:37:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1444056871',display_name='tempest-ServerRescueNegativeTestJSON-server-1444056871',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1444056871',id=39,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac17209f912a4f248dd642be32a75ede',ramdisk_id='',reservation_id='r-sfmqf8yu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1453574557',owner_user_name='tempest-ServerRescueNegativeTestJSON-1453574557-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:37:38Z,user_data=None,user_id='1f5cb1727c864652a6873a38ec1f7bf7',uuid=4296ca4c-1e3e-474f-98ba-9f947d333b8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9", "address": "fa:16:3e:09:7c:97", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434ea21d-d4", "ovs_interfaceid": "434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:37:40 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Converting VIF {"id": "434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9", "address": "fa:16:3e:09:7c:97", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434ea21d-d4", "ovs_interfaceid": "434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:37:40 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:7c:97,bridge_name='br-int',has_traffic_filtering=True,id=434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9,network=Network(2f70b9cc-bc8f-46d8-9633-542cd881c89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap434ea21d-d4') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:37:40 user nova-compute[72362]: DEBUG nova.objects.instance [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lazy-loading 'pci_devices' on Instance uuid 4296ca4c-1e3e-474f-98ba-9f947d333b8d {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:37:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:37:40 user nova-compute[72362]:   <uuid>4296ca4c-1e3e-474f-98ba-9f947d333b8d</uuid>
Aug 09 10:37:40 user nova-compute[72362]:   <name>instance-00000027</name>
Aug 09 10:37:40 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:37:40 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:37:40 user nova-compute[72362]:   <metadata>
Aug 09 10:37:40 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:37:40 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:37:40 user nova-compute[72362]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1444056871</nova:name>
Aug 09 10:37:40 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:37:40</nova:creationTime>
Aug 09 10:37:40 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:37:40 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:37:40 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:37:40 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:37:40 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:37:40 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:37:40 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:37:40 user nova-compute[72362]:       <nova:owner>
Aug 09 10:37:40 user nova-compute[72362]:         <nova:user uuid="1f5cb1727c864652a6873a38ec1f7bf7">tempest-ServerRescueNegativeTestJSON-1453574557-project-member</nova:user>
Aug 09 10:37:40 user nova-compute[72362]:         <nova:project uuid="ac17209f912a4f248dd642be32a75ede">tempest-ServerRescueNegativeTestJSON-1453574557</nova:project>
Aug 09 10:37:40 user nova-compute[72362]:       </nova:owner>
Aug 09 10:37:40 user nova-compute[72362]:       <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:37:40 user nova-compute[72362]:       <nova:ports>
Aug 09 10:37:40 user nova-compute[72362]:         <nova:port uuid="434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9">
Aug 09 10:37:40 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 10:37:40 user nova-compute[72362]:         </nova:port>
Aug 09 10:37:40 user nova-compute[72362]:       </nova:ports>
Aug 09 10:37:40 user nova-compute[72362]:     </nova:instance>
Aug 09 10:37:40 user nova-compute[72362]:   </metadata>
Aug 09 10:37:40 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:37:40 user nova-compute[72362]:     <system>
Aug 09 10:37:40 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:37:40 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:37:40 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:37:40 user nova-compute[72362]:       <entry name="serial">4296ca4c-1e3e-474f-98ba-9f947d333b8d</entry>
Aug 09 10:37:40 user nova-compute[72362]:       <entry name="uuid">4296ca4c-1e3e-474f-98ba-9f947d333b8d</entry>
Aug 09 10:37:40 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:37:40 user nova-compute[72362]:     </system>
Aug 09 10:37:40 user nova-compute[72362]:   </sysinfo>
Aug 09 10:37:40 user nova-compute[72362]:   <os>
Aug 09 10:37:40 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:37:40 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:37:40 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:37:40 user nova-compute[72362]:   </os>
Aug 09 10:37:40 user nova-compute[72362]:   <features>
Aug 09 10:37:40 user nova-compute[72362]:     <acpi/>
Aug 09 10:37:40 user nova-compute[72362]:     <apic/>
Aug 09 10:37:40 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:37:40 user nova-compute[72362]:   </features>
Aug 09 10:37:40 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:37:40 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:37:40 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:37:40 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:37:40 user nova-compute[72362]:   </clock>
Aug 09 10:37:40 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:37:40 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:37:40 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:37:40 user nova-compute[72362]:   </cpu>
Aug 09 10:37:40 user nova-compute[72362]:   <devices>
Aug 09 10:37:40 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:37:40 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:37:40 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk"/>
Aug 09 10:37:40 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:37:40 user nova-compute[72362]:     </disk>
Aug 09 10:37:40 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:37:40 user nova-compute[72362]:       <mac address="fa:16:3e:09:7c:97"/>
Aug 09 10:37:40 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:37:40 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:37:40 user nova-compute[72362]:       <target dev="tap434ea21d-d4"/>
Aug 09 10:37:40 user nova-compute[72362]:     </interface>
Aug 09 10:37:40 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:37:40 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/console.log" append="off"/>
Aug 09 10:37:40 user nova-compute[72362]:     </serial>
Aug 09 10:37:40 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:37:40 user nova-compute[72362]:     <video>
Aug 09 10:37:40 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:37:40 user nova-compute[72362]:     </video>
Aug 09 10:37:40 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:37:40 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:37:40 user nova-compute[72362]:     </rng>
Aug 09 10:37:40 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:37:40 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:37:40 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:37:40 user nova-compute[72362]:     </memballoon>
Aug 09 10:37:40 user nova-compute[72362]:   </devices>
Aug 09 10:37:40 user nova-compute[72362]: </domain>
Aug 09 10:37:40 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:37:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:37:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1444056871',display_name='tempest-ServerRescueNegativeTestJSON-server-1444056871',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1444056871',id=39,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac17209f912a4f248dd642be32a75ede',ramdisk_id='',reservation_id='r-sfmqf8yu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1453574557',owner_user_name='tempest-ServerRescueNegativeTestJSON-1453574557-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:37:38Z,user_data=None,user_id='1f5cb1727c864652a6873a38ec1f7bf7',uuid=4296ca4c-1e3e-474f-98ba-9f947d333b8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9", "address": "fa:16:3e:09:7c:97", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434ea21d-d4", "ovs_interfaceid": "434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:37:40 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Converting VIF {"id": "434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9", "address": "fa:16:3e:09:7c:97", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434ea21d-d4", "ovs_interfaceid": "434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:37:40 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:7c:97,bridge_name='br-int',has_traffic_filtering=True,id=434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9,network=Network(2f70b9cc-bc8f-46d8-9633-542cd881c89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap434ea21d-d4') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:37:40 user nova-compute[72362]: DEBUG os_vif [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:7c:97,bridge_name='br-int',has_traffic_filtering=True,id=434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9,network=Network(2f70b9cc-bc8f-46d8-9633-542cd881c89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap434ea21d-d4') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:37:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:37:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:37:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap434ea21d-d4, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:37:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap434ea21d-d4, col_values=(('external_ids', {'iface-id': '434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:7c:97', 'vm-uuid': '4296ca4c-1e3e-474f-98ba-9f947d333b8d'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:37:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:37:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:40 user nova-compute[72362]: INFO os_vif [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:7c:97,bridge_name='br-int',has_traffic_filtering=True,id=434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9,network=Network(2f70b9cc-bc8f-46d8-9633-542cd881c89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap434ea21d-d4')
Aug 09 10:37:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:37:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] No VIF found with MAC fa:16:3e:09:7c:97, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:37:40 user nova-compute[72362]: DEBUG nova.network.neutron [req-048a0b78-23d6-44d8-b85a-cce8afe0e5b3 req-d85d5cc1-e6ed-4227-b6ac-247e412c551f service nova] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Updated VIF entry in instance network info cache for port 434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:37:40 user nova-compute[72362]: DEBUG nova.network.neutron [req-048a0b78-23d6-44d8-b85a-cce8afe0e5b3 req-d85d5cc1-e6ed-4227-b6ac-247e412c551f service nova] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Updating instance_info_cache with network_info: [{"id": "434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9", "address": "fa:16:3e:09:7c:97", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434ea21d-d4", "ovs_interfaceid": "434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:37:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-048a0b78-23d6-44d8-b85a-cce8afe0e5b3 req-d85d5cc1-e6ed-4227-b6ac-247e412c551f service nova] Releasing lock "refresh_cache-4296ca4c-1e3e-474f-98ba-9f947d333b8d" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:37:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:41 user nova-compute[72362]: DEBUG nova.compute.manager [req-c3a44f28-5b29-4f41-80d4-14bfe87e1d45 req-b023194f-e4e1-4126-bf8c-7038fcce16ef service nova] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Received event network-vif-plugged-1d14bbdf-8802-42b5-bd22-c6bd03a53761 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:37:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c3a44f28-5b29-4f41-80d4-14bfe87e1d45 req-b023194f-e4e1-4126-bf8c-7038fcce16ef service nova] Acquiring lock "cefe383b-978f-4391-baf6-3b3ad17e0083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:37:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c3a44f28-5b29-4f41-80d4-14bfe87e1d45 req-b023194f-e4e1-4126-bf8c-7038fcce16ef service nova] Lock "cefe383b-978f-4391-baf6-3b3ad17e0083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:37:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c3a44f28-5b29-4f41-80d4-14bfe87e1d45 req-b023194f-e4e1-4126-bf8c-7038fcce16ef service nova] Lock "cefe383b-978f-4391-baf6-3b3ad17e0083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:37:41 user nova-compute[72362]: DEBUG nova.compute.manager [req-c3a44f28-5b29-4f41-80d4-14bfe87e1d45 req-b023194f-e4e1-4126-bf8c-7038fcce16ef service nova] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] No waiting events found dispatching network-vif-plugged-1d14bbdf-8802-42b5-bd22-c6bd03a53761 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:37:41 user nova-compute[72362]: WARNING nova.compute.manager [req-c3a44f28-5b29-4f41-80d4-14bfe87e1d45 req-b023194f-e4e1-4126-bf8c-7038fcce16ef service nova] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Received unexpected event network-vif-plugged-1d14bbdf-8802-42b5-bd22-c6bd03a53761 for instance with vm_state building and task_state spawning.
Aug 09 10:37:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:43 user nova-compute[72362]: DEBUG nova.compute.manager [req-77a5f988-6212-435a-a38b-df5f396ae9b0 req-8e49e992-23b6-4c84-a865-ed36e77fca6e service nova] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Received event network-vif-plugged-434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:37:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-77a5f988-6212-435a-a38b-df5f396ae9b0 req-8e49e992-23b6-4c84-a865-ed36e77fca6e service nova] Acquiring lock "4296ca4c-1e3e-474f-98ba-9f947d333b8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:37:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-77a5f988-6212-435a-a38b-df5f396ae9b0 req-8e49e992-23b6-4c84-a865-ed36e77fca6e service nova] Lock "4296ca4c-1e3e-474f-98ba-9f947d333b8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:37:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-77a5f988-6212-435a-a38b-df5f396ae9b0 req-8e49e992-23b6-4c84-a865-ed36e77fca6e service nova] Lock "4296ca4c-1e3e-474f-98ba-9f947d333b8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:37:43 user nova-compute[72362]: DEBUG nova.compute.manager [req-77a5f988-6212-435a-a38b-df5f396ae9b0 req-8e49e992-23b6-4c84-a865-ed36e77fca6e service nova] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] No waiting events found dispatching network-vif-plugged-434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:37:43 user nova-compute[72362]: WARNING nova.compute.manager [req-77a5f988-6212-435a-a38b-df5f396ae9b0 req-8e49e992-23b6-4c84-a865-ed36e77fca6e service nova] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Received unexpected event network-vif-plugged-434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9 for instance with vm_state building and task_state spawning.
Aug 09 10:37:43 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:43 user nova-compute[72362]: DEBUG nova.compute.manager [req-34f49e91-1f8e-4af8-969d-da2e359f4d3b req-e79ecc7e-447e-4db9-81dd-ab7aad527ea6 service nova] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Received event network-vif-plugged-1d14bbdf-8802-42b5-bd22-c6bd03a53761 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:37:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-34f49e91-1f8e-4af8-969d-da2e359f4d3b req-e79ecc7e-447e-4db9-81dd-ab7aad527ea6 service nova] Acquiring lock "cefe383b-978f-4391-baf6-3b3ad17e0083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:37:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-34f49e91-1f8e-4af8-969d-da2e359f4d3b req-e79ecc7e-447e-4db9-81dd-ab7aad527ea6 service nova] Lock "cefe383b-978f-4391-baf6-3b3ad17e0083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:37:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-34f49e91-1f8e-4af8-969d-da2e359f4d3b req-e79ecc7e-447e-4db9-81dd-ab7aad527ea6 service nova] Lock "cefe383b-978f-4391-baf6-3b3ad17e0083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:37:43 user nova-compute[72362]: DEBUG nova.compute.manager [req-34f49e91-1f8e-4af8-969d-da2e359f4d3b req-e79ecc7e-447e-4db9-81dd-ab7aad527ea6 service nova] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] No waiting events found dispatching network-vif-plugged-1d14bbdf-8802-42b5-bd22-c6bd03a53761 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:37:43 user nova-compute[72362]: WARNING nova.compute.manager [req-34f49e91-1f8e-4af8-969d-da2e359f4d3b req-e79ecc7e-447e-4db9-81dd-ab7aad527ea6 service nova] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Received unexpected event network-vif-plugged-1d14bbdf-8802-42b5-bd22-c6bd03a53761 for instance with vm_state building and task_state spawning.
Aug 09 10:37:44 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577464.7299807, cefe383b-978f-4391-baf6-3b3ad17e0083 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:37:44 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] VM Resumed (Lifecycle Event)
Aug 09 10:37:44 user nova-compute[72362]: DEBUG nova.compute.manager [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:37:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:37:44 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Instance spawned successfully.
Aug 09 10:37:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 10:37:44 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:37:44 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:37:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Found default for hw_cdrom_bus of ide {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:37:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Found default for hw_disk_bus of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:37:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:37:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:37:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Found default for hw_video_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:37:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Found default for hw_vif_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:37:44 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:37:44 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577464.7311532, cefe383b-978f-4391-baf6-3b3ad17e0083 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:37:44 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] VM Started (Lifecycle Event)
Aug 09 10:37:44 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:37:44 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:37:44 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:37:44 user nova-compute[72362]: INFO nova.compute.manager [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Took 7.49 seconds to spawn the instance on the hypervisor.
Aug 09 10:37:44 user nova-compute[72362]: DEBUG nova.compute.manager [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:37:44 user nova-compute[72362]: INFO nova.compute.manager [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Took 8.17 seconds to build instance.
Aug 09 10:37:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-89d2a00b-bae3-4792-aef1-043521655117 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "cefe383b-978f-4391-baf6-3b3ad17e0083" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.272s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:37:44 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577464.9441054, 4296ca4c-1e3e-474f-98ba-9f947d333b8d => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:37:44 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] VM Resumed (Lifecycle Event)
Aug 09 10:37:44 user nova-compute[72362]: DEBUG nova.compute.manager [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:37:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:37:44 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Instance spawned successfully.
Aug 09 10:37:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 10:37:44 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:37:44 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:37:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Found default for hw_cdrom_bus of ide {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:37:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Found default for hw_disk_bus of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:37:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:37:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:37:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Found default for hw_video_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:37:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Found default for hw_vif_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:37:44 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:37:44 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577464.9465864, 4296ca4c-1e3e-474f-98ba-9f947d333b8d => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:37:44 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] VM Started (Lifecycle Event)
Aug 09 10:37:45 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:37:45 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:37:45 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:37:45 user nova-compute[72362]: INFO nova.compute.manager [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Took 6.86 seconds to spawn the instance on the hypervisor.
Aug 09 10:37:45 user nova-compute[72362]: DEBUG nova.compute.manager [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:37:45 user nova-compute[72362]: DEBUG nova.compute.manager [req-159f7265-3bcf-4aee-afd1-4cd6e4d6bcc2 req-0a29f0dc-eb17-40eb-9e49-a94f8a2973e7 service nova] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Received event network-vif-plugged-434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:37:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-159f7265-3bcf-4aee-afd1-4cd6e4d6bcc2 req-0a29f0dc-eb17-40eb-9e49-a94f8a2973e7 service nova] Acquiring lock "4296ca4c-1e3e-474f-98ba-9f947d333b8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:37:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-159f7265-3bcf-4aee-afd1-4cd6e4d6bcc2 req-0a29f0dc-eb17-40eb-9e49-a94f8a2973e7 service nova] Lock "4296ca4c-1e3e-474f-98ba-9f947d333b8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:37:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-159f7265-3bcf-4aee-afd1-4cd6e4d6bcc2 req-0a29f0dc-eb17-40eb-9e49-a94f8a2973e7 service nova] Lock "4296ca4c-1e3e-474f-98ba-9f947d333b8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:37:45 user nova-compute[72362]: DEBUG nova.compute.manager [req-159f7265-3bcf-4aee-afd1-4cd6e4d6bcc2 req-0a29f0dc-eb17-40eb-9e49-a94f8a2973e7 service nova] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] No waiting events found dispatching network-vif-plugged-434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:37:45 user nova-compute[72362]: WARNING nova.compute.manager [req-159f7265-3bcf-4aee-afd1-4cd6e4d6bcc2 req-0a29f0dc-eb17-40eb-9e49-a94f8a2973e7 service nova] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Received unexpected event network-vif-plugged-434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9 for instance with vm_state building and task_state spawning.
Aug 09 10:37:45 user nova-compute[72362]: INFO nova.compute.manager [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Took 7.75 seconds to build instance.
Aug 09 10:37:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4633fe3c-151e-4910-983e-4a18834b136b tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "4296ca4c-1e3e-474f-98ba-9f947d333b8d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.855s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:37:45 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:50 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:54 user nova-compute[72362]: DEBUG nova.compute.manager [req-d790c830-b813-42ad-8003-cc2429f0bda9 req-6c56de85-e4b6-4545-b29f-ebec50eabe83 service nova] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Received event network-changed-4c907e79-d540-4521-bc58-ebc624c13456 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:37:54 user nova-compute[72362]: DEBUG nova.compute.manager [req-d790c830-b813-42ad-8003-cc2429f0bda9 req-6c56de85-e4b6-4545-b29f-ebec50eabe83 service nova] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Refreshing instance network info cache due to event network-changed-4c907e79-d540-4521-bc58-ebc624c13456. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:37:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-d790c830-b813-42ad-8003-cc2429f0bda9 req-6c56de85-e4b6-4545-b29f-ebec50eabe83 service nova] Acquiring lock "refresh_cache-be231c58-3e84-4b0f-bbbd-c44246954c47" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:37:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-d790c830-b813-42ad-8003-cc2429f0bda9 req-6c56de85-e4b6-4545-b29f-ebec50eabe83 service nova] Acquired lock "refresh_cache-be231c58-3e84-4b0f-bbbd-c44246954c47" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:37:54 user nova-compute[72362]: DEBUG nova.network.neutron [req-d790c830-b813-42ad-8003-cc2429f0bda9 req-6c56de85-e4b6-4545-b29f-ebec50eabe83 service nova] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Refreshing network info cache for port 4c907e79-d540-4521-bc58-ebc624c13456 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:37:55 user nova-compute[72362]: DEBUG nova.network.neutron [req-d790c830-b813-42ad-8003-cc2429f0bda9 req-6c56de85-e4b6-4545-b29f-ebec50eabe83 service nova] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Updated VIF entry in instance network info cache for port 4c907e79-d540-4521-bc58-ebc624c13456. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:37:55 user nova-compute[72362]: DEBUG nova.network.neutron [req-d790c830-b813-42ad-8003-cc2429f0bda9 req-6c56de85-e4b6-4545-b29f-ebec50eabe83 service nova] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Updating instance_info_cache with network_info: [{"id": "4c907e79-d540-4521-bc58-ebc624c13456", "address": "fa:16:3e:ea:97:51", "network": {"id": "e56e2a0a-0a6d-4546-86ef-7bb333e829ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1495216341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980f1c36cab0449b949419cf495c16d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c907e79-d5", "ovs_interfaceid": "4c907e79-d540-4521-bc58-ebc624c13456", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:37:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-d790c830-b813-42ad-8003-cc2429f0bda9 req-6c56de85-e4b6-4545-b29f-ebec50eabe83 service nova] Releasing lock "refresh_cache-be231c58-3e84-4b0f-bbbd-c44246954c47" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:37:55 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:56 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:37:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7b3496a7-4a93-4681-b88c-dc78a41da0e9 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "be231c58-3e84-4b0f-bbbd-c44246954c47" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:37:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7b3496a7-4a93-4681-b88c-dc78a41da0e9 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "be231c58-3e84-4b0f-bbbd-c44246954c47" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:37:59 user nova-compute[72362]: DEBUG nova.objects.instance [None req-7b3496a7-4a93-4681-b88c-dc78a41da0e9 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lazy-loading 'flavor' on Instance uuid be231c58-3e84-4b0f-bbbd-c44246954c47 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:37:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7b3496a7-4a93-4681-b88c-dc78a41da0e9 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "be231c58-3e84-4b0f-bbbd-c44246954c47" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:37:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7b3496a7-4a93-4681-b88c-dc78a41da0e9 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "be231c58-3e84-4b0f-bbbd-c44246954c47" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:37:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7b3496a7-4a93-4681-b88c-dc78a41da0e9 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "be231c58-3e84-4b0f-bbbd-c44246954c47" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:37:59 user nova-compute[72362]: INFO nova.compute.manager [None req-7b3496a7-4a93-4681-b88c-dc78a41da0e9 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Attaching volume 317ea820-31e7-47cd-8d7e-bdcae76d421f to /dev/vdb
Aug 09 10:37:59 user nova-compute[72362]: DEBUG os_brick.utils [None req-7b3496a7-4a93-4681-b88c-dc78a41da0e9 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:37:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:37:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:37:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[098cfa6b-37bb-4ee6-ba4a-8eed86678371]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:37:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:37:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:37:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[da50d1cb-834e-4074-a657-e425a2c6b63e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:37:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:37:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:37:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4abb5d10-6db6-47d3-9b54-a7ed605df229]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:37:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7adcb9c-92ed-42dc-b6cc-d0b55f0366eb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:37:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-7b3496a7-4a93-4681-b88c-dc78a41da0e9 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:37:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-7b3496a7-4a93-4681-b88c-dc78a41da0e9 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:37:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7b3496a7-4a93-4681-b88c-dc78a41da0e9 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:37:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:37:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:37:59 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:37:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fa2da7-192f-4695-a0c6-f844cab97d33]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:37:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-7b3496a7-4a93-4681-b88c-dc78a41da0e9 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:37:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-7b3496a7-4a93-4681-b88c-dc78a41da0e9 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:37:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-7b3496a7-4a93-4681-b88c-dc78a41da0e9 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:37:59 user nova-compute[72362]: DEBUG os_brick.utils [None req-7b3496a7-4a93-4681-b88c-dc78a41da0e9 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:37:59 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-7b3496a7-4a93-4681-b88c-dc78a41da0e9 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Updating existing volume attachment record: a41cc8d2-3a5b-4183-9853-8d02cef8405b {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 10:38:00 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:02 user nova-compute[72362]: DEBUG nova.compute.manager [req-4344a3ec-8e04-42cf-ab22-389a41710b6a req-b163879f-6e7b-40c9-b6fc-9727038d26b7 service nova] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Received event network-changed-6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:38:02 user nova-compute[72362]: DEBUG nova.compute.manager [req-4344a3ec-8e04-42cf-ab22-389a41710b6a req-b163879f-6e7b-40c9-b6fc-9727038d26b7 service nova] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Refreshing instance network info cache due to event network-changed-6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:38:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-4344a3ec-8e04-42cf-ab22-389a41710b6a req-b163879f-6e7b-40c9-b6fc-9727038d26b7 service nova] Acquiring lock "refresh_cache-1da4edf1-dce6-4411-8494-8c3f7c7b8ea1" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:38:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-4344a3ec-8e04-42cf-ab22-389a41710b6a req-b163879f-6e7b-40c9-b6fc-9727038d26b7 service nova] Acquired lock "refresh_cache-1da4edf1-dce6-4411-8494-8c3f7c7b8ea1" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:38:02 user nova-compute[72362]: DEBUG nova.network.neutron [req-4344a3ec-8e04-42cf-ab22-389a41710b6a req-b163879f-6e7b-40c9-b6fc-9727038d26b7 service nova] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Refreshing network info cache for port 6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:38:03 user nova-compute[72362]: DEBUG nova.network.neutron [req-4344a3ec-8e04-42cf-ab22-389a41710b6a req-b163879f-6e7b-40c9-b6fc-9727038d26b7 service nova] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Updated VIF entry in instance network info cache for port 6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:38:03 user nova-compute[72362]: DEBUG nova.network.neutron [req-4344a3ec-8e04-42cf-ab22-389a41710b6a req-b163879f-6e7b-40c9-b6fc-9727038d26b7 service nova] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Updating instance_info_cache with network_info: [{"id": "6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606", "address": "fa:16:3e:04:13:a4", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9e1aa0-d1", "ovs_interfaceid": "6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:38:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-4344a3ec-8e04-42cf-ab22-389a41710b6a req-b163879f-6e7b-40c9-b6fc-9727038d26b7 service nova] Releasing lock "refresh_cache-1da4edf1-dce6-4411-8494-8c3f7c7b8ea1" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:38:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:05 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:38:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:06 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:38:06 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 10:38:07 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b3496a7-4a93-4681-b88c-dc78a41da0e9 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3496a7-4a93-4681-b88c-dc78a41da0e9 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DTVYlHFe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:38:08 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-7b3496a7-4a93-4681-b88c-dc78a41da0e9 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:38:08 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-7b3496a7-4a93-4681-b88c-dc78a41da0e9 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-7b3496a7-4a93-4681-b88c-dc78a41da0e9 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:38:08 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-7b3496a7-4a93-4681-b88c-dc78a41da0e9 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:38:08 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-7b3496a7-4a93-4681-b88c-dc78a41da0e9 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-7b3496a7-4a93-4681-b88c-dc78a41da0e9 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:38:08 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-7b3496a7-4a93-4681-b88c-dc78a41da0e9 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:38:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d3ae50-77ba-4929-93fb-8739de420012]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3496a7-4a93-4681-b88c-dc78a41da0e9 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:38:08 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[44780ded-37e9-41a1-800b-397b4bd322a8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3496a7-4a93-4681-b88c-dc78a41da0e9 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f] added
Aug 09 10:38:08 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[2365c8a8-0ade-4b1e-973b-5b00eeac0965]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3496a7-4a93-4681-b88c-dc78a41da0e9 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6296e030-441c-4ab2-9a45-344042ce2907]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3496a7-4a93-4681-b88c-dc78a41da0e9 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DTVYlHFe {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DTVYlHFe" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df8128f-5cde-471d-a45a-cf7a8f5e17cf]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3496a7-4a93-4681-b88c-dc78a41da0e9 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DTVYlHFe'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f37301c-3b42-4f4b-b977-b5a72d662454]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3496a7-4a93-4681-b88c-dc78a41da0e9 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea6b6f3-8700-481c-bcd1-161c5cfdf4c1]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3496a7-4a93-4681-b88c-dc78a41da0e9 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:38:08 user nova-compute[72362]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247 (non-flash)
Aug 09 10:38:08 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3496a7-4a93-4681-b88c-dc78a41da0e9 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:38:08 user nova-compute[72362]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247 (non-flash)
Aug 09 10:38:08 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e393c2b2-698f-4395-a0fa-c93b3c719cbc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3496a7-4a93-4681-b88c-dc78a41da0e9 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f, portal: 172.16.0.220,3260]
Aug 09 10:38:08 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f, portal: 172.16.0.220,3260] successful.
Aug 09 10:38:08 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[140432ab-e407-4ff3-b7e2-632770469612]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3496a7-4a93-4681-b88c-dc78a41da0e9 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8eedeb3-266d-405e-8367-e468a140b667]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3496a7-4a93-4681-b88c-dc78a41da0e9 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:38:08 user nova-compute[72362]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247 (non-flash)
Aug 09 10:38:08 user nova-compute[72362]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f (non-flash)
Aug 09 10:38:08 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3496a7-4a93-4681-b88c-dc78a41da0e9 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:38:08 user nova-compute[72362]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247 (non-flash)
Aug 09 10:38:08 user nova-compute[72362]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f (non-flash)
Aug 09 10:38:08 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-7b3496a7-4a93-4681-b88c-dc78a41da0e9 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3496a7-4a93-4681-b88c-dc78a41da0e9 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-7b3496a7-4a93-4681-b88c-dc78a41da0e9 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-7b3496a7-4a93-4681-b88c-dc78a41da0e9 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[879ee3e6-66d6-48d5-a807-3a93856c5502]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-7b3496a7-4a93-4681-b88c-dc78a41da0e9 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: None {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:38:08 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 10:38:09 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Didn't find any instances for network info cache update. {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 10:38:09 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:38:09 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-7b3496a7-4a93-4681-b88c-dc78a41da0e9 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:38:09 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3496a7-4a93-4681-b88c-dc78a41da0e9 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DTVYlHFe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:38:09 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-7b3496a7-4a93-4681-b88c-dc78a41da0e9 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:38:09 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3496a7-4a93-4681-b88c-dc78a41da0e9 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '26136303033643065', 'path': '/dev/sdb'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:38:09 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b3496a7-4a93-4681-b88c-dc78a41da0e9 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136303033643065', 'path': '/dev/sdb'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:38:09 user nova-compute[72362]: DEBUG nova.objects.instance [None req-7b3496a7-4a93-4681-b88c-dc78a41da0e9 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lazy-loading 'flavor' on Instance uuid be231c58-3e84-4b0f-bbbd-c44246954c47 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:38:09 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:38:10 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-7b3496a7-4a93-4681-b88c-dc78a41da0e9 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 10:38:10 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:38:10 user nova-compute[72362]:   <source dev="/dev/sdb"/>
Aug 09 10:38:10 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:38:10 user nova-compute[72362]:   <serial>317ea820-31e7-47cd-8d7e-bdcae76d421f</serial>
Aug 09 10:38:10 user nova-compute[72362]: </disk>
Aug 09 10:38:10 user nova-compute[72362]:  {{(pid=72362) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 10:38:10 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:10 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:10 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7b3496a7-4a93-4681-b88c-dc78a41da0e9 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:38:10 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7b3496a7-4a93-4681-b88c-dc78a41da0e9 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:38:10 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7b3496a7-4a93-4681-b88c-dc78a41da0e9 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] No VIF found with MAC fa:16:3e:ea:97:51, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:38:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7b3496a7-4a93-4681-b88c-dc78a41da0e9 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "be231c58-3e84-4b0f-bbbd-c44246954c47" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.776s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:38:10 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:38:10 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:38:11 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:12 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3442a64c-63aa-46d5-9494-8eb8efeed1c5 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquiring lock "30213e67-6b1d-4d97-a971-1544335d02fb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:38:12 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3442a64c-63aa-46d5-9494-8eb8efeed1c5 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "30213e67-6b1d-4d97-a971-1544335d02fb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:38:12 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3442a64c-63aa-46d5-9494-8eb8efeed1c5 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquiring lock "30213e67-6b1d-4d97-a971-1544335d02fb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:38:12 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3442a64c-63aa-46d5-9494-8eb8efeed1c5 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "30213e67-6b1d-4d97-a971-1544335d02fb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:38:12 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3442a64c-63aa-46d5-9494-8eb8efeed1c5 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "30213e67-6b1d-4d97-a971-1544335d02fb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:38:12 user nova-compute[72362]: INFO nova.compute.manager [None req-3442a64c-63aa-46d5-9494-8eb8efeed1c5 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Terminating instance
Aug 09 10:38:12 user nova-compute[72362]: DEBUG nova.compute.manager [None req-3442a64c-63aa-46d5-9494-8eb8efeed1c5 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Start destroying the instance on the hypervisor. {{(pid=72362) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 10:38:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:12 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Instance destroyed successfully.
Aug 09 10:38:12 user nova-compute[72362]: DEBUG nova.objects.instance [None req-3442a64c-63aa-46d5-9494-8eb8efeed1c5 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lazy-loading 'resources' on Instance uuid 30213e67-6b1d-4d97-a971-1544335d02fb {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:38:12 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-3442a64c-63aa-46d5-9494-8eb8efeed1c5 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:22:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-358044317',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-358044317',id=21,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:24:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f206cedc59df46deb91e7ec2167c1f2b',ramdisk_id='',reservation_id='r-0rukucvy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1706340435',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:26:12Z,user_data=None,user_id='4a1904ffd10b4e8b959971b5e2383113',uuid=30213e67-6b1d-4d97-a971-1544335d02fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86a5b4ed-c891-4322-9ed4-4ddb3795148c", "address": "fa:16:3e:7b:56:f2", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a5b4ed-c8", "ovs_interfaceid": "86a5b4ed-c891-4322-9ed4-4ddb3795148c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:38:12 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-3442a64c-63aa-46d5-9494-8eb8efeed1c5 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Converting VIF {"id": "86a5b4ed-c891-4322-9ed4-4ddb3795148c", "address": "fa:16:3e:7b:56:f2", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a5b4ed-c8", "ovs_interfaceid": "86a5b4ed-c891-4322-9ed4-4ddb3795148c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:38:12 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-3442a64c-63aa-46d5-9494-8eb8efeed1c5 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:56:f2,bridge_name='br-int',has_traffic_filtering=True,id=86a5b4ed-c891-4322-9ed4-4ddb3795148c,network=Network(bb852331-57aa-4911-b8ff-30f5411f65b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86a5b4ed-c8') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:38:12 user nova-compute[72362]: DEBUG os_vif [None req-3442a64c-63aa-46d5-9494-8eb8efeed1c5 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:56:f2,bridge_name='br-int',has_traffic_filtering=True,id=86a5b4ed-c891-4322-9ed4-4ddb3795148c,network=Network(bb852331-57aa-4911-b8ff-30f5411f65b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86a5b4ed-c8') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:38:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap86a5b4ed-c8, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:38:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:12 user nova-compute[72362]: INFO os_vif [None req-3442a64c-63aa-46d5-9494-8eb8efeed1c5 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:56:f2,bridge_name='br-int',has_traffic_filtering=True,id=86a5b4ed-c891-4322-9ed4-4ddb3795148c,network=Network(bb852331-57aa-4911-b8ff-30f5411f65b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86a5b4ed-c8')
Aug 09 10:38:13 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3442a64c-63aa-46d5-9494-8eb8efeed1c5 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3442a64c-63aa-46d5-9494-8eb8efeed1c5 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vHFgXAfm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:38:13 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-3442a64c-63aa-46d5-9494-8eb8efeed1c5 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:38:13 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-3442a64c-63aa-46d5-9494-8eb8efeed1c5 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-3442a64c-63aa-46d5-9494-8eb8efeed1c5 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3442a64c-63aa-46d5-9494-8eb8efeed1c5 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a71c1b-7e8c-4e22-abee-c5a8a9a17f36]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8034374-38e4-4470-9859-f7a398af2833]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3442a64c-63aa-46d5-9494-8eb8efeed1c5 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:38:13 user nova-compute[72362]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247 (non-flash)
Aug 09 10:38:13 user nova-compute[72362]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f (non-flash)
Aug 09 10:38:13 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3442a64c-63aa-46d5-9494-8eb8efeed1c5 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 (non-flash)
Aug 09 10:38:13 user nova-compute[72362]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247 (non-flash)
Aug 09 10:38:13 user nova-compute[72362]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f (non-flash)
Aug 09 10:38:13 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3442a64c-63aa-46d5-9494-8eb8efeed1c5 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e44184c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9'): ({'sdh'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-3442a64c-63aa-46d5-9494-8eb8efeed1c5 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Removing single pathed devices sdh {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b475d4-d0e0-446d-b3c6-8a5ab658d4d3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[89169631-599b-400b-a276-5ac2e94a2ad8]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-3442a64c-63aa-46d5-9494-8eb8efeed1c5 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Flushing IO for device /dev/sdh {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[2106ed11-d1f2-41a3-86f2-6646f26a456b]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-3442a64c-63aa-46d5-9494-8eb8efeed1c5 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG nova.compute.manager [req-0e120f6d-755f-4fed-8aac-eba1b74a1cc5 req-9efc46cc-4c9b-4175-a7dd-591cd743a58e service nova] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Received event network-vif-unplugged-86a5b4ed-c891-4322-9ed4-4ddb3795148c {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-0e120f6d-755f-4fed-8aac-eba1b74a1cc5 req-9efc46cc-4c9b-4175-a7dd-591cd743a58e service nova] Acquiring lock "30213e67-6b1d-4d97-a971-1544335d02fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-0e120f6d-755f-4fed-8aac-eba1b74a1cc5 req-9efc46cc-4c9b-4175-a7dd-591cd743a58e service nova] Lock "30213e67-6b1d-4d97-a971-1544335d02fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-0e120f6d-755f-4fed-8aac-eba1b74a1cc5 req-9efc46cc-4c9b-4175-a7dd-591cd743a58e service nova] Lock "30213e67-6b1d-4d97-a971-1544335d02fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG nova.compute.manager [req-0e120f6d-755f-4fed-8aac-eba1b74a1cc5 req-9efc46cc-4c9b-4175-a7dd-591cd743a58e service nova] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] No waiting events found dispatching network-vif-unplugged-86a5b4ed-c891-4322-9ed4-4ddb3795148c {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG nova.compute.manager [req-0e120f6d-755f-4fed-8aac-eba1b74a1cc5 req-9efc46cc-4c9b-4175-a7dd-591cd743a58e service nova] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Received event network-vif-unplugged-86a5b4ed-c891-4322-9ed4-4ddb3795148c for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.043s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c91f8de-8931-4ed8-aec1-6879fa1b8eee]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-3442a64c-63aa-46d5-9494-8eb8efeed1c5 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-3442a64c-63aa-46d5-9494-8eb8efeed1c5 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] SCSI volumes sdh have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3442a64c-63aa-46d5-9494-8eb8efeed1c5 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84768bd-f5d9-4396-9d93-9b00e60728cc]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3442a64c-63aa-46d5-9494-8eb8efeed1c5 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6da8e1-cbb1-4343-a065-8134f7ff0f9e]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3442a64c-63aa-46d5-9494-8eb8efeed1c5 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9, portal: 172.16.0.220,3260]
Aug 09 10:38:13 user nova-compute[72362]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9, portal: 172.16.0.220,3260] successful.
Aug 09 10:38:13 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68af9a24-14e2-4f6b-902b-08139cf943b9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[851fc877-9fd9-4a26-aa0a-efd5b07f2567]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3442a64c-63aa-46d5-9494-8eb8efeed1c5 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-3442a64c-63aa-46d5-9494-8eb8efeed1c5 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3442a64c-63aa-46d5-9494-8eb8efeed1c5 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] <== disconnect_volume: return (310ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3442a64c-63aa-46d5-9494-8eb8efeed1c5 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:38:13 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-3442a64c-63aa-46d5-9494-8eb8efeed1c5 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Deleting instance files /opt/stack/data/nova/instances/30213e67-6b1d-4d97-a971-1544335d02fb_del
Aug 09 10:38:13 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-3442a64c-63aa-46d5-9494-8eb8efeed1c5 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Deletion of /opt/stack/data/nova/instances/30213e67-6b1d-4d97-a971-1544335d02fb_del complete
Aug 09 10:38:13 user nova-compute[72362]: INFO nova.compute.manager [None req-3442a64c-63aa-46d5-9494-8eb8efeed1c5 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Took 1.11 seconds to destroy the instance on the hypervisor.
Aug 09 10:38:13 user nova-compute[72362]: DEBUG oslo.service.loopingcall [None req-3442a64c-63aa-46d5-9494-8eb8efeed1c5 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72362) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG nova.compute.manager [-] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Deallocating network for instance {{(pid=72362) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] deallocate_for_instance() {{(pid=72362) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "b74acebd-10f6-4c8e-9e58-f220b9483ade" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "b74acebd-10f6-4c8e-9e58-f220b9483ade" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG nova.compute.manager [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Starting instance... {{(pid=72362) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:38:13 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:38:13 user nova-compute[72362]: INFO nova.compute.claims [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Claim successful on node user
Aug 09 10:38:14 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:38:14 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:38:14 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.367s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:38:14 user nova-compute[72362]: DEBUG nova.compute.manager [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Start building networks asynchronously for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 10:38:14 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 10:38:14 user nova-compute[72362]: DEBUG nova.compute.manager [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Allocating IP information in the background. {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 10:38:14 user nova-compute[72362]: DEBUG nova.network.neutron [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] allocate_for_instance() {{(pid=72362) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 10:38:14 user nova-compute[72362]: DEBUG nova.compute.manager [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Start building block device mappings for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 10:38:14 user nova-compute[72362]: INFO nova.virt.block_device [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Booting with volume snapshot 9838b168-c874-4972-8f5c-36175983cad7 at /dev/vda
Aug 09 10:38:14 user nova-compute[72362]: DEBUG nova.policy [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e96900e953f64d02bdb5d48f136133c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e38599de0b4b06b723f5647a7fe121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72362) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 10:38:15 user nova-compute[72362]: DEBUG nova.compute.manager [req-509b2791-e65a-4d47-8a20-fe7b77dd4330 req-9b28b741-e217-4bed-b1af-f85a246d6cbb service nova] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Received event network-vif-plugged-86a5b4ed-c891-4322-9ed4-4ddb3795148c {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:38:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-509b2791-e65a-4d47-8a20-fe7b77dd4330 req-9b28b741-e217-4bed-b1af-f85a246d6cbb service nova] Acquiring lock "30213e67-6b1d-4d97-a971-1544335d02fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:38:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-509b2791-e65a-4d47-8a20-fe7b77dd4330 req-9b28b741-e217-4bed-b1af-f85a246d6cbb service nova] Lock "30213e67-6b1d-4d97-a971-1544335d02fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:38:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-509b2791-e65a-4d47-8a20-fe7b77dd4330 req-9b28b741-e217-4bed-b1af-f85a246d6cbb service nova] Lock "30213e67-6b1d-4d97-a971-1544335d02fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:38:15 user nova-compute[72362]: DEBUG nova.compute.manager [req-509b2791-e65a-4d47-8a20-fe7b77dd4330 req-9b28b741-e217-4bed-b1af-f85a246d6cbb service nova] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] No waiting events found dispatching network-vif-plugged-86a5b4ed-c891-4322-9ed4-4ddb3795148c {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:38:15 user nova-compute[72362]: WARNING nova.compute.manager [req-509b2791-e65a-4d47-8a20-fe7b77dd4330 req-9b28b741-e217-4bed-b1af-f85a246d6cbb service nova] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Received unexpected event network-vif-plugged-86a5b4ed-c891-4322-9ed4-4ddb3795148c for instance with vm_state active and task_state deleting.
Aug 09 10:38:15 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:38:15 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Took 1.76 seconds to deallocate network for instance.
Aug 09 10:38:15 user nova-compute[72362]: DEBUG nova.network.neutron [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Successfully created port: 009988a8-77e4-434d-91da-20b13633dbee {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:38:16 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:16 user nova-compute[72362]: INFO nova.compute.manager [None req-3442a64c-63aa-46d5-9494-8eb8efeed1c5 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Took 0.85 seconds to detach 1 volumes for instance.
Aug 09 10:38:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "96da3bac-a460-4253-a4f6-cd8de34e59f8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:38:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "96da3bac-a460-4253-a4f6-cd8de34e59f8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:38:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3442a64c-63aa-46d5-9494-8eb8efeed1c5 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:38:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3442a64c-63aa-46d5-9494-8eb8efeed1c5 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:38:16 user nova-compute[72362]: DEBUG nova.compute.manager [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Starting instance... {{(pid=72362) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 10:38:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:38:16 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-3442a64c-63aa-46d5-9494-8eb8efeed1c5 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:38:16 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-3442a64c-63aa-46d5-9494-8eb8efeed1c5 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:38:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3442a64c-63aa-46d5-9494-8eb8efeed1c5 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.413s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:38:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.216s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:38:16 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:38:16 user nova-compute[72362]: INFO nova.compute.claims [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Claim successful on node user
Aug 09 10:38:16 user nova-compute[72362]: DEBUG nova.network.neutron [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Successfully updated port: 009988a8-77e4-434d-91da-20b13633dbee {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:38:16 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-3442a64c-63aa-46d5-9494-8eb8efeed1c5 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Deleted allocations for instance 30213e67-6b1d-4d97-a971-1544335d02fb
Aug 09 10:38:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "refresh_cache-b74acebd-10f6-4c8e-9e58-f220b9483ade" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:38:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquired lock "refresh_cache-b74acebd-10f6-4c8e-9e58-f220b9483ade" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:38:16 user nova-compute[72362]: DEBUG nova.network.neutron [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:38:16 user nova-compute[72362]: DEBUG nova.compute.manager [req-6258efa3-c443-47f5-8747-6a95a17e818c req-ad4df45e-7171-406c-a1e5-c0ed050f42d6 service nova] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Received event network-changed-009988a8-77e4-434d-91da-20b13633dbee {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:38:16 user nova-compute[72362]: DEBUG nova.compute.manager [req-6258efa3-c443-47f5-8747-6a95a17e818c req-ad4df45e-7171-406c-a1e5-c0ed050f42d6 service nova] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Refreshing instance network info cache due to event network-changed-009988a8-77e4-434d-91da-20b13633dbee. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:38:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-6258efa3-c443-47f5-8747-6a95a17e818c req-ad4df45e-7171-406c-a1e5-c0ed050f42d6 service nova] Acquiring lock "refresh_cache-b74acebd-10f6-4c8e-9e58-f220b9483ade" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:38:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3442a64c-63aa-46d5-9494-8eb8efeed1c5 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "30213e67-6b1d-4d97-a971-1544335d02fb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.322s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:38:16 user nova-compute[72362]: DEBUG nova.network.neutron [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:38:16 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:38:16 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:38:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.364s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:38:16 user nova-compute[72362]: DEBUG nova.compute.manager [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Start building networks asynchronously for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 10:38:16 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:17 user nova-compute[72362]: DEBUG nova.network.neutron [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Updating instance_info_cache with network_info: [{"id": "009988a8-77e4-434d-91da-20b13633dbee", "address": "fa:16:3e:1d:30:91", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap009988a8-77", "ovs_interfaceid": "009988a8-77e4-434d-91da-20b13633dbee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:38:17 user nova-compute[72362]: DEBUG nova.compute.manager [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Allocating IP information in the background. {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 10:38:17 user nova-compute[72362]: DEBUG nova.network.neutron [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] allocate_for_instance() {{(pid=72362) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 10:38:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Releasing lock "refresh_cache-b74acebd-10f6-4c8e-9e58-f220b9483ade" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:38:17 user nova-compute[72362]: DEBUG nova.compute.manager [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Instance network_info: |[{"id": "009988a8-77e4-434d-91da-20b13633dbee", "address": "fa:16:3e:1d:30:91", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap009988a8-77", "ovs_interfaceid": "009988a8-77e4-434d-91da-20b13633dbee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 10:38:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-6258efa3-c443-47f5-8747-6a95a17e818c req-ad4df45e-7171-406c-a1e5-c0ed050f42d6 service nova] Acquired lock "refresh_cache-b74acebd-10f6-4c8e-9e58-f220b9483ade" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:38:17 user nova-compute[72362]: DEBUG nova.network.neutron [req-6258efa3-c443-47f5-8747-6a95a17e818c req-ad4df45e-7171-406c-a1e5-c0ed050f42d6 service nova] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Refreshing network info cache for port 009988a8-77e4-434d-91da-20b13633dbee {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:38:17 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 10:38:17 user nova-compute[72362]: DEBUG nova.compute.manager [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Start building block device mappings for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 10:38:17 user nova-compute[72362]: DEBUG nova.policy [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bed469ff9d954891905c98bdf238c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980f1c36cab0449b949419cf495c16d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72362) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 10:38:17 user nova-compute[72362]: DEBUG nova.compute.manager [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Start spawning the instance on the hypervisor. {{(pid=72362) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 10:38:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:38:17 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Creating image(s)
Aug 09 10:38:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "/opt/stack/data/nova/instances/96da3bac-a460-4253-a4f6-cd8de34e59f8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:38:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "/opt/stack/data/nova/instances/96da3bac-a460-4253-a4f6-cd8de34e59f8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:38:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "/opt/stack/data/nova/instances/96da3bac-a460-4253-a4f6-cd8de34e59f8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:38:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:17 user nova-compute[72362]: DEBUG nova.compute.manager [req-19ea3bb0-2c7c-40c7-9928-0a290d4e44a0 req-b92ef169-7e92-4131-b859-9947f727af4c service nova] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Received event network-vif-deleted-86a5b4ed-c891-4322-9ed4-4ddb3795148c {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:38:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.139s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:38:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:38:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.139s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/96da3bac-a460-4253-a4f6-cd8de34e59f8/disk 1073741824 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/96da3bac-a460-4253-a4f6-cd8de34e59f8/disk 1073741824" returned: 0 in 0.052s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:38:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.163s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:17 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Checking if we can resize image /opt/stack/data/nova/instances/96da3bac-a460-4253-a4f6-cd8de34e59f8/disk. size=1073741824 {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 10:38:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96da3bac-a460-4253-a4f6-cd8de34e59f8/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:17 user nova-compute[72362]: DEBUG nova.network.neutron [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Successfully created port: c4b78135-dc1f-4eab-a5c6-e00aecfc09df {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:38:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96da3bac-a460-4253-a4f6-cd8de34e59f8/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:17 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Cannot resize image /opt/stack/data/nova/instances/96da3bac-a460-4253-a4f6-cd8de34e59f8/disk to a smaller size. {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 10:38:17 user nova-compute[72362]: DEBUG nova.objects.instance [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lazy-loading 'migration_context' on Instance uuid 96da3bac-a460-4253-a4f6-cd8de34e59f8 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:38:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Created local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 10:38:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Ensure instance console log exists: /opt/stack/data/nova/instances/96da3bac-a460-4253-a4f6-cd8de34e59f8/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:38:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:38:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:38:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:38:17 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:18 user nova-compute[72362]: DEBUG nova.network.neutron [req-6258efa3-c443-47f5-8747-6a95a17e818c req-ad4df45e-7171-406c-a1e5-c0ed050f42d6 service nova] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Updated VIF entry in instance network info cache for port 009988a8-77e4-434d-91da-20b13633dbee. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:38:18 user nova-compute[72362]: DEBUG nova.network.neutron [req-6258efa3-c443-47f5-8747-6a95a17e818c req-ad4df45e-7171-406c-a1e5-c0ed050f42d6 service nova] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Updating instance_info_cache with network_info: [{"id": "009988a8-77e4-434d-91da-20b13633dbee", "address": "fa:16:3e:1d:30:91", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap009988a8-77", "ovs_interfaceid": "009988a8-77e4-434d-91da-20b13633dbee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:38:18 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-6258efa3-c443-47f5-8747-6a95a17e818c req-ad4df45e-7171-406c-a1e5-c0ed050f42d6 service nova] Releasing lock "refresh_cache-b74acebd-10f6-4c8e-9e58-f220b9483ade" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:38:18 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:18 user nova-compute[72362]: DEBUG nova.network.neutron [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Successfully updated port: c4b78135-dc1f-4eab-a5c6-e00aecfc09df {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:38:18 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "refresh_cache-96da3bac-a460-4253-a4f6-cd8de34e59f8" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:38:18 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquired lock "refresh_cache-96da3bac-a460-4253-a4f6-cd8de34e59f8" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:38:18 user nova-compute[72362]: DEBUG nova.network.neutron [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:38:18 user nova-compute[72362]: DEBUG nova.network.neutron [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:38:18 user nova-compute[72362]: DEBUG nova.compute.manager [req-7854272f-d169-4c6a-904a-5747b75331c7 req-69dabde6-f091-4efb-96ca-86002bda641d service nova] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Received event network-changed-c4b78135-dc1f-4eab-a5c6-e00aecfc09df {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:38:18 user nova-compute[72362]: DEBUG nova.compute.manager [req-7854272f-d169-4c6a-904a-5747b75331c7 req-69dabde6-f091-4efb-96ca-86002bda641d service nova] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Refreshing instance network info cache due to event network-changed-c4b78135-dc1f-4eab-a5c6-e00aecfc09df. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:38:18 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-7854272f-d169-4c6a-904a-5747b75331c7 req-69dabde6-f091-4efb-96ca-86002bda641d service nova] Acquiring lock "refresh_cache-96da3bac-a460-4253-a4f6-cd8de34e59f8" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:38:18 user nova-compute[72362]: DEBUG nova.network.neutron [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Updating instance_info_cache with network_info: [{"id": "c4b78135-dc1f-4eab-a5c6-e00aecfc09df", "address": "fa:16:3e:22:88:0f", "network": {"id": "e56e2a0a-0a6d-4546-86ef-7bb333e829ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1495216341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980f1c36cab0449b949419cf495c16d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b78135-dc", "ovs_interfaceid": "c4b78135-dc1f-4eab-a5c6-e00aecfc09df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:38:18 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Releasing lock "refresh_cache-96da3bac-a460-4253-a4f6-cd8de34e59f8" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:38:18 user nova-compute[72362]: DEBUG nova.compute.manager [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Instance network_info: |[{"id": "c4b78135-dc1f-4eab-a5c6-e00aecfc09df", "address": "fa:16:3e:22:88:0f", "network": {"id": "e56e2a0a-0a6d-4546-86ef-7bb333e829ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1495216341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980f1c36cab0449b949419cf495c16d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b78135-dc", "ovs_interfaceid": "c4b78135-dc1f-4eab-a5c6-e00aecfc09df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 10:38:18 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-7854272f-d169-4c6a-904a-5747b75331c7 req-69dabde6-f091-4efb-96ca-86002bda641d service nova] Acquired lock "refresh_cache-96da3bac-a460-4253-a4f6-cd8de34e59f8" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:38:18 user nova-compute[72362]: DEBUG nova.network.neutron [req-7854272f-d169-4c6a-904a-5747b75331c7 req-69dabde6-f091-4efb-96ca-86002bda641d service nova] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Refreshing network info cache for port c4b78135-dc1f-4eab-a5c6-e00aecfc09df {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:38:18 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Start _get_guest_xml network_info=[{"id": "c4b78135-dc1f-4eab-a5c6-e00aecfc09df", "address": "fa:16:3e:22:88:0f", "network": {"id": "e56e2a0a-0a6d-4546-86ef-7bb333e829ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1495216341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980f1c36cab0449b949419cf495c16d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b78135-dc", "ovs_interfaceid": "c4b78135-dc1f-4eab-a5c6-e00aecfc09df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': 'a08d1a11-49eb-4212-a351-e11ee9553b95'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:38:18 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:38:18 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:38:18 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:38:18 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:38:18 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:38:18 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:38:18 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:38:18 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:38:18 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:38:18 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:38:18 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:38:18 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:38:18 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:38:18 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:38:18 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:38:18 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:38:18 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:38:18 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:38:18 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:38:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-870631158',display_name='tempest-AttachVolumeNegativeTest-server-870631158',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-870631158',id=41,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANQ90xr6vonftsSs4VyC7ntV2sD0euSMD60OCo+wBhjUo4SPv74GIZdYYBm+sffp+uixEz8kQpmJT9h9IVl+3jInsi4Zg3u+WVHR+q+5NHWXcUcgPpM+cNTt21sAcL99w==',key_name='tempest-keypair-442646897',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='980f1c36cab0449b949419cf495c16d5',ramdisk_id='',reservation_id='r-5q9s0007',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-486756066',owner_user_name='tempest-AttachVolumeNegativeTest-486756066-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:38:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bed469ff9d954891905c98bdf238c097',uuid=96da3bac-a460-4253-a4f6-cd8de34e59f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4b78135-dc1f-4eab-a5c6-e00aecfc09df", "address": "fa:16:3e:22:88:0f", "network": {"id": "e56e2a0a-0a6d-4546-86ef-7bb333e829ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1495216341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980f1c36cab0449b949419cf495c16d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b78135-dc", "ovs_interfaceid": "c4b78135-dc1f-4eab-a5c6-e00aecfc09df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:38:18 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Converting VIF {"id": "c4b78135-dc1f-4eab-a5c6-e00aecfc09df", "address": "fa:16:3e:22:88:0f", "network": {"id": "e56e2a0a-0a6d-4546-86ef-7bb333e829ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1495216341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980f1c36cab0449b949419cf495c16d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b78135-dc", "ovs_interfaceid": "c4b78135-dc1f-4eab-a5c6-e00aecfc09df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:38:19 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:88:0f,bridge_name='br-int',has_traffic_filtering=True,id=c4b78135-dc1f-4eab-a5c6-e00aecfc09df,network=Network(e56e2a0a-0a6d-4546-86ef-7bb333e829ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4b78135-dc') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:38:19 user nova-compute[72362]: DEBUG nova.objects.instance [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lazy-loading 'pci_devices' on Instance uuid 96da3bac-a460-4253-a4f6-cd8de34e59f8 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:38:19 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:38:19 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:38:19 user nova-compute[72362]:   <uuid>96da3bac-a460-4253-a4f6-cd8de34e59f8</uuid>
Aug 09 10:38:19 user nova-compute[72362]:   <name>instance-00000029</name>
Aug 09 10:38:19 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:38:19 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:38:19 user nova-compute[72362]:   <metadata>
Aug 09 10:38:19 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:38:19 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:38:19 user nova-compute[72362]:       <nova:name>tempest-AttachVolumeNegativeTest-server-870631158</nova:name>
Aug 09 10:38:19 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:38:18</nova:creationTime>
Aug 09 10:38:19 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:38:19 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:38:19 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:38:19 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:38:19 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:38:19 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:38:19 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:38:19 user nova-compute[72362]:       <nova:owner>
Aug 09 10:38:19 user nova-compute[72362]:         <nova:user uuid="bed469ff9d954891905c98bdf238c097">tempest-AttachVolumeNegativeTest-486756066-project-member</nova:user>
Aug 09 10:38:19 user nova-compute[72362]:         <nova:project uuid="980f1c36cab0449b949419cf495c16d5">tempest-AttachVolumeNegativeTest-486756066</nova:project>
Aug 09 10:38:19 user nova-compute[72362]:       </nova:owner>
Aug 09 10:38:19 user nova-compute[72362]:       <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:38:19 user nova-compute[72362]:       <nova:ports>
Aug 09 10:38:19 user nova-compute[72362]:         <nova:port uuid="c4b78135-dc1f-4eab-a5c6-e00aecfc09df">
Aug 09 10:38:19 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 10:38:19 user nova-compute[72362]:         </nova:port>
Aug 09 10:38:19 user nova-compute[72362]:       </nova:ports>
Aug 09 10:38:19 user nova-compute[72362]:     </nova:instance>
Aug 09 10:38:19 user nova-compute[72362]:   </metadata>
Aug 09 10:38:19 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:38:19 user nova-compute[72362]:     <system>
Aug 09 10:38:19 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:38:19 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:38:19 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:38:19 user nova-compute[72362]:       <entry name="serial">96da3bac-a460-4253-a4f6-cd8de34e59f8</entry>
Aug 09 10:38:19 user nova-compute[72362]:       <entry name="uuid">96da3bac-a460-4253-a4f6-cd8de34e59f8</entry>
Aug 09 10:38:19 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:38:19 user nova-compute[72362]:     </system>
Aug 09 10:38:19 user nova-compute[72362]:   </sysinfo>
Aug 09 10:38:19 user nova-compute[72362]:   <os>
Aug 09 10:38:19 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:38:19 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:38:19 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:38:19 user nova-compute[72362]:   </os>
Aug 09 10:38:19 user nova-compute[72362]:   <features>
Aug 09 10:38:19 user nova-compute[72362]:     <acpi/>
Aug 09 10:38:19 user nova-compute[72362]:     <apic/>
Aug 09 10:38:19 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:38:19 user nova-compute[72362]:   </features>
Aug 09 10:38:19 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:38:19 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:38:19 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:38:19 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:38:19 user nova-compute[72362]:   </clock>
Aug 09 10:38:19 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:38:19 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:38:19 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:38:19 user nova-compute[72362]:   </cpu>
Aug 09 10:38:19 user nova-compute[72362]:   <devices>
Aug 09 10:38:19 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:38:19 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:38:19 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/96da3bac-a460-4253-a4f6-cd8de34e59f8/disk"/>
Aug 09 10:38:19 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:38:19 user nova-compute[72362]:     </disk>
Aug 09 10:38:19 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:38:19 user nova-compute[72362]:       <mac address="fa:16:3e:22:88:0f"/>
Aug 09 10:38:19 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:38:19 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:38:19 user nova-compute[72362]:       <target dev="tapc4b78135-dc"/>
Aug 09 10:38:19 user nova-compute[72362]:     </interface>
Aug 09 10:38:19 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:38:19 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/96da3bac-a460-4253-a4f6-cd8de34e59f8/console.log" append="off"/>
Aug 09 10:38:19 user nova-compute[72362]:     </serial>
Aug 09 10:38:19 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:38:19 user nova-compute[72362]:     <video>
Aug 09 10:38:19 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:38:19 user nova-compute[72362]:     </video>
Aug 09 10:38:19 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:38:19 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:38:19 user nova-compute[72362]:     </rng>
Aug 09 10:38:19 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:38:19 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:38:19 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:38:19 user nova-compute[72362]:     </memballoon>
Aug 09 10:38:19 user nova-compute[72362]:   </devices>
Aug 09 10:38:19 user nova-compute[72362]: </domain>
Aug 09 10:38:19 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:38:19 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:38:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-870631158',display_name='tempest-AttachVolumeNegativeTest-server-870631158',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-870631158',id=41,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANQ90xr6vonftsSs4VyC7ntV2sD0euSMD60OCo+wBhjUo4SPv74GIZdYYBm+sffp+uixEz8kQpmJT9h9IVl+3jInsi4Zg3u+WVHR+q+5NHWXcUcgPpM+cNTt21sAcL99w==',key_name='tempest-keypair-442646897',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='980f1c36cab0449b949419cf495c16d5',ramdisk_id='',reservation_id='r-5q9s0007',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-486756066',owner_user_name='tempest-AttachVolumeNegativeTest-486756066-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:38:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bed469ff9d954891905c98bdf238c097',uuid=96da3bac-a460-4253-a4f6-cd8de34e59f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4b78135-dc1f-4eab-a5c6-e00aecfc09df", "address": "fa:16:3e:22:88:0f", "network": {"id": "e56e2a0a-0a6d-4546-86ef-7bb333e829ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1495216341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980f1c36cab0449b949419cf495c16d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b78135-dc", "ovs_interfaceid": "c4b78135-dc1f-4eab-a5c6-e00aecfc09df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:38:19 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Converting VIF {"id": "c4b78135-dc1f-4eab-a5c6-e00aecfc09df", "address": "fa:16:3e:22:88:0f", "network": {"id": "e56e2a0a-0a6d-4546-86ef-7bb333e829ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1495216341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980f1c36cab0449b949419cf495c16d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b78135-dc", "ovs_interfaceid": "c4b78135-dc1f-4eab-a5c6-e00aecfc09df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:38:19 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:88:0f,bridge_name='br-int',has_traffic_filtering=True,id=c4b78135-dc1f-4eab-a5c6-e00aecfc09df,network=Network(e56e2a0a-0a6d-4546-86ef-7bb333e829ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4b78135-dc') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:38:19 user nova-compute[72362]: DEBUG os_vif [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:88:0f,bridge_name='br-int',has_traffic_filtering=True,id=c4b78135-dc1f-4eab-a5c6-e00aecfc09df,network=Network(e56e2a0a-0a6d-4546-86ef-7bb333e829ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4b78135-dc') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:38:19 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:19 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:38:19 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:38:19 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:19 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc4b78135-dc, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:38:19 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc4b78135-dc, col_values=(('external_ids', {'iface-id': 'c4b78135-dc1f-4eab-a5c6-e00aecfc09df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:88:0f', 'vm-uuid': '96da3bac-a460-4253-a4f6-cd8de34e59f8'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:38:19 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:19 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:38:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:38:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:38:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:38:19 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 10:38:19 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:19 user nova-compute[72362]: INFO os_vif [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:88:0f,bridge_name='br-int',has_traffic_filtering=True,id=c4b78135-dc1f-4eab-a5c6-e00aecfc09df,network=Network(e56e2a0a-0a6d-4546-86ef-7bb333e829ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4b78135-dc')
Aug 09 10:38:19 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:38:19 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] No VIF found with MAC fa:16:3e:22:88:0f, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:38:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Acquiring lock "94aedd29-1832-4ff4-97ac-d70ed1775223" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:38:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "94aedd29-1832-4ff4-97ac-d70ed1775223" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:38:19 user nova-compute[72362]: DEBUG nova.network.neutron [req-7854272f-d169-4c6a-904a-5747b75331c7 req-69dabde6-f091-4efb-96ca-86002bda641d service nova] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Updated VIF entry in instance network info cache for port c4b78135-dc1f-4eab-a5c6-e00aecfc09df. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:38:19 user nova-compute[72362]: DEBUG nova.network.neutron [req-7854272f-d169-4c6a-904a-5747b75331c7 req-69dabde6-f091-4efb-96ca-86002bda641d service nova] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Updating instance_info_cache with network_info: [{"id": "c4b78135-dc1f-4eab-a5c6-e00aecfc09df", "address": "fa:16:3e:22:88:0f", "network": {"id": "e56e2a0a-0a6d-4546-86ef-7bb333e829ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1495216341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980f1c36cab0449b949419cf495c16d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b78135-dc", "ovs_interfaceid": "c4b78135-dc1f-4eab-a5c6-e00aecfc09df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:38:19 user nova-compute[72362]: DEBUG nova.compute.manager [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Starting instance... {{(pid=72362) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 10:38:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-7854272f-d169-4c6a-904a-5747b75331c7 req-69dabde6-f091-4efb-96ca-86002bda641d service nova] Releasing lock "refresh_cache-96da3bac-a460-4253-a4f6-cd8de34e59f8" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:38:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:38:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:38:19 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:38:19 user nova-compute[72362]: INFO nova.compute.claims [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Claim successful on node user
Aug 09 10:38:19 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:38:19 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:38:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.330s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:38:19 user nova-compute[72362]: DEBUG nova.compute.manager [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Start building networks asynchronously for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 10:38:19 user nova-compute[72362]: DEBUG nova.compute.manager [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Allocating IP information in the background. {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 10:38:19 user nova-compute[72362]: DEBUG nova.network.neutron [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] allocate_for_instance() {{(pid=72362) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 10:38:19 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 10:38:19 user nova-compute[72362]: DEBUG nova.compute.manager [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Start building block device mappings for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG nova.policy [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '299166afe21b4d3cac05fdb072a78a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9d6a60f24d41deb91ae59189c62ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72362) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG nova.compute.manager [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Start spawning the instance on the hypervisor. {{(pid=72362) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:38:20 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Creating image(s)
Aug 09 10:38:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Acquiring lock "/opt/stack/data/nova/instances/94aedd29-1832-4ff4-97ac-d70ed1775223/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "/opt/stack/data/nova/instances/94aedd29-1832-4ff4-97ac-d70ed1775223/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "/opt/stack/data/nova/instances/94aedd29-1832-4ff4-97ac-d70ed1775223/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG os_brick.utils [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.145s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Acquiring lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fe1c57-9fc0-4cb2-a2ad-ed567f860dc8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2dca51e-4364-45d8-b390-c6ffd23d6513]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[517d55ab-4f57-4710-9422-9a2ec1a9a940]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cfd7956-a659-4016-b92e-50b4754b1a08]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:38:20 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:38:20 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c22ef6e-4f80-471b-bf1f-82c23052826f]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG os_brick.utils [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] <== get_connector_properties: return (181ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Updating existing volume attachment record: 571cb982-87cd-4687-9684-da7c45ccac2e {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.184s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/94aedd29-1832-4ff4-97ac-d70ed1775223/disk 1073741824 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/94aedd29-1832-4ff4-97ac-d70ed1775223/disk 1073741824" returned: 0 in 0.066s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG nova.compute.manager [req-226469b8-8af1-4171-ab64-07f7b88f7512 req-b21e0dcc-7232-4cf3-8bbc-a54ca0061a35 service nova] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Received event network-vif-plugged-c4b78135-dc1f-4eab-a5c6-e00aecfc09df {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-226469b8-8af1-4171-ab64-07f7b88f7512 req-b21e0dcc-7232-4cf3-8bbc-a54ca0061a35 service nova] Acquiring lock "96da3bac-a460-4253-a4f6-cd8de34e59f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-226469b8-8af1-4171-ab64-07f7b88f7512 req-b21e0dcc-7232-4cf3-8bbc-a54ca0061a35 service nova] Lock "96da3bac-a460-4253-a4f6-cd8de34e59f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-226469b8-8af1-4171-ab64-07f7b88f7512 req-b21e0dcc-7232-4cf3-8bbc-a54ca0061a35 service nova] Lock "96da3bac-a460-4253-a4f6-cd8de34e59f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG nova.compute.manager [req-226469b8-8af1-4171-ab64-07f7b88f7512 req-b21e0dcc-7232-4cf3-8bbc-a54ca0061a35 service nova] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] No waiting events found dispatching network-vif-plugged-c4b78135-dc1f-4eab-a5c6-e00aecfc09df {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:38:20 user nova-compute[72362]: WARNING nova.compute.manager [req-226469b8-8af1-4171-ab64-07f7b88f7512 req-b21e0dcc-7232-4cf3-8bbc-a54ca0061a35 service nova] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Received unexpected event network-vif-plugged-c4b78135-dc1f-4eab-a5c6-e00aecfc09df for instance with vm_state building and task_state spawning.
Aug 09 10:38:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.160s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Checking if we can resize image /opt/stack/data/nova/instances/94aedd29-1832-4ff4-97ac-d70ed1775223/disk. size=1073741824 {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94aedd29-1832-4ff4-97ac-d70ed1775223/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG nova.network.neutron [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Successfully created port: 1a21fab7-2746-481c-8003-5f8e6d67ea2a {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94aedd29-1832-4ff4-97ac-d70ed1775223/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Cannot resize image /opt/stack/data/nova/instances/94aedd29-1832-4ff4-97ac-d70ed1775223/disk to a smaller size. {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG nova.objects.instance [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lazy-loading 'migration_context' on Instance uuid 94aedd29-1832-4ff4-97ac-d70ed1775223 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Created local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Ensure instance console log exists: /opt/stack/data/nova/instances/94aedd29-1832-4ff4-97ac-d70ed1775223/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:38:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be231c58-3e84-4b0f-bbbd-c44246954c47/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be231c58-3e84-4b0f-bbbd-c44246954c47/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be231c58-3e84-4b0f-bbbd-c44246954c47/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be231c58-3e84-4b0f-bbbd-c44246954c47/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:21 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:38:21 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:38:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96da3bac-a460-4253-a4f6-cd8de34e59f8/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:21 user nova-compute[72362]: DEBUG nova.network.neutron [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Successfully updated port: 1a21fab7-2746-481c-8003-5f8e6d67ea2a {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:38:21 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Acquiring lock "refresh_cache-94aedd29-1832-4ff4-97ac-d70ed1775223" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:38:21 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Acquired lock "refresh_cache-94aedd29-1832-4ff4-97ac-d70ed1775223" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:38:21 user nova-compute[72362]: DEBUG nova.network.neutron [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:38:21 user nova-compute[72362]: DEBUG nova.compute.manager [req-375decbb-9a15-464c-bd34-6598783a79fb req-0b930592-f699-4dbd-b5df-0382a0862baf service nova] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Received event network-changed-1a21fab7-2746-481c-8003-5f8e6d67ea2a {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:38:21 user nova-compute[72362]: DEBUG nova.compute.manager [req-375decbb-9a15-464c-bd34-6598783a79fb req-0b930592-f699-4dbd-b5df-0382a0862baf service nova] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Refreshing instance network info cache due to event network-changed-1a21fab7-2746-481c-8003-5f8e6d67ea2a. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:38:21 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-375decbb-9a15-464c-bd34-6598783a79fb req-0b930592-f699-4dbd-b5df-0382a0862baf service nova] Acquiring lock "refresh_cache-94aedd29-1832-4ff4-97ac-d70ed1775223" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:38:21 user nova-compute[72362]: DEBUG nova.network.neutron [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:38:21 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96da3bac-a460-4253-a4f6-cd8de34e59f8/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96da3bac-a460-4253-a4f6-cd8de34e59f8/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96da3bac-a460-4253-a4f6-cd8de34e59f8/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:22 user nova-compute[72362]: DEBUG nova.network.neutron [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Updating instance_info_cache with network_info: [{"id": "1a21fab7-2746-481c-8003-5f8e6d67ea2a", "address": "fa:16:3e:15:9c:15", "network": {"id": "362446ea-173c-4989-93f8-882088822208", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-499399633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f9d6a60f24d41deb91ae59189c62ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a21fab7-27", "ovs_interfaceid": "1a21fab7-2746-481c-8003-5f8e6d67ea2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:38:22 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Releasing lock "refresh_cache-94aedd29-1832-4ff4-97ac-d70ed1775223" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:38:22 user nova-compute[72362]: DEBUG nova.compute.manager [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Instance network_info: |[{"id": "1a21fab7-2746-481c-8003-5f8e6d67ea2a", "address": "fa:16:3e:15:9c:15", "network": {"id": "362446ea-173c-4989-93f8-882088822208", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-499399633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f9d6a60f24d41deb91ae59189c62ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a21fab7-27", "ovs_interfaceid": "1a21fab7-2746-481c-8003-5f8e6d67ea2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 10:38:22 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-375decbb-9a15-464c-bd34-6598783a79fb req-0b930592-f699-4dbd-b5df-0382a0862baf service nova] Acquired lock "refresh_cache-94aedd29-1832-4ff4-97ac-d70ed1775223" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:38:22 user nova-compute[72362]: DEBUG nova.network.neutron [req-375decbb-9a15-464c-bd34-6598783a79fb req-0b930592-f699-4dbd-b5df-0382a0862baf service nova] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Refreshing network info cache for port 1a21fab7-2746-481c-8003-5f8e6d67ea2a {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:38:22 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Start _get_guest_xml network_info=[{"id": "1a21fab7-2746-481c-8003-5f8e6d67ea2a", "address": "fa:16:3e:15:9c:15", "network": {"id": "362446ea-173c-4989-93f8-882088822208", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-499399633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f9d6a60f24d41deb91ae59189c62ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a21fab7-27", "ovs_interfaceid": "1a21fab7-2746-481c-8003-5f8e6d67ea2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': 'a08d1a11-49eb-4212-a351-e11ee9553b95'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:38:22 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:38:22 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:38:22 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:38:22 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:38:22 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:38:22 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:38:22 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:38:22 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:38:22 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:38:22 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:38:22 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:38:22 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:38:22 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:38:22 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:38:22 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:38:22 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:38:22 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:38:22 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:38:22 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:38:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-45479132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-45479132',id=42,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4gqGqKEyEBtLFKXkQToz6Rf8n6KOiXPf3Pmm/FZvG/oFNArAk44bhIJ9jkn8xdUjvGEiVns4+ZB/U94N22x6mMs9rGyVQqC5j4GuVj1X/qyx9a2pFKko3raRd0CBAUyg==',key_name='tempest-keypair-631856663',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f9d6a60f24d41deb91ae59189c62ba2',ramdisk_id='',reservation_id='r-qaaj0twi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2139825844',owner_user_name='tempest-AttachVolumeShelveTestJSON-2139825844-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:38:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='299166afe21b4d3cac05fdb072a78a78',uuid=94aedd29-1832-4ff4-97ac-d70ed1775223,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a21fab7-2746-481c-8003-5f8e6d67ea2a", "address": "fa:16:3e:15:9c:15", "network": {"id": "362446ea-173c-4989-93f8-882088822208", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-499399633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f9d6a60f24d41deb91ae59189c62ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a21fab7-27", "ovs_interfaceid": "1a21fab7-2746-481c-8003-5f8e6d67ea2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:38:22 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Converting VIF {"id": "1a21fab7-2746-481c-8003-5f8e6d67ea2a", "address": "fa:16:3e:15:9c:15", "network": {"id": "362446ea-173c-4989-93f8-882088822208", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-499399633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f9d6a60f24d41deb91ae59189c62ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a21fab7-27", "ovs_interfaceid": "1a21fab7-2746-481c-8003-5f8e6d67ea2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:38:22 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:9c:15,bridge_name='br-int',has_traffic_filtering=True,id=1a21fab7-2746-481c-8003-5f8e6d67ea2a,network=Network(362446ea-173c-4989-93f8-882088822208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a21fab7-27') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:38:22 user nova-compute[72362]: DEBUG nova.objects.instance [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lazy-loading 'pci_devices' on Instance uuid 94aedd29-1832-4ff4-97ac-d70ed1775223 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:38:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:22 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:38:22 user nova-compute[72362]:   <uuid>94aedd29-1832-4ff4-97ac-d70ed1775223</uuid>
Aug 09 10:38:22 user nova-compute[72362]:   <name>instance-0000002a</name>
Aug 09 10:38:22 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:38:22 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:38:22 user nova-compute[72362]:   <metadata>
Aug 09 10:38:22 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:38:22 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:38:22 user nova-compute[72362]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-45479132</nova:name>
Aug 09 10:38:22 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:38:22</nova:creationTime>
Aug 09 10:38:22 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:38:22 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:38:22 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:38:22 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:38:22 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:38:22 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:38:22 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:38:22 user nova-compute[72362]:       <nova:owner>
Aug 09 10:38:22 user nova-compute[72362]:         <nova:user uuid="299166afe21b4d3cac05fdb072a78a78">tempest-AttachVolumeShelveTestJSON-2139825844-project-member</nova:user>
Aug 09 10:38:22 user nova-compute[72362]:         <nova:project uuid="2f9d6a60f24d41deb91ae59189c62ba2">tempest-AttachVolumeShelveTestJSON-2139825844</nova:project>
Aug 09 10:38:22 user nova-compute[72362]:       </nova:owner>
Aug 09 10:38:22 user nova-compute[72362]:       <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:38:22 user nova-compute[72362]:       <nova:ports>
Aug 09 10:38:22 user nova-compute[72362]:         <nova:port uuid="1a21fab7-2746-481c-8003-5f8e6d67ea2a">
Aug 09 10:38:22 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 10:38:22 user nova-compute[72362]:         </nova:port>
Aug 09 10:38:22 user nova-compute[72362]:       </nova:ports>
Aug 09 10:38:22 user nova-compute[72362]:     </nova:instance>
Aug 09 10:38:22 user nova-compute[72362]:   </metadata>
Aug 09 10:38:22 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:38:22 user nova-compute[72362]:     <system>
Aug 09 10:38:22 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:38:22 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:38:22 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:38:22 user nova-compute[72362]:       <entry name="serial">94aedd29-1832-4ff4-97ac-d70ed1775223</entry>
Aug 09 10:38:22 user nova-compute[72362]:       <entry name="uuid">94aedd29-1832-4ff4-97ac-d70ed1775223</entry>
Aug 09 10:38:22 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:38:22 user nova-compute[72362]:     </system>
Aug 09 10:38:22 user nova-compute[72362]:   </sysinfo>
Aug 09 10:38:22 user nova-compute[72362]:   <os>
Aug 09 10:38:22 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:38:22 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:38:22 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:38:22 user nova-compute[72362]:   </os>
Aug 09 10:38:22 user nova-compute[72362]:   <features>
Aug 09 10:38:22 user nova-compute[72362]:     <acpi/>
Aug 09 10:38:22 user nova-compute[72362]:     <apic/>
Aug 09 10:38:22 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:38:22 user nova-compute[72362]:   </features>
Aug 09 10:38:22 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:38:22 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:38:22 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:38:22 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:38:22 user nova-compute[72362]:   </clock>
Aug 09 10:38:22 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:38:22 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:38:22 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:38:22 user nova-compute[72362]:   </cpu>
Aug 09 10:38:22 user nova-compute[72362]:   <devices>
Aug 09 10:38:22 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:38:22 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:38:22 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/94aedd29-1832-4ff4-97ac-d70ed1775223/disk"/>
Aug 09 10:38:22 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:38:22 user nova-compute[72362]:     </disk>
Aug 09 10:38:22 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:38:22 user nova-compute[72362]:       <mac address="fa:16:3e:15:9c:15"/>
Aug 09 10:38:22 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:38:22 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:38:22 user nova-compute[72362]:       <target dev="tap1a21fab7-27"/>
Aug 09 10:38:22 user nova-compute[72362]:     </interface>
Aug 09 10:38:22 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:38:22 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/94aedd29-1832-4ff4-97ac-d70ed1775223/console.log" append="off"/>
Aug 09 10:38:22 user nova-compute[72362]:     </serial>
Aug 09 10:38:22 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:38:22 user nova-compute[72362]:     <video>
Aug 09 10:38:22 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:38:22 user nova-compute[72362]:     </video>
Aug 09 10:38:22 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:38:22 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:38:22 user nova-compute[72362]:     </rng>
Aug 09 10:38:22 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:38:22 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:38:22 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:38:22 user nova-compute[72362]:     </memballoon>
Aug 09 10:38:22 user nova-compute[72362]:   </devices>
Aug 09 10:38:22 user nova-compute[72362]: </domain>
Aug 09 10:38:22 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:38:22 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:38:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-45479132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-45479132',id=42,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4gqGqKEyEBtLFKXkQToz6Rf8n6KOiXPf3Pmm/FZvG/oFNArAk44bhIJ9jkn8xdUjvGEiVns4+ZB/U94N22x6mMs9rGyVQqC5j4GuVj1X/qyx9a2pFKko3raRd0CBAUyg==',key_name='tempest-keypair-631856663',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f9d6a60f24d41deb91ae59189c62ba2',ramdisk_id='',reservation_id='r-qaaj0twi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2139825844',owner_user_name='tempest-AttachVolumeShelveTestJSON-2139825844-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:38:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='299166afe21b4d3cac05fdb072a78a78',uuid=94aedd29-1832-4ff4-97ac-d70ed1775223,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a21fab7-2746-481c-8003-5f8e6d67ea2a", "address": "fa:16:3e:15:9c:15", "network": {"id": "362446ea-173c-4989-93f8-882088822208", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-499399633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f9d6a60f24d41deb91ae59189c62ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a21fab7-27", "ovs_interfaceid": "1a21fab7-2746-481c-8003-5f8e6d67ea2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:38:22 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Converting VIF {"id": "1a21fab7-2746-481c-8003-5f8e6d67ea2a", "address": "fa:16:3e:15:9c:15", "network": {"id": "362446ea-173c-4989-93f8-882088822208", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-499399633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f9d6a60f24d41deb91ae59189c62ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a21fab7-27", "ovs_interfaceid": "1a21fab7-2746-481c-8003-5f8e6d67ea2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:38:22 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:9c:15,bridge_name='br-int',has_traffic_filtering=True,id=1a21fab7-2746-481c-8003-5f8e6d67ea2a,network=Network(362446ea-173c-4989-93f8-882088822208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a21fab7-27') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:38:22 user nova-compute[72362]: DEBUG os_vif [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:9c:15,bridge_name='br-int',has_traffic_filtering=True,id=1a21fab7-2746-481c-8003-5f8e6d67ea2a,network=Network(362446ea-173c-4989-93f8-882088822208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a21fab7-27') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:38:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:38:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:38:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1a21fab7-27, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:38:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1a21fab7-27, col_values=(('external_ids', {'iface-id': '1a21fab7-2746-481c-8003-5f8e6d67ea2a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:9c:15', 'vm-uuid': '94aedd29-1832-4ff4-97ac-d70ed1775223'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:38:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:38:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:22 user nova-compute[72362]: INFO os_vif [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:9c:15,bridge_name='br-int',has_traffic_filtering=True,id=1a21fab7-2746-481c-8003-5f8e6d67ea2a,network=Network(362446ea-173c-4989-93f8-882088822208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a21fab7-27')
Aug 09 10:38:23 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577502.677334, 96da3bac-a460-4253-a4f6-cd8de34e59f8 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:38:23 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] VM Resumed (Lifecycle Event)
Aug 09 10:38:23 user nova-compute[72362]: DEBUG nova.compute.manager [req-1fd9c735-83b6-4ca3-9923-ccfb8d8b335f req-90bf5fe7-4268-452c-a8ec-9747d7e2b1dc service nova] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Received event network-vif-plugged-c4b78135-dc1f-4eab-a5c6-e00aecfc09df {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:38:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-1fd9c735-83b6-4ca3-9923-ccfb8d8b335f req-90bf5fe7-4268-452c-a8ec-9747d7e2b1dc service nova] Acquiring lock "96da3bac-a460-4253-a4f6-cd8de34e59f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:38:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-1fd9c735-83b6-4ca3-9923-ccfb8d8b335f req-90bf5fe7-4268-452c-a8ec-9747d7e2b1dc service nova] Lock "96da3bac-a460-4253-a4f6-cd8de34e59f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:38:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-1fd9c735-83b6-4ca3-9923-ccfb8d8b335f req-90bf5fe7-4268-452c-a8ec-9747d7e2b1dc service nova] Lock "96da3bac-a460-4253-a4f6-cd8de34e59f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:38:23 user nova-compute[72362]: DEBUG nova.compute.manager [req-1fd9c735-83b6-4ca3-9923-ccfb8d8b335f req-90bf5fe7-4268-452c-a8ec-9747d7e2b1dc service nova] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] No waiting events found dispatching network-vif-plugged-c4b78135-dc1f-4eab-a5c6-e00aecfc09df {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:38:23 user nova-compute[72362]: WARNING nova.compute.manager [req-1fd9c735-83b6-4ca3-9923-ccfb8d8b335f req-90bf5fe7-4268-452c-a8ec-9747d7e2b1dc service nova] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Received unexpected event network-vif-plugged-c4b78135-dc1f-4eab-a5c6-e00aecfc09df for instance with vm_state building and task_state spawning.
Aug 09 10:38:23 user nova-compute[72362]: DEBUG nova.compute.manager [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:38:23 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:38:23 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:38:23 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:38:23 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:38:23 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:38:23 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=8127MB free_disk=25.054279327392578GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 10:38:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:38:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:38:23 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Instance spawned successfully.
Aug 09 10:38:23 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 10:38:23 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:38:23 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577502.67861, 96da3bac-a460-4253-a4f6-cd8de34e59f8 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:38:23 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] VM Started (Lifecycle Event)
Aug 09 10:38:23 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:38:23 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] No VIF found with MAC fa:16:3e:15:9c:15, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:38:23 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Found default for hw_cdrom_bus of ide {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:38:23 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Found default for hw_disk_bus of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:38:23 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:38:23 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:38:23 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Found default for hw_video_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:38:23 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Found default for hw_vif_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:38:23 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:38:23 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:38:23 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:38:23 user nova-compute[72362]: INFO nova.compute.manager [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Took 5.97 seconds to spawn the instance on the hypervisor.
Aug 09 10:38:23 user nova-compute[72362]: DEBUG nova.compute.manager [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:38:23 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 8e055c58-a365-4f18-a6e3-377e32e2189d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:38:23 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance be231c58-3e84-4b0f-bbbd-c44246954c47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:38:23 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:38:23 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance cefe383b-978f-4391-baf6-3b3ad17e0083 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:38:23 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 4296ca4c-1e3e-474f-98ba-9f947d333b8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:38:23 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance b74acebd-10f6-4c8e-9e58-f220b9483ade actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:38:23 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 96da3bac-a460-4253-a4f6-cd8de34e59f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:38:23 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 94aedd29-1832-4ff4-97ac-d70ed1775223 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:38:23 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 10:38:23 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 10:38:23 user nova-compute[72362]: INFO nova.compute.manager [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Took 6.93 seconds to build instance.
Aug 09 10:38:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d6ca7145-8669-44ae-827d-1b2882d1b9d5 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "96da3bac-a460-4253-a4f6-cd8de34e59f8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.132s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:38:23 user nova-compute[72362]: DEBUG nova.network.neutron [req-375decbb-9a15-464c-bd34-6598783a79fb req-0b930592-f699-4dbd-b5df-0382a0862baf service nova] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Updated VIF entry in instance network info cache for port 1a21fab7-2746-481c-8003-5f8e6d67ea2a. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:38:23 user nova-compute[72362]: DEBUG nova.network.neutron [req-375decbb-9a15-464c-bd34-6598783a79fb req-0b930592-f699-4dbd-b5df-0382a0862baf service nova] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Updating instance_info_cache with network_info: [{"id": "1a21fab7-2746-481c-8003-5f8e6d67ea2a", "address": "fa:16:3e:15:9c:15", "network": {"id": "362446ea-173c-4989-93f8-882088822208", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-499399633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f9d6a60f24d41deb91ae59189c62ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a21fab7-27", "ovs_interfaceid": "1a21fab7-2746-481c-8003-5f8e6d67ea2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:38:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-375decbb-9a15-464c-bd34-6598783a79fb req-0b930592-f699-4dbd-b5df-0382a0862baf service nova] Releasing lock "refresh_cache-94aedd29-1832-4ff4-97ac-d70ed1775223" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:38:23 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:38:23 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:38:23 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 10:38:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.469s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:38:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:24 user nova-compute[72362]: DEBUG nova.compute.manager [req-4a195f2e-3987-4ffb-b817-6fc0ce762552 req-bfde32f0-d11c-4ffd-b36c-f95157e304c9 service nova] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Received event network-vif-plugged-1a21fab7-2746-481c-8003-5f8e6d67ea2a {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:38:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-4a195f2e-3987-4ffb-b817-6fc0ce762552 req-bfde32f0-d11c-4ffd-b36c-f95157e304c9 service nova] Acquiring lock "94aedd29-1832-4ff4-97ac-d70ed1775223-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:38:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-4a195f2e-3987-4ffb-b817-6fc0ce762552 req-bfde32f0-d11c-4ffd-b36c-f95157e304c9 service nova] Lock "94aedd29-1832-4ff4-97ac-d70ed1775223-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:38:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-4a195f2e-3987-4ffb-b817-6fc0ce762552 req-bfde32f0-d11c-4ffd-b36c-f95157e304c9 service nova] Lock "94aedd29-1832-4ff4-97ac-d70ed1775223-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:38:24 user nova-compute[72362]: DEBUG nova.compute.manager [req-4a195f2e-3987-4ffb-b817-6fc0ce762552 req-bfde32f0-d11c-4ffd-b36c-f95157e304c9 service nova] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] No waiting events found dispatching network-vif-plugged-1a21fab7-2746-481c-8003-5f8e6d67ea2a {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:38:24 user nova-compute[72362]: WARNING nova.compute.manager [req-4a195f2e-3987-4ffb-b817-6fc0ce762552 req-bfde32f0-d11c-4ffd-b36c-f95157e304c9 service nova] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Received unexpected event network-vif-plugged-1a21fab7-2746-481c-8003-5f8e6d67ea2a for instance with vm_state building and task_state spawning.
Aug 09 10:38:25 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:25 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:25 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:26 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577506.5510323, 94aedd29-1832-4ff4-97ac-d70ed1775223 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:38:26 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] VM Resumed (Lifecycle Event)
Aug 09 10:38:26 user nova-compute[72362]: DEBUG nova.compute.manager [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:38:26 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:38:26 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Instance spawned successfully.
Aug 09 10:38:26 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 10:38:26 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:38:26 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:38:26 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Found default for hw_cdrom_bus of ide {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:38:26 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Found default for hw_disk_bus of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:38:26 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:38:26 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:38:26 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Found default for hw_video_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:38:26 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Found default for hw_vif_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:38:26 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:38:26 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577506.552403, 94aedd29-1832-4ff4-97ac-d70ed1775223 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:38:26 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] VM Started (Lifecycle Event)
Aug 09 10:38:26 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:38:26 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:38:26 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:38:26 user nova-compute[72362]: INFO nova.compute.manager [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Took 6.58 seconds to spawn the instance on the hypervisor.
Aug 09 10:38:26 user nova-compute[72362]: DEBUG nova.compute.manager [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:38:26 user nova-compute[72362]: INFO nova.compute.manager [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Took 7.28 seconds to build instance.
Aug 09 10:38:26 user nova-compute[72362]: DEBUG nova.compute.manager [req-697233b7-7931-429f-9d06-f95188646461 req-66b981b4-9506-424f-9b28-b640d776d70c service nova] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Received event network-vif-plugged-1a21fab7-2746-481c-8003-5f8e6d67ea2a {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:38:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-697233b7-7931-429f-9d06-f95188646461 req-66b981b4-9506-424f-9b28-b640d776d70c service nova] Acquiring lock "94aedd29-1832-4ff4-97ac-d70ed1775223-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:38:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-697233b7-7931-429f-9d06-f95188646461 req-66b981b4-9506-424f-9b28-b640d776d70c service nova] Lock "94aedd29-1832-4ff4-97ac-d70ed1775223-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:38:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-697233b7-7931-429f-9d06-f95188646461 req-66b981b4-9506-424f-9b28-b640d776d70c service nova] Lock "94aedd29-1832-4ff4-97ac-d70ed1775223-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:38:26 user nova-compute[72362]: DEBUG nova.compute.manager [req-697233b7-7931-429f-9d06-f95188646461 req-66b981b4-9506-424f-9b28-b640d776d70c service nova] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] No waiting events found dispatching network-vif-plugged-1a21fab7-2746-481c-8003-5f8e6d67ea2a {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:38:26 user nova-compute[72362]: WARNING nova.compute.manager [req-697233b7-7931-429f-9d06-f95188646461 req-66b981b4-9506-424f-9b28-b640d776d70c service nova] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Received unexpected event network-vif-plugged-1a21fab7-2746-481c-8003-5f8e6d67ea2a for instance with vm_state active and task_state None.
Aug 09 10:38:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d2d3975c-271a-4cdf-99d7-99a705f6d2ae tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "94aedd29-1832-4ff4-97ac-d70ed1775223" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.381s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:38:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:27 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691577492.9536467, 30213e67-6b1d-4d97-a971-1544335d02fb => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:38:27 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] VM Stopped (Lifecycle Event)
Aug 09 10:38:27 user nova-compute[72362]: DEBUG nova.compute.manager [None req-fc670990-b41e-4537-8aff-87b632fd6ca4 None None] [instance: 30213e67-6b1d-4d97-a971-1544335d02fb] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG nova.compute.manager [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Start spawning the instance on the hypervisor. {{(pid=72362) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:38:29 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Creating image(s)
Aug 09 10:38:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Did not create local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Ensure instance console log exists: /opt/stack/data/nova/instances/b74acebd-10f6-4c8e-9e58-f220b9483ade/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Start _get_guest_xml network_info=[{"id": "009988a8-77e4-434d-91da-20b13633dbee", "address": "fa:16:3e:1d:30:91", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap009988a8-77", "ovs_interfaceid": "009988a8-77e4-434d-91da-20b13633dbee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-09T10:38:04Z,direct_url=<?>,disk_format='qcow2',id=182a9ac9-42a8-4e27-a98d-8c58baa98ac7,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1767567638',owner='26e38599de0b4b06b723f5647a7fe121',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-09T10:38:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '571cb982-87cd-4687-9684-da7c45ccac2e', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3b415aae-03a1-4746-a19f-21a21a579290'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JeBFhrIA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b74acebd-10f6-4c8e-9e58-f220b9483ade', 'attached_at': '', 'detached_at': '', 'volume_id': '3b415aae-03a1-4746-a19f-21a21a579290', 'serial': '3b415aae-03a1-4746-a19f-21a21a579290'}, 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:38:29 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:38:29 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:38:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-09T10:38:04Z,direct_url=<?>,disk_format='qcow2',id=182a9ac9-42a8-4e27-a98d-8c58baa98ac7,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1767567638',owner='26e38599de0b4b06b723f5647a7fe121',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-09T10:38:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3b415aae-03a1-4746-a19f-21a21a579290'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JeBFhrIA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:38:29 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:38:29 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:38:29 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:38:29 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b415aae-03a1-4746-a19f-21a21a579290" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b415aae-03a1-4746-a19f-21a21a579290" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:38:29 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:38:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b415aae-03a1-4746-a19f-21a21a579290 -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b415aae-03a1-4746-a19f-21a21a579290 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[9176cfe0-ee65-423f-9966-9d1b8791bcdb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:38:29 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b415aae-03a1-4746-a19f-21a21a579290 -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b415aae-03a1-4746-a19f-21a21a579290 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd2f565-9518-4abc-9659-2b7ac5211d70]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b415aae-03a1-4746-a19f-21a21a579290] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b415aae-03a1-4746-a19f-21a21a579290] added
Aug 09 10:38:29 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b415aae-03a1-4746-a19f-21a21a579290 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b415aae-03a1-4746-a19f-21a21a579290 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc03b6cd-150f-46c3-a62e-92554a2395f1]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b415aae-03a1-4746-a19f-21a21a579290 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b415aae-03a1-4746-a19f-21a21a579290 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d709b7-323a-44b7-9351-d86af0d8c332]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b415aae-03a1-4746-a19f-21a21a579290 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JeBFhrIA {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b415aae-03a1-4746-a19f-21a21a579290 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JeBFhrIA" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0a0e0f-8f2e-44e2-8f79-532d0ebe4896]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JeBFhrIA'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b415aae-03a1-4746-a19f-21a21a579290 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b415aae-03a1-4746-a19f-21a21a579290 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e129ced-7ba3-4d1f-bfe3-d6ce50be4566]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0dd5b9-f0ad-43c7-8445-3f3c72cf47c3]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247 (non-flash)
Aug 09 10:38:29 user nova-compute[72362]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f (non-flash)
Aug 09 10:38:29 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247 (non-flash)
Aug 09 10:38:29 user nova-compute[72362]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f (non-flash)
Aug 09 10:38:29 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b415aae-03a1-4746-a19f-21a21a579290 -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b415aae-03a1-4746-a19f-21a21a579290 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab20c808-4aa3-4b66-81bd-e8219d66bcff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b415aae-03a1-4746-a19f-21a21a579290, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3b415aae-03a1-4746-a19f-21a21a579290, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b415aae-03a1-4746-a19f-21a21a579290, portal: 172.16.0.220,3260]
Aug 09 10:38:29 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:3b415aae-03a1-4746-a19f-21a21a579290, portal: 172.16.0.220,3260] successful.
Aug 09 10:38:29 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b415aae-03a1-4746-a19f-21a21a579290 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b415aae-03a1-4746-a19f-21a21a579290 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d19c77-8c24-4536-a628-808ea7a01d43]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[35cdd373-82bc-4aab-91df-606967d454fe]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b415aae-03a1-4746-a19f-21a21a579290 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247 (non-flash)
Aug 09 10:38:29 user nova-compute[72362]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f (non-flash)
Aug 09 10:38:29 user nova-compute[72362]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b415aae-03a1-4746-a19f-21a21a579290 (non-flash)
Aug 09 10:38:29 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247 (non-flash)
Aug 09 10:38:29 user nova-compute[72362]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f (non-flash)
Aug 09 10:38:29 user nova-compute[72362]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b415aae-03a1-4746-a19f-21a21a579290 (non-flash)
Aug 09 10:38:29 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b415aae-03a1-4746-a19f-21a21a579290" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] HCTL ('35', '-', '-', 0) found on session 52 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d081db-52a1-4fda-8e12-4ae48f7e4066]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:38:29 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JeBFhrIA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:38:30 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:38:30 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '26130306234633365', 'path': '/dev/sdd'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:38:30 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26130306234633365', 'path': '/dev/sdd'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:38:30 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:38:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1621959906',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1621959906',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1621959906',id=40,image_ref='182a9ac9-42a8-4e27-a98d-8c58baa98ac7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtRbmTGdtOAlCiY0DbF9ZM1jb5ziAsWHaXBtKmX1kRnCs6zDv3LcnQV5W5kybHpgabMt2uoD/bafJN8ihMDBhHeqVvmJDI7nW1hVwvWyCL3TjKASgCP0VJmxXrR0duwJw==',key_name='tempest-keypair-1925991308',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26e38599de0b4b06b723f5647a7fe121',ramdisk_id='',reservation_id='r-wqb9j386',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1478436240',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1478436240-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1478436240',owner_user_name='tempest-TestVolumeBootPattern-1478436240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:38:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e96900e953f64d02bdb5d48f136133c3',uuid=b74acebd-10f6-4c8e-9e58-f220b9483ade,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "009988a8-77e4-434d-91da-20b13633dbee", "address": "fa:16:3e:1d:30:91", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap009988a8-77", "ovs_interfaceid": "009988a8-77e4-434d-91da-20b13633dbee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:38:30 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Converting VIF {"id": "009988a8-77e4-434d-91da-20b13633dbee", "address": "fa:16:3e:1d:30:91", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap009988a8-77", "ovs_interfaceid": "009988a8-77e4-434d-91da-20b13633dbee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:38:30 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:30:91,bridge_name='br-int',has_traffic_filtering=True,id=009988a8-77e4-434d-91da-20b13633dbee,network=Network(b4a9e050-41f1-404a-bf5c-41421f034644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap009988a8-77') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:38:30 user nova-compute[72362]: DEBUG nova.objects.instance [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lazy-loading 'pci_devices' on Instance uuid b74acebd-10f6-4c8e-9e58-f220b9483ade {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:38:30 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:38:30 user nova-compute[72362]:   <uuid>b74acebd-10f6-4c8e-9e58-f220b9483ade</uuid>
Aug 09 10:38:30 user nova-compute[72362]:   <name>instance-00000028</name>
Aug 09 10:38:30 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:38:30 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:38:30 user nova-compute[72362]:   <metadata>
Aug 09 10:38:30 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:38:30 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:38:30 user nova-compute[72362]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1621959906</nova:name>
Aug 09 10:38:30 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:38:29</nova:creationTime>
Aug 09 10:38:30 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:38:30 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:38:30 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:38:30 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:38:30 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:38:30 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:38:30 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:38:30 user nova-compute[72362]:       <nova:owner>
Aug 09 10:38:30 user nova-compute[72362]:         <nova:user uuid="e96900e953f64d02bdb5d48f136133c3">tempest-TestVolumeBootPattern-1478436240-project-member</nova:user>
Aug 09 10:38:30 user nova-compute[72362]:         <nova:project uuid="26e38599de0b4b06b723f5647a7fe121">tempest-TestVolumeBootPattern-1478436240</nova:project>
Aug 09 10:38:30 user nova-compute[72362]:       </nova:owner>
Aug 09 10:38:30 user nova-compute[72362]:       <nova:root type="image" uuid="182a9ac9-42a8-4e27-a98d-8c58baa98ac7"/>
Aug 09 10:38:30 user nova-compute[72362]:       <nova:ports>
Aug 09 10:38:30 user nova-compute[72362]:         <nova:port uuid="009988a8-77e4-434d-91da-20b13633dbee">
Aug 09 10:38:30 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 10:38:30 user nova-compute[72362]:         </nova:port>
Aug 09 10:38:30 user nova-compute[72362]:       </nova:ports>
Aug 09 10:38:30 user nova-compute[72362]:     </nova:instance>
Aug 09 10:38:30 user nova-compute[72362]:   </metadata>
Aug 09 10:38:30 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:38:30 user nova-compute[72362]:     <system>
Aug 09 10:38:30 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:38:30 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:38:30 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:38:30 user nova-compute[72362]:       <entry name="serial">b74acebd-10f6-4c8e-9e58-f220b9483ade</entry>
Aug 09 10:38:30 user nova-compute[72362]:       <entry name="uuid">b74acebd-10f6-4c8e-9e58-f220b9483ade</entry>
Aug 09 10:38:30 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:38:30 user nova-compute[72362]:     </system>
Aug 09 10:38:30 user nova-compute[72362]:   </sysinfo>
Aug 09 10:38:30 user nova-compute[72362]:   <os>
Aug 09 10:38:30 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:38:30 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:38:30 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:38:30 user nova-compute[72362]:   </os>
Aug 09 10:38:30 user nova-compute[72362]:   <features>
Aug 09 10:38:30 user nova-compute[72362]:     <acpi/>
Aug 09 10:38:30 user nova-compute[72362]:     <apic/>
Aug 09 10:38:30 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:38:30 user nova-compute[72362]:   </features>
Aug 09 10:38:30 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:38:30 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:38:30 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:38:30 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:38:30 user nova-compute[72362]:   </clock>
Aug 09 10:38:30 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:38:30 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:38:30 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:38:30 user nova-compute[72362]:   </cpu>
Aug 09 10:38:30 user nova-compute[72362]:   <devices>
Aug 09 10:38:30 user nova-compute[72362]:     <disk type="block" device="disk">
Aug 09 10:38:30 user nova-compute[72362]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:38:30 user nova-compute[72362]:       <source dev="/dev/sdd"/>
Aug 09 10:38:30 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:38:30 user nova-compute[72362]:       <serial>3b415aae-03a1-4746-a19f-21a21a579290</serial>
Aug 09 10:38:30 user nova-compute[72362]:     </disk>
Aug 09 10:38:30 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:38:30 user nova-compute[72362]:       <mac address="fa:16:3e:1d:30:91"/>
Aug 09 10:38:30 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:38:30 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:38:30 user nova-compute[72362]:       <target dev="tap009988a8-77"/>
Aug 09 10:38:30 user nova-compute[72362]:     </interface>
Aug 09 10:38:30 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:38:30 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/b74acebd-10f6-4c8e-9e58-f220b9483ade/console.log" append="off"/>
Aug 09 10:38:30 user nova-compute[72362]:     </serial>
Aug 09 10:38:30 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:38:30 user nova-compute[72362]:     <video>
Aug 09 10:38:30 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:38:30 user nova-compute[72362]:     </video>
Aug 09 10:38:30 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:38:30 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:38:30 user nova-compute[72362]:     </rng>
Aug 09 10:38:30 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:38:30 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:38:30 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:38:30 user nova-compute[72362]:     </memballoon>
Aug 09 10:38:30 user nova-compute[72362]:   </devices>
Aug 09 10:38:30 user nova-compute[72362]: </domain>
Aug 09 10:38:30 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:38:30 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:38:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1621959906',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1621959906',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1621959906',id=40,image_ref='182a9ac9-42a8-4e27-a98d-8c58baa98ac7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtRbmTGdtOAlCiY0DbF9ZM1jb5ziAsWHaXBtKmX1kRnCs6zDv3LcnQV5W5kybHpgabMt2uoD/bafJN8ihMDBhHeqVvmJDI7nW1hVwvWyCL3TjKASgCP0VJmxXrR0duwJw==',key_name='tempest-keypair-1925991308',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26e38599de0b4b06b723f5647a7fe121',ramdisk_id='',reservation_id='r-wqb9j386',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1478436240',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1478436240-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1478436240',owner_user_name='tempest-TestVolumeBootPattern-1478436240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:38:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e96900e953f64d02bdb5d48f136133c3',uuid=b74acebd-10f6-4c8e-9e58-f220b9483ade,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "009988a8-77e4-434d-91da-20b13633dbee", "address": "fa:16:3e:1d:30:91", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap009988a8-77", "ovs_interfaceid": "009988a8-77e4-434d-91da-20b13633dbee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:38:30 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Converting VIF {"id": "009988a8-77e4-434d-91da-20b13633dbee", "address": "fa:16:3e:1d:30:91", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap009988a8-77", "ovs_interfaceid": "009988a8-77e4-434d-91da-20b13633dbee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:38:30 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:30:91,bridge_name='br-int',has_traffic_filtering=True,id=009988a8-77e4-434d-91da-20b13633dbee,network=Network(b4a9e050-41f1-404a-bf5c-41421f034644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap009988a8-77') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:38:30 user nova-compute[72362]: DEBUG os_vif [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:30:91,bridge_name='br-int',has_traffic_filtering=True,id=009988a8-77e4-434d-91da-20b13633dbee,network=Network(b4a9e050-41f1-404a-bf5c-41421f034644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap009988a8-77') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:38:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:38:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:38:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap009988a8-77, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:38:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap009988a8-77, col_values=(('external_ids', {'iface-id': '009988a8-77e4-434d-91da-20b13633dbee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:30:91', 'vm-uuid': 'b74acebd-10f6-4c8e-9e58-f220b9483ade'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:38:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:38:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:30 user nova-compute[72362]: INFO os_vif [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:30:91,bridge_name='br-int',has_traffic_filtering=True,id=009988a8-77e4-434d-91da-20b13633dbee,network=Network(b4a9e050-41f1-404a-bf5c-41421f034644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap009988a8-77')
Aug 09 10:38:30 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:38:30 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] No VIF found with MAC fa:16:3e:1d:30:91, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:38:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:32 user nova-compute[72362]: DEBUG nova.compute.manager [req-e6f5c860-0286-4b53-8afa-97110cea3485 req-35e92850-8e84-4297-afbf-0d9c0858d803 service nova] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Received event network-vif-plugged-009988a8-77e4-434d-91da-20b13633dbee {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:38:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e6f5c860-0286-4b53-8afa-97110cea3485 req-35e92850-8e84-4297-afbf-0d9c0858d803 service nova] Acquiring lock "b74acebd-10f6-4c8e-9e58-f220b9483ade-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:38:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e6f5c860-0286-4b53-8afa-97110cea3485 req-35e92850-8e84-4297-afbf-0d9c0858d803 service nova] Lock "b74acebd-10f6-4c8e-9e58-f220b9483ade-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:38:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e6f5c860-0286-4b53-8afa-97110cea3485 req-35e92850-8e84-4297-afbf-0d9c0858d803 service nova] Lock "b74acebd-10f6-4c8e-9e58-f220b9483ade-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:38:32 user nova-compute[72362]: DEBUG nova.compute.manager [req-e6f5c860-0286-4b53-8afa-97110cea3485 req-35e92850-8e84-4297-afbf-0d9c0858d803 service nova] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] No waiting events found dispatching network-vif-plugged-009988a8-77e4-434d-91da-20b13633dbee {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:38:32 user nova-compute[72362]: WARNING nova.compute.manager [req-e6f5c860-0286-4b53-8afa-97110cea3485 req-35e92850-8e84-4297-afbf-0d9c0858d803 service nova] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Received unexpected event network-vif-plugged-009988a8-77e4-434d-91da-20b13633dbee for instance with vm_state building and task_state spawning.
Aug 09 10:38:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:34 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577514.1895387, b74acebd-10f6-4c8e-9e58-f220b9483ade => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:38:34 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] VM Resumed (Lifecycle Event)
Aug 09 10:38:34 user nova-compute[72362]: DEBUG nova.compute.manager [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:38:34 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:38:34 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Instance spawned successfully.
Aug 09 10:38:34 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 10:38:34 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:38:34 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:38:34 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:38:34 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:38:34 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:38:34 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577514.1904502, b74acebd-10f6-4c8e-9e58-f220b9483ade => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:38:34 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] VM Started (Lifecycle Event)
Aug 09 10:38:34 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:38:34 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:38:34 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:38:34 user nova-compute[72362]: DEBUG nova.compute.manager [req-aa91d094-56be-4cc7-963a-ea95f3a8bf85 req-29135ef9-0e1d-4126-a3a4-07037a6115ef service nova] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Received event network-vif-plugged-009988a8-77e4-434d-91da-20b13633dbee {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:38:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-aa91d094-56be-4cc7-963a-ea95f3a8bf85 req-29135ef9-0e1d-4126-a3a4-07037a6115ef service nova] Acquiring lock "b74acebd-10f6-4c8e-9e58-f220b9483ade-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:38:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-aa91d094-56be-4cc7-963a-ea95f3a8bf85 req-29135ef9-0e1d-4126-a3a4-07037a6115ef service nova] Lock "b74acebd-10f6-4c8e-9e58-f220b9483ade-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:38:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-aa91d094-56be-4cc7-963a-ea95f3a8bf85 req-29135ef9-0e1d-4126-a3a4-07037a6115ef service nova] Lock "b74acebd-10f6-4c8e-9e58-f220b9483ade-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:38:34 user nova-compute[72362]: DEBUG nova.compute.manager [req-aa91d094-56be-4cc7-963a-ea95f3a8bf85 req-29135ef9-0e1d-4126-a3a4-07037a6115ef service nova] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] No waiting events found dispatching network-vif-plugged-009988a8-77e4-434d-91da-20b13633dbee {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:38:34 user nova-compute[72362]: WARNING nova.compute.manager [req-aa91d094-56be-4cc7-963a-ea95f3a8bf85 req-29135ef9-0e1d-4126-a3a4-07037a6115ef service nova] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Received unexpected event network-vif-plugged-009988a8-77e4-434d-91da-20b13633dbee for instance with vm_state building and task_state spawning.
Aug 09 10:38:34 user nova-compute[72362]: INFO nova.compute.manager [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Took 5.28 seconds to spawn the instance on the hypervisor.
Aug 09 10:38:34 user nova-compute[72362]: DEBUG nova.compute.manager [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:38:34 user nova-compute[72362]: INFO nova.compute.manager [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Took 20.67 seconds to build instance.
Aug 09 10:38:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-11d3ea4b-4116-4481-8a55-6e34eeba4414 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "b74acebd-10f6-4c8e-9e58-f220b9483ade" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.761s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:38:35 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:45 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:50 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:52 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:55 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:38:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:39:00 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:39:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:39:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c8c3459a-ad4a-4ca1-8cfc-5b086b9b03b8 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquiring lock "8e055c58-a365-4f18-a6e3-377e32e2189d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:39:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c8c3459a-ad4a-4ca1-8cfc-5b086b9b03b8 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "8e055c58-a365-4f18-a6e3-377e32e2189d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:39:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c8c3459a-ad4a-4ca1-8cfc-5b086b9b03b8 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquiring lock "8e055c58-a365-4f18-a6e3-377e32e2189d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:39:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c8c3459a-ad4a-4ca1-8cfc-5b086b9b03b8 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "8e055c58-a365-4f18-a6e3-377e32e2189d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:39:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c8c3459a-ad4a-4ca1-8cfc-5b086b9b03b8 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "8e055c58-a365-4f18-a6e3-377e32e2189d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:39:03 user nova-compute[72362]: INFO nova.compute.manager [None req-c8c3459a-ad4a-4ca1-8cfc-5b086b9b03b8 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Terminating instance
Aug 09 10:39:03 user nova-compute[72362]: DEBUG nova.compute.manager [None req-c8c3459a-ad4a-4ca1-8cfc-5b086b9b03b8 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Start destroying the instance on the hypervisor. {{(pid=72362) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 10:39:03 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:39:03 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:39:03 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:39:03 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:39:03 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:39:04 user nova-compute[72362]: DEBUG nova.compute.manager [req-80e2f7dd-75ad-4ead-8a5d-38aa36dc1cd1 req-616361ed-361b-4fa5-85fe-d59755eb0817 service nova] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Received event network-vif-unplugged-f1a870b6-1d3b-4567-b165-8f2571edf9bd {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:39:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-80e2f7dd-75ad-4ead-8a5d-38aa36dc1cd1 req-616361ed-361b-4fa5-85fe-d59755eb0817 service nova] Acquiring lock "8e055c58-a365-4f18-a6e3-377e32e2189d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:39:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-80e2f7dd-75ad-4ead-8a5d-38aa36dc1cd1 req-616361ed-361b-4fa5-85fe-d59755eb0817 service nova] Lock "8e055c58-a365-4f18-a6e3-377e32e2189d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:39:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-80e2f7dd-75ad-4ead-8a5d-38aa36dc1cd1 req-616361ed-361b-4fa5-85fe-d59755eb0817 service nova] Lock "8e055c58-a365-4f18-a6e3-377e32e2189d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:39:04 user nova-compute[72362]: DEBUG nova.compute.manager [req-80e2f7dd-75ad-4ead-8a5d-38aa36dc1cd1 req-616361ed-361b-4fa5-85fe-d59755eb0817 service nova] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] No waiting events found dispatching network-vif-unplugged-f1a870b6-1d3b-4567-b165-8f2571edf9bd {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:39:04 user nova-compute[72362]: DEBUG nova.compute.manager [req-80e2f7dd-75ad-4ead-8a5d-38aa36dc1cd1 req-616361ed-361b-4fa5-85fe-d59755eb0817 service nova] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Received event network-vif-unplugged-f1a870b6-1d3b-4567-b165-8f2571edf9bd for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:39:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:39:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:39:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:39:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:39:04 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Instance destroyed successfully.
Aug 09 10:39:04 user nova-compute[72362]: DEBUG nova.objects.instance [None req-c8c3459a-ad4a-4ca1-8cfc-5b086b9b03b8 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lazy-loading 'resources' on Instance uuid 8e055c58-a365-4f18-a6e3-377e32e2189d {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:39:04 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-c8c3459a-ad4a-4ca1-8cfc-5b086b9b03b8 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:19:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1293388884',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1293388884',id=12,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:19:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f206cedc59df46deb91e7ec2167c1f2b',ramdisk_id='',reservation_id='r-yyx17fjp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1706340435',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:21:21Z,user_data=None,user_id='4a1904ffd10b4e8b959971b5e2383113',uuid=8e055c58-a365-4f18-a6e3-377e32e2189d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f1a870b6-1d3b-4567-b165-8f2571edf9bd", "address": "fa:16:3e:d7:84:09", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a870b6-1d", "ovs_interfaceid": "f1a870b6-1d3b-4567-b165-8f2571edf9bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:39:04 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-c8c3459a-ad4a-4ca1-8cfc-5b086b9b03b8 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Converting VIF {"id": "f1a870b6-1d3b-4567-b165-8f2571edf9bd", "address": "fa:16:3e:d7:84:09", "network": {"id": "bb852331-57aa-4911-b8ff-30f5411f65b0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-287881666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f206cedc59df46deb91e7ec2167c1f2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a870b6-1d", "ovs_interfaceid": "f1a870b6-1d3b-4567-b165-8f2571edf9bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:39:04 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-c8c3459a-ad4a-4ca1-8cfc-5b086b9b03b8 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:84:09,bridge_name='br-int',has_traffic_filtering=True,id=f1a870b6-1d3b-4567-b165-8f2571edf9bd,network=Network(bb852331-57aa-4911-b8ff-30f5411f65b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1a870b6-1d') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:39:04 user nova-compute[72362]: DEBUG os_vif [None req-c8c3459a-ad4a-4ca1-8cfc-5b086b9b03b8 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:84:09,bridge_name='br-int',has_traffic_filtering=True,id=f1a870b6-1d3b-4567-b165-8f2571edf9bd,network=Network(bb852331-57aa-4911-b8ff-30f5411f65b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1a870b6-1d') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:39:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:39:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf1a870b6-1d, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:39:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:39:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:39:04 user nova-compute[72362]: INFO os_vif [None req-c8c3459a-ad4a-4ca1-8cfc-5b086b9b03b8 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:84:09,bridge_name='br-int',has_traffic_filtering=True,id=f1a870b6-1d3b-4567-b165-8f2571edf9bd,network=Network(bb852331-57aa-4911-b8ff-30f5411f65b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1a870b6-1d')
Aug 09 10:39:04 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-c8c3459a-ad4a-4ca1-8cfc-5b086b9b03b8 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Deleting instance files /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d_del
Aug 09 10:39:04 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-c8c3459a-ad4a-4ca1-8cfc-5b086b9b03b8 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Deletion of /opt/stack/data/nova/instances/8e055c58-a365-4f18-a6e3-377e32e2189d_del complete
Aug 09 10:39:04 user nova-compute[72362]: INFO nova.compute.manager [None req-c8c3459a-ad4a-4ca1-8cfc-5b086b9b03b8 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 09 10:39:04 user nova-compute[72362]: DEBUG oslo.service.loopingcall [None req-c8c3459a-ad4a-4ca1-8cfc-5b086b9b03b8 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72362) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 10:39:04 user nova-compute[72362]: DEBUG nova.compute.manager [-] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Deallocating network for instance {{(pid=72362) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 10:39:04 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] deallocate_for_instance() {{(pid=72362) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 10:39:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:39:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:39:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:39:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:39:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:39:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:39:05 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:39:05 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Took 0.66 seconds to deallocate network for instance.
Aug 09 10:39:05 user nova-compute[72362]: DEBUG nova.compute.manager [req-3ade1f7b-04d4-4080-a635-dc1bac9870c3 req-339da96d-ebaf-40a5-a4b5-5cad06356f93 service nova] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Received event network-vif-deleted-f1a870b6-1d3b-4567-b165-8f2571edf9bd {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:39:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c8c3459a-ad4a-4ca1-8cfc-5b086b9b03b8 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:39:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c8c3459a-ad4a-4ca1-8cfc-5b086b9b03b8 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:39:05 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-c8c3459a-ad4a-4ca1-8cfc-5b086b9b03b8 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:39:05 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-c8c3459a-ad4a-4ca1-8cfc-5b086b9b03b8 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:39:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c8c3459a-ad4a-4ca1-8cfc-5b086b9b03b8 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.267s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:39:05 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-c8c3459a-ad4a-4ca1-8cfc-5b086b9b03b8 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Deleted allocations for instance 8e055c58-a365-4f18-a6e3-377e32e2189d
Aug 09 10:39:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c8c3459a-ad4a-4ca1-8cfc-5b086b9b03b8 tempest-ServerBootFromVolumeStableRescueTest-1706340435 tempest-ServerBootFromVolumeStableRescueTest-1706340435-project-member] Lock "8e055c58-a365-4f18-a6e3-377e32e2189d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.037s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:39:06 user nova-compute[72362]: DEBUG nova.compute.manager [req-b119aeb7-658f-4ad4-962e-708ebc5944f7 req-9e53f87e-3227-44b0-b948-f9b4ebd7ae62 service nova] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Received event network-vif-plugged-f1a870b6-1d3b-4567-b165-8f2571edf9bd {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:39:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b119aeb7-658f-4ad4-962e-708ebc5944f7 req-9e53f87e-3227-44b0-b948-f9b4ebd7ae62 service nova] Acquiring lock "8e055c58-a365-4f18-a6e3-377e32e2189d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:39:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b119aeb7-658f-4ad4-962e-708ebc5944f7 req-9e53f87e-3227-44b0-b948-f9b4ebd7ae62 service nova] Lock "8e055c58-a365-4f18-a6e3-377e32e2189d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:39:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b119aeb7-658f-4ad4-962e-708ebc5944f7 req-9e53f87e-3227-44b0-b948-f9b4ebd7ae62 service nova] Lock "8e055c58-a365-4f18-a6e3-377e32e2189d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:39:06 user nova-compute[72362]: DEBUG nova.compute.manager [req-b119aeb7-658f-4ad4-962e-708ebc5944f7 req-9e53f87e-3227-44b0-b948-f9b4ebd7ae62 service nova] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] No waiting events found dispatching network-vif-plugged-f1a870b6-1d3b-4567-b165-8f2571edf9bd {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:39:06 user nova-compute[72362]: WARNING nova.compute.manager [req-b119aeb7-658f-4ad4-962e-708ebc5944f7 req-9e53f87e-3227-44b0-b948-f9b4ebd7ae62 service nova] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Received unexpected event network-vif-plugged-f1a870b6-1d3b-4567-b165-8f2571edf9bd for instance with vm_state deleted and task_state None.
Aug 09 10:39:06 user nova-compute[72362]: DEBUG nova.compute.manager [req-b119aeb7-658f-4ad4-962e-708ebc5944f7 req-9e53f87e-3227-44b0-b948-f9b4ebd7ae62 service nova] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Received event network-vif-plugged-f1a870b6-1d3b-4567-b165-8f2571edf9bd {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:39:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b119aeb7-658f-4ad4-962e-708ebc5944f7 req-9e53f87e-3227-44b0-b948-f9b4ebd7ae62 service nova] Acquiring lock "8e055c58-a365-4f18-a6e3-377e32e2189d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:39:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b119aeb7-658f-4ad4-962e-708ebc5944f7 req-9e53f87e-3227-44b0-b948-f9b4ebd7ae62 service nova] Lock "8e055c58-a365-4f18-a6e3-377e32e2189d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:39:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b119aeb7-658f-4ad4-962e-708ebc5944f7 req-9e53f87e-3227-44b0-b948-f9b4ebd7ae62 service nova] Lock "8e055c58-a365-4f18-a6e3-377e32e2189d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:39:06 user nova-compute[72362]: DEBUG nova.compute.manager [req-b119aeb7-658f-4ad4-962e-708ebc5944f7 req-9e53f87e-3227-44b0-b948-f9b4ebd7ae62 service nova] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] No waiting events found dispatching network-vif-plugged-f1a870b6-1d3b-4567-b165-8f2571edf9bd {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:39:06 user nova-compute[72362]: WARNING nova.compute.manager [req-b119aeb7-658f-4ad4-962e-708ebc5944f7 req-9e53f87e-3227-44b0-b948-f9b4ebd7ae62 service nova] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Received unexpected event network-vif-plugged-f1a870b6-1d3b-4567-b165-8f2571edf9bd for instance with vm_state deleted and task_state None.
Aug 09 10:39:06 user nova-compute[72362]: DEBUG nova.compute.manager [req-b119aeb7-658f-4ad4-962e-708ebc5944f7 req-9e53f87e-3227-44b0-b948-f9b4ebd7ae62 service nova] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Received event network-vif-plugged-f1a870b6-1d3b-4567-b165-8f2571edf9bd {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:39:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b119aeb7-658f-4ad4-962e-708ebc5944f7 req-9e53f87e-3227-44b0-b948-f9b4ebd7ae62 service nova] Acquiring lock "8e055c58-a365-4f18-a6e3-377e32e2189d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:39:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b119aeb7-658f-4ad4-962e-708ebc5944f7 req-9e53f87e-3227-44b0-b948-f9b4ebd7ae62 service nova] Lock "8e055c58-a365-4f18-a6e3-377e32e2189d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:39:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b119aeb7-658f-4ad4-962e-708ebc5944f7 req-9e53f87e-3227-44b0-b948-f9b4ebd7ae62 service nova] Lock "8e055c58-a365-4f18-a6e3-377e32e2189d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:39:06 user nova-compute[72362]: DEBUG nova.compute.manager [req-b119aeb7-658f-4ad4-962e-708ebc5944f7 req-9e53f87e-3227-44b0-b948-f9b4ebd7ae62 service nova] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] No waiting events found dispatching network-vif-plugged-f1a870b6-1d3b-4567-b165-8f2571edf9bd {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:39:06 user nova-compute[72362]: WARNING nova.compute.manager [req-b119aeb7-658f-4ad4-962e-708ebc5944f7 req-9e53f87e-3227-44b0-b948-f9b4ebd7ae62 service nova] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Received unexpected event network-vif-plugged-f1a870b6-1d3b-4567-b165-8f2571edf9bd for instance with vm_state deleted and task_state None.
Aug 09 10:39:06 user nova-compute[72362]: DEBUG nova.compute.manager [req-b119aeb7-658f-4ad4-962e-708ebc5944f7 req-9e53f87e-3227-44b0-b948-f9b4ebd7ae62 service nova] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Received event network-vif-unplugged-f1a870b6-1d3b-4567-b165-8f2571edf9bd {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:39:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b119aeb7-658f-4ad4-962e-708ebc5944f7 req-9e53f87e-3227-44b0-b948-f9b4ebd7ae62 service nova] Acquiring lock "8e055c58-a365-4f18-a6e3-377e32e2189d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:39:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b119aeb7-658f-4ad4-962e-708ebc5944f7 req-9e53f87e-3227-44b0-b948-f9b4ebd7ae62 service nova] Lock "8e055c58-a365-4f18-a6e3-377e32e2189d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:39:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b119aeb7-658f-4ad4-962e-708ebc5944f7 req-9e53f87e-3227-44b0-b948-f9b4ebd7ae62 service nova] Lock "8e055c58-a365-4f18-a6e3-377e32e2189d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:39:06 user nova-compute[72362]: DEBUG nova.compute.manager [req-b119aeb7-658f-4ad4-962e-708ebc5944f7 req-9e53f87e-3227-44b0-b948-f9b4ebd7ae62 service nova] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] No waiting events found dispatching network-vif-unplugged-f1a870b6-1d3b-4567-b165-8f2571edf9bd {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:39:06 user nova-compute[72362]: WARNING nova.compute.manager [req-b119aeb7-658f-4ad4-962e-708ebc5944f7 req-9e53f87e-3227-44b0-b948-f9b4ebd7ae62 service nova] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Received unexpected event network-vif-unplugged-f1a870b6-1d3b-4567-b165-8f2571edf9bd for instance with vm_state deleted and task_state None.
Aug 09 10:39:06 user nova-compute[72362]: DEBUG nova.compute.manager [req-b119aeb7-658f-4ad4-962e-708ebc5944f7 req-9e53f87e-3227-44b0-b948-f9b4ebd7ae62 service nova] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Received event network-vif-plugged-f1a870b6-1d3b-4567-b165-8f2571edf9bd {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:39:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b119aeb7-658f-4ad4-962e-708ebc5944f7 req-9e53f87e-3227-44b0-b948-f9b4ebd7ae62 service nova] Acquiring lock "8e055c58-a365-4f18-a6e3-377e32e2189d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:39:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b119aeb7-658f-4ad4-962e-708ebc5944f7 req-9e53f87e-3227-44b0-b948-f9b4ebd7ae62 service nova] Lock "8e055c58-a365-4f18-a6e3-377e32e2189d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:39:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b119aeb7-658f-4ad4-962e-708ebc5944f7 req-9e53f87e-3227-44b0-b948-f9b4ebd7ae62 service nova] Lock "8e055c58-a365-4f18-a6e3-377e32e2189d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:39:06 user nova-compute[72362]: DEBUG nova.compute.manager [req-b119aeb7-658f-4ad4-962e-708ebc5944f7 req-9e53f87e-3227-44b0-b948-f9b4ebd7ae62 service nova] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] No waiting events found dispatching network-vif-plugged-f1a870b6-1d3b-4567-b165-8f2571edf9bd {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:39:06 user nova-compute[72362]: WARNING nova.compute.manager [req-b119aeb7-658f-4ad4-962e-708ebc5944f7 req-9e53f87e-3227-44b0-b948-f9b4ebd7ae62 service nova] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Received unexpected event network-vif-plugged-f1a870b6-1d3b-4567-b165-8f2571edf9bd for instance with vm_state deleted and task_state None.
Aug 09 10:39:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:39:09 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:39:12 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:39:12 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:39:12 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 10:39:12 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Rebuilding the list of instances to heal {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 10:39:12 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "refresh_cache-be231c58-3e84-4b0f-bbbd-c44246954c47" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:39:12 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquired lock "refresh_cache-be231c58-3e84-4b0f-bbbd-c44246954c47" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:39:12 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Forcefully refreshing network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 10:39:12 user nova-compute[72362]: DEBUG nova.objects.instance [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lazy-loading 'info_cache' on Instance uuid be231c58-3e84-4b0f-bbbd-c44246954c47 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:39:13 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Updating instance_info_cache with network_info: [{"id": "4c907e79-d540-4521-bc58-ebc624c13456", "address": "fa:16:3e:ea:97:51", "network": {"id": "e56e2a0a-0a6d-4546-86ef-7bb333e829ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1495216341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980f1c36cab0449b949419cf495c16d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c907e79-d5", "ovs_interfaceid": "4c907e79-d540-4521-bc58-ebc624c13456", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:39:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Releasing lock "refresh_cache-be231c58-3e84-4b0f-bbbd-c44246954c47" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:39:13 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Updated the network info_cache for instance {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 10:39:13 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:39:13 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:39:13 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:39:13 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:39:13 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:39:13 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:39:13 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 10:39:14 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:39:14 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:39:14 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 10:39:14 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 10:39:14 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 10:39:14 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:39:18 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:39:18 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:39:18 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:39:18 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:39:18 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 10:39:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be231c58-3e84-4b0f-bbbd-c44246954c47/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:39:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be231c58-3e84-4b0f-bbbd-c44246954c47/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:39:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be231c58-3e84-4b0f-bbbd-c44246954c47/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:39:19 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691577544.3954096, 8e055c58-a365-4f18-a6e3-377e32e2189d => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:39:19 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] VM Stopped (Lifecycle Event)
Aug 09 10:39:19 user nova-compute[72362]: DEBUG nova.compute.manager [None req-5f0f8c6a-6c84-4a19-8bd2-21b2a84459c7 None None] [instance: 8e055c58-a365-4f18-a6e3-377e32e2189d] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:39:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be231c58-3e84-4b0f-bbbd-c44246954c47/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:39:19 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:39:19 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:39:19 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:39:19 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:39:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:39:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:39:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:39:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:39:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96da3bac-a460-4253-a4f6-cd8de34e59f8/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:39:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96da3bac-a460-4253-a4f6-cd8de34e59f8/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:39:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96da3bac-a460-4253-a4f6-cd8de34e59f8/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:39:19 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96da3bac-a460-4253-a4f6-cd8de34e59f8/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:39:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:39:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:39:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:39:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:39:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94aedd29-1832-4ff4-97ac-d70ed1775223/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:39:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94aedd29-1832-4ff4-97ac-d70ed1775223/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:39:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94aedd29-1832-4ff4-97ac-d70ed1775223/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:39:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94aedd29-1832-4ff4-97ac-d70ed1775223/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:39:20 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:39:21 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:39:21 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=7842MB free_disk=25.12039566040039GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 10:39:21 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:39:21 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:39:21 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance be231c58-3e84-4b0f-bbbd-c44246954c47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:39:21 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:39:21 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance cefe383b-978f-4391-baf6-3b3ad17e0083 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:39:21 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 4296ca4c-1e3e-474f-98ba-9f947d333b8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:39:21 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance b74acebd-10f6-4c8e-9e58-f220b9483ade actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:39:21 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 96da3bac-a460-4253-a4f6-cd8de34e59f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:39:21 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 94aedd29-1832-4ff4-97ac-d70ed1775223 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:39:21 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 10:39:21 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 10:39:21 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:39:21 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:39:21 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 10:39:21 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.395s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:39:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:39:27 user nova-compute[72362]: INFO nova.compute.manager [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Rescuing
Aug 09 10:39:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Acquiring lock "refresh_cache-4296ca4c-1e3e-474f-98ba-9f947d333b8d" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:39:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Acquired lock "refresh_cache-4296ca4c-1e3e-474f-98ba-9f947d333b8d" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:39:27 user nova-compute[72362]: DEBUG nova.network.neutron [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:39:27 user nova-compute[72362]: DEBUG nova.network.neutron [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Updating instance_info_cache with network_info: [{"id": "434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9", "address": "fa:16:3e:09:7c:97", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434ea21d-d4", "ovs_interfaceid": "434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:39:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Releasing lock "refresh_cache-4296ca4c-1e3e-474f-98ba-9f947d333b8d" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:39:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:39:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:39:28 user nova-compute[72362]: DEBUG nova.compute.manager [req-546af726-f364-4c5e-9906-79cc3fd0917e req-158a347e-6cc9-4408-b16d-1d1ab4b2e74a service nova] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Received event network-vif-unplugged-434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:39:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-546af726-f364-4c5e-9906-79cc3fd0917e req-158a347e-6cc9-4408-b16d-1d1ab4b2e74a service nova] Acquiring lock "4296ca4c-1e3e-474f-98ba-9f947d333b8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:39:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-546af726-f364-4c5e-9906-79cc3fd0917e req-158a347e-6cc9-4408-b16d-1d1ab4b2e74a service nova] Lock "4296ca4c-1e3e-474f-98ba-9f947d333b8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:39:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-546af726-f364-4c5e-9906-79cc3fd0917e req-158a347e-6cc9-4408-b16d-1d1ab4b2e74a service nova] Lock "4296ca4c-1e3e-474f-98ba-9f947d333b8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:39:28 user nova-compute[72362]: DEBUG nova.compute.manager [req-546af726-f364-4c5e-9906-79cc3fd0917e req-158a347e-6cc9-4408-b16d-1d1ab4b2e74a service nova] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] No waiting events found dispatching network-vif-unplugged-434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:39:28 user nova-compute[72362]: WARNING nova.compute.manager [req-546af726-f364-4c5e-9906-79cc3fd0917e req-158a347e-6cc9-4408-b16d-1d1ab4b2e74a service nova] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Received unexpected event network-vif-unplugged-434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9 for instance with vm_state active and task_state rescuing.
Aug 09 10:39:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:39:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:39:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:39:28 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Instance destroyed successfully.
Aug 09 10:39:28 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Attempting rescue
Aug 09 10:39:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72362) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 09 10:39:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Instance directory exists: not creating {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 10:39:28 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Creating image(s)
Aug 09 10:39:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Acquiring lock "/opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:39:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "/opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:39:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "/opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:39:28 user nova-compute[72362]: DEBUG nova.objects.instance [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4296ca4c-1e3e-474f-98ba-9f947d333b8d {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:39:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Acquiring lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:39:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:39:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:39:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.135s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:39:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:39:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue" returned: 0 in 0.062s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:39:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:39:28 user nova-compute[72362]: DEBUG nova.objects.instance [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lazy-loading 'migration_context' on Instance uuid 4296ca4c-1e3e-474f-98ba-9f947d333b8d {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:39:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Created local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 10:39:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Start _get_guest_xml network_info=[{"id": "434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9", "address": "fa:16:3e:09:7c:97", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "vif_mac": "fa:16:3e:09:7c:97"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434ea21d-d4", "ovs_interfaceid": "434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a08d1a11-49eb-4212-a351-e11ee9553b95', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:39:28 user nova-compute[72362]: DEBUG nova.objects.instance [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lazy-loading 'resources' on Instance uuid 4296ca4c-1e3e-474f-98ba-9f947d333b8d {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:39:28 user nova-compute[72362]: DEBUG nova.objects.instance [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lazy-loading 'numa_topology' on Instance uuid 4296ca4c-1e3e-474f-98ba-9f947d333b8d {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:39:28 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:39:28 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:39:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:39:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:39:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:39:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:39:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:39:28 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:39:28 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:39:28 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:39:28 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:39:28 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:39:28 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:39:28 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:39:28 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:39:28 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:39:28 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:39:28 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:39:28 user nova-compute[72362]: DEBUG nova.objects.instance [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4296ca4c-1e3e-474f-98ba-9f947d333b8d {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:39:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:37:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1444056871',display_name='tempest-ServerRescueNegativeTestJSON-server-1444056871',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1444056871',id=39,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:37:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac17209f912a4f248dd642be32a75ede',ramdisk_id='',reservation_id='r-sfmqf8yu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1453574557',owner_user_name='tempest-ServerRescueNegativeTestJSON-1453574557-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:37:45Z,user_data=None,user_id='1f5cb1727c864652a6873a38ec1f7bf7',uuid=4296ca4c-1e3e-474f-98ba-9f947d333b8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9", "address": "fa:16:3e:09:7c:97", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "vif_mac": "fa:16:3e:09:7c:97"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434ea21d-d4", "ovs_interfaceid": "434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:39:28 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Converting VIF {"id": "434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9", "address": "fa:16:3e:09:7c:97", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "vif_mac": "fa:16:3e:09:7c:97"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434ea21d-d4", "ovs_interfaceid": "434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:39:28 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:7c:97,bridge_name='br-int',has_traffic_filtering=True,id=434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9,network=Network(2f70b9cc-bc8f-46d8-9633-542cd881c89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap434ea21d-d4') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:39:28 user nova-compute[72362]: DEBUG nova.objects.instance [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lazy-loading 'pci_devices' on Instance uuid 4296ca4c-1e3e-474f-98ba-9f947d333b8d {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:39:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:39:28 user nova-compute[72362]:   <uuid>4296ca4c-1e3e-474f-98ba-9f947d333b8d</uuid>
Aug 09 10:39:28 user nova-compute[72362]:   <name>instance-00000027</name>
Aug 09 10:39:28 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:39:28 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:39:28 user nova-compute[72362]:   <metadata>
Aug 09 10:39:28 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:39:28 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:39:28 user nova-compute[72362]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1444056871</nova:name>
Aug 09 10:39:28 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:39:28</nova:creationTime>
Aug 09 10:39:28 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:39:28 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:39:28 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:39:28 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:39:28 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:39:28 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:39:28 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:39:28 user nova-compute[72362]:       <nova:owner>
Aug 09 10:39:28 user nova-compute[72362]:         <nova:user uuid="1f5cb1727c864652a6873a38ec1f7bf7">tempest-ServerRescueNegativeTestJSON-1453574557-project-member</nova:user>
Aug 09 10:39:28 user nova-compute[72362]:         <nova:project uuid="ac17209f912a4f248dd642be32a75ede">tempest-ServerRescueNegativeTestJSON-1453574557</nova:project>
Aug 09 10:39:28 user nova-compute[72362]:       </nova:owner>
Aug 09 10:39:28 user nova-compute[72362]:       <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:39:28 user nova-compute[72362]:       <nova:ports>
Aug 09 10:39:28 user nova-compute[72362]:         <nova:port uuid="434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9">
Aug 09 10:39:28 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 10:39:28 user nova-compute[72362]:         </nova:port>
Aug 09 10:39:28 user nova-compute[72362]:       </nova:ports>
Aug 09 10:39:28 user nova-compute[72362]:     </nova:instance>
Aug 09 10:39:28 user nova-compute[72362]:   </metadata>
Aug 09 10:39:28 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:39:28 user nova-compute[72362]:     <system>
Aug 09 10:39:28 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:39:28 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:39:28 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:39:28 user nova-compute[72362]:       <entry name="serial">4296ca4c-1e3e-474f-98ba-9f947d333b8d</entry>
Aug 09 10:39:28 user nova-compute[72362]:       <entry name="uuid">4296ca4c-1e3e-474f-98ba-9f947d333b8d</entry>
Aug 09 10:39:28 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:39:28 user nova-compute[72362]:     </system>
Aug 09 10:39:28 user nova-compute[72362]:   </sysinfo>
Aug 09 10:39:28 user nova-compute[72362]:   <os>
Aug 09 10:39:28 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:39:28 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:39:28 user nova-compute[72362]:   </os>
Aug 09 10:39:28 user nova-compute[72362]:   <features>
Aug 09 10:39:28 user nova-compute[72362]:     <acpi/>
Aug 09 10:39:28 user nova-compute[72362]:     <apic/>
Aug 09 10:39:28 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:39:28 user nova-compute[72362]:   </features>
Aug 09 10:39:28 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:39:28 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:39:28 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:39:28 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:39:28 user nova-compute[72362]:   </clock>
Aug 09 10:39:28 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:39:28 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:39:28 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:39:28 user nova-compute[72362]:   </cpu>
Aug 09 10:39:28 user nova-compute[72362]:   <devices>
Aug 09 10:39:28 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:39:28 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:39:28 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue"/>
Aug 09 10:39:28 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:39:28 user nova-compute[72362]:     </disk>
Aug 09 10:39:28 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:39:28 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:39:28 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk"/>
Aug 09 10:39:28 user nova-compute[72362]:       <target dev="vdb" bus="virtio"/>
Aug 09 10:39:28 user nova-compute[72362]:     </disk>
Aug 09 10:39:28 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:39:28 user nova-compute[72362]:       <mac address="fa:16:3e:09:7c:97"/>
Aug 09 10:39:28 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:39:28 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:39:28 user nova-compute[72362]:       <target dev="tap434ea21d-d4"/>
Aug 09 10:39:28 user nova-compute[72362]:     </interface>
Aug 09 10:39:28 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:39:28 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/console.log" append="off"/>
Aug 09 10:39:28 user nova-compute[72362]:     </serial>
Aug 09 10:39:28 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:39:28 user nova-compute[72362]:     <video>
Aug 09 10:39:28 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:39:28 user nova-compute[72362]:     </video>
Aug 09 10:39:28 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:39:28 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:39:28 user nova-compute[72362]:     </rng>
Aug 09 10:39:28 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:39:28 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:39:28 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:39:28 user nova-compute[72362]:     </memballoon>
Aug 09 10:39:28 user nova-compute[72362]:   </devices>
Aug 09 10:39:28 user nova-compute[72362]: </domain>
Aug 09 10:39:28 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:39:28 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Instance destroyed successfully.
Aug 09 10:39:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:39:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:39:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] No VIF found with MAC fa:16:3e:09:7c:97, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:39:29 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:39:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:39:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:39:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:39:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:39:30 user nova-compute[72362]: DEBUG nova.compute.manager [req-e2b3f335-44cd-479e-b810-d1b131c398d2 req-ce10e034-2af2-40e8-9b52-6601e8220794 service nova] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Received event network-vif-plugged-434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:39:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e2b3f335-44cd-479e-b810-d1b131c398d2 req-ce10e034-2af2-40e8-9b52-6601e8220794 service nova] Acquiring lock "4296ca4c-1e3e-474f-98ba-9f947d333b8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:39:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e2b3f335-44cd-479e-b810-d1b131c398d2 req-ce10e034-2af2-40e8-9b52-6601e8220794 service nova] Lock "4296ca4c-1e3e-474f-98ba-9f947d333b8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:39:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e2b3f335-44cd-479e-b810-d1b131c398d2 req-ce10e034-2af2-40e8-9b52-6601e8220794 service nova] Lock "4296ca4c-1e3e-474f-98ba-9f947d333b8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:39:30 user nova-compute[72362]: DEBUG nova.compute.manager [req-e2b3f335-44cd-479e-b810-d1b131c398d2 req-ce10e034-2af2-40e8-9b52-6601e8220794 service nova] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] No waiting events found dispatching network-vif-plugged-434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:39:30 user nova-compute[72362]: WARNING nova.compute.manager [req-e2b3f335-44cd-479e-b810-d1b131c398d2 req-ce10e034-2af2-40e8-9b52-6601e8220794 service nova] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Received unexpected event network-vif-plugged-434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9 for instance with vm_state active and task_state rescuing.
Aug 09 10:39:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:39:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:39:32 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Removed pending event for 4296ca4c-1e3e-474f-98ba-9f947d333b8d due to event {{(pid=72362) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 10:39:32 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577572.2779977, 4296ca4c-1e3e-474f-98ba-9f947d333b8d => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:39:32 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] VM Resumed (Lifecycle Event)
Aug 09 10:39:32 user nova-compute[72362]: DEBUG nova.compute.manager [req-de3bfa6c-6bbb-4511-951a-1e4d0a316cb8 req-1fe3b9bf-3fff-49d4-9543-67d1f0fef4a2 service nova] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Received event network-vif-plugged-434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:39:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-de3bfa6c-6bbb-4511-951a-1e4d0a316cb8 req-1fe3b9bf-3fff-49d4-9543-67d1f0fef4a2 service nova] Acquiring lock "4296ca4c-1e3e-474f-98ba-9f947d333b8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:39:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-de3bfa6c-6bbb-4511-951a-1e4d0a316cb8 req-1fe3b9bf-3fff-49d4-9543-67d1f0fef4a2 service nova] Lock "4296ca4c-1e3e-474f-98ba-9f947d333b8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:39:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-de3bfa6c-6bbb-4511-951a-1e4d0a316cb8 req-1fe3b9bf-3fff-49d4-9543-67d1f0fef4a2 service nova] Lock "4296ca4c-1e3e-474f-98ba-9f947d333b8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:39:32 user nova-compute[72362]: DEBUG nova.compute.manager [req-de3bfa6c-6bbb-4511-951a-1e4d0a316cb8 req-1fe3b9bf-3fff-49d4-9543-67d1f0fef4a2 service nova] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] No waiting events found dispatching network-vif-plugged-434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:39:32 user nova-compute[72362]: WARNING nova.compute.manager [req-de3bfa6c-6bbb-4511-951a-1e4d0a316cb8 req-1fe3b9bf-3fff-49d4-9543-67d1f0fef4a2 service nova] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Received unexpected event network-vif-plugged-434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9 for instance with vm_state active and task_state rescuing.
Aug 09 10:39:32 user nova-compute[72362]: DEBUG nova.compute.manager [req-de3bfa6c-6bbb-4511-951a-1e4d0a316cb8 req-1fe3b9bf-3fff-49d4-9543-67d1f0fef4a2 service nova] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Received event network-vif-plugged-434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:39:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-de3bfa6c-6bbb-4511-951a-1e4d0a316cb8 req-1fe3b9bf-3fff-49d4-9543-67d1f0fef4a2 service nova] Acquiring lock "4296ca4c-1e3e-474f-98ba-9f947d333b8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:39:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-de3bfa6c-6bbb-4511-951a-1e4d0a316cb8 req-1fe3b9bf-3fff-49d4-9543-67d1f0fef4a2 service nova] Lock "4296ca4c-1e3e-474f-98ba-9f947d333b8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:39:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-de3bfa6c-6bbb-4511-951a-1e4d0a316cb8 req-1fe3b9bf-3fff-49d4-9543-67d1f0fef4a2 service nova] Lock "4296ca4c-1e3e-474f-98ba-9f947d333b8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:39:32 user nova-compute[72362]: DEBUG nova.compute.manager [req-de3bfa6c-6bbb-4511-951a-1e4d0a316cb8 req-1fe3b9bf-3fff-49d4-9543-67d1f0fef4a2 service nova] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] No waiting events found dispatching network-vif-plugged-434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:39:32 user nova-compute[72362]: WARNING nova.compute.manager [req-de3bfa6c-6bbb-4511-951a-1e4d0a316cb8 req-1fe3b9bf-3fff-49d4-9543-67d1f0fef4a2 service nova] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Received unexpected event network-vif-plugged-434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9 for instance with vm_state active and task_state rescuing.
Aug 09 10:39:32 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7d24e089-b53f-4e6c-87a4-fc7e7fe79264 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:39:32 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:39:32 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:39:32 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 10:39:32 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577572.2782998, 4296ca4c-1e3e-474f-98ba-9f947d333b8d => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:39:32 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] VM Started (Lifecycle Event)
Aug 09 10:39:32 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:39:32 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:39:34 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:39:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:39:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:39:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:39:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:39:52 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:39:54 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:39:56 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:39:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:39:59 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:40:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:40:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:40:05 user nova-compute[72362]: DEBUG nova.compute.manager [req-ffa1df4f-6552-4137-9de7-6958894ff2fc req-3cb1e5e7-b0dc-49f6-88ad-904a1d661514 service nova] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Received event network-changed-009988a8-77e4-434d-91da-20b13633dbee {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:40:05 user nova-compute[72362]: DEBUG nova.compute.manager [req-ffa1df4f-6552-4137-9de7-6958894ff2fc req-3cb1e5e7-b0dc-49f6-88ad-904a1d661514 service nova] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Refreshing instance network info cache due to event network-changed-009988a8-77e4-434d-91da-20b13633dbee. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:40:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ffa1df4f-6552-4137-9de7-6958894ff2fc req-3cb1e5e7-b0dc-49f6-88ad-904a1d661514 service nova] Acquiring lock "refresh_cache-b74acebd-10f6-4c8e-9e58-f220b9483ade" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:40:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ffa1df4f-6552-4137-9de7-6958894ff2fc req-3cb1e5e7-b0dc-49f6-88ad-904a1d661514 service nova] Acquired lock "refresh_cache-b74acebd-10f6-4c8e-9e58-f220b9483ade" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:40:05 user nova-compute[72362]: DEBUG nova.network.neutron [req-ffa1df4f-6552-4137-9de7-6958894ff2fc req-3cb1e5e7-b0dc-49f6-88ad-904a1d661514 service nova] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Refreshing network info cache for port 009988a8-77e4-434d-91da-20b13633dbee {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:40:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-381cb4f6-bdbf-4919-b4f9-a554ed3581b9 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "b74acebd-10f6-4c8e-9e58-f220b9483ade" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:40:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-381cb4f6-bdbf-4919-b4f9-a554ed3581b9 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "b74acebd-10f6-4c8e-9e58-f220b9483ade" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:40:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-381cb4f6-bdbf-4919-b4f9-a554ed3581b9 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "b74acebd-10f6-4c8e-9e58-f220b9483ade-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:40:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-381cb4f6-bdbf-4919-b4f9-a554ed3581b9 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "b74acebd-10f6-4c8e-9e58-f220b9483ade-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:40:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-381cb4f6-bdbf-4919-b4f9-a554ed3581b9 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "b74acebd-10f6-4c8e-9e58-f220b9483ade-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:40:05 user nova-compute[72362]: INFO nova.compute.manager [None req-381cb4f6-bdbf-4919-b4f9-a554ed3581b9 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Terminating instance
Aug 09 10:40:05 user nova-compute[72362]: DEBUG nova.compute.manager [None req-381cb4f6-bdbf-4919-b4f9-a554ed3581b9 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Start destroying the instance on the hypervisor. {{(pid=72362) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 10:40:05 user nova-compute[72362]: DEBUG nova.network.neutron [req-ffa1df4f-6552-4137-9de7-6958894ff2fc req-3cb1e5e7-b0dc-49f6-88ad-904a1d661514 service nova] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Updated VIF entry in instance network info cache for port 009988a8-77e4-434d-91da-20b13633dbee. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:40:05 user nova-compute[72362]: DEBUG nova.network.neutron [req-ffa1df4f-6552-4137-9de7-6958894ff2fc req-3cb1e5e7-b0dc-49f6-88ad-904a1d661514 service nova] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Updating instance_info_cache with network_info: [{"id": "009988a8-77e4-434d-91da-20b13633dbee", "address": "fa:16:3e:1d:30:91", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap009988a8-77", "ovs_interfaceid": "009988a8-77e4-434d-91da-20b13633dbee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:40:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ffa1df4f-6552-4137-9de7-6958894ff2fc req-3cb1e5e7-b0dc-49f6-88ad-904a1d661514 service nova] Releasing lock "refresh_cache-b74acebd-10f6-4c8e-9e58-f220b9483ade" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:40:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:40:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:40:06 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Instance destroyed successfully.
Aug 09 10:40:06 user nova-compute[72362]: DEBUG nova.objects.instance [None req-381cb4f6-bdbf-4919-b4f9-a554ed3581b9 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lazy-loading 'resources' on Instance uuid b74acebd-10f6-4c8e-9e58-f220b9483ade {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-381cb4f6-bdbf-4919-b4f9-a554ed3581b9 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:38:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1621959906',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1621959906',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1621959906',id=40,image_ref='182a9ac9-42a8-4e27-a98d-8c58baa98ac7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtRbmTGdtOAlCiY0DbF9ZM1jb5ziAsWHaXBtKmX1kRnCs6zDv3LcnQV5W5kybHpgabMt2uoD/bafJN8ihMDBhHeqVvmJDI7nW1hVwvWyCL3TjKASgCP0VJmxXrR0duwJw==',key_name='tempest-keypair-1925991308',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:38:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='26e38599de0b4b06b723f5647a7fe121',ramdisk_id='',reservation_id='r-wqb9j386',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1478436240',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1478436240-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1478436240',owner_user_name='tempest-TestVolumeBootPattern-1478436240-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:38:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e96900e953f64d02bdb5d48f136133c3',uuid=b74acebd-10f6-4c8e-9e58-f220b9483ade,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "009988a8-77e4-434d-91da-20b13633dbee", "address": "fa:16:3e:1d:30:91", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap009988a8-77", "ovs_interfaceid": "009988a8-77e4-434d-91da-20b13633dbee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-381cb4f6-bdbf-4919-b4f9-a554ed3581b9 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Converting VIF {"id": "009988a8-77e4-434d-91da-20b13633dbee", "address": "fa:16:3e:1d:30:91", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap009988a8-77", "ovs_interfaceid": "009988a8-77e4-434d-91da-20b13633dbee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-381cb4f6-bdbf-4919-b4f9-a554ed3581b9 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:30:91,bridge_name='br-int',has_traffic_filtering=True,id=009988a8-77e4-434d-91da-20b13633dbee,network=Network(b4a9e050-41f1-404a-bf5c-41421f034644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap009988a8-77') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG os_vif [None req-381cb4f6-bdbf-4919-b4f9-a554ed3581b9 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:30:91,bridge_name='br-int',has_traffic_filtering=True,id=009988a8-77e4-434d-91da-20b13633dbee,network=Network(b4a9e050-41f1-404a-bf5c-41421f034644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap009988a8-77') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap009988a8-77, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:40:06 user nova-compute[72362]: INFO os_vif [None req-381cb4f6-bdbf-4919-b4f9-a554ed3581b9 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:30:91,bridge_name='br-int',has_traffic_filtering=True,id=009988a8-77e4-434d-91da-20b13633dbee,network=Network(b4a9e050-41f1-404a-bf5c-41421f034644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap009988a8-77')
Aug 09 10:40:06 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-381cb4f6-bdbf-4919-b4f9-a554ed3581b9 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-381cb4f6-bdbf-4919-b4f9-a554ed3581b9 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:3b415aae-03a1-4746-a19f-21a21a579290'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JeBFhrIA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:40:06 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-381cb4f6-bdbf-4919-b4f9-a554ed3581b9 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:40:06 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-381cb4f6-bdbf-4919-b4f9-a554ed3581b9 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-381cb4f6-bdbf-4919-b4f9-a554ed3581b9 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-381cb4f6-bdbf-4919-b4f9-a554ed3581b9 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b415aae-03a1-4746-a19f-21a21a579290', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[eefb5828-5513-409d-99e9-c65255b1439f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b415aae-03a1-4746-a19f-21a21a579290\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64f9186-bc66-4a8a-b2a5-afb75b23f9f5]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b415aae-03a1-4746-a19f-21a21a579290 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-381cb4f6-bdbf-4919-b4f9-a554ed3581b9 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247 (non-flash)
Aug 09 10:40:06 user nova-compute[72362]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f (non-flash)
Aug 09 10:40:06 user nova-compute[72362]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b415aae-03a1-4746-a19f-21a21a579290 (non-flash)
Aug 09 10:40:06 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-381cb4f6-bdbf-4919-b4f9-a554ed3581b9 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247 (non-flash)
Aug 09 10:40:06 user nova-compute[72362]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f (non-flash)
Aug 09 10:40:06 user nova-compute[72362]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b415aae-03a1-4746-a19f-21a21a579290 (non-flash)
Aug 09 10:40:06 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-381cb4f6-bdbf-4919-b4f9-a554ed3581b9 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e4460af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b415aae-03a1-4746-a19f-21a21a579290'): ({'sdd'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-381cb4f6-bdbf-4919-b4f9-a554ed3581b9 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Removing single pathed devices sdd {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[314800eb-8e97-4acd-954e-6531279c4630]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2d3073-77fc-4d20-a957-c0db1534c854]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-381cb4f6-bdbf-4919-b4f9-a554ed3581b9 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Flushing IO for device /dev/sdd {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf16cc5-a1f4-46dc-86a4-cf8a60a7094d]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-381cb4f6-bdbf-4919-b4f9-a554ed3581b9 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[436f7c5d-acc0-473a-9618-f59df3342885]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-381cb4f6-bdbf-4919-b4f9-a554ed3581b9 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-381cb4f6-bdbf-4919-b4f9-a554ed3581b9 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] SCSI volumes sdd have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO83da38d6-a00b4c3ebe985e38', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_83da38d6', '/dev/disk/by-id/scsi-26130306234633365') {{(pid=84003) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73723c2-7c8f-43d8-8956-029f71593977]: (4, None) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-381cb4f6-bdbf-4919-b4f9-a554ed3581b9 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b415aae-03a1-4746-a19f-21a21a579290')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b415aae-03a1-4746-a19f-21a21a579290 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b415aae-03a1-4746-a19f-21a21a579290 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed908c98-afd7-403a-986c-91a96e369c49]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-381cb4f6-bdbf-4919-b4f9-a554ed3581b9 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b415aae-03a1-4746-a19f-21a21a579290 -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b415aae-03a1-4746-a19f-21a21a579290 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[36523faf-2716-44a4-a52a-d560216a121e]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:3b415aae-03a1-4746-a19f-21a21a579290, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:3b415aae-03a1-4746-a19f-21a21a579290, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-381cb4f6-bdbf-4919-b4f9-a554ed3581b9 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:3b415aae-03a1-4746-a19f-21a21a579290, portal: 172.16.0.220,3260]
Aug 09 10:40:06 user nova-compute[72362]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:3b415aae-03a1-4746-a19f-21a21a579290, portal: 172.16.0.220,3260] successful.
Aug 09 10:40:06 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b415aae-03a1-4746-a19f-21a21a579290 -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b415aae-03a1-4746-a19f-21a21a579290 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca64f816-1d49-4a81-9a64-131c1579d3a3]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-381cb4f6-bdbf-4919-b4f9-a554ed3581b9 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-381cb4f6-bdbf-4919-b4f9-a554ed3581b9 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-381cb4f6-bdbf-4919-b4f9-a554ed3581b9 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] <== disconnect_volume: return (302ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:40:06 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-381cb4f6-bdbf-4919-b4f9-a554ed3581b9 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:40:06 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-381cb4f6-bdbf-4919-b4f9-a554ed3581b9 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Deleting instance files /opt/stack/data/nova/instances/b74acebd-10f6-4c8e-9e58-f220b9483ade_del
Aug 09 10:40:06 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-381cb4f6-bdbf-4919-b4f9-a554ed3581b9 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Deletion of /opt/stack/data/nova/instances/b74acebd-10f6-4c8e-9e58-f220b9483ade_del complete
Aug 09 10:40:07 user nova-compute[72362]: INFO nova.compute.manager [None req-381cb4f6-bdbf-4919-b4f9-a554ed3581b9 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Took 1.20 seconds to destroy the instance on the hypervisor.
Aug 09 10:40:07 user nova-compute[72362]: DEBUG oslo.service.loopingcall [None req-381cb4f6-bdbf-4919-b4f9-a554ed3581b9 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72362) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 10:40:07 user nova-compute[72362]: DEBUG nova.compute.manager [-] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Deallocating network for instance {{(pid=72362) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 10:40:07 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] deallocate_for_instance() {{(pid=72362) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 10:40:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:40:07 user nova-compute[72362]: DEBUG nova.compute.manager [req-b8d49e88-ce08-4165-8eda-35a8621cf26c req-791a5038-42dd-41b9-82c5-05bdf3b8f4fa service nova] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Received event network-vif-unplugged-009988a8-77e4-434d-91da-20b13633dbee {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:40:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b8d49e88-ce08-4165-8eda-35a8621cf26c req-791a5038-42dd-41b9-82c5-05bdf3b8f4fa service nova] Acquiring lock "b74acebd-10f6-4c8e-9e58-f220b9483ade-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:40:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b8d49e88-ce08-4165-8eda-35a8621cf26c req-791a5038-42dd-41b9-82c5-05bdf3b8f4fa service nova] Lock "b74acebd-10f6-4c8e-9e58-f220b9483ade-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:40:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b8d49e88-ce08-4165-8eda-35a8621cf26c req-791a5038-42dd-41b9-82c5-05bdf3b8f4fa service nova] Lock "b74acebd-10f6-4c8e-9e58-f220b9483ade-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:40:07 user nova-compute[72362]: DEBUG nova.compute.manager [req-b8d49e88-ce08-4165-8eda-35a8621cf26c req-791a5038-42dd-41b9-82c5-05bdf3b8f4fa service nova] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] No waiting events found dispatching network-vif-unplugged-009988a8-77e4-434d-91da-20b13633dbee {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:40:07 user nova-compute[72362]: DEBUG nova.compute.manager [req-b8d49e88-ce08-4165-8eda-35a8621cf26c req-791a5038-42dd-41b9-82c5-05bdf3b8f4fa service nova] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Received event network-vif-unplugged-009988a8-77e4-434d-91da-20b13633dbee for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:40:07 user nova-compute[72362]: DEBUG nova.compute.manager [req-b8d49e88-ce08-4165-8eda-35a8621cf26c req-791a5038-42dd-41b9-82c5-05bdf3b8f4fa service nova] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Received event network-vif-plugged-009988a8-77e4-434d-91da-20b13633dbee {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:40:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b8d49e88-ce08-4165-8eda-35a8621cf26c req-791a5038-42dd-41b9-82c5-05bdf3b8f4fa service nova] Acquiring lock "b74acebd-10f6-4c8e-9e58-f220b9483ade-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:40:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b8d49e88-ce08-4165-8eda-35a8621cf26c req-791a5038-42dd-41b9-82c5-05bdf3b8f4fa service nova] Lock "b74acebd-10f6-4c8e-9e58-f220b9483ade-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:40:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b8d49e88-ce08-4165-8eda-35a8621cf26c req-791a5038-42dd-41b9-82c5-05bdf3b8f4fa service nova] Lock "b74acebd-10f6-4c8e-9e58-f220b9483ade-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:40:07 user nova-compute[72362]: DEBUG nova.compute.manager [req-b8d49e88-ce08-4165-8eda-35a8621cf26c req-791a5038-42dd-41b9-82c5-05bdf3b8f4fa service nova] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] No waiting events found dispatching network-vif-plugged-009988a8-77e4-434d-91da-20b13633dbee {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:40:07 user nova-compute[72362]: WARNING nova.compute.manager [req-b8d49e88-ce08-4165-8eda-35a8621cf26c req-791a5038-42dd-41b9-82c5-05bdf3b8f4fa service nova] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Received unexpected event network-vif-plugged-009988a8-77e4-434d-91da-20b13633dbee for instance with vm_state active and task_state deleting.
Aug 09 10:40:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-202dcb96-4cdf-4af8-9069-948d44456f72 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "96da3bac-a460-4253-a4f6-cd8de34e59f8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:40:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-202dcb96-4cdf-4af8-9069-948d44456f72 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "96da3bac-a460-4253-a4f6-cd8de34e59f8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:40:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-202dcb96-4cdf-4af8-9069-948d44456f72 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "96da3bac-a460-4253-a4f6-cd8de34e59f8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:40:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-202dcb96-4cdf-4af8-9069-948d44456f72 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "96da3bac-a460-4253-a4f6-cd8de34e59f8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:40:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-202dcb96-4cdf-4af8-9069-948d44456f72 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "96da3bac-a460-4253-a4f6-cd8de34e59f8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:40:07 user nova-compute[72362]: INFO nova.compute.manager [None req-202dcb96-4cdf-4af8-9069-948d44456f72 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Terminating instance
Aug 09 10:40:07 user nova-compute[72362]: DEBUG nova.compute.manager [None req-202dcb96-4cdf-4af8-9069-948d44456f72 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Start destroying the instance on the hypervisor. {{(pid=72362) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 10:40:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:40:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:40:08 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:40:08 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:40:08 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:40:08 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Took 1.36 seconds to deallocate network for instance.
Aug 09 10:40:08 user nova-compute[72362]: DEBUG nova.compute.manager [req-95525293-a94e-46c6-83b9-8c10871db89f req-e491f8b2-2abd-4d3a-bf1e-1030bc716f39 service nova] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Received event network-vif-deleted-009988a8-77e4-434d-91da-20b13633dbee {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:40:08 user nova-compute[72362]: DEBUG nova.compute.manager [req-15c1e2fd-98fb-4b83-b50f-7c1c9426b2fb req-31f0513d-5816-4a51-861c-3595a2a82039 service nova] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Received event network-vif-unplugged-c4b78135-dc1f-4eab-a5c6-e00aecfc09df {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:40:08 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-15c1e2fd-98fb-4b83-b50f-7c1c9426b2fb req-31f0513d-5816-4a51-861c-3595a2a82039 service nova] Acquiring lock "96da3bac-a460-4253-a4f6-cd8de34e59f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:40:08 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-15c1e2fd-98fb-4b83-b50f-7c1c9426b2fb req-31f0513d-5816-4a51-861c-3595a2a82039 service nova] Lock "96da3bac-a460-4253-a4f6-cd8de34e59f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:40:08 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-15c1e2fd-98fb-4b83-b50f-7c1c9426b2fb req-31f0513d-5816-4a51-861c-3595a2a82039 service nova] Lock "96da3bac-a460-4253-a4f6-cd8de34e59f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:40:08 user nova-compute[72362]: DEBUG nova.compute.manager [req-15c1e2fd-98fb-4b83-b50f-7c1c9426b2fb req-31f0513d-5816-4a51-861c-3595a2a82039 service nova] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] No waiting events found dispatching network-vif-unplugged-c4b78135-dc1f-4eab-a5c6-e00aecfc09df {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:40:08 user nova-compute[72362]: DEBUG nova.compute.manager [req-15c1e2fd-98fb-4b83-b50f-7c1c9426b2fb req-31f0513d-5816-4a51-861c-3595a2a82039 service nova] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Received event network-vif-unplugged-c4b78135-dc1f-4eab-a5c6-e00aecfc09df for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:40:08 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:40:08 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:40:08 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:40:08 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Instance destroyed successfully.
Aug 09 10:40:08 user nova-compute[72362]: DEBUG nova.objects.instance [None req-202dcb96-4cdf-4af8-9069-948d44456f72 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lazy-loading 'resources' on Instance uuid 96da3bac-a460-4253-a4f6-cd8de34e59f8 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:40:08 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:40:08 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-202dcb96-4cdf-4af8-9069-948d44456f72 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:38:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-870631158',display_name='tempest-AttachVolumeNegativeTest-server-870631158',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-870631158',id=41,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANQ90xr6vonftsSs4VyC7ntV2sD0euSMD60OCo+wBhjUo4SPv74GIZdYYBm+sffp+uixEz8kQpmJT9h9IVl+3jInsi4Zg3u+WVHR+q+5NHWXcUcgPpM+cNTt21sAcL99w==',key_name='tempest-keypair-442646897',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:38:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='980f1c36cab0449b949419cf495c16d5',ramdisk_id='',reservation_id='r-5q9s0007',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-486756066',owner_user_name='tempest-AttachVolumeNegativeTest-486756066-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:38:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bed469ff9d954891905c98bdf238c097',uuid=96da3bac-a460-4253-a4f6-cd8de34e59f8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c4b78135-dc1f-4eab-a5c6-e00aecfc09df", "address": "fa:16:3e:22:88:0f", "network": {"id": "e56e2a0a-0a6d-4546-86ef-7bb333e829ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1495216341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980f1c36cab0449b949419cf495c16d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b78135-dc", "ovs_interfaceid": "c4b78135-dc1f-4eab-a5c6-e00aecfc09df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:40:08 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-202dcb96-4cdf-4af8-9069-948d44456f72 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Converting VIF {"id": "c4b78135-dc1f-4eab-a5c6-e00aecfc09df", "address": "fa:16:3e:22:88:0f", "network": {"id": "e56e2a0a-0a6d-4546-86ef-7bb333e829ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1495216341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980f1c36cab0449b949419cf495c16d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b78135-dc", "ovs_interfaceid": "c4b78135-dc1f-4eab-a5c6-e00aecfc09df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:40:08 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-202dcb96-4cdf-4af8-9069-948d44456f72 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:88:0f,bridge_name='br-int',has_traffic_filtering=True,id=c4b78135-dc1f-4eab-a5c6-e00aecfc09df,network=Network(e56e2a0a-0a6d-4546-86ef-7bb333e829ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4b78135-dc') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:40:08 user nova-compute[72362]: DEBUG os_vif [None req-202dcb96-4cdf-4af8-9069-948d44456f72 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:88:0f,bridge_name='br-int',has_traffic_filtering=True,id=c4b78135-dc1f-4eab-a5c6-e00aecfc09df,network=Network(e56e2a0a-0a6d-4546-86ef-7bb333e829ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4b78135-dc') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:40:08 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:40:08 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc4b78135-dc, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:40:08 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:40:08 user nova-compute[72362]: INFO os_vif [None req-202dcb96-4cdf-4af8-9069-948d44456f72 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:88:0f,bridge_name='br-int',has_traffic_filtering=True,id=c4b78135-dc1f-4eab-a5c6-e00aecfc09df,network=Network(e56e2a0a-0a6d-4546-86ef-7bb333e829ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4b78135-dc')
Aug 09 10:40:08 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-202dcb96-4cdf-4af8-9069-948d44456f72 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Deleting instance files /opt/stack/data/nova/instances/96da3bac-a460-4253-a4f6-cd8de34e59f8_del
Aug 09 10:40:08 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-202dcb96-4cdf-4af8-9069-948d44456f72 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Deletion of /opt/stack/data/nova/instances/96da3bac-a460-4253-a4f6-cd8de34e59f8_del complete
Aug 09 10:40:08 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:40:08 user nova-compute[72362]: INFO nova.compute.manager [None req-202dcb96-4cdf-4af8-9069-948d44456f72 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Took 0.74 seconds to destroy the instance on the hypervisor.
Aug 09 10:40:08 user nova-compute[72362]: DEBUG oslo.service.loopingcall [None req-202dcb96-4cdf-4af8-9069-948d44456f72 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72362) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 10:40:08 user nova-compute[72362]: DEBUG nova.compute.manager [-] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Deallocating network for instance {{(pid=72362) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 10:40:08 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] deallocate_for_instance() {{(pid=72362) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 10:40:08 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:40:08 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:40:09 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:40:09 user nova-compute[72362]: INFO nova.compute.manager [None req-381cb4f6-bdbf-4919-b4f9-a554ed3581b9 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Took 0.87 seconds to detach 1 volumes for instance.
Aug 09 10:40:09 user nova-compute[72362]: DEBUG nova.compute.manager [None req-381cb4f6-bdbf-4919-b4f9-a554ed3581b9 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Deleting volume: 3b415aae-03a1-4746-a19f-21a21a579290 {{(pid=72362) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 09 10:40:09 user nova-compute[72362]: DEBUG nova.compute.manager [req-e1df9a37-1da4-48f4-bd6e-b1ae192f4d50 req-2e69fadb-8b83-4ded-97bd-48736e5daa6f service nova] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Received event network-changed-c4b78135-dc1f-4eab-a5c6-e00aecfc09df {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:40:09 user nova-compute[72362]: DEBUG nova.compute.manager [req-e1df9a37-1da4-48f4-bd6e-b1ae192f4d50 req-2e69fadb-8b83-4ded-97bd-48736e5daa6f service nova] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Refreshing instance network info cache due to event network-changed-c4b78135-dc1f-4eab-a5c6-e00aecfc09df. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:40:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e1df9a37-1da4-48f4-bd6e-b1ae192f4d50 req-2e69fadb-8b83-4ded-97bd-48736e5daa6f service nova] Acquiring lock "refresh_cache-96da3bac-a460-4253-a4f6-cd8de34e59f8" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:40:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e1df9a37-1da4-48f4-bd6e-b1ae192f4d50 req-2e69fadb-8b83-4ded-97bd-48736e5daa6f service nova] Acquired lock "refresh_cache-96da3bac-a460-4253-a4f6-cd8de34e59f8" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:40:09 user nova-compute[72362]: DEBUG nova.network.neutron [req-e1df9a37-1da4-48f4-bd6e-b1ae192f4d50 req-2e69fadb-8b83-4ded-97bd-48736e5daa6f service nova] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Refreshing network info cache for port c4b78135-dc1f-4eab-a5c6-e00aecfc09df {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:40:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-381cb4f6-bdbf-4919-b4f9-a554ed3581b9 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:40:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-381cb4f6-bdbf-4919-b4f9-a554ed3581b9 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:40:09 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:40:09 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Took 1.05 seconds to deallocate network for instance.
Aug 09 10:40:09 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-381cb4f6-bdbf-4919-b4f9-a554ed3581b9 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:40:09 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-381cb4f6-bdbf-4919-b4f9-a554ed3581b9 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:40:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-202dcb96-4cdf-4af8-9069-948d44456f72 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:40:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-381cb4f6-bdbf-4919-b4f9-a554ed3581b9 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.297s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:40:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-202dcb96-4cdf-4af8-9069-948d44456f72 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.031s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:40:09 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-381cb4f6-bdbf-4919-b4f9-a554ed3581b9 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Deleted allocations for instance b74acebd-10f6-4c8e-9e58-f220b9483ade
Aug 09 10:40:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-381cb4f6-bdbf-4919-b4f9-a554ed3581b9 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "b74acebd-10f6-4c8e-9e58-f220b9483ade" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.091s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:40:09 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-202dcb96-4cdf-4af8-9069-948d44456f72 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:40:09 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-202dcb96-4cdf-4af8-9069-948d44456f72 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:40:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-202dcb96-4cdf-4af8-9069-948d44456f72 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.264s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:40:10 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-202dcb96-4cdf-4af8-9069-948d44456f72 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Deleted allocations for instance 96da3bac-a460-4253-a4f6-cd8de34e59f8
Aug 09 10:40:10 user nova-compute[72362]: DEBUG nova.network.neutron [req-e1df9a37-1da4-48f4-bd6e-b1ae192f4d50 req-2e69fadb-8b83-4ded-97bd-48736e5daa6f service nova] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Updated VIF entry in instance network info cache for port c4b78135-dc1f-4eab-a5c6-e00aecfc09df. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:40:10 user nova-compute[72362]: DEBUG nova.network.neutron [req-e1df9a37-1da4-48f4-bd6e-b1ae192f4d50 req-2e69fadb-8b83-4ded-97bd-48736e5daa6f service nova] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Updating instance_info_cache with network_info: [{"id": "c4b78135-dc1f-4eab-a5c6-e00aecfc09df", "address": "fa:16:3e:22:88:0f", "network": {"id": "e56e2a0a-0a6d-4546-86ef-7bb333e829ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1495216341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980f1c36cab0449b949419cf495c16d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b78135-dc", "ovs_interfaceid": "c4b78135-dc1f-4eab-a5c6-e00aecfc09df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:40:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e1df9a37-1da4-48f4-bd6e-b1ae192f4d50 req-2e69fadb-8b83-4ded-97bd-48736e5daa6f service nova] Releasing lock "refresh_cache-96da3bac-a460-4253-a4f6-cd8de34e59f8" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:40:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-202dcb96-4cdf-4af8-9069-948d44456f72 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "96da3bac-a460-4253-a4f6-cd8de34e59f8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.291s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:40:10 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:40:10 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:40:10 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 10:40:10 user nova-compute[72362]: DEBUG nova.compute.manager [req-9672089c-32f8-4979-86f9-9d507657c7a8 req-60575f9b-56ba-4f5e-8110-3b153056d58f service nova] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Received event network-vif-deleted-c4b78135-dc1f-4eab-a5c6-e00aecfc09df {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:40:10 user nova-compute[72362]: INFO nova.compute.manager [req-9672089c-32f8-4979-86f9-9d507657c7a8 req-60575f9b-56ba-4f5e-8110-3b153056d58f service nova] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Neutron deleted interface c4b78135-dc1f-4eab-a5c6-e00aecfc09df; detaching it from the instance and deleting it from the info cache
Aug 09 10:40:10 user nova-compute[72362]: DEBUG nova.network.neutron [req-9672089c-32f8-4979-86f9-9d507657c7a8 req-60575f9b-56ba-4f5e-8110-3b153056d58f service nova] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Instance is deleted, no further info cache update {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Aug 09 10:40:10 user nova-compute[72362]: DEBUG nova.compute.manager [req-9672089c-32f8-4979-86f9-9d507657c7a8 req-60575f9b-56ba-4f5e-8110-3b153056d58f service nova] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Detach interface failed, port_id=c4b78135-dc1f-4eab-a5c6-e00aecfc09df, reason: Instance 96da3bac-a460-4253-a4f6-cd8de34e59f8 could not be found. {{(pid=72362) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 10:40:10 user nova-compute[72362]: DEBUG nova.compute.manager [req-f1748797-ae0f-4556-9739-5ece445de300 req-e0961822-c265-403c-8ab8-64df34cd8ba5 service nova] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Received event network-vif-plugged-c4b78135-dc1f-4eab-a5c6-e00aecfc09df {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:40:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f1748797-ae0f-4556-9739-5ece445de300 req-e0961822-c265-403c-8ab8-64df34cd8ba5 service nova] Acquiring lock "96da3bac-a460-4253-a4f6-cd8de34e59f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:40:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f1748797-ae0f-4556-9739-5ece445de300 req-e0961822-c265-403c-8ab8-64df34cd8ba5 service nova] Lock "96da3bac-a460-4253-a4f6-cd8de34e59f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:40:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f1748797-ae0f-4556-9739-5ece445de300 req-e0961822-c265-403c-8ab8-64df34cd8ba5 service nova] Lock "96da3bac-a460-4253-a4f6-cd8de34e59f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:40:10 user nova-compute[72362]: DEBUG nova.compute.manager [req-f1748797-ae0f-4556-9739-5ece445de300 req-e0961822-c265-403c-8ab8-64df34cd8ba5 service nova] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] No waiting events found dispatching network-vif-plugged-c4b78135-dc1f-4eab-a5c6-e00aecfc09df {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:40:10 user nova-compute[72362]: WARNING nova.compute.manager [req-f1748797-ae0f-4556-9739-5ece445de300 req-e0961822-c265-403c-8ab8-64df34cd8ba5 service nova] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Received unexpected event network-vif-plugged-c4b78135-dc1f-4eab-a5c6-e00aecfc09df for instance with vm_state deleted and task_state None.
Aug 09 10:40:10 user nova-compute[72362]: DEBUG nova.compute.manager [req-f1748797-ae0f-4556-9739-5ece445de300 req-e0961822-c265-403c-8ab8-64df34cd8ba5 service nova] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Received event network-vif-plugged-c4b78135-dc1f-4eab-a5c6-e00aecfc09df {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:40:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f1748797-ae0f-4556-9739-5ece445de300 req-e0961822-c265-403c-8ab8-64df34cd8ba5 service nova] Acquiring lock "96da3bac-a460-4253-a4f6-cd8de34e59f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:40:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f1748797-ae0f-4556-9739-5ece445de300 req-e0961822-c265-403c-8ab8-64df34cd8ba5 service nova] Lock "96da3bac-a460-4253-a4f6-cd8de34e59f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:40:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f1748797-ae0f-4556-9739-5ece445de300 req-e0961822-c265-403c-8ab8-64df34cd8ba5 service nova] Lock "96da3bac-a460-4253-a4f6-cd8de34e59f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:40:10 user nova-compute[72362]: DEBUG nova.compute.manager [req-f1748797-ae0f-4556-9739-5ece445de300 req-e0961822-c265-403c-8ab8-64df34cd8ba5 service nova] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] No waiting events found dispatching network-vif-plugged-c4b78135-dc1f-4eab-a5c6-e00aecfc09df {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:40:10 user nova-compute[72362]: WARNING nova.compute.manager [req-f1748797-ae0f-4556-9739-5ece445de300 req-e0961822-c265-403c-8ab8-64df34cd8ba5 service nova] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Received unexpected event network-vif-plugged-c4b78135-dc1f-4eab-a5c6-e00aecfc09df for instance with vm_state deleted and task_state None.
Aug 09 10:40:10 user nova-compute[72362]: DEBUG nova.compute.manager [req-f1748797-ae0f-4556-9739-5ece445de300 req-e0961822-c265-403c-8ab8-64df34cd8ba5 service nova] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Received event network-vif-plugged-c4b78135-dc1f-4eab-a5c6-e00aecfc09df {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:40:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f1748797-ae0f-4556-9739-5ece445de300 req-e0961822-c265-403c-8ab8-64df34cd8ba5 service nova] Acquiring lock "96da3bac-a460-4253-a4f6-cd8de34e59f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:40:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f1748797-ae0f-4556-9739-5ece445de300 req-e0961822-c265-403c-8ab8-64df34cd8ba5 service nova] Lock "96da3bac-a460-4253-a4f6-cd8de34e59f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:40:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f1748797-ae0f-4556-9739-5ece445de300 req-e0961822-c265-403c-8ab8-64df34cd8ba5 service nova] Lock "96da3bac-a460-4253-a4f6-cd8de34e59f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:40:10 user nova-compute[72362]: DEBUG nova.compute.manager [req-f1748797-ae0f-4556-9739-5ece445de300 req-e0961822-c265-403c-8ab8-64df34cd8ba5 service nova] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] No waiting events found dispatching network-vif-plugged-c4b78135-dc1f-4eab-a5c6-e00aecfc09df {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:40:10 user nova-compute[72362]: WARNING nova.compute.manager [req-f1748797-ae0f-4556-9739-5ece445de300 req-e0961822-c265-403c-8ab8-64df34cd8ba5 service nova] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Received unexpected event network-vif-plugged-c4b78135-dc1f-4eab-a5c6-e00aecfc09df for instance with vm_state deleted and task_state None.
Aug 09 10:40:10 user nova-compute[72362]: DEBUG nova.compute.manager [req-f1748797-ae0f-4556-9739-5ece445de300 req-e0961822-c265-403c-8ab8-64df34cd8ba5 service nova] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Received event network-vif-unplugged-c4b78135-dc1f-4eab-a5c6-e00aecfc09df {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:40:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f1748797-ae0f-4556-9739-5ece445de300 req-e0961822-c265-403c-8ab8-64df34cd8ba5 service nova] Acquiring lock "96da3bac-a460-4253-a4f6-cd8de34e59f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:40:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f1748797-ae0f-4556-9739-5ece445de300 req-e0961822-c265-403c-8ab8-64df34cd8ba5 service nova] Lock "96da3bac-a460-4253-a4f6-cd8de34e59f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:40:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f1748797-ae0f-4556-9739-5ece445de300 req-e0961822-c265-403c-8ab8-64df34cd8ba5 service nova] Lock "96da3bac-a460-4253-a4f6-cd8de34e59f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:40:10 user nova-compute[72362]: DEBUG nova.compute.manager [req-f1748797-ae0f-4556-9739-5ece445de300 req-e0961822-c265-403c-8ab8-64df34cd8ba5 service nova] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] No waiting events found dispatching network-vif-unplugged-c4b78135-dc1f-4eab-a5c6-e00aecfc09df {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:40:10 user nova-compute[72362]: WARNING nova.compute.manager [req-f1748797-ae0f-4556-9739-5ece445de300 req-e0961822-c265-403c-8ab8-64df34cd8ba5 service nova] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Received unexpected event network-vif-unplugged-c4b78135-dc1f-4eab-a5c6-e00aecfc09df for instance with vm_state deleted and task_state None.
Aug 09 10:40:10 user nova-compute[72362]: DEBUG nova.compute.manager [req-f1748797-ae0f-4556-9739-5ece445de300 req-e0961822-c265-403c-8ab8-64df34cd8ba5 service nova] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Received event network-vif-plugged-c4b78135-dc1f-4eab-a5c6-e00aecfc09df {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:40:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f1748797-ae0f-4556-9739-5ece445de300 req-e0961822-c265-403c-8ab8-64df34cd8ba5 service nova] Acquiring lock "96da3bac-a460-4253-a4f6-cd8de34e59f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:40:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f1748797-ae0f-4556-9739-5ece445de300 req-e0961822-c265-403c-8ab8-64df34cd8ba5 service nova] Lock "96da3bac-a460-4253-a4f6-cd8de34e59f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:40:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f1748797-ae0f-4556-9739-5ece445de300 req-e0961822-c265-403c-8ab8-64df34cd8ba5 service nova] Lock "96da3bac-a460-4253-a4f6-cd8de34e59f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:40:10 user nova-compute[72362]: DEBUG nova.compute.manager [req-f1748797-ae0f-4556-9739-5ece445de300 req-e0961822-c265-403c-8ab8-64df34cd8ba5 service nova] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] No waiting events found dispatching network-vif-plugged-c4b78135-dc1f-4eab-a5c6-e00aecfc09df {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:40:10 user nova-compute[72362]: WARNING nova.compute.manager [req-f1748797-ae0f-4556-9739-5ece445de300 req-e0961822-c265-403c-8ab8-64df34cd8ba5 service nova] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Received unexpected event network-vif-plugged-c4b78135-dc1f-4eab-a5c6-e00aecfc09df for instance with vm_state deleted and task_state None.
Aug 09 10:40:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "refresh_cache-1da4edf1-dce6-4411-8494-8c3f7c7b8ea1" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:40:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquired lock "refresh_cache-1da4edf1-dce6-4411-8494-8c3f7c7b8ea1" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:40:10 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Forcefully refreshing network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 10:40:11 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Updating instance_info_cache with network_info: [{"id": "6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606", "address": "fa:16:3e:04:13:a4", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9e1aa0-d1", "ovs_interfaceid": "6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:40:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Releasing lock "refresh_cache-1da4edf1-dce6-4411-8494-8c3f7c7b8ea1" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:40:11 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Updated the network info_cache for instance {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 10:40:11 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:40:11 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:40:11 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:40:11 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:40:11 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 10:40:11 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:40:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:40:12 user nova-compute[72362]: DEBUG nova.compute.manager [req-f3b48c17-909d-40a6-affd-45e58e224662 req-a31a7fa6-e01f-484e-a904-b47a3a52e80c service nova] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Received event network-changed-1a21fab7-2746-481c-8003-5f8e6d67ea2a {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:40:12 user nova-compute[72362]: DEBUG nova.compute.manager [req-f3b48c17-909d-40a6-affd-45e58e224662 req-a31a7fa6-e01f-484e-a904-b47a3a52e80c service nova] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Refreshing instance network info cache due to event network-changed-1a21fab7-2746-481c-8003-5f8e6d67ea2a. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:40:12 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f3b48c17-909d-40a6-affd-45e58e224662 req-a31a7fa6-e01f-484e-a904-b47a3a52e80c service nova] Acquiring lock "refresh_cache-94aedd29-1832-4ff4-97ac-d70ed1775223" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:40:12 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f3b48c17-909d-40a6-affd-45e58e224662 req-a31a7fa6-e01f-484e-a904-b47a3a52e80c service nova] Acquired lock "refresh_cache-94aedd29-1832-4ff4-97ac-d70ed1775223" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:40:12 user nova-compute[72362]: DEBUG nova.network.neutron [req-f3b48c17-909d-40a6-affd-45e58e224662 req-a31a7fa6-e01f-484e-a904-b47a3a52e80c service nova] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Refreshing network info cache for port 1a21fab7-2746-481c-8003-5f8e6d67ea2a {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:40:12 user nova-compute[72362]: DEBUG nova.network.neutron [req-f3b48c17-909d-40a6-affd-45e58e224662 req-a31a7fa6-e01f-484e-a904-b47a3a52e80c service nova] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Updated VIF entry in instance network info cache for port 1a21fab7-2746-481c-8003-5f8e6d67ea2a. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:40:12 user nova-compute[72362]: DEBUG nova.network.neutron [req-f3b48c17-909d-40a6-affd-45e58e224662 req-a31a7fa6-e01f-484e-a904-b47a3a52e80c service nova] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Updating instance_info_cache with network_info: [{"id": "1a21fab7-2746-481c-8003-5f8e6d67ea2a", "address": "fa:16:3e:15:9c:15", "network": {"id": "362446ea-173c-4989-93f8-882088822208", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-499399633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f9d6a60f24d41deb91ae59189c62ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a21fab7-27", "ovs_interfaceid": "1a21fab7-2746-481c-8003-5f8e6d67ea2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:40:12 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:40:12 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:40:12 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f3b48c17-909d-40a6-affd-45e58e224662 req-a31a7fa6-e01f-484e-a904-b47a3a52e80c service nova] Releasing lock "refresh_cache-94aedd29-1832-4ff4-97ac-d70ed1775223" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:40:13 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:40:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-17abc042-5e36-4b81-9b24-bb25d748870b tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Acquiring lock "94aedd29-1832-4ff4-97ac-d70ed1775223" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:40:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-17abc042-5e36-4b81-9b24-bb25d748870b tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "94aedd29-1832-4ff4-97ac-d70ed1775223" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:40:16 user nova-compute[72362]: INFO nova.compute.manager [None req-17abc042-5e36-4b81-9b24-bb25d748870b tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Shelving
Aug 09 10:40:16 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:40:16 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:40:16 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:40:16 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:40:17 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:40:17 user nova-compute[72362]: DEBUG nova.compute.manager [req-0ea52785-ce8d-416a-b414-7e28fb641002 req-5bd91414-3488-467b-baee-5d9f3d5d3f7a service nova] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Received event network-vif-unplugged-1a21fab7-2746-481c-8003-5f8e6d67ea2a {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:40:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-0ea52785-ce8d-416a-b414-7e28fb641002 req-5bd91414-3488-467b-baee-5d9f3d5d3f7a service nova] Acquiring lock "94aedd29-1832-4ff4-97ac-d70ed1775223-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:40:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-0ea52785-ce8d-416a-b414-7e28fb641002 req-5bd91414-3488-467b-baee-5d9f3d5d3f7a service nova] Lock "94aedd29-1832-4ff4-97ac-d70ed1775223-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:40:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-0ea52785-ce8d-416a-b414-7e28fb641002 req-5bd91414-3488-467b-baee-5d9f3d5d3f7a service nova] Lock "94aedd29-1832-4ff4-97ac-d70ed1775223-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:40:17 user nova-compute[72362]: DEBUG nova.compute.manager [req-0ea52785-ce8d-416a-b414-7e28fb641002 req-5bd91414-3488-467b-baee-5d9f3d5d3f7a service nova] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] No waiting events found dispatching network-vif-unplugged-1a21fab7-2746-481c-8003-5f8e6d67ea2a {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:40:17 user nova-compute[72362]: WARNING nova.compute.manager [req-0ea52785-ce8d-416a-b414-7e28fb641002 req-5bd91414-3488-467b-baee-5d9f3d5d3f7a service nova] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Received unexpected event network-vif-unplugged-1a21fab7-2746-481c-8003-5f8e6d67ea2a for instance with vm_state active and task_state shelving.
Aug 09 10:40:17 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Instance destroyed successfully.
Aug 09 10:40:17 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-17abc042-5e36-4b81-9b24-bb25d748870b tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Beginning cold snapshot process
Aug 09 10:40:17 user nova-compute[72362]: DEBUG nova.privsep.utils [None req-17abc042-5e36-4b81-9b24-bb25d748870b tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72362) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 10:40:17 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-17abc042-5e36-4b81-9b24-bb25d748870b tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/94aedd29-1832-4ff4-97ac-d70ed1775223/disk /opt/stack/data/nova/instances/snapshots/tmpvt9idye2/ec75a1a7e6cd45d7ac7fdb00ea9198ac {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:40:18 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-17abc042-5e36-4b81-9b24-bb25d748870b tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/94aedd29-1832-4ff4-97ac-d70ed1775223/disk /opt/stack/data/nova/instances/snapshots/tmpvt9idye2/ec75a1a7e6cd45d7ac7fdb00ea9198ac" returned: 0 in 0.601s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:40:18 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-17abc042-5e36-4b81-9b24-bb25d748870b tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Snapshot extracted, beginning image upload
Aug 09 10:40:18 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:40:19 user nova-compute[72362]: DEBUG nova.compute.manager [req-df288457-f050-48b7-989b-e09b657a949b req-4f6be855-aa6a-4fe6-a915-55e515593106 service nova] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Received event network-vif-plugged-1a21fab7-2746-481c-8003-5f8e6d67ea2a {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:40:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-df288457-f050-48b7-989b-e09b657a949b req-4f6be855-aa6a-4fe6-a915-55e515593106 service nova] Acquiring lock "94aedd29-1832-4ff4-97ac-d70ed1775223-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:40:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-df288457-f050-48b7-989b-e09b657a949b req-4f6be855-aa6a-4fe6-a915-55e515593106 service nova] Lock "94aedd29-1832-4ff4-97ac-d70ed1775223-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:40:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-df288457-f050-48b7-989b-e09b657a949b req-4f6be855-aa6a-4fe6-a915-55e515593106 service nova] Lock "94aedd29-1832-4ff4-97ac-d70ed1775223-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:40:19 user nova-compute[72362]: DEBUG nova.compute.manager [req-df288457-f050-48b7-989b-e09b657a949b req-4f6be855-aa6a-4fe6-a915-55e515593106 service nova] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] No waiting events found dispatching network-vif-plugged-1a21fab7-2746-481c-8003-5f8e6d67ea2a {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:40:19 user nova-compute[72362]: WARNING nova.compute.manager [req-df288457-f050-48b7-989b-e09b657a949b req-4f6be855-aa6a-4fe6-a915-55e515593106 service nova] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Received unexpected event network-vif-plugged-1a21fab7-2746-481c-8003-5f8e6d67ea2a for instance with vm_state active and task_state shelving_image_uploading.
Aug 09 10:40:20 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:40:21 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:40:21 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:40:21 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:40:21 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 10:40:21 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-17abc042-5e36-4b81-9b24-bb25d748870b tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Snapshot image upload complete
Aug 09 10:40:21 user nova-compute[72362]: DEBUG nova.compute.manager [None req-17abc042-5e36-4b81-9b24-bb25d748870b tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:40:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be231c58-3e84-4b0f-bbbd-c44246954c47/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:40:21 user nova-compute[72362]: INFO nova.compute.manager [None req-17abc042-5e36-4b81-9b24-bb25d748870b tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Shelve offloading
Aug 09 10:40:21 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Instance destroyed successfully.
Aug 09 10:40:21 user nova-compute[72362]: DEBUG nova.compute.manager [None req-17abc042-5e36-4b81-9b24-bb25d748870b tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:40:21 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-17abc042-5e36-4b81-9b24-bb25d748870b tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Acquiring lock "refresh_cache-94aedd29-1832-4ff4-97ac-d70ed1775223" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:40:21 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-17abc042-5e36-4b81-9b24-bb25d748870b tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Acquired lock "refresh_cache-94aedd29-1832-4ff4-97ac-d70ed1775223" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:40:21 user nova-compute[72362]: DEBUG nova.network.neutron [None req-17abc042-5e36-4b81-9b24-bb25d748870b tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:40:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be231c58-3e84-4b0f-bbbd-c44246954c47/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:40:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be231c58-3e84-4b0f-bbbd-c44246954c47/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:40:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be231c58-3e84-4b0f-bbbd-c44246954c47/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:40:21 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:40:21 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:40:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:40:21 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691577606.565624, b74acebd-10f6-4c8e-9e58-f220b9483ade => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:40:21 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] VM Stopped (Lifecycle Event)
Aug 09 10:40:21 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1360e21c-57d5-4a6f-87c9-be1439251f95 None None] [instance: b74acebd-10f6-4c8e-9e58-f220b9483ade] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:40:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:40:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:40:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:40:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:40:21 user nova-compute[72362]: DEBUG nova.network.neutron [None req-17abc042-5e36-4b81-9b24-bb25d748870b tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Updating instance_info_cache with network_info: [{"id": "1a21fab7-2746-481c-8003-5f8e6d67ea2a", "address": "fa:16:3e:15:9c:15", "network": {"id": "362446ea-173c-4989-93f8-882088822208", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-499399633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f9d6a60f24d41deb91ae59189c62ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a21fab7-27", "ovs_interfaceid": "1a21fab7-2746-481c-8003-5f8e6d67ea2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:40:21 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-17abc042-5e36-4b81-9b24-bb25d748870b tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Releasing lock "refresh_cache-94aedd29-1832-4ff4-97ac-d70ed1775223" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:40:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:40:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:40:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:40:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:40:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:40:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:40:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:40:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:40:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94aedd29-1832-4ff4-97ac-d70ed1775223/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:40:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94aedd29-1832-4ff4-97ac-d70ed1775223/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:40:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94aedd29-1832-4ff4-97ac-d70ed1775223/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:40:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94aedd29-1832-4ff4-97ac-d70ed1775223/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:40:23 user nova-compute[72362]: DEBUG nova.compute.manager [req-d8a13567-d36d-4138-8dcf-d5ce41cc09fb req-1fbc184b-fd40-4003-81f2-ddf38de670db service nova] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Received event network-changed-1a21fab7-2746-481c-8003-5f8e6d67ea2a {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:40:23 user nova-compute[72362]: DEBUG nova.compute.manager [req-d8a13567-d36d-4138-8dcf-d5ce41cc09fb req-1fbc184b-fd40-4003-81f2-ddf38de670db service nova] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Refreshing instance network info cache due to event network-changed-1a21fab7-2746-481c-8003-5f8e6d67ea2a. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:40:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-d8a13567-d36d-4138-8dcf-d5ce41cc09fb req-1fbc184b-fd40-4003-81f2-ddf38de670db service nova] Acquiring lock "refresh_cache-94aedd29-1832-4ff4-97ac-d70ed1775223" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:40:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-d8a13567-d36d-4138-8dcf-d5ce41cc09fb req-1fbc184b-fd40-4003-81f2-ddf38de670db service nova] Acquired lock "refresh_cache-94aedd29-1832-4ff4-97ac-d70ed1775223" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:40:23 user nova-compute[72362]: DEBUG nova.network.neutron [req-d8a13567-d36d-4138-8dcf-d5ce41cc09fb req-1fbc184b-fd40-4003-81f2-ddf38de670db service nova] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Refreshing network info cache for port 1a21fab7-2746-481c-8003-5f8e6d67ea2a {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:40:23 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:40:23 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:40:23 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=8300MB free_disk=25.04694366455078GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 10:40:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:40:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:40:23 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Instance destroyed successfully.
Aug 09 10:40:23 user nova-compute[72362]: DEBUG nova.objects.instance [None req-17abc042-5e36-4b81-9b24-bb25d748870b tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lazy-loading 'resources' on Instance uuid 94aedd29-1832-4ff4-97ac-d70ed1775223 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:40:23 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-17abc042-5e36-4b81-9b24-bb25d748870b tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:38:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-45479132',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-45479132',id=42,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4gqGqKEyEBtLFKXkQToz6Rf8n6KOiXPf3Pmm/FZvG/oFNArAk44bhIJ9jkn8xdUjvGEiVns4+ZB/U94N22x6mMs9rGyVQqC5j4GuVj1X/qyx9a2pFKko3raRd0CBAUyg==',key_name='tempest-keypair-631856663',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:38:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2f9d6a60f24d41deb91ae59189c62ba2',ramdisk_id='',reservation_id='r-qaaj0twi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2139825844',owner_user_name='tempest-AttachVolumeShelveTestJSON-2139825844-project-member',shelved_at='2023-08-09T10:40:21.091315',shelved_host='user',shelved_image_id='1d55fcef-84a8-4cde-a397-01b94e6885ff'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:40:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='299166afe21b4d3cac05fdb072a78a78',uuid=94aedd29-1832-4ff4-97ac-d70ed1775223,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "1a21fab7-2746-481c-8003-5f8e6d67ea2a", "address": "fa:16:3e:15:9c:15", "network": {"id": "362446ea-173c-4989-93f8-882088822208", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-499399633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f9d6a60f24d41deb91ae59189c62ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a21fab7-27", "ovs_interfaceid": "1a21fab7-2746-481c-8003-5f8e6d67ea2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:40:23 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-17abc042-5e36-4b81-9b24-bb25d748870b tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Converting VIF {"id": "1a21fab7-2746-481c-8003-5f8e6d67ea2a", "address": "fa:16:3e:15:9c:15", "network": {"id": "362446ea-173c-4989-93f8-882088822208", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-499399633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f9d6a60f24d41deb91ae59189c62ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a21fab7-27", "ovs_interfaceid": "1a21fab7-2746-481c-8003-5f8e6d67ea2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:40:23 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-17abc042-5e36-4b81-9b24-bb25d748870b tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:9c:15,bridge_name='br-int',has_traffic_filtering=True,id=1a21fab7-2746-481c-8003-5f8e6d67ea2a,network=Network(362446ea-173c-4989-93f8-882088822208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a21fab7-27') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:40:23 user nova-compute[72362]: DEBUG os_vif [None req-17abc042-5e36-4b81-9b24-bb25d748870b tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:9c:15,bridge_name='br-int',has_traffic_filtering=True,id=1a21fab7-2746-481c-8003-5f8e6d67ea2a,network=Network(362446ea-173c-4989-93f8-882088822208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a21fab7-27') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:40:23 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:40:23 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1a21fab7-27, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:40:23 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:40:23 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:40:23 user nova-compute[72362]: INFO os_vif [None req-17abc042-5e36-4b81-9b24-bb25d748870b tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:9c:15,bridge_name='br-int',has_traffic_filtering=True,id=1a21fab7-2746-481c-8003-5f8e6d67ea2a,network=Network(362446ea-173c-4989-93f8-882088822208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a21fab7-27')
Aug 09 10:40:23 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-17abc042-5e36-4b81-9b24-bb25d748870b tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Deleting instance files /opt/stack/data/nova/instances/94aedd29-1832-4ff4-97ac-d70ed1775223_del
Aug 09 10:40:23 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-17abc042-5e36-4b81-9b24-bb25d748870b tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Deletion of /opt/stack/data/nova/instances/94aedd29-1832-4ff4-97ac-d70ed1775223_del complete
Aug 09 10:40:23 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance be231c58-3e84-4b0f-bbbd-c44246954c47 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:40:23 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:40:23 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance cefe383b-978f-4391-baf6-3b3ad17e0083 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:40:23 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 4296ca4c-1e3e-474f-98ba-9f947d333b8d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:40:23 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 94aedd29-1832-4ff4-97ac-d70ed1775223 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:40:23 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 10:40:23 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 10:40:23 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-17abc042-5e36-4b81-9b24-bb25d748870b tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Deleted allocations for instance 94aedd29-1832-4ff4-97ac-d70ed1775223
Aug 09 10:40:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-17abc042-5e36-4b81-9b24-bb25d748870b tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:40:23 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:40:23 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:40:23 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 10:40:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.374s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:40:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-17abc042-5e36-4b81-9b24-bb25d748870b tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.127s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:40:23 user nova-compute[72362]: DEBUG nova.objects.instance [None req-17abc042-5e36-4b81-9b24-bb25d748870b tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lazy-loading 'numa_topology' on Instance uuid 94aedd29-1832-4ff4-97ac-d70ed1775223 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:40:23 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691577608.5070646, 96da3bac-a460-4253-a4f6-cd8de34e59f8 => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:40:23 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] VM Stopped (Lifecycle Event)
Aug 09 10:40:23 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1e472e5a-47aa-4439-84be-1df9999eb9a2 None None] [instance: 96da3bac-a460-4253-a4f6-cd8de34e59f8] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:40:23 user nova-compute[72362]: DEBUG nova.network.neutron [req-d8a13567-d36d-4138-8dcf-d5ce41cc09fb req-1fbc184b-fd40-4003-81f2-ddf38de670db service nova] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Updated VIF entry in instance network info cache for port 1a21fab7-2746-481c-8003-5f8e6d67ea2a. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:40:23 user nova-compute[72362]: DEBUG nova.network.neutron [req-d8a13567-d36d-4138-8dcf-d5ce41cc09fb req-1fbc184b-fd40-4003-81f2-ddf38de670db service nova] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Updating instance_info_cache with network_info: [{"id": "1a21fab7-2746-481c-8003-5f8e6d67ea2a", "address": "fa:16:3e:15:9c:15", "network": {"id": "362446ea-173c-4989-93f8-882088822208", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-499399633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f9d6a60f24d41deb91ae59189c62ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap1a21fab7-27", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:40:23 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-17abc042-5e36-4b81-9b24-bb25d748870b tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:40:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-d8a13567-d36d-4138-8dcf-d5ce41cc09fb req-1fbc184b-fd40-4003-81f2-ddf38de670db service nova] Releasing lock "refresh_cache-94aedd29-1832-4ff4-97ac-d70ed1775223" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:40:23 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-17abc042-5e36-4b81-9b24-bb25d748870b tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:40:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-17abc042-5e36-4b81-9b24-bb25d748870b tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.512s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:40:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-17abc042-5e36-4b81-9b24-bb25d748870b tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "94aedd29-1832-4ff4-97ac-d70ed1775223" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.282s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:40:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:40:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:40:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:40:32 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691577617.5720046, 94aedd29-1832-4ff4-97ac-d70ed1775223 => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:40:32 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] VM Stopped (Lifecycle Event)
Aug 09 10:40:32 user nova-compute[72362]: DEBUG nova.compute.manager [None req-b700a3b8-4f7a-446c-b328-9b6e495ac6d4 None None] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:40:33 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:40:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:40:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:40:43 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:40:48 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:40:53 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:40:58 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:40:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-29a0c380-7ab6-4f78-838f-316129fa23f4 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "be231c58-3e84-4b0f-bbbd-c44246954c47" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:40:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-29a0c380-7ab6-4f78-838f-316129fa23f4 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "be231c58-3e84-4b0f-bbbd-c44246954c47" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:40:59 user nova-compute[72362]: INFO nova.compute.manager [None req-29a0c380-7ab6-4f78-838f-316129fa23f4 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Detaching volume 317ea820-31e7-47cd-8d7e-bdcae76d421f
Aug 09 10:40:59 user nova-compute[72362]: INFO nova.virt.block_device [None req-29a0c380-7ab6-4f78-838f-316129fa23f4 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Attempting to driver detach volume 317ea820-31e7-47cd-8d7e-bdcae76d421f from mountpoint /dev/vdb
Aug 09 10:40:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-29a0c380-7ab6-4f78-838f-316129fa23f4 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Attempting to detach device vdb from instance be231c58-3e84-4b0f-bbbd-c44246954c47 from the persistent domain config. {{(pid=72362) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 10:40:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-29a0c380-7ab6-4f78-838f-316129fa23f4 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 10:40:59 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:40:59 user nova-compute[72362]:   <source dev="/dev/sdb"/>
Aug 09 10:40:59 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:40:59 user nova-compute[72362]:   <serial>317ea820-31e7-47cd-8d7e-bdcae76d421f</serial>
Aug 09 10:40:59 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 10:40:59 user nova-compute[72362]: </disk>
Aug 09 10:40:59 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:40:59 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-29a0c380-7ab6-4f78-838f-316129fa23f4 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Successfully detached device vdb from instance be231c58-3e84-4b0f-bbbd-c44246954c47 from the persistent domain config.
Aug 09 10:40:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-29a0c380-7ab6-4f78-838f-316129fa23f4 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance be231c58-3e84-4b0f-bbbd-c44246954c47 from the live domain config. {{(pid=72362) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 10:40:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-29a0c380-7ab6-4f78-838f-316129fa23f4 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 10:40:59 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:40:59 user nova-compute[72362]:   <source dev="/dev/sdb"/>
Aug 09 10:40:59 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:40:59 user nova-compute[72362]:   <serial>317ea820-31e7-47cd-8d7e-bdcae76d421f</serial>
Aug 09 10:40:59 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 10:40:59 user nova-compute[72362]: </disk>
Aug 09 10:40:59 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:40:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Received event <DeviceRemovedEvent: 1691577659.5659704, be231c58-3e84-4b0f-bbbd-c44246954c47 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72362) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 10:40:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-29a0c380-7ab6-4f78-838f-316129fa23f4 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance be231c58-3e84-4b0f-bbbd-c44246954c47 {{(pid=72362) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 10:40:59 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-29a0c380-7ab6-4f78-838f-316129fa23f4 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Successfully detached device vdb from instance be231c58-3e84-4b0f-bbbd-c44246954c47 from the live domain config.
Aug 09 10:40:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29a0c380-7ab6-4f78-838f-316129fa23f4 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:40:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a0c380-7ab6-4f78-838f-316129fa23f4 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DTVYlHFe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:40:59 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-29a0c380-7ab6-4f78-838f-316129fa23f4 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:40:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-29a0c380-7ab6-4f78-838f-316129fa23f4 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:40:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-29a0c380-7ab6-4f78-838f-316129fa23f4 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:40:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a0c380-7ab6-4f78-838f-316129fa23f4 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:40:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:40:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:40:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[123aceba-b85a-49cd-be35-81a1e4637b38]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:40:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:40:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:40:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6d0a0d-2776-44dd-b075-ad7d03727269]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:40:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a0c380-7ab6-4f78-838f-316129fa23f4 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247 (non-flash)
Aug 09 10:40:59 user nova-compute[72362]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f (non-flash)
Aug 09 10:40:59 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:40:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a0c380-7ab6-4f78-838f-316129fa23f4 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247 (non-flash)
Aug 09 10:40:59 user nova-compute[72362]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f (non-flash)
Aug 09 10:40:59 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:40:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a0c380-7ab6-4f78-838f-316129fa23f4 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34dc2c9990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f'): ({'sdb'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:40:59 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-29a0c380-7ab6-4f78-838f-316129fa23f4 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Removing single pathed devices sdb {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:40:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:40:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:40:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef36495-f852-4550-bc02-144239886111]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:40:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:40:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:40:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba087b8-e6f0-4e86-a3a3-f8603daa1a48]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:40:59 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-29a0c380-7ab6-4f78-838f-316129fa23f4 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Flushing IO for device /dev/sdb {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:40:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:40:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:40:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0babba-2f65-49af-8f68-74ac90ba9911]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:40:59 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-29a0c380-7ab6-4f78-838f-316129fa23f4 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:40:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:40:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:40:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b9c4e1-de06-44a6-8d61-645a0d372063]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:40:59 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-29a0c380-7ab6-4f78-838f-316129fa23f4 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:40:59 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-29a0c380-7ab6-4f78-838f-316129fa23f4 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] SCSI volumes sdb have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:40:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a0c380-7ab6-4f78-838f-316129fa23f4 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:40:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:40:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:40:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[8347a3bd-8611-4df2-9bf6-7ada6cb02baf]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:40:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a0c380-7ab6-4f78-838f-316129fa23f4 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:40:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:40:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:40:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93e9a93-e72a-4b65-b134-83eaaee19def]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:40:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a0c380-7ab6-4f78-838f-316129fa23f4 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f, portal: 172.16.0.220,3260]
Aug 09 10:40:59 user nova-compute[72362]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f, portal: 172.16.0.220,3260] successful.
Aug 09 10:40:59 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:40:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:40:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317ea820-31e7-47cd-8d7e-bdcae76d421f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:40:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b97009-d35d-4ccc-83ce-33fcf446f263]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:40:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a0c380-7ab6-4f78-838f-316129fa23f4 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:40:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-29a0c380-7ab6-4f78-838f-316129fa23f4 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.248s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:40:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a0c380-7ab6-4f78-838f-316129fa23f4 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] <== disconnect_volume: return (249ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:40:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29a0c380-7ab6-4f78-838f-316129fa23f4 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:41:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0b7515e6-bccf-48ac-aa48-ceb121cb7050 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "1da4edf1-dce6-4411-8494-8c3f7c7b8ea1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:41:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0b7515e6-bccf-48ac-aa48-ceb121cb7050 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "1da4edf1-dce6-4411-8494-8c3f7c7b8ea1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:41:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0b7515e6-bccf-48ac-aa48-ceb121cb7050 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "1da4edf1-dce6-4411-8494-8c3f7c7b8ea1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:41:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0b7515e6-bccf-48ac-aa48-ceb121cb7050 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "1da4edf1-dce6-4411-8494-8c3f7c7b8ea1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:41:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0b7515e6-bccf-48ac-aa48-ceb121cb7050 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "1da4edf1-dce6-4411-8494-8c3f7c7b8ea1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:41:00 user nova-compute[72362]: INFO nova.compute.manager [None req-0b7515e6-bccf-48ac-aa48-ceb121cb7050 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Terminating instance
Aug 09 10:41:00 user nova-compute[72362]: DEBUG nova.compute.manager [None req-0b7515e6-bccf-48ac-aa48-ceb121cb7050 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Start destroying the instance on the hypervisor. {{(pid=72362) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 10:41:00 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:41:00 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:41:00 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:41:00 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:41:00 user nova-compute[72362]: DEBUG nova.objects.instance [None req-29a0c380-7ab6-4f78-838f-316129fa23f4 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lazy-loading 'flavor' on Instance uuid be231c58-3e84-4b0f-bbbd-c44246954c47 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:41:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-29a0c380-7ab6-4f78-838f-316129fa23f4 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "be231c58-3e84-4b0f-bbbd-c44246954c47" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.873s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:41:00 user nova-compute[72362]: DEBUG nova.compute.manager [req-30b4ed47-3af1-4657-9531-233c5004f442 req-97d930d1-292a-49f0-ba2e-d7ea6fae590d service nova] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Received event network-vif-unplugged-6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:41:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-30b4ed47-3af1-4657-9531-233c5004f442 req-97d930d1-292a-49f0-ba2e-d7ea6fae590d service nova] Acquiring lock "1da4edf1-dce6-4411-8494-8c3f7c7b8ea1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:41:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-30b4ed47-3af1-4657-9531-233c5004f442 req-97d930d1-292a-49f0-ba2e-d7ea6fae590d service nova] Lock "1da4edf1-dce6-4411-8494-8c3f7c7b8ea1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:41:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-30b4ed47-3af1-4657-9531-233c5004f442 req-97d930d1-292a-49f0-ba2e-d7ea6fae590d service nova] Lock "1da4edf1-dce6-4411-8494-8c3f7c7b8ea1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:41:00 user nova-compute[72362]: DEBUG nova.compute.manager [req-30b4ed47-3af1-4657-9531-233c5004f442 req-97d930d1-292a-49f0-ba2e-d7ea6fae590d service nova] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] No waiting events found dispatching network-vif-unplugged-6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:41:00 user nova-compute[72362]: DEBUG nova.compute.manager [req-30b4ed47-3af1-4657-9531-233c5004f442 req-97d930d1-292a-49f0-ba2e-d7ea6fae590d service nova] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Received event network-vif-unplugged-6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606 for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:41:01 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Instance destroyed successfully.
Aug 09 10:41:01 user nova-compute[72362]: DEBUG nova.objects.instance [None req-0b7515e6-bccf-48ac-aa48-ceb121cb7050 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lazy-loading 'resources' on Instance uuid 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-0b7515e6-bccf-48ac-aa48-ceb121cb7050 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:36:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-544578261',display_name='tempest-TestVolumeBootPattern-volume-backed-server-544578261',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-544578261',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6em6mSBf/2CQokZlzlCDY2qxGLE4Izc6Xt2X3SSZ2GDtNUPa1CBOgrNLxUgqZpaX/KHdbN4EcomYXdEIwVfIxEbDy1gNcHh8xtF1XXiURvlNf6J4M1BXUQ10OZ3GdzRQ==',key_name='tempest-keypair-1354713331',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:36:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='26e38599de0b4b06b723f5647a7fe121',ramdisk_id='',reservation_id='r-6t0a404a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1478436240',owner_user_name='tempest-TestVolumeBootPattern-1478436240-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:36:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e96900e953f64d02bdb5d48f136133c3',uuid=1da4edf1-dce6-4411-8494-8c3f7c7b8ea1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606", "address": "fa:16:3e:04:13:a4", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9e1aa0-d1", "ovs_interfaceid": "6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-0b7515e6-bccf-48ac-aa48-ceb121cb7050 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Converting VIF {"id": "6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606", "address": "fa:16:3e:04:13:a4", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9e1aa0-d1", "ovs_interfaceid": "6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-0b7515e6-bccf-48ac-aa48-ceb121cb7050 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:13:a4,bridge_name='br-int',has_traffic_filtering=True,id=6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606,network=Network(b4a9e050-41f1-404a-bf5c-41421f034644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9e1aa0-d1') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG os_vif [None req-0b7515e6-bccf-48ac-aa48-ceb121cb7050 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:13:a4,bridge_name='br-int',has_traffic_filtering=True,id=6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606,network=Network(b4a9e050-41f1-404a-bf5c-41421f034644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9e1aa0-d1') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e9e1aa0-d1, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:41:01 user nova-compute[72362]: INFO os_vif [None req-0b7515e6-bccf-48ac-aa48-ceb121cb7050 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:13:a4,bridge_name='br-int',has_traffic_filtering=True,id=6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606,network=Network(b4a9e050-41f1-404a-bf5c-41421f034644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9e1aa0-d1')
Aug 09 10:41:01 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b7515e6-bccf-48ac-aa48-ceb121cb7050 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b7515e6-bccf-48ac-aa48-ceb121cb7050 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gNewnOMj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:41:01 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-0b7515e6-bccf-48ac-aa48-ceb121cb7050 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:41:01 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-0b7515e6-bccf-48ac-aa48-ceb121cb7050 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-0b7515e6-bccf-48ac-aa48-ceb121cb7050 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b7515e6-bccf-48ac-aa48-ceb121cb7050 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d057d8dd-2566-4113-af2a-eaa25a4c9bd0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[76239dad-c1e8-4c43-9c1a-282708b29f39]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b7515e6-bccf-48ac-aa48-ceb121cb7050 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247 (non-flash)
Aug 09 10:41:01 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b7515e6-bccf-48ac-aa48-ceb121cb7050 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247 (non-flash)
Aug 09 10:41:01 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b7515e6-bccf-48ac-aa48-ceb121cb7050 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34dc2ee050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247'): ({'sdc'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-0b7515e6-bccf-48ac-aa48-ceb121cb7050 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Removing single pathed devices sdc {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca318868-b7a3-44b5-b18e-a0257a3a3f08]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04bf123-c99c-4ec1-a69c-9c13d9e6f4cc]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-0b7515e6-bccf-48ac-aa48-ceb121cb7050 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Flushing IO for device /dev/sdc {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4813fea6-253a-402b-9445-196e613feb10]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-0b7515e6-bccf-48ac-aa48-ceb121cb7050 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[365c66fe-7988-4f9e-b28d-5be8db197983]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-0b7515e6-bccf-48ac-aa48-ceb121cb7050 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-0b7515e6-bccf-48ac-aa48-ceb121cb7050 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] SCSI volumes sdc have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO3f9d7787-dc41c36f51660fca', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_3f9d7787', '/dev/disk/by-id/scsi-26463343163333666') {{(pid=84003) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bcfa462-436a-4a70-ab80-824bc4031901]: (4, None) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b7515e6-bccf-48ac-aa48-ceb121cb7050 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[da114e2c-6892-4962-ab00-c07369663dde]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b7515e6-bccf-48ac-aa48-ceb121cb7050 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247 -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b432c6-6226-4eaa-a097-e2f1e8c81bbe]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b7515e6-bccf-48ac-aa48-ceb121cb7050 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247, portal: 172.16.0.220,3260]
Aug 09 10:41:01 user nova-compute[72362]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247, portal: 172.16.0.220,3260] successful.
Aug 09 10:41:01 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247 -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3c41411-1beb-46e3-b0a4-888734995247 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e714c056-28d3-4585-b244-6da2381d5a2f]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b7515e6-bccf-48ac-aa48-ceb121cb7050 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-0b7515e6-bccf-48ac-aa48-ceb121cb7050 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.265s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b7515e6-bccf-48ac-aa48-ceb121cb7050 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] <== disconnect_volume: return (267ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b7515e6-bccf-48ac-aa48-ceb121cb7050 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:41:01 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-0b7515e6-bccf-48ac-aa48-ceb121cb7050 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Deleting instance files /opt/stack/data/nova/instances/1da4edf1-dce6-4411-8494-8c3f7c7b8ea1_del
Aug 09 10:41:01 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-0b7515e6-bccf-48ac-aa48-ceb121cb7050 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Deletion of /opt/stack/data/nova/instances/1da4edf1-dce6-4411-8494-8c3f7c7b8ea1_del complete
Aug 09 10:41:01 user nova-compute[72362]: INFO nova.compute.manager [None req-0b7515e6-bccf-48ac-aa48-ceb121cb7050 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Took 1.11 seconds to destroy the instance on the hypervisor.
Aug 09 10:41:01 user nova-compute[72362]: DEBUG oslo.service.loopingcall [None req-0b7515e6-bccf-48ac-aa48-ceb121cb7050 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72362) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG nova.compute.manager [-] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Deallocating network for instance {{(pid=72362) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 10:41:01 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] deallocate_for_instance() {{(pid=72362) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 10:41:02 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:41:02 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Took 0.84 seconds to deallocate network for instance.
Aug 09 10:41:03 user nova-compute[72362]: DEBUG nova.compute.manager [req-d2414b3d-70e2-4437-aebb-262f9cc586a7 req-061e9789-72e0-45d2-8d7c-55e4f31b7018 service nova] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Received event network-vif-plugged-6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:41:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-d2414b3d-70e2-4437-aebb-262f9cc586a7 req-061e9789-72e0-45d2-8d7c-55e4f31b7018 service nova] Acquiring lock "1da4edf1-dce6-4411-8494-8c3f7c7b8ea1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:41:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-d2414b3d-70e2-4437-aebb-262f9cc586a7 req-061e9789-72e0-45d2-8d7c-55e4f31b7018 service nova] Lock "1da4edf1-dce6-4411-8494-8c3f7c7b8ea1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:41:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-d2414b3d-70e2-4437-aebb-262f9cc586a7 req-061e9789-72e0-45d2-8d7c-55e4f31b7018 service nova] Lock "1da4edf1-dce6-4411-8494-8c3f7c7b8ea1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:41:03 user nova-compute[72362]: DEBUG nova.compute.manager [req-d2414b3d-70e2-4437-aebb-262f9cc586a7 req-061e9789-72e0-45d2-8d7c-55e4f31b7018 service nova] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] No waiting events found dispatching network-vif-plugged-6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:41:03 user nova-compute[72362]: WARNING nova.compute.manager [req-d2414b3d-70e2-4437-aebb-262f9cc586a7 req-061e9789-72e0-45d2-8d7c-55e4f31b7018 service nova] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Received unexpected event network-vif-plugged-6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606 for instance with vm_state active and task_state deleting.
Aug 09 10:41:03 user nova-compute[72362]: DEBUG nova.compute.manager [req-d2414b3d-70e2-4437-aebb-262f9cc586a7 req-061e9789-72e0-45d2-8d7c-55e4f31b7018 service nova] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Received event network-vif-deleted-6e9e1aa0-d194-4d8a-89f9-cc97ae2b1606 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:41:03 user nova-compute[72362]: INFO nova.compute.manager [None req-0b7515e6-bccf-48ac-aa48-ceb121cb7050 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Took 0.76 seconds to detach 1 volumes for instance.
Aug 09 10:41:03 user nova-compute[72362]: DEBUG nova.compute.manager [None req-0b7515e6-bccf-48ac-aa48-ceb121cb7050 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Deleting volume: f3c41411-1beb-46e3-b0a4-888734995247 {{(pid=72362) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 09 10:41:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0b7515e6-bccf-48ac-aa48-ceb121cb7050 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:41:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0b7515e6-bccf-48ac-aa48-ceb121cb7050 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:41:03 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-0b7515e6-bccf-48ac-aa48-ceb121cb7050 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:41:03 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-0b7515e6-bccf-48ac-aa48-ceb121cb7050 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:41:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0b7515e6-bccf-48ac-aa48-ceb121cb7050 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.195s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:41:03 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-0b7515e6-bccf-48ac-aa48-ceb121cb7050 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Deleted allocations for instance 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1
Aug 09 10:41:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0b7515e6-bccf-48ac-aa48-ceb121cb7050 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "1da4edf1-dce6-4411-8494-8c3f7c7b8ea1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.290s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:41:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:41:10 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:41:10 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:41:10 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 10:41:10 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:41:10 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:41:11 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:41:11 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:41:11 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 10:41:11 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 10:41:11 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 10:41:11 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:41:11 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:41:11 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 10:41:12 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "refresh_cache-cefe383b-978f-4391-baf6-3b3ad17e0083" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:41:12 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquired lock "refresh_cache-cefe383b-978f-4391-baf6-3b3ad17e0083" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:41:12 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Forcefully refreshing network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 10:41:12 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Updating instance_info_cache with network_info: [{"id": "1d14bbdf-8802-42b5-bd22-c6bd03a53761", "address": "fa:16:3e:fe:ee:4f", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d14bbdf-88", "ovs_interfaceid": "1d14bbdf-8802-42b5-bd22-c6bd03a53761", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:41:12 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Releasing lock "refresh_cache-cefe383b-978f-4391-baf6-3b3ad17e0083" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:41:12 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Updated the network info_cache for instance {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 10:41:12 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:41:13 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:41:13 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:41:16 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691577661.22409, 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1 => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:41:16 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] VM Stopped (Lifecycle Event)
Aug 09 10:41:16 user nova-compute[72362]: DEBUG nova.compute.manager [None req-11da68e9-8c35-4c6c-8be3-acfaff7ca66a None None] [instance: 1da4edf1-dce6-4411-8494-8c3f7c7b8ea1] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:41:16 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:41:20 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:41:21 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:41:21 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:41:21 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:41:21 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 10:41:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be231c58-3e84-4b0f-bbbd-c44246954c47/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:41:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be231c58-3e84-4b0f-bbbd-c44246954c47/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:41:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be231c58-3e84-4b0f-bbbd-c44246954c47/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:41:21 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:41:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be231c58-3e84-4b0f-bbbd-c44246954c47/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:41:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:41:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:41:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:41:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:41:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:41:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:41:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:41:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:41:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:41:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:41:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:41:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:41:22 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:41:22 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:41:22 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=8534MB free_disk=25.106143951416016GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 10:41:22 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:41:22 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:41:22 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance be231c58-3e84-4b0f-bbbd-c44246954c47 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:41:22 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance cefe383b-978f-4391-baf6-3b3ad17e0083 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:41:22 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 4296ca4c-1e3e-474f-98ba-9f947d333b8d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:41:22 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 10:41:22 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 10:41:22 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:41:22 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:41:23 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 10:41:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.296s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:41:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:41:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:41:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:41:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 10:41:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 10:41:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 10:41:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:41:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:41:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:41:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:41:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 10:41:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 10:41:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 10:41:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:41:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:41:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-278269e5-4a3e-4f7b-bb45-efc674989132 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "be231c58-3e84-4b0f-bbbd-c44246954c47" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:41:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-278269e5-4a3e-4f7b-bb45-efc674989132 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "be231c58-3e84-4b0f-bbbd-c44246954c47" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:41:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-278269e5-4a3e-4f7b-bb45-efc674989132 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "be231c58-3e84-4b0f-bbbd-c44246954c47-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:41:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-278269e5-4a3e-4f7b-bb45-efc674989132 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "be231c58-3e84-4b0f-bbbd-c44246954c47-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:41:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-278269e5-4a3e-4f7b-bb45-efc674989132 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "be231c58-3e84-4b0f-bbbd-c44246954c47-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:41:49 user nova-compute[72362]: INFO nova.compute.manager [None req-278269e5-4a3e-4f7b-bb45-efc674989132 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Terminating instance
Aug 09 10:41:49 user nova-compute[72362]: DEBUG nova.compute.manager [None req-278269e5-4a3e-4f7b-bb45-efc674989132 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Start destroying the instance on the hypervisor. {{(pid=72362) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 10:41:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:41:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:41:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:41:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:41:49 user nova-compute[72362]: DEBUG nova.compute.manager [req-f4ab9f8b-33c9-4191-9f3f-a99f6102fae8 req-37b4f3cd-e844-4497-be12-88d0e622b756 service nova] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Received event network-vif-unplugged-4c907e79-d540-4521-bc58-ebc624c13456 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:41:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f4ab9f8b-33c9-4191-9f3f-a99f6102fae8 req-37b4f3cd-e844-4497-be12-88d0e622b756 service nova] Acquiring lock "be231c58-3e84-4b0f-bbbd-c44246954c47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:41:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f4ab9f8b-33c9-4191-9f3f-a99f6102fae8 req-37b4f3cd-e844-4497-be12-88d0e622b756 service nova] Lock "be231c58-3e84-4b0f-bbbd-c44246954c47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:41:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f4ab9f8b-33c9-4191-9f3f-a99f6102fae8 req-37b4f3cd-e844-4497-be12-88d0e622b756 service nova] Lock "be231c58-3e84-4b0f-bbbd-c44246954c47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:41:49 user nova-compute[72362]: DEBUG nova.compute.manager [req-f4ab9f8b-33c9-4191-9f3f-a99f6102fae8 req-37b4f3cd-e844-4497-be12-88d0e622b756 service nova] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] No waiting events found dispatching network-vif-unplugged-4c907e79-d540-4521-bc58-ebc624c13456 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:41:49 user nova-compute[72362]: DEBUG nova.compute.manager [req-f4ab9f8b-33c9-4191-9f3f-a99f6102fae8 req-37b4f3cd-e844-4497-be12-88d0e622b756 service nova] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Received event network-vif-unplugged-4c907e79-d540-4521-bc58-ebc624c13456 for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:41:50 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Instance destroyed successfully.
Aug 09 10:41:50 user nova-compute[72362]: DEBUG nova.objects.instance [None req-278269e5-4a3e-4f7b-bb45-efc674989132 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lazy-loading 'resources' on Instance uuid be231c58-3e84-4b0f-bbbd-c44246954c47 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:41:50 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-278269e5-4a3e-4f7b-bb45-efc674989132 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:36:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1258122356',display_name='tempest-AttachVolumeNegativeTest-server-1258122356',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1258122356',id=36,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiNoPm3w8o+Zwj9sH88wknolYrxNlUoTqg5cMzzCV9zhvLWcW1SX3WjO4m2DuhM6E92ds+smyuFs9AJXD9ugzw76cPsChq0OQtdtqB2xjnkuk76sxfKBFB2mVVs3jQLyw==',key_name='tempest-keypair-1348046424',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:36:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='980f1c36cab0449b949419cf495c16d5',ramdisk_id='',reservation_id='r-is960l10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-486756066',owner_user_name='tempest-AttachVolumeNegativeTest-486756066-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:36:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bed469ff9d954891905c98bdf238c097',uuid=be231c58-3e84-4b0f-bbbd-c44246954c47,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c907e79-d540-4521-bc58-ebc624c13456", "address": "fa:16:3e:ea:97:51", "network": {"id": "e56e2a0a-0a6d-4546-86ef-7bb333e829ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1495216341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980f1c36cab0449b949419cf495c16d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c907e79-d5", "ovs_interfaceid": "4c907e79-d540-4521-bc58-ebc624c13456", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:41:50 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-278269e5-4a3e-4f7b-bb45-efc674989132 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Converting VIF {"id": "4c907e79-d540-4521-bc58-ebc624c13456", "address": "fa:16:3e:ea:97:51", "network": {"id": "e56e2a0a-0a6d-4546-86ef-7bb333e829ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1495216341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980f1c36cab0449b949419cf495c16d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c907e79-d5", "ovs_interfaceid": "4c907e79-d540-4521-bc58-ebc624c13456", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:41:50 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-278269e5-4a3e-4f7b-bb45-efc674989132 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:97:51,bridge_name='br-int',has_traffic_filtering=True,id=4c907e79-d540-4521-bc58-ebc624c13456,network=Network(e56e2a0a-0a6d-4546-86ef-7bb333e829ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c907e79-d5') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:41:50 user nova-compute[72362]: DEBUG os_vif [None req-278269e5-4a3e-4f7b-bb45-efc674989132 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:97:51,bridge_name='br-int',has_traffic_filtering=True,id=4c907e79-d540-4521-bc58-ebc624c13456,network=Network(e56e2a0a-0a6d-4546-86ef-7bb333e829ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c907e79-d5') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:41:50 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:41:50 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c907e79-d5, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:41:50 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:41:50 user nova-compute[72362]: INFO os_vif [None req-278269e5-4a3e-4f7b-bb45-efc674989132 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:97:51,bridge_name='br-int',has_traffic_filtering=True,id=4c907e79-d540-4521-bc58-ebc624c13456,network=Network(e56e2a0a-0a6d-4546-86ef-7bb333e829ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c907e79-d5')
Aug 09 10:41:50 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-278269e5-4a3e-4f7b-bb45-efc674989132 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Deleting instance files /opt/stack/data/nova/instances/be231c58-3e84-4b0f-bbbd-c44246954c47_del
Aug 09 10:41:50 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-278269e5-4a3e-4f7b-bb45-efc674989132 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Deletion of /opt/stack/data/nova/instances/be231c58-3e84-4b0f-bbbd-c44246954c47_del complete
Aug 09 10:41:50 user nova-compute[72362]: INFO nova.compute.manager [None req-278269e5-4a3e-4f7b-bb45-efc674989132 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 09 10:41:50 user nova-compute[72362]: DEBUG oslo.service.loopingcall [None req-278269e5-4a3e-4f7b-bb45-efc674989132 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72362) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 10:41:50 user nova-compute[72362]: DEBUG nova.compute.manager [-] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Deallocating network for instance {{(pid=72362) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 10:41:50 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] deallocate_for_instance() {{(pid=72362) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 10:41:51 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:41:51 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Took 0.87 seconds to deallocate network for instance.
Aug 09 10:41:51 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-278269e5-4a3e-4f7b-bb45-efc674989132 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:41:51 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-278269e5-4a3e-4f7b-bb45-efc674989132 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:41:51 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-278269e5-4a3e-4f7b-bb45-efc674989132 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:41:51 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-278269e5-4a3e-4f7b-bb45-efc674989132 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:41:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:41:51 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-278269e5-4a3e-4f7b-bb45-efc674989132 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.213s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:41:51 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-278269e5-4a3e-4f7b-bb45-efc674989132 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Deleted allocations for instance be231c58-3e84-4b0f-bbbd-c44246954c47
Aug 09 10:41:51 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-278269e5-4a3e-4f7b-bb45-efc674989132 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "be231c58-3e84-4b0f-bbbd-c44246954c47" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.198s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:41:51 user nova-compute[72362]: DEBUG nova.compute.manager [req-318de449-aee4-488c-b343-3a5200398db8 req-a57d8305-7e17-4c0b-928e-5150266182b1 service nova] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Received event network-vif-plugged-4c907e79-d540-4521-bc58-ebc624c13456 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:41:51 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-318de449-aee4-488c-b343-3a5200398db8 req-a57d8305-7e17-4c0b-928e-5150266182b1 service nova] Acquiring lock "be231c58-3e84-4b0f-bbbd-c44246954c47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:41:51 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-318de449-aee4-488c-b343-3a5200398db8 req-a57d8305-7e17-4c0b-928e-5150266182b1 service nova] Lock "be231c58-3e84-4b0f-bbbd-c44246954c47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:41:51 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-318de449-aee4-488c-b343-3a5200398db8 req-a57d8305-7e17-4c0b-928e-5150266182b1 service nova] Lock "be231c58-3e84-4b0f-bbbd-c44246954c47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:41:51 user nova-compute[72362]: DEBUG nova.compute.manager [req-318de449-aee4-488c-b343-3a5200398db8 req-a57d8305-7e17-4c0b-928e-5150266182b1 service nova] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] No waiting events found dispatching network-vif-plugged-4c907e79-d540-4521-bc58-ebc624c13456 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:41:51 user nova-compute[72362]: WARNING nova.compute.manager [req-318de449-aee4-488c-b343-3a5200398db8 req-a57d8305-7e17-4c0b-928e-5150266182b1 service nova] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Received unexpected event network-vif-plugged-4c907e79-d540-4521-bc58-ebc624c13456 for instance with vm_state deleted and task_state None.
Aug 09 10:41:51 user nova-compute[72362]: DEBUG nova.compute.manager [req-318de449-aee4-488c-b343-3a5200398db8 req-a57d8305-7e17-4c0b-928e-5150266182b1 service nova] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Received event network-vif-deleted-4c907e79-d540-4521-bc58-ebc624c13456 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:41:55 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:00 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:42:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "902ed05f-84c3-40f2-a991-4a5264f5d972" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:42:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "902ed05f-84c3-40f2-a991-4a5264f5d972" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:42:02 user nova-compute[72362]: DEBUG nova.compute.manager [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Starting instance... {{(pid=72362) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 10:42:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:42:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:42:02 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:42:02 user nova-compute[72362]: INFO nova.compute.claims [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Claim successful on node user
Aug 09 10:42:02 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:42:02 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:42:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.211s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:42:02 user nova-compute[72362]: DEBUG nova.compute.manager [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Start building networks asynchronously for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 10:42:02 user nova-compute[72362]: DEBUG nova.compute.manager [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Allocating IP information in the background. {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 10:42:02 user nova-compute[72362]: DEBUG nova.network.neutron [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] allocate_for_instance() {{(pid=72362) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 10:42:02 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 10:42:02 user nova-compute[72362]: DEBUG nova.compute.manager [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Start building block device mappings for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 10:42:02 user nova-compute[72362]: INFO nova.virt.block_device [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Booting with volume b13e9f29-5849-486f-b75a-9520443d9135 at /dev/vda
Aug 09 10:42:02 user nova-compute[72362]: DEBUG nova.policy [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e96900e953f64d02bdb5d48f136133c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e38599de0b4b06b723f5647a7fe121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72362) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 10:42:03 user nova-compute[72362]: DEBUG os_brick.utils [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:42:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:42:03 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[13629750-4592-4a45-b56f-e1ba226e80c8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:42:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:42:03 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b3c38b-a628-4bc7-8c61-ede3e9399952]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:42:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:42:03 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bca3078-285d-4907-a1f9-40f702861d33]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:42:03 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d479aa1-bf23-4fad-8294-5e12e2171745]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:42:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:42:03 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:42:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:42:03 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:42:03 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f7d2c3-037e-4cbf-a3d0-d944bdb9243f]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:42:03 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:42:03 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:42:03 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:42:03 user nova-compute[72362]: DEBUG os_brick.utils [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:42:03 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Updating existing volume attachment record: 932069bb-3806-4df4-a02d-c8a7b4b762d7 {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 10:42:03 user nova-compute[72362]: DEBUG nova.network.neutron [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Successfully created port: cb19a9db-8c08-4ae0-b7ec-7dda0b276718 {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:42:04 user nova-compute[72362]: DEBUG nova.network.neutron [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Successfully updated port: cb19a9db-8c08-4ae0-b7ec-7dda0b276718 {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:42:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "refresh_cache-902ed05f-84c3-40f2-a991-4a5264f5d972" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:42:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquired lock "refresh_cache-902ed05f-84c3-40f2-a991-4a5264f5d972" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:42:04 user nova-compute[72362]: DEBUG nova.network.neutron [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:42:04 user nova-compute[72362]: DEBUG nova.compute.manager [req-85e32139-1c4c-443d-8c3e-8e39cffb1169 req-5ea30ac9-5a45-4427-8ad5-eea0e9b5b6b5 service nova] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Received event network-changed-cb19a9db-8c08-4ae0-b7ec-7dda0b276718 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:42:04 user nova-compute[72362]: DEBUG nova.compute.manager [req-85e32139-1c4c-443d-8c3e-8e39cffb1169 req-5ea30ac9-5a45-4427-8ad5-eea0e9b5b6b5 service nova] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Refreshing instance network info cache due to event network-changed-cb19a9db-8c08-4ae0-b7ec-7dda0b276718. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:42:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-85e32139-1c4c-443d-8c3e-8e39cffb1169 req-5ea30ac9-5a45-4427-8ad5-eea0e9b5b6b5 service nova] Acquiring lock "refresh_cache-902ed05f-84c3-40f2-a991-4a5264f5d972" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:42:04 user nova-compute[72362]: DEBUG nova.network.neutron [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:42:04 user nova-compute[72362]: DEBUG nova.network.neutron [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Updating instance_info_cache with network_info: [{"id": "cb19a9db-8c08-4ae0-b7ec-7dda0b276718", "address": "fa:16:3e:96:5d:a5", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb19a9db-8c", "ovs_interfaceid": "cb19a9db-8c08-4ae0-b7ec-7dda0b276718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:42:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Releasing lock "refresh_cache-902ed05f-84c3-40f2-a991-4a5264f5d972" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:42:04 user nova-compute[72362]: DEBUG nova.compute.manager [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Instance network_info: |[{"id": "cb19a9db-8c08-4ae0-b7ec-7dda0b276718", "address": "fa:16:3e:96:5d:a5", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb19a9db-8c", "ovs_interfaceid": "cb19a9db-8c08-4ae0-b7ec-7dda0b276718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 10:42:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-85e32139-1c4c-443d-8c3e-8e39cffb1169 req-5ea30ac9-5a45-4427-8ad5-eea0e9b5b6b5 service nova] Acquired lock "refresh_cache-902ed05f-84c3-40f2-a991-4a5264f5d972" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:42:04 user nova-compute[72362]: DEBUG nova.network.neutron [req-85e32139-1c4c-443d-8c3e-8e39cffb1169 req-5ea30ac9-5a45-4427-8ad5-eea0e9b5b6b5 service nova] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Refreshing network info cache for port cb19a9db-8c08-4ae0-b7ec-7dda0b276718 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:42:05 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691577710.1937644, be231c58-3e84-4b0f-bbbd-c44246954c47 => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:42:05 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] VM Stopped (Lifecycle Event)
Aug 09 10:42:05 user nova-compute[72362]: DEBUG nova.compute.manager [None req-a8e52229-e000-4763-8b29-1d72f3cd5a7a None None] [instance: be231c58-3e84-4b0f-bbbd-c44246954c47] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:42:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:42:05 user nova-compute[72362]: DEBUG nova.network.neutron [req-85e32139-1c4c-443d-8c3e-8e39cffb1169 req-5ea30ac9-5a45-4427-8ad5-eea0e9b5b6b5 service nova] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Updated VIF entry in instance network info cache for port cb19a9db-8c08-4ae0-b7ec-7dda0b276718. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:42:05 user nova-compute[72362]: DEBUG nova.network.neutron [req-85e32139-1c4c-443d-8c3e-8e39cffb1169 req-5ea30ac9-5a45-4427-8ad5-eea0e9b5b6b5 service nova] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Updating instance_info_cache with network_info: [{"id": "cb19a9db-8c08-4ae0-b7ec-7dda0b276718", "address": "fa:16:3e:96:5d:a5", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb19a9db-8c", "ovs_interfaceid": "cb19a9db-8c08-4ae0-b7ec-7dda0b276718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:42:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-85e32139-1c4c-443d-8c3e-8e39cffb1169 req-5ea30ac9-5a45-4427-8ad5-eea0e9b5b6b5 service nova] Releasing lock "refresh_cache-902ed05f-84c3-40f2-a991-4a5264f5d972" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:42:07 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:42:08 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Acquiring lock "94aedd29-1832-4ff4-97ac-d70ed1775223" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:42:08 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "94aedd29-1832-4ff4-97ac-d70ed1775223" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:42:08 user nova-compute[72362]: INFO nova.compute.manager [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Unshelving
Aug 09 10:42:08 user nova-compute[72362]: INFO nova.virt.block_device [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Booting with volume c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33 at /dev/vdc
Aug 09 10:42:08 user nova-compute[72362]: DEBUG os_brick.utils [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:42:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:42:08 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d3031a-f915-4485-b97a-eaf96b967e0e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:42:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:42:08 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f19b1b-e35f-4c6f-9234-ce03509fe392]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:42:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:42:08 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7da153-9a61-4a7b-9ff3-f5ba12856928]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:42:08 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[919bad2f-8076-4132-bfdf-51cf27819467]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:42:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:09 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:42:09 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:42:09 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:09 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:42:09 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:42:09 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[923c0876-d068-4dee-aff8-8069e6af58b3]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:42:09 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:42:09 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:42:09 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:42:09 user nova-compute[72362]: DEBUG os_brick.utils [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:42:09 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Updating existing volume attachment record: c910a049-dd92-437f-9bf4-7efdb44a260c {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 10:42:09 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:42:09 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 10:42:10 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:10 user nova-compute[72362]: DEBUG nova.compute.manager [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Start spawning the instance on the hypervisor. {{(pid=72362) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 10:42:10 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:42:10 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Creating image(s)
Aug 09 10:42:10 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Did not create local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 10:42:10 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Ensure instance console log exists: /opt/stack/data/nova/instances/902ed05f-84c3-40f2-a991-4a5264f5d972/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:42:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:42:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:42:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:42:10 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Start _get_guest_xml network_info=[{"id": "cb19a9db-8c08-4ae0-b7ec-7dda0b276718", "address": "fa:16:3e:96:5d:a5", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb19a9db-8c", "ovs_interfaceid": "cb19a9db-8c08-4ae0-b7ec-7dda0b276718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '932069bb-3806-4df4-a02d-c8a7b4b762d7', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vPXkBflS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '902ed05f-84c3-40f2-a991-4a5264f5d972', 'attached_at': '', 'detached_at': '', 'volume_id': 'b13e9f29-5849-486f-b75a-9520443d9135', 'serial': 'b13e9f29-5849-486f-b75a-9520443d9135'}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:42:10 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:42:10 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:42:10 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:42:10 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:42:10 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:42:10 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:42:10 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:42:10 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:42:10 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:42:10 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:42:10 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:42:10 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:42:10 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:42:10 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:42:10 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:42:10 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:42:10 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:42:10 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:42:10 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:42:10 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vPXkBflS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:42:10 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:42:10 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:42:10 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:42:10 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:42:10 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:42:10 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:42:10 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:42:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:42:10 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[67dd50d1-4ea5-4801-9565-aed79f9bbbdf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:42:10 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:42:10 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:42:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:42:10 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5e83d7-8802-4c17-88e5-830bf84feeeb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:42:10 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135] added
Aug 09 10:42:10 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:42:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:10 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:42:10 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:42:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:42:10 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5048040-bd37-4a53-82b2-659606e3f1a9]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:42:10 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:42:10 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:42:11 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[664af8d1-be5a-42b5-aae0-1dc67b8264d0]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:42:11 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:42:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vPXkBflS {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vPXkBflS" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:42:11 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d394fc-a848-44e8-9f09-7c716db8063a]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:42:11 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vPXkBflS'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:42:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:42:11 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0fc1d2d-4c8a-4847-97fb-79cc1e0c4cf3]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:42:11 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:42:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:42:11 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dbae33b-678c-416d-8897-721183def4dd]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:42:11 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 10:42:11 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:42:11 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 10:42:11 user nova-compute[72362]:  {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:42:11 user nova-compute[72362]: WARNING os_brick.initiator.connectors.iscsi [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 10:42:11 user nova-compute[72362]: 
Aug 09 10:42:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:42:11 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8be4d7-67ab-40f9-b679-30f7a375b8d9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:42:11 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135, portal: 172.16.0.220,3260]
Aug 09 10:42:11 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135, portal: 172.16.0.220,3260] successful.
Aug 09 10:42:11 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:42:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:42:11 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[213b5dbc-a563-4666-8013-94efc45f494b]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:42:11 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:42:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:42:11 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1d590f-0e2d-463e-9ab8-72ff7c708b65]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:42:11 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 (non-flash)
Aug 09 10:42:11 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:42:11 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 (non-flash)
Aug 09 10:42:11 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:42:11 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:42:11 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:42:11 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:42:11 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:42:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:42:11 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b9c067-be16-4972-b619-c3770698c6a1]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:42:11 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:42:11 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vPXkBflS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:42:11 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:42:11 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:42:12 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:42:12 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '26265313335396333', 'path': '/dev/sdb'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:42:12 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265313335396333', 'path': '/dev/sdb'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:42:12 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:42:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1427700819',display_name='tempest-TestVolumeBootPattern-server-1427700819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1427700819',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHphUKjpMkPjhZoTYlVJxPOuywq6OJUJWcHduVoRu9b0hlVgGA5+i25KrjKtdJwPAqa6k/+4sAUFZLxd189pJwbl9oyVmaY/KLuastlFffcAKt/RqOFaRqRDbZFRQvHB1g==',key_name='tempest-TestVolumeBootPattern-1201178489',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26e38599de0b4b06b723f5647a7fe121',ramdisk_id='',reservation_id='r-mw8ppfpw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1478436240',owner_user_name='tempest-TestVolumeBootPattern-1478436240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:42:03Z,user_data=None,user_id='e96900e953f64d02bdb5d48f136133c3',uuid=902ed05f-84c3-40f2-a991-4a5264f5d972,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb19a9db-8c08-4ae0-b7ec-7dda0b276718", "address": "fa:16:3e:96:5d:a5", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb19a9db-8c", "ovs_interfaceid": "cb19a9db-8c08-4ae0-b7ec-7dda0b276718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:42:12 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Converting VIF {"id": "cb19a9db-8c08-4ae0-b7ec-7dda0b276718", "address": "fa:16:3e:96:5d:a5", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb19a9db-8c", "ovs_interfaceid": "cb19a9db-8c08-4ae0-b7ec-7dda0b276718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:42:12 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:5d:a5,bridge_name='br-int',has_traffic_filtering=True,id=cb19a9db-8c08-4ae0-b7ec-7dda0b276718,network=Network(b4a9e050-41f1-404a-bf5c-41421f034644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb19a9db-8c') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:42:12 user nova-compute[72362]: DEBUG nova.objects.instance [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lazy-loading 'pci_devices' on Instance uuid 902ed05f-84c3-40f2-a991-4a5264f5d972 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:42:12 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:42:12 user nova-compute[72362]:   <uuid>902ed05f-84c3-40f2-a991-4a5264f5d972</uuid>
Aug 09 10:42:12 user nova-compute[72362]:   <name>instance-0000002b</name>
Aug 09 10:42:12 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:42:12 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:42:12 user nova-compute[72362]:   <metadata>
Aug 09 10:42:12 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:42:12 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:42:12 user nova-compute[72362]:       <nova:name>tempest-TestVolumeBootPattern-server-1427700819</nova:name>
Aug 09 10:42:12 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:42:10</nova:creationTime>
Aug 09 10:42:12 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:42:12 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:42:12 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:42:12 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:42:12 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:42:12 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:42:12 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:42:12 user nova-compute[72362]:       <nova:owner>
Aug 09 10:42:12 user nova-compute[72362]:         <nova:user uuid="e96900e953f64d02bdb5d48f136133c3">tempest-TestVolumeBootPattern-1478436240-project-member</nova:user>
Aug 09 10:42:12 user nova-compute[72362]:         <nova:project uuid="26e38599de0b4b06b723f5647a7fe121">tempest-TestVolumeBootPattern-1478436240</nova:project>
Aug 09 10:42:12 user nova-compute[72362]:       </nova:owner>
Aug 09 10:42:12 user nova-compute[72362]:       <nova:ports>
Aug 09 10:42:12 user nova-compute[72362]:         <nova:port uuid="cb19a9db-8c08-4ae0-b7ec-7dda0b276718">
Aug 09 10:42:12 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 09 10:42:12 user nova-compute[72362]:         </nova:port>
Aug 09 10:42:12 user nova-compute[72362]:       </nova:ports>
Aug 09 10:42:12 user nova-compute[72362]:     </nova:instance>
Aug 09 10:42:12 user nova-compute[72362]:   </metadata>
Aug 09 10:42:12 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:42:12 user nova-compute[72362]:     <system>
Aug 09 10:42:12 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:42:12 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:42:12 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:42:12 user nova-compute[72362]:       <entry name="serial">902ed05f-84c3-40f2-a991-4a5264f5d972</entry>
Aug 09 10:42:12 user nova-compute[72362]:       <entry name="uuid">902ed05f-84c3-40f2-a991-4a5264f5d972</entry>
Aug 09 10:42:12 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:42:12 user nova-compute[72362]:     </system>
Aug 09 10:42:12 user nova-compute[72362]:   </sysinfo>
Aug 09 10:42:12 user nova-compute[72362]:   <os>
Aug 09 10:42:12 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:42:12 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:42:12 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:42:12 user nova-compute[72362]:   </os>
Aug 09 10:42:12 user nova-compute[72362]:   <features>
Aug 09 10:42:12 user nova-compute[72362]:     <acpi/>
Aug 09 10:42:12 user nova-compute[72362]:     <apic/>
Aug 09 10:42:12 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:42:12 user nova-compute[72362]:   </features>
Aug 09 10:42:12 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:42:12 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:42:12 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:42:12 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:42:12 user nova-compute[72362]:   </clock>
Aug 09 10:42:12 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:42:12 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:42:12 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:42:12 user nova-compute[72362]:   </cpu>
Aug 09 10:42:12 user nova-compute[72362]:   <devices>
Aug 09 10:42:12 user nova-compute[72362]:     <disk type="block" device="disk">
Aug 09 10:42:12 user nova-compute[72362]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:42:12 user nova-compute[72362]:       <source dev="/dev/sdb"/>
Aug 09 10:42:12 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:42:12 user nova-compute[72362]:       <serial>b13e9f29-5849-486f-b75a-9520443d9135</serial>
Aug 09 10:42:12 user nova-compute[72362]:     </disk>
Aug 09 10:42:12 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:42:12 user nova-compute[72362]:       <mac address="fa:16:3e:96:5d:a5"/>
Aug 09 10:42:12 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:42:12 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:42:12 user nova-compute[72362]:       <target dev="tapcb19a9db-8c"/>
Aug 09 10:42:12 user nova-compute[72362]:     </interface>
Aug 09 10:42:12 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:42:12 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/902ed05f-84c3-40f2-a991-4a5264f5d972/console.log" append="off"/>
Aug 09 10:42:12 user nova-compute[72362]:     </serial>
Aug 09 10:42:12 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:42:12 user nova-compute[72362]:     <video>
Aug 09 10:42:12 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:42:12 user nova-compute[72362]:     </video>
Aug 09 10:42:12 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:42:12 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:42:12 user nova-compute[72362]:     </rng>
Aug 09 10:42:12 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:42:12 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:42:12 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:42:12 user nova-compute[72362]:     </memballoon>
Aug 09 10:42:12 user nova-compute[72362]:   </devices>
Aug 09 10:42:12 user nova-compute[72362]: </domain>
Aug 09 10:42:12 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:42:12 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:42:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1427700819',display_name='tempest-TestVolumeBootPattern-server-1427700819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1427700819',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHphUKjpMkPjhZoTYlVJxPOuywq6OJUJWcHduVoRu9b0hlVgGA5+i25KrjKtdJwPAqa6k/+4sAUFZLxd189pJwbl9oyVmaY/KLuastlFffcAKt/RqOFaRqRDbZFRQvHB1g==',key_name='tempest-TestVolumeBootPattern-1201178489',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26e38599de0b4b06b723f5647a7fe121',ramdisk_id='',reservation_id='r-mw8ppfpw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1478436240',owner_user_name='tempest-TestVolumeBootPattern-1478436240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:42:03Z,user_data=None,user_id='e96900e953f64d02bdb5d48f136133c3',uuid=902ed05f-84c3-40f2-a991-4a5264f5d972,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb19a9db-8c08-4ae0-b7ec-7dda0b276718", "address": "fa:16:3e:96:5d:a5", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb19a9db-8c", "ovs_interfaceid": "cb19a9db-8c08-4ae0-b7ec-7dda0b276718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:42:12 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Converting VIF {"id": "cb19a9db-8c08-4ae0-b7ec-7dda0b276718", "address": "fa:16:3e:96:5d:a5", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb19a9db-8c", "ovs_interfaceid": "cb19a9db-8c08-4ae0-b7ec-7dda0b276718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:42:12 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:5d:a5,bridge_name='br-int',has_traffic_filtering=True,id=cb19a9db-8c08-4ae0-b7ec-7dda0b276718,network=Network(b4a9e050-41f1-404a-bf5c-41421f034644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb19a9db-8c') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:42:12 user nova-compute[72362]: DEBUG os_vif [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:5d:a5,bridge_name='br-int',has_traffic_filtering=True,id=cb19a9db-8c08-4ae0-b7ec-7dda0b276718,network=Network(b4a9e050-41f1-404a-bf5c-41421f034644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb19a9db-8c') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:42:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:42:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:42:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb19a9db-8c, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:42:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcb19a9db-8c, col_values=(('external_ids', {'iface-id': 'cb19a9db-8c08-4ae0-b7ec-7dda0b276718', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:5d:a5', 'vm-uuid': '902ed05f-84c3-40f2-a991-4a5264f5d972'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:42:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:42:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:12 user nova-compute[72362]: INFO os_vif [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:5d:a5,bridge_name='br-int',has_traffic_filtering=True,id=cb19a9db-8c08-4ae0-b7ec-7dda0b276718,network=Network(b4a9e050-41f1-404a-bf5c-41421f034644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb19a9db-8c')
Aug 09 10:42:12 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:42:12 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] No VIF found with MAC fa:16:3e:96:5d:a5, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:42:12 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:42:13 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:13 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:13 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:13 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:13 user nova-compute[72362]: DEBUG nova.compute.manager [req-bd9ad959-c2b6-4257-a2ee-34d620992aed req-be2dfb99-77e4-4ae1-8aa4-d78eb74e0963 service nova] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Received event network-vif-plugged-cb19a9db-8c08-4ae0-b7ec-7dda0b276718 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:42:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-bd9ad959-c2b6-4257-a2ee-34d620992aed req-be2dfb99-77e4-4ae1-8aa4-d78eb74e0963 service nova] Acquiring lock "902ed05f-84c3-40f2-a991-4a5264f5d972-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:42:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-bd9ad959-c2b6-4257-a2ee-34d620992aed req-be2dfb99-77e4-4ae1-8aa4-d78eb74e0963 service nova] Lock "902ed05f-84c3-40f2-a991-4a5264f5d972-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:42:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-bd9ad959-c2b6-4257-a2ee-34d620992aed req-be2dfb99-77e4-4ae1-8aa4-d78eb74e0963 service nova] Lock "902ed05f-84c3-40f2-a991-4a5264f5d972-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:42:13 user nova-compute[72362]: DEBUG nova.compute.manager [req-bd9ad959-c2b6-4257-a2ee-34d620992aed req-be2dfb99-77e4-4ae1-8aa4-d78eb74e0963 service nova] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] No waiting events found dispatching network-vif-plugged-cb19a9db-8c08-4ae0-b7ec-7dda0b276718 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:42:13 user nova-compute[72362]: WARNING nova.compute.manager [req-bd9ad959-c2b6-4257-a2ee-34d620992aed req-be2dfb99-77e4-4ae1-8aa4-d78eb74e0963 service nova] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Received unexpected event network-vif-plugged-cb19a9db-8c08-4ae0-b7ec-7dda0b276718 for instance with vm_state building and task_state spawning.
Aug 09 10:42:13 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:42:13 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 10:42:14 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "refresh_cache-4296ca4c-1e3e-474f-98ba-9f947d333b8d" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:42:14 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquired lock "refresh_cache-4296ca4c-1e3e-474f-98ba-9f947d333b8d" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:42:14 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Forcefully refreshing network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 10:42:14 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:14 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:14 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:14 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Updating instance_info_cache with network_info: [{"id": "434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9", "address": "fa:16:3e:09:7c:97", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434ea21d-d4", "ovs_interfaceid": "434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:42:14 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Releasing lock "refresh_cache-4296ca4c-1e3e-474f-98ba-9f947d333b8d" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:42:14 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Updated the network info_cache for instance {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 10:42:14 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:42:14 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:42:15 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577735.6205888, 902ed05f-84c3-40f2-a991-4a5264f5d972 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:42:15 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] VM Resumed (Lifecycle Event)
Aug 09 10:42:15 user nova-compute[72362]: DEBUG nova.compute.manager [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:42:15 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:42:15 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Instance spawned successfully.
Aug 09 10:42:15 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 10:42:15 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:42:15 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:42:15 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Found default for hw_cdrom_bus of ide {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:42:15 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Found default for hw_disk_bus of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:42:15 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:42:15 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:42:15 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Found default for hw_video_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:42:15 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Found default for hw_vif_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:42:15 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:42:15 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577735.6221704, 902ed05f-84c3-40f2-a991-4a5264f5d972 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:42:15 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] VM Started (Lifecycle Event)
Aug 09 10:42:15 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:42:15 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:42:15 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:42:15 user nova-compute[72362]: INFO nova.compute.manager [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Took 4.91 seconds to spawn the instance on the hypervisor.
Aug 09 10:42:15 user nova-compute[72362]: DEBUG nova.compute.manager [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:42:15 user nova-compute[72362]: INFO nova.compute.manager [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Took 13.23 seconds to build instance.
Aug 09 10:42:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c14d5a74-0a8c-4bd9-823f-682e0c65c406 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "902ed05f-84c3-40f2-a991-4a5264f5d972" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.323s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:42:15 user nova-compute[72362]: DEBUG nova.compute.manager [req-3f8de490-1d05-4bc9-a251-48750ccdb599 req-8e2bcd76-9c55-4cd7-a115-bb88819d23c3 service nova] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Received event network-vif-plugged-cb19a9db-8c08-4ae0-b7ec-7dda0b276718 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:42:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3f8de490-1d05-4bc9-a251-48750ccdb599 req-8e2bcd76-9c55-4cd7-a115-bb88819d23c3 service nova] Acquiring lock "902ed05f-84c3-40f2-a991-4a5264f5d972-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:42:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3f8de490-1d05-4bc9-a251-48750ccdb599 req-8e2bcd76-9c55-4cd7-a115-bb88819d23c3 service nova] Lock "902ed05f-84c3-40f2-a991-4a5264f5d972-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:42:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3f8de490-1d05-4bc9-a251-48750ccdb599 req-8e2bcd76-9c55-4cd7-a115-bb88819d23c3 service nova] Lock "902ed05f-84c3-40f2-a991-4a5264f5d972-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:42:15 user nova-compute[72362]: DEBUG nova.compute.manager [req-3f8de490-1d05-4bc9-a251-48750ccdb599 req-8e2bcd76-9c55-4cd7-a115-bb88819d23c3 service nova] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] No waiting events found dispatching network-vif-plugged-cb19a9db-8c08-4ae0-b7ec-7dda0b276718 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:42:15 user nova-compute[72362]: WARNING nova.compute.manager [req-3f8de490-1d05-4bc9-a251-48750ccdb599 req-8e2bcd76-9c55-4cd7-a115-bb88819d23c3 service nova] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Received unexpected event network-vif-plugged-cb19a9db-8c08-4ae0-b7ec-7dda0b276718 for instance with vm_state active and task_state None.
Aug 09 10:42:17 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:17 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:42:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:42:17 user nova-compute[72362]: DEBUG nova.objects.instance [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lazy-loading 'pci_requests' on Instance uuid 94aedd29-1832-4ff4-97ac-d70ed1775223 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:42:17 user nova-compute[72362]: DEBUG nova.objects.instance [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lazy-loading 'numa_topology' on Instance uuid 94aedd29-1832-4ff4-97ac-d70ed1775223 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:42:17 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:42:17 user nova-compute[72362]: INFO nova.compute.claims [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Claim successful on node user
Aug 09 10:42:17 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:42:17 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:42:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.294s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:42:17 user nova-compute[72362]: INFO nova.network.neutron [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Updating port 1a21fab7-2746-481c-8003-5f8e6d67ea2a with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 09 10:42:18 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Acquiring lock "refresh_cache-94aedd29-1832-4ff4-97ac-d70ed1775223" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:42:18 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Acquired lock "refresh_cache-94aedd29-1832-4ff4-97ac-d70ed1775223" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:42:18 user nova-compute[72362]: DEBUG nova.network.neutron [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:42:18 user nova-compute[72362]: DEBUG nova.compute.manager [req-ccfa7d4e-797d-4081-9217-d8d19a707dc8 req-b1bd9d18-3056-4c66-be11-8f9628a98473 service nova] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Received event network-changed-1a21fab7-2746-481c-8003-5f8e6d67ea2a {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:42:18 user nova-compute[72362]: DEBUG nova.compute.manager [req-ccfa7d4e-797d-4081-9217-d8d19a707dc8 req-b1bd9d18-3056-4c66-be11-8f9628a98473 service nova] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Refreshing instance network info cache due to event network-changed-1a21fab7-2746-481c-8003-5f8e6d67ea2a. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:42:18 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ccfa7d4e-797d-4081-9217-d8d19a707dc8 req-b1bd9d18-3056-4c66-be11-8f9628a98473 service nova] Acquiring lock "refresh_cache-94aedd29-1832-4ff4-97ac-d70ed1775223" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:42:19 user nova-compute[72362]: DEBUG nova.network.neutron [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Updating instance_info_cache with network_info: [{"id": "1a21fab7-2746-481c-8003-5f8e6d67ea2a", "address": "fa:16:3e:15:9c:15", "network": {"id": "362446ea-173c-4989-93f8-882088822208", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-499399633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f9d6a60f24d41deb91ae59189c62ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a21fab7-27", "ovs_interfaceid": "1a21fab7-2746-481c-8003-5f8e6d67ea2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:42:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Releasing lock "refresh_cache-94aedd29-1832-4ff4-97ac-d70ed1775223" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:42:19 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:42:19 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Creating image(s)
Aug 09 10:42:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Acquiring lock "/opt/stack/data/nova/instances/94aedd29-1832-4ff4-97ac-d70ed1775223/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:42:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "/opt/stack/data/nova/instances/94aedd29-1832-4ff4-97ac-d70ed1775223/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:42:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "/opt/stack/data/nova/instances/94aedd29-1832-4ff4-97ac-d70ed1775223/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:42:19 user nova-compute[72362]: DEBUG nova.objects.instance [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lazy-loading 'trusted_certs' on Instance uuid 94aedd29-1832-4ff4-97ac-d70ed1775223 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:42:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ccfa7d4e-797d-4081-9217-d8d19a707dc8 req-b1bd9d18-3056-4c66-be11-8f9628a98473 service nova] Acquired lock "refresh_cache-94aedd29-1832-4ff4-97ac-d70ed1775223" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:42:19 user nova-compute[72362]: DEBUG nova.network.neutron [req-ccfa7d4e-797d-4081-9217-d8d19a707dc8 req-b1bd9d18-3056-4c66-be11-8f9628a98473 service nova] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Refreshing network info cache for port 1a21fab7-2746-481c-8003-5f8e6d67ea2a {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:42:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Acquiring lock "a2f35d8a814264d5d485adda5c238ff3daa61767" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:42:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "a2f35d8a814264d5d485adda5c238ff3daa61767" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:42:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2f35d8a814264d5d485adda5c238ff3daa61767.part --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:20 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:42:20 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Cleaning up deleted instances {{(pid=72362) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 10:42:20 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] There are 0 instances to clean {{(pid=72362) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 10:42:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2f35d8a814264d5d485adda5c238ff3daa61767.part --force-share --output=json" returned: 0 in 0.149s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:42:20 user nova-compute[72362]: DEBUG nova.virt.images [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] 1d55fcef-84a8-4cde-a397-01b94e6885ff was qcow2, converting to raw {{(pid=72362) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 10:42:20 user nova-compute[72362]: DEBUG nova.privsep.utils [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72362) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 10:42:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a2f35d8a814264d5d485adda5c238ff3daa61767.part /opt/stack/data/nova/instances/_base/a2f35d8a814264d5d485adda5c238ff3daa61767.converted {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:21 user nova-compute[72362]: DEBUG nova.network.neutron [req-ccfa7d4e-797d-4081-9217-d8d19a707dc8 req-b1bd9d18-3056-4c66-be11-8f9628a98473 service nova] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Updated VIF entry in instance network info cache for port 1a21fab7-2746-481c-8003-5f8e6d67ea2a. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:42:21 user nova-compute[72362]: DEBUG nova.network.neutron [req-ccfa7d4e-797d-4081-9217-d8d19a707dc8 req-b1bd9d18-3056-4c66-be11-8f9628a98473 service nova] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Updating instance_info_cache with network_info: [{"id": "1a21fab7-2746-481c-8003-5f8e6d67ea2a", "address": "fa:16:3e:15:9c:15", "network": {"id": "362446ea-173c-4989-93f8-882088822208", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-499399633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f9d6a60f24d41deb91ae59189c62ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a21fab7-27", "ovs_interfaceid": "1a21fab7-2746-481c-8003-5f8e6d67ea2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:42:21 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:42:21 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ccfa7d4e-797d-4081-9217-d8d19a707dc8 req-b1bd9d18-3056-4c66-be11-8f9628a98473 service nova] Releasing lock "refresh_cache-94aedd29-1832-4ff4-97ac-d70ed1775223" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:42:21 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:42:21 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:42:21 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:42:21 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 10:42:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a2f35d8a814264d5d485adda5c238ff3daa61767.part /opt/stack/data/nova/instances/_base/a2f35d8a814264d5d485adda5c238ff3daa61767.converted" returned: 0 in 0.605s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:42:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2f35d8a814264d5d485adda5c238ff3daa61767.converted --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2f35d8a814264d5d485adda5c238ff3daa61767.converted --force-share --output=json" returned: 0 in 0.141s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:42:21 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "a2f35d8a814264d5d485adda5c238ff3daa61767" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.924s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:42:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2f35d8a814264d5d485adda5c238ff3daa61767 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:42:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2f35d8a814264d5d485adda5c238ff3daa61767 --force-share --output=json" returned: 0 in 0.148s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:42:21 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Acquiring lock "a2f35d8a814264d5d485adda5c238ff3daa61767" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:42:21 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "a2f35d8a814264d5d485adda5c238ff3daa61767" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:42:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2f35d8a814264d5d485adda5c238ff3daa61767 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:42:21 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:42:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2f35d8a814264d5d485adda5c238ff3daa61767 --force-share --output=json" returned: 0 in 0.140s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:42:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a2f35d8a814264d5d485adda5c238ff3daa61767,backing_fmt=raw /opt/stack/data/nova/instances/94aedd29-1832-4ff4-97ac-d70ed1775223/disk 1073741824 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a2f35d8a814264d5d485adda5c238ff3daa61767,backing_fmt=raw /opt/stack/data/nova/instances/94aedd29-1832-4ff4-97ac-d70ed1775223/disk 1073741824" returned: 0 in 0.051s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:42:21 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "a2f35d8a814264d5d485adda5c238ff3daa61767" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:42:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2f35d8a814264d5d485adda5c238ff3daa61767 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json" returned: 0 in 0.154s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:42:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2f35d8a814264d5d485adda5c238ff3daa61767 --force-share --output=json" returned: 0 in 0.145s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:42:21 user nova-compute[72362]: DEBUG nova.objects.instance [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lazy-loading 'migration_context' on Instance uuid 94aedd29-1832-4ff4-97ac-d70ed1775223 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:42:21 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Rebasing disk image.
Aug 09 10:42:21 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:42:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.134s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:42:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 -F raw /opt/stack/data/nova/instances/94aedd29-1832-4ff4-97ac-d70ed1775223/disk {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:42:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:42:22 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:42:22 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:42:22 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:42:22 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=8572MB free_disk=25.00246810913086GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 10:42:22 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:42:22 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:42:22 user nova-compute[72362]: INFO nova.compute.manager [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Rescuing
Aug 09 10:42:22 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Acquiring lock "refresh_cache-cefe383b-978f-4391-baf6-3b3ad17e0083" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:42:22 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Acquired lock "refresh_cache-cefe383b-978f-4391-baf6-3b3ad17e0083" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:42:22 user nova-compute[72362]: DEBUG nova.network.neutron [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:42:22 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance cefe383b-978f-4391-baf6-3b3ad17e0083 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:42:22 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 4296ca4c-1e3e-474f-98ba-9f947d333b8d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:42:22 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 902ed05f-84c3-40f2-a991-4a5264f5d972 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:42:22 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (6a678ae9-d474-4dd0-a246-9ae5a9a7108d): {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. Skipping heal of allocations during the task state transition. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Aug 09 10:42:22 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 10:42:22 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 10:42:22 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Refreshing inventories for resource provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 10:42:22 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Updating ProviderTree inventory for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 10:42:22 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Updating inventory in ProviderTree for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 10:42:22 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Refreshing aggregate associations for resource provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d, aggregates: None {{(pid=72362) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 10:42:22 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Refreshing trait associations for resource provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE41,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=72362) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 10:42:23 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:42:23 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:42:23 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 10:42:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.410s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:42:23 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:42:23 user nova-compute[72362]: DEBUG nova.network.neutron [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Updating instance_info_cache with network_info: [{"id": "1d14bbdf-8802-42b5-bd22-c6bd03a53761", "address": "fa:16:3e:fe:ee:4f", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d14bbdf-88", "ovs_interfaceid": "1d14bbdf-8802-42b5-bd22-c6bd03a53761", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:42:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Releasing lock "refresh_cache-cefe383b-978f-4391-baf6-3b3ad17e0083" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:42:23 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:23 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:23 user nova-compute[72362]: DEBUG nova.compute.manager [req-42fd5822-4ea4-4de8-b6bc-59650db4f988 req-0a00ade9-c644-4b5c-9916-b3920c1680c6 service nova] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Received event network-vif-unplugged-1d14bbdf-8802-42b5-bd22-c6bd03a53761 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:42:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-42fd5822-4ea4-4de8-b6bc-59650db4f988 req-0a00ade9-c644-4b5c-9916-b3920c1680c6 service nova] Acquiring lock "cefe383b-978f-4391-baf6-3b3ad17e0083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:42:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-42fd5822-4ea4-4de8-b6bc-59650db4f988 req-0a00ade9-c644-4b5c-9916-b3920c1680c6 service nova] Lock "cefe383b-978f-4391-baf6-3b3ad17e0083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:42:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-42fd5822-4ea4-4de8-b6bc-59650db4f988 req-0a00ade9-c644-4b5c-9916-b3920c1680c6 service nova] Lock "cefe383b-978f-4391-baf6-3b3ad17e0083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:42:23 user nova-compute[72362]: DEBUG nova.compute.manager [req-42fd5822-4ea4-4de8-b6bc-59650db4f988 req-0a00ade9-c644-4b5c-9916-b3920c1680c6 service nova] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] No waiting events found dispatching network-vif-unplugged-1d14bbdf-8802-42b5-bd22-c6bd03a53761 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:42:23 user nova-compute[72362]: WARNING nova.compute.manager [req-42fd5822-4ea4-4de8-b6bc-59650db4f988 req-0a00ade9-c644-4b5c-9916-b3920c1680c6 service nova] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Received unexpected event network-vif-unplugged-1d14bbdf-8802-42b5-bd22-c6bd03a53761 for instance with vm_state active and task_state rescuing.
Aug 09 10:42:23 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:23 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:24 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Instance destroyed successfully.
Aug 09 10:42:24 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Attempting rescue
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72362) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Instance directory exists: not creating {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 10:42:24 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Creating image(s)
Aug 09 10:42:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Acquiring lock "/opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "/opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "/opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.objects.instance [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lazy-loading 'trusted_certs' on Instance uuid cefe383b-978f-4391-baf6-3b3ad17e0083 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Acquiring lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.155s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk.rescue {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk.rescue" returned: 0 in 0.060s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.objects.instance [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lazy-loading 'migration_context' on Instance uuid cefe383b-978f-4391-baf6-3b3ad17e0083 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Created local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Start _get_guest_xml network_info=[{"id": "1d14bbdf-8802-42b5-bd22-c6bd03a53761", "address": "fa:16:3e:fe:ee:4f", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "vif_mac": "fa:16:3e:fe:ee:4f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d14bbdf-88", "ovs_interfaceid": "1d14bbdf-8802-42b5-bd22-c6bd03a53761", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a08d1a11-49eb-4212-a351-e11ee9553b95', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.objects.instance [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lazy-loading 'resources' on Instance uuid cefe383b-978f-4391-baf6-3b3ad17e0083 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.objects.instance [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lazy-loading 'numa_topology' on Instance uuid cefe383b-978f-4391-baf6-3b3ad17e0083 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 -F raw /opt/stack/data/nova/instances/94aedd29-1832-4ff4-97ac-d70ed1775223/disk" returned: 0 in 2.362s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Created local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Ensure instance console log exists: /opt/stack/data/nova/instances/94aedd29-1832-4ff4-97ac-d70ed1775223/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Start _get_guest_xml network_info=[{"id": "1a21fab7-2746-481c-8003-5f8e6d67ea2a", "address": "fa:16:3e:15:9c:15", "network": {"id": "362446ea-173c-4989-93f8-882088822208", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-499399633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f9d6a60f24d41deb91ae59189c62ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a21fab7-27", "ovs_interfaceid": "1a21fab7-2746-481c-8003-5f8e6d67ea2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='0e07c9e6dd80833881565931422b86bb',container_format='bare',created_at=2023-08-09T10:40:17Z,direct_url=<?>,disk_format='qcow2',id=1d55fcef-84a8-4cde-a397-01b94e6885ff,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-45479132-shelved',owner='2f9d6a60f24d41deb91ae59189c62ba2',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-09T10:40:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': 'a08d1a11-49eb-4212-a351-e11ee9553b95'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'c910a049-dd92-437f-9bf4-7efdb44a260c', 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pHcNtmnO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '94aedd29-1832-4ff4-97ac-d70ed1775223', 'attached_at': '', 'detached_at': '', 'volume_id': 'c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33', 'serial': 'c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33'}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:42:24 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:42:24 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:42:24 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:42:24 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.objects.instance [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lazy-loading 'vcpu_model' on Instance uuid cefe383b-978f-4391-baf6-3b3ad17e0083 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0e07c9e6dd80833881565931422b86bb',container_format='bare',created_at=2023-08-09T10:40:17Z,direct_url=<?>,disk_format='qcow2',id=1d55fcef-84a8-4cde-a397-01b94e6885ff,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-45479132-shelved',owner='2f9d6a60f24d41deb91ae59189c62ba2',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-09T10:40:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.objects.instance [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lazy-loading 'vcpu_model' on Instance uuid 94aedd29-1832-4ff4-97ac-d70ed1775223 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:37:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1691599130',display_name='tempest-ServerRescueNegativeTestJSON-server-1691599130',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1691599130',id=38,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:37:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac17209f912a4f248dd642be32a75ede',ramdisk_id='',reservation_id='r-ofb1zx0f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1453574557',owner_user_name='tempest-ServerRescueNegativeTestJSON-1453574557-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:37:45Z,user_data=None,user_id='1f5cb1727c864652a6873a38ec1f7bf7',uuid=cefe383b-978f-4391-baf6-3b3ad17e0083,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d14bbdf-8802-42b5-bd22-c6bd03a53761", "address": "fa:16:3e:fe:ee:4f", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "vif_mac": "fa:16:3e:fe:ee:4f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d14bbdf-88", "ovs_interfaceid": "1d14bbdf-8802-42b5-bd22-c6bd03a53761", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Converting VIF {"id": "1d14bbdf-8802-42b5-bd22-c6bd03a53761", "address": "fa:16:3e:fe:ee:4f", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "vif_mac": "fa:16:3e:fe:ee:4f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d14bbdf-88", "ovs_interfaceid": "1d14bbdf-8802-42b5-bd22-c6bd03a53761", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:ee:4f,bridge_name='br-int',has_traffic_filtering=True,id=1d14bbdf-8802-42b5-bd22-c6bd03a53761,network=Network(2f70b9cc-bc8f-46d8-9633-542cd881c89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d14bbdf-88') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.objects.instance [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lazy-loading 'pci_devices' on Instance uuid cefe383b-978f-4391-baf6-3b3ad17e0083 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pHcNtmnO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:42:24 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:42:24 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:42:24 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:42:24 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:42:24 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:42:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33 -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:42:24 user nova-compute[72362]:   <uuid>cefe383b-978f-4391-baf6-3b3ad17e0083</uuid>
Aug 09 10:42:24 user nova-compute[72362]:   <name>instance-00000026</name>
Aug 09 10:42:24 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:42:24 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:42:24 user nova-compute[72362]:   <metadata>
Aug 09 10:42:24 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:42:24 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:42:24 user nova-compute[72362]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1691599130</nova:name>
Aug 09 10:42:24 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:42:24</nova:creationTime>
Aug 09 10:42:24 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:42:24 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:42:24 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:42:24 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:42:24 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:42:24 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:42:24 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:42:24 user nova-compute[72362]:       <nova:owner>
Aug 09 10:42:24 user nova-compute[72362]:         <nova:user uuid="1f5cb1727c864652a6873a38ec1f7bf7">tempest-ServerRescueNegativeTestJSON-1453574557-project-member</nova:user>
Aug 09 10:42:24 user nova-compute[72362]:         <nova:project uuid="ac17209f912a4f248dd642be32a75ede">tempest-ServerRescueNegativeTestJSON-1453574557</nova:project>
Aug 09 10:42:24 user nova-compute[72362]:       </nova:owner>
Aug 09 10:42:24 user nova-compute[72362]:       <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:42:24 user nova-compute[72362]:       <nova:ports>
Aug 09 10:42:24 user nova-compute[72362]:         <nova:port uuid="1d14bbdf-8802-42b5-bd22-c6bd03a53761">
Aug 09 10:42:24 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 09 10:42:24 user nova-compute[72362]:         </nova:port>
Aug 09 10:42:24 user nova-compute[72362]:       </nova:ports>
Aug 09 10:42:24 user nova-compute[72362]:     </nova:instance>
Aug 09 10:42:24 user nova-compute[72362]:   </metadata>
Aug 09 10:42:24 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:42:24 user nova-compute[72362]:     <system>
Aug 09 10:42:24 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:42:24 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:42:24 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:42:24 user nova-compute[72362]:       <entry name="serial">cefe383b-978f-4391-baf6-3b3ad17e0083</entry>
Aug 09 10:42:24 user nova-compute[72362]:       <entry name="uuid">cefe383b-978f-4391-baf6-3b3ad17e0083</entry>
Aug 09 10:42:24 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:42:24 user nova-compute[72362]:     </system>
Aug 09 10:42:24 user nova-compute[72362]:   </sysinfo>
Aug 09 10:42:24 user nova-compute[72362]:   <os>
Aug 09 10:42:24 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:42:24 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:42:24 user nova-compute[72362]:   </os>
Aug 09 10:42:24 user nova-compute[72362]:   <features>
Aug 09 10:42:24 user nova-compute[72362]:     <acpi/>
Aug 09 10:42:24 user nova-compute[72362]:     <apic/>
Aug 09 10:42:24 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:42:24 user nova-compute[72362]:   </features>
Aug 09 10:42:24 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:42:24 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:42:24 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:42:24 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:42:24 user nova-compute[72362]:   </clock>
Aug 09 10:42:24 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:42:24 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:42:24 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:42:24 user nova-compute[72362]:   </cpu>
Aug 09 10:42:24 user nova-compute[72362]:   <devices>
Aug 09 10:42:24 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:42:24 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:42:24 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk.rescue"/>
Aug 09 10:42:24 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:42:24 user nova-compute[72362]:     </disk>
Aug 09 10:42:24 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:42:24 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:42:24 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk"/>
Aug 09 10:42:24 user nova-compute[72362]:       <target dev="vdb" bus="virtio"/>
Aug 09 10:42:24 user nova-compute[72362]:     </disk>
Aug 09 10:42:24 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:42:24 user nova-compute[72362]:       <mac address="fa:16:3e:fe:ee:4f"/>
Aug 09 10:42:24 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:42:24 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:42:24 user nova-compute[72362]:       <target dev="tap1d14bbdf-88"/>
Aug 09 10:42:24 user nova-compute[72362]:     </interface>
Aug 09 10:42:24 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:42:24 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/console.log" append="off"/>
Aug 09 10:42:24 user nova-compute[72362]:     </serial>
Aug 09 10:42:24 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:42:24 user nova-compute[72362]:     <video>
Aug 09 10:42:24 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:42:24 user nova-compute[72362]:     </video>
Aug 09 10:42:24 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:42:24 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:42:24 user nova-compute[72362]:     </rng>
Aug 09 10:42:24 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:42:24 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:42:24 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:42:24 user nova-compute[72362]:     </memballoon>
Aug 09 10:42:24 user nova-compute[72362]:   </devices>
Aug 09 10:42:24 user nova-compute[72362]: </domain>
Aug 09 10:42:24 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:42:24 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Instance destroyed successfully.
Aug 09 10:42:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[94aea02f-bc6b-4cfc-a736-c308b9885940]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:42:24 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33 -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8aa42b-5915-4e46-b4a9-00ab03fe7f21]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33] added
Aug 09 10:42:24 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] No VIF found with MAC fa:16:3e:fe:ee:4f, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdcfb1f-074c-4be8-8d1f-1859a138811b]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eabc29e-0c84-42c8-b818-5a4432ce4bd9]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pHcNtmnO {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pHcNtmnO" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef297db-18d3-4250-a61e-25c1dc0fab19]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pHcNtmnO'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.059s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d507e12-308a-4323-9a1d-5d68f0e358cb]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[85bb7209-151f-4d1c-a783-658a827f05b8]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 (non-flash)
Aug 09 10:42:24 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 (non-flash)
Aug 09 10:42:24 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33 -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35026d8-bce2-4083-a8f1-427e268cd75d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33, portal: 172.16.0.220,3260]
Aug 09 10:42:24 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33, portal: 172.16.0.220,3260] successful.
Aug 09 10:42:24 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.100s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[96617b7d-ab1a-463f-95fe-3c346cf86f27]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[92480bea-2782-4cf3-b593-9a50eee5c741]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 (non-flash)
Aug 09 10:42:24 user nova-compute[72362]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33 (non-flash)
Aug 09 10:42:24 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 (non-flash)
Aug 09 10:42:24 user nova-compute[72362]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33 (non-flash)
Aug 09 10:42:24 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.416s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:42:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:42:25 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2f63c7-81e3-413e-95a2-fa2332a5c1be]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:42:25 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:42:25 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pHcNtmnO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:42:25 user nova-compute[72362]: DEBUG nova.compute.manager [req-74ed49a4-3243-4909-bd8a-172b4e8d9489 req-8e4dd417-583d-423c-bcb1-eb990512a3e1 service nova] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Received event network-vif-plugged-1d14bbdf-8802-42b5-bd22-c6bd03a53761 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:42:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-74ed49a4-3243-4909-bd8a-172b4e8d9489 req-8e4dd417-583d-423c-bcb1-eb990512a3e1 service nova] Acquiring lock "cefe383b-978f-4391-baf6-3b3ad17e0083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:42:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-74ed49a4-3243-4909-bd8a-172b4e8d9489 req-8e4dd417-583d-423c-bcb1-eb990512a3e1 service nova] Lock "cefe383b-978f-4391-baf6-3b3ad17e0083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:42:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-74ed49a4-3243-4909-bd8a-172b4e8d9489 req-8e4dd417-583d-423c-bcb1-eb990512a3e1 service nova] Lock "cefe383b-978f-4391-baf6-3b3ad17e0083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:42:25 user nova-compute[72362]: DEBUG nova.compute.manager [req-74ed49a4-3243-4909-bd8a-172b4e8d9489 req-8e4dd417-583d-423c-bcb1-eb990512a3e1 service nova] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] No waiting events found dispatching network-vif-plugged-1d14bbdf-8802-42b5-bd22-c6bd03a53761 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:42:25 user nova-compute[72362]: WARNING nova.compute.manager [req-74ed49a4-3243-4909-bd8a-172b4e8d9489 req-8e4dd417-583d-423c-bcb1-eb990512a3e1 service nova] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Received unexpected event network-vif-plugged-1d14bbdf-8802-42b5-bd22-c6bd03a53761 for instance with vm_state active and task_state rescuing.
Aug 09 10:42:25 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:25 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:25 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:26 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.449s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:42:26 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] <== connect_volume: return (1450ms) {'type': 'block', 'scsi_wwn': '23935386431316535', 'path': '/dev/sdc'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:42:26 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935386431316535', 'path': '/dev/sdc'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:42:26 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T10:38:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-45479132',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-45479132',id=42,image_ref='1d55fcef-84a8-4cde-a397-01b94e6885ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-631856663',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:38:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2f9d6a60f24d41deb91ae59189c62ba2',ramdisk_id='',reservation_id='r-qaaj0twi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2139825844',owner_user_name='tempest-AttachVolumeShelveTestJSON-2139825844-project-member',shelved_at='2023-08-09T10:40:21.091315',shelved_host='user',shelved_image_id='1d55fcef-84a8-4cde-a397-01b94e6885ff'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:42:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='299166afe21b4d3cac05fdb072a78a78',uuid=94aedd29-1832-4ff4-97ac-d70ed1775223,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1a21fab7-2746-481c-8003-5f8e6d67ea2a", "address": "fa:16:3e:15:9c:15", "network": {"id": "362446ea-173c-4989-93f8-882088822208", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-499399633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f9d6a60f24d41deb91ae59189c62ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a21fab7-27", "ovs_interfaceid": "1a21fab7-2746-481c-8003-5f8e6d67ea2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:42:26 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Converting VIF {"id": "1a21fab7-2746-481c-8003-5f8e6d67ea2a", "address": "fa:16:3e:15:9c:15", "network": {"id": "362446ea-173c-4989-93f8-882088822208", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-499399633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f9d6a60f24d41deb91ae59189c62ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a21fab7-27", "ovs_interfaceid": "1a21fab7-2746-481c-8003-5f8e6d67ea2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:42:26 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:9c:15,bridge_name='br-int',has_traffic_filtering=True,id=1a21fab7-2746-481c-8003-5f8e6d67ea2a,network=Network(362446ea-173c-4989-93f8-882088822208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a21fab7-27') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:42:26 user nova-compute[72362]: DEBUG nova.objects.instance [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lazy-loading 'pci_devices' on Instance uuid 94aedd29-1832-4ff4-97ac-d70ed1775223 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:42:26 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:42:26 user nova-compute[72362]:   <uuid>94aedd29-1832-4ff4-97ac-d70ed1775223</uuid>
Aug 09 10:42:26 user nova-compute[72362]:   <name>instance-0000002a</name>
Aug 09 10:42:26 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:42:26 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:42:26 user nova-compute[72362]:   <metadata>
Aug 09 10:42:26 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:42:26 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:42:26 user nova-compute[72362]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-45479132</nova:name>
Aug 09 10:42:26 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:42:24</nova:creationTime>
Aug 09 10:42:26 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:42:26 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:42:26 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:42:26 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:42:26 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:42:26 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:42:26 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:42:26 user nova-compute[72362]:       <nova:owner>
Aug 09 10:42:26 user nova-compute[72362]:         <nova:user uuid="299166afe21b4d3cac05fdb072a78a78">tempest-AttachVolumeShelveTestJSON-2139825844-project-member</nova:user>
Aug 09 10:42:26 user nova-compute[72362]:         <nova:project uuid="2f9d6a60f24d41deb91ae59189c62ba2">tempest-AttachVolumeShelveTestJSON-2139825844</nova:project>
Aug 09 10:42:26 user nova-compute[72362]:       </nova:owner>
Aug 09 10:42:26 user nova-compute[72362]:       <nova:root type="image" uuid="1d55fcef-84a8-4cde-a397-01b94e6885ff"/>
Aug 09 10:42:26 user nova-compute[72362]:       <nova:ports>
Aug 09 10:42:26 user nova-compute[72362]:         <nova:port uuid="1a21fab7-2746-481c-8003-5f8e6d67ea2a">
Aug 09 10:42:26 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 10:42:26 user nova-compute[72362]:         </nova:port>
Aug 09 10:42:26 user nova-compute[72362]:       </nova:ports>
Aug 09 10:42:26 user nova-compute[72362]:     </nova:instance>
Aug 09 10:42:26 user nova-compute[72362]:   </metadata>
Aug 09 10:42:26 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:42:26 user nova-compute[72362]:     <system>
Aug 09 10:42:26 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:42:26 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:42:26 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:42:26 user nova-compute[72362]:       <entry name="serial">94aedd29-1832-4ff4-97ac-d70ed1775223</entry>
Aug 09 10:42:26 user nova-compute[72362]:       <entry name="uuid">94aedd29-1832-4ff4-97ac-d70ed1775223</entry>
Aug 09 10:42:26 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:42:26 user nova-compute[72362]:     </system>
Aug 09 10:42:26 user nova-compute[72362]:   </sysinfo>
Aug 09 10:42:26 user nova-compute[72362]:   <os>
Aug 09 10:42:26 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:42:26 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:42:26 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:42:26 user nova-compute[72362]:   </os>
Aug 09 10:42:26 user nova-compute[72362]:   <features>
Aug 09 10:42:26 user nova-compute[72362]:     <acpi/>
Aug 09 10:42:26 user nova-compute[72362]:     <apic/>
Aug 09 10:42:26 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:42:26 user nova-compute[72362]:   </features>
Aug 09 10:42:26 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:42:26 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:42:26 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:42:26 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:42:26 user nova-compute[72362]:   </clock>
Aug 09 10:42:26 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:42:26 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:42:26 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:42:26 user nova-compute[72362]:   </cpu>
Aug 09 10:42:26 user nova-compute[72362]:   <devices>
Aug 09 10:42:26 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:42:26 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:42:26 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/94aedd29-1832-4ff4-97ac-d70ed1775223/disk"/>
Aug 09 10:42:26 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:42:26 user nova-compute[72362]:     </disk>
Aug 09 10:42:26 user nova-compute[72362]:     <disk type="block" device="disk">
Aug 09 10:42:26 user nova-compute[72362]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:42:26 user nova-compute[72362]:       <source dev="/dev/sdc"/>
Aug 09 10:42:26 user nova-compute[72362]:       <target dev="vdc" bus="virtio"/>
Aug 09 10:42:26 user nova-compute[72362]:       <serial>c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33</serial>
Aug 09 10:42:26 user nova-compute[72362]:     </disk>
Aug 09 10:42:26 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:42:26 user nova-compute[72362]:       <mac address="fa:16:3e:15:9c:15"/>
Aug 09 10:42:26 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:42:26 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:42:26 user nova-compute[72362]:       <target dev="tap1a21fab7-27"/>
Aug 09 10:42:26 user nova-compute[72362]:     </interface>
Aug 09 10:42:26 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:42:26 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/94aedd29-1832-4ff4-97ac-d70ed1775223/console.log" append="off"/>
Aug 09 10:42:26 user nova-compute[72362]:     </serial>
Aug 09 10:42:26 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:42:26 user nova-compute[72362]:     <video>
Aug 09 10:42:26 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:42:26 user nova-compute[72362]:     </video>
Aug 09 10:42:26 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:42:26 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:42:26 user nova-compute[72362]:     </rng>
Aug 09 10:42:26 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:42:26 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:42:26 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:42:26 user nova-compute[72362]:     </memballoon>
Aug 09 10:42:26 user nova-compute[72362]:   </devices>
Aug 09 10:42:26 user nova-compute[72362]: </domain>
Aug 09 10:42:26 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:42:26 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T10:38:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-45479132',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-45479132',id=42,image_ref='1d55fcef-84a8-4cde-a397-01b94e6885ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-631856663',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:38:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2f9d6a60f24d41deb91ae59189c62ba2',ramdisk_id='',reservation_id='r-qaaj0twi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2139825844',owner_user_name='tempest-AttachVolumeShelveTestJSON-2139825844-project-member',shelved_at='2023-08-09T10:40:21.091315',shelved_host='user',shelved_image_id='1d55fcef-84a8-4cde-a397-01b94e6885ff'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:42:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='299166afe21b4d3cac05fdb072a78a78',uuid=94aedd29-1832-4ff4-97ac-d70ed1775223,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1a21fab7-2746-481c-8003-5f8e6d67ea2a", "address": "fa:16:3e:15:9c:15", "network": {"id": "362446ea-173c-4989-93f8-882088822208", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-499399633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f9d6a60f24d41deb91ae59189c62ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a21fab7-27", "ovs_interfaceid": "1a21fab7-2746-481c-8003-5f8e6d67ea2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:42:26 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Converting VIF {"id": "1a21fab7-2746-481c-8003-5f8e6d67ea2a", "address": "fa:16:3e:15:9c:15", "network": {"id": "362446ea-173c-4989-93f8-882088822208", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-499399633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f9d6a60f24d41deb91ae59189c62ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a21fab7-27", "ovs_interfaceid": "1a21fab7-2746-481c-8003-5f8e6d67ea2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:42:26 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:9c:15,bridge_name='br-int',has_traffic_filtering=True,id=1a21fab7-2746-481c-8003-5f8e6d67ea2a,network=Network(362446ea-173c-4989-93f8-882088822208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a21fab7-27') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:42:26 user nova-compute[72362]: DEBUG os_vif [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:9c:15,bridge_name='br-int',has_traffic_filtering=True,id=1a21fab7-2746-481c-8003-5f8e6d67ea2a,network=Network(362446ea-173c-4989-93f8-882088822208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a21fab7-27') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:42:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:42:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:42:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1a21fab7-27, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:42:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1a21fab7-27, col_values=(('external_ids', {'iface-id': '1a21fab7-2746-481c-8003-5f8e6d67ea2a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:9c:15', 'vm-uuid': '94aedd29-1832-4ff4-97ac-d70ed1775223'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:42:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:42:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:26 user nova-compute[72362]: INFO os_vif [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:9c:15,bridge_name='br-int',has_traffic_filtering=True,id=1a21fab7-2746-481c-8003-5f8e6d67ea2a,network=Network(362446ea-173c-4989-93f8-882088822208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a21fab7-27')
Aug 09 10:42:26 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:42:26 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:42:26 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] No VIF found with MAC fa:16:3e:15:9c:15, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:42:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:27 user nova-compute[72362]: DEBUG nova.compute.manager [req-90a0dde6-8d21-4e44-91b7-1d98be764fda req-a9d353e2-4d33-46d8-b0e8-c771f31471a5 service nova] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Received event network-vif-plugged-1a21fab7-2746-481c-8003-5f8e6d67ea2a {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:42:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-90a0dde6-8d21-4e44-91b7-1d98be764fda req-a9d353e2-4d33-46d8-b0e8-c771f31471a5 service nova] Acquiring lock "94aedd29-1832-4ff4-97ac-d70ed1775223-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:42:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-90a0dde6-8d21-4e44-91b7-1d98be764fda req-a9d353e2-4d33-46d8-b0e8-c771f31471a5 service nova] Lock "94aedd29-1832-4ff4-97ac-d70ed1775223-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:42:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-90a0dde6-8d21-4e44-91b7-1d98be764fda req-a9d353e2-4d33-46d8-b0e8-c771f31471a5 service nova] Lock "94aedd29-1832-4ff4-97ac-d70ed1775223-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:42:27 user nova-compute[72362]: DEBUG nova.compute.manager [req-90a0dde6-8d21-4e44-91b7-1d98be764fda req-a9d353e2-4d33-46d8-b0e8-c771f31471a5 service nova] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] No waiting events found dispatching network-vif-plugged-1a21fab7-2746-481c-8003-5f8e6d67ea2a {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:42:27 user nova-compute[72362]: WARNING nova.compute.manager [req-90a0dde6-8d21-4e44-91b7-1d98be764fda req-a9d353e2-4d33-46d8-b0e8-c771f31471a5 service nova] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Received unexpected event network-vif-plugged-1a21fab7-2746-481c-8003-5f8e6d67ea2a for instance with vm_state shelved_offloaded and task_state spawning.
Aug 09 10:42:27 user nova-compute[72362]: DEBUG nova.compute.manager [req-87878154-2341-4f7c-a151-c25838985394 req-161ca73c-902f-4b37-8b09-2150d1a4c1c3 service nova] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Received event network-vif-plugged-1d14bbdf-8802-42b5-bd22-c6bd03a53761 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:42:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-87878154-2341-4f7c-a151-c25838985394 req-161ca73c-902f-4b37-8b09-2150d1a4c1c3 service nova] Acquiring lock "cefe383b-978f-4391-baf6-3b3ad17e0083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:42:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-87878154-2341-4f7c-a151-c25838985394 req-161ca73c-902f-4b37-8b09-2150d1a4c1c3 service nova] Lock "cefe383b-978f-4391-baf6-3b3ad17e0083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:42:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-87878154-2341-4f7c-a151-c25838985394 req-161ca73c-902f-4b37-8b09-2150d1a4c1c3 service nova] Lock "cefe383b-978f-4391-baf6-3b3ad17e0083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:42:27 user nova-compute[72362]: DEBUG nova.compute.manager [req-87878154-2341-4f7c-a151-c25838985394 req-161ca73c-902f-4b37-8b09-2150d1a4c1c3 service nova] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] No waiting events found dispatching network-vif-plugged-1d14bbdf-8802-42b5-bd22-c6bd03a53761 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:42:27 user nova-compute[72362]: WARNING nova.compute.manager [req-87878154-2341-4f7c-a151-c25838985394 req-161ca73c-902f-4b37-8b09-2150d1a4c1c3 service nova] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Received unexpected event network-vif-plugged-1d14bbdf-8802-42b5-bd22-c6bd03a53761 for instance with vm_state active and task_state rescuing.
Aug 09 10:42:27 user nova-compute[72362]: DEBUG nova.compute.manager [req-87878154-2341-4f7c-a151-c25838985394 req-161ca73c-902f-4b37-8b09-2150d1a4c1c3 service nova] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Received event network-vif-plugged-1d14bbdf-8802-42b5-bd22-c6bd03a53761 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:42:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-87878154-2341-4f7c-a151-c25838985394 req-161ca73c-902f-4b37-8b09-2150d1a4c1c3 service nova] Acquiring lock "cefe383b-978f-4391-baf6-3b3ad17e0083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:42:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-87878154-2341-4f7c-a151-c25838985394 req-161ca73c-902f-4b37-8b09-2150d1a4c1c3 service nova] Lock "cefe383b-978f-4391-baf6-3b3ad17e0083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:42:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-87878154-2341-4f7c-a151-c25838985394 req-161ca73c-902f-4b37-8b09-2150d1a4c1c3 service nova] Lock "cefe383b-978f-4391-baf6-3b3ad17e0083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:42:27 user nova-compute[72362]: DEBUG nova.compute.manager [req-87878154-2341-4f7c-a151-c25838985394 req-161ca73c-902f-4b37-8b09-2150d1a4c1c3 service nova] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] No waiting events found dispatching network-vif-plugged-1d14bbdf-8802-42b5-bd22-c6bd03a53761 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:42:27 user nova-compute[72362]: WARNING nova.compute.manager [req-87878154-2341-4f7c-a151-c25838985394 req-161ca73c-902f-4b37-8b09-2150d1a4c1c3 service nova] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Received unexpected event network-vif-plugged-1d14bbdf-8802-42b5-bd22-c6bd03a53761 for instance with vm_state active and task_state rescuing.
Aug 09 10:42:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Removed pending event for cefe383b-978f-4391-baf6-3b3ad17e0083 due to event {{(pid=72362) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 10:42:29 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577749.1661751, cefe383b-978f-4391-baf6-3b3ad17e0083 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:42:29 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] VM Resumed (Lifecycle Event)
Aug 09 10:42:29 user nova-compute[72362]: DEBUG nova.compute.manager [None req-93451478-0c6e-434e-b7e6-e080cbd87245 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:42:29 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:42:29 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:42:29 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 10:42:29 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577749.168096, cefe383b-978f-4391-baf6-3b3ad17e0083 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:42:29 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] VM Started (Lifecycle Event)
Aug 09 10:42:29 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:42:29 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:42:29 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577749.6930988, 94aedd29-1832-4ff4-97ac-d70ed1775223 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:42:29 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] VM Resumed (Lifecycle Event)
Aug 09 10:42:29 user nova-compute[72362]: DEBUG nova.compute.manager [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:42:29 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:42:29 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Instance spawned successfully.
Aug 09 10:42:29 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:42:29 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:42:29 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:42:29 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577749.695315, 94aedd29-1832-4ff4-97ac-d70ed1775223 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:42:29 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] VM Started (Lifecycle Event)
Aug 09 10:42:29 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:42:29 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:42:29 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:42:29 user nova-compute[72362]: DEBUG nova.compute.manager [req-fd1650a4-ddcf-4de4-bf9d-5f6905598eb5 req-a87fa099-1ae3-481a-9dd1-63ba82d5f0d1 service nova] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Received event network-vif-plugged-1a21fab7-2746-481c-8003-5f8e6d67ea2a {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:42:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-fd1650a4-ddcf-4de4-bf9d-5f6905598eb5 req-a87fa099-1ae3-481a-9dd1-63ba82d5f0d1 service nova] Acquiring lock "94aedd29-1832-4ff4-97ac-d70ed1775223-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:42:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-fd1650a4-ddcf-4de4-bf9d-5f6905598eb5 req-a87fa099-1ae3-481a-9dd1-63ba82d5f0d1 service nova] Lock "94aedd29-1832-4ff4-97ac-d70ed1775223-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:42:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-fd1650a4-ddcf-4de4-bf9d-5f6905598eb5 req-a87fa099-1ae3-481a-9dd1-63ba82d5f0d1 service nova] Lock "94aedd29-1832-4ff4-97ac-d70ed1775223-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:42:29 user nova-compute[72362]: DEBUG nova.compute.manager [req-fd1650a4-ddcf-4de4-bf9d-5f6905598eb5 req-a87fa099-1ae3-481a-9dd1-63ba82d5f0d1 service nova] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] No waiting events found dispatching network-vif-plugged-1a21fab7-2746-481c-8003-5f8e6d67ea2a {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:42:29 user nova-compute[72362]: WARNING nova.compute.manager [req-fd1650a4-ddcf-4de4-bf9d-5f6905598eb5 req-a87fa099-1ae3-481a-9dd1-63ba82d5f0d1 service nova] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Received unexpected event network-vif-plugged-1a21fab7-2746-481c-8003-5f8e6d67ea2a for instance with vm_state shelved_offloaded and task_state spawning.
Aug 09 10:42:29 user nova-compute[72362]: DEBUG nova.compute.manager [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:42:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b4d2456b-4787-455f-93b4-729ee4285edf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "94aedd29-1832-4ff4-97ac-d70ed1775223" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 21.303s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:42:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:34 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:42:34 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72362) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 10:42:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "37f4a735-db06-4ad9-81f8-1863330628f9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:42:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "37f4a735-db06-4ad9-81f8-1863330628f9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:42:43 user nova-compute[72362]: DEBUG nova.compute.manager [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Starting instance... {{(pid=72362) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 10:42:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:42:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:42:43 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:42:43 user nova-compute[72362]: INFO nova.compute.claims [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Claim successful on node user
Aug 09 10:42:43 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:42:43 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:42:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.340s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:42:43 user nova-compute[72362]: DEBUG nova.compute.manager [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Start building networks asynchronously for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 10:42:43 user nova-compute[72362]: DEBUG nova.compute.manager [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Allocating IP information in the background. {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 10:42:43 user nova-compute[72362]: DEBUG nova.network.neutron [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] allocate_for_instance() {{(pid=72362) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 10:42:43 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 10:42:43 user nova-compute[72362]: DEBUG nova.compute.manager [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Start building block device mappings for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 10:42:44 user nova-compute[72362]: DEBUG nova.policy [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bed469ff9d954891905c98bdf238c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980f1c36cab0449b949419cf495c16d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72362) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 10:42:44 user nova-compute[72362]: DEBUG nova.compute.manager [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Start spawning the instance on the hypervisor. {{(pid=72362) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 10:42:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:42:44 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Creating image(s)
Aug 09 10:42:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "/opt/stack/data/nova/instances/37f4a735-db06-4ad9-81f8-1863330628f9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:42:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "/opt/stack/data/nova/instances/37f4a735-db06-4ad9-81f8-1863330628f9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:42:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "/opt/stack/data/nova/instances/37f4a735-db06-4ad9-81f8-1863330628f9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:42:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.141s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:42:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:42:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:42:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.140s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:42:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/37f4a735-db06-4ad9-81f8-1863330628f9/disk 1073741824 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/37f4a735-db06-4ad9-81f8-1863330628f9/disk 1073741824" returned: 0 in 0.055s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:42:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:42:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.143s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:42:44 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Checking if we can resize image /opt/stack/data/nova/instances/37f4a735-db06-4ad9-81f8-1863330628f9/disk. size=1073741824 {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 10:42:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f4a735-db06-4ad9-81f8-1863330628f9/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:42:44 user nova-compute[72362]: DEBUG nova.network.neutron [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Successfully created port: 0befdbb1-af32-4c72-880c-7cff448a3870 {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:42:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f4a735-db06-4ad9-81f8-1863330628f9/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:42:44 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Cannot resize image /opt/stack/data/nova/instances/37f4a735-db06-4ad9-81f8-1863330628f9/disk to a smaller size. {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 10:42:44 user nova-compute[72362]: DEBUG nova.objects.instance [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lazy-loading 'migration_context' on Instance uuid 37f4a735-db06-4ad9-81f8-1863330628f9 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:42:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Created local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 10:42:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Ensure instance console log exists: /opt/stack/data/nova/instances/37f4a735-db06-4ad9-81f8-1863330628f9/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:42:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:42:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:42:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:42:45 user nova-compute[72362]: DEBUG nova.network.neutron [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Successfully updated port: 0befdbb1-af32-4c72-880c-7cff448a3870 {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:42:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "refresh_cache-37f4a735-db06-4ad9-81f8-1863330628f9" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:42:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquired lock "refresh_cache-37f4a735-db06-4ad9-81f8-1863330628f9" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:42:45 user nova-compute[72362]: DEBUG nova.network.neutron [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:42:45 user nova-compute[72362]: DEBUG nova.network.neutron [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:42:45 user nova-compute[72362]: DEBUG nova.compute.manager [req-52ad40fd-7cd5-485f-bdc9-03385cd0e5ff req-4069bd0a-4342-4922-976a-c9cedfb7600a service nova] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Received event network-changed-0befdbb1-af32-4c72-880c-7cff448a3870 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:42:45 user nova-compute[72362]: DEBUG nova.compute.manager [req-52ad40fd-7cd5-485f-bdc9-03385cd0e5ff req-4069bd0a-4342-4922-976a-c9cedfb7600a service nova] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Refreshing instance network info cache due to event network-changed-0befdbb1-af32-4c72-880c-7cff448a3870. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:42:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-52ad40fd-7cd5-485f-bdc9-03385cd0e5ff req-4069bd0a-4342-4922-976a-c9cedfb7600a service nova] Acquiring lock "refresh_cache-37f4a735-db06-4ad9-81f8-1863330628f9" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:42:45 user nova-compute[72362]: DEBUG nova.network.neutron [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Updating instance_info_cache with network_info: [{"id": "0befdbb1-af32-4c72-880c-7cff448a3870", "address": "fa:16:3e:86:29:60", "network": {"id": "e56e2a0a-0a6d-4546-86ef-7bb333e829ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1495216341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980f1c36cab0449b949419cf495c16d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0befdbb1-af", "ovs_interfaceid": "0befdbb1-af32-4c72-880c-7cff448a3870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:42:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Releasing lock "refresh_cache-37f4a735-db06-4ad9-81f8-1863330628f9" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:42:45 user nova-compute[72362]: DEBUG nova.compute.manager [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Instance network_info: |[{"id": "0befdbb1-af32-4c72-880c-7cff448a3870", "address": "fa:16:3e:86:29:60", "network": {"id": "e56e2a0a-0a6d-4546-86ef-7bb333e829ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1495216341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980f1c36cab0449b949419cf495c16d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0befdbb1-af", "ovs_interfaceid": "0befdbb1-af32-4c72-880c-7cff448a3870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 10:42:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-52ad40fd-7cd5-485f-bdc9-03385cd0e5ff req-4069bd0a-4342-4922-976a-c9cedfb7600a service nova] Acquired lock "refresh_cache-37f4a735-db06-4ad9-81f8-1863330628f9" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:42:45 user nova-compute[72362]: DEBUG nova.network.neutron [req-52ad40fd-7cd5-485f-bdc9-03385cd0e5ff req-4069bd0a-4342-4922-976a-c9cedfb7600a service nova] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Refreshing network info cache for port 0befdbb1-af32-4c72-880c-7cff448a3870 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:42:45 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Start _get_guest_xml network_info=[{"id": "0befdbb1-af32-4c72-880c-7cff448a3870", "address": "fa:16:3e:86:29:60", "network": {"id": "e56e2a0a-0a6d-4546-86ef-7bb333e829ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1495216341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980f1c36cab0449b949419cf495c16d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0befdbb1-af", "ovs_interfaceid": "0befdbb1-af32-4c72-880c-7cff448a3870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': 'a08d1a11-49eb-4212-a351-e11ee9553b95'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:42:45 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:42:45 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:42:45 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:42:45 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:42:45 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:42:45 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:42:45 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:42:45 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:42:45 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:42:45 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:42:45 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:42:45 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:42:45 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:42:45 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:42:45 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:42:45 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:42:45 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:42:45 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:42:45 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:42:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-77660331',display_name='tempest-AttachVolumeNegativeTest-server-77660331',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-77660331',id=44,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGgMVyViMMF2ScZK8622aw2G9bObMCbXXWDUvTyw44Ybech0pxcN6fnk9Azza/cRndRIt26rpboadbbxE83QX7o5AOYJoXTlv5Le7WopUU8uYYBOGvu6VDsX0dLrKoFiQ==',key_name='tempest-keypair-298891728',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='980f1c36cab0449b949419cf495c16d5',ramdisk_id='',reservation_id='r-jqelp5a0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-486756066',owner_user_name='tempest-AttachVolumeNegativeTest-486756066-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:42:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bed469ff9d954891905c98bdf238c097',uuid=37f4a735-db06-4ad9-81f8-1863330628f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0befdbb1-af32-4c72-880c-7cff448a3870", "address": "fa:16:3e:86:29:60", "network": {"id": "e56e2a0a-0a6d-4546-86ef-7bb333e829ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1495216341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980f1c36cab0449b949419cf495c16d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0befdbb1-af", "ovs_interfaceid": "0befdbb1-af32-4c72-880c-7cff448a3870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:42:45 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Converting VIF {"id": "0befdbb1-af32-4c72-880c-7cff448a3870", "address": "fa:16:3e:86:29:60", "network": {"id": "e56e2a0a-0a6d-4546-86ef-7bb333e829ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1495216341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980f1c36cab0449b949419cf495c16d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0befdbb1-af", "ovs_interfaceid": "0befdbb1-af32-4c72-880c-7cff448a3870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:42:45 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:29:60,bridge_name='br-int',has_traffic_filtering=True,id=0befdbb1-af32-4c72-880c-7cff448a3870,network=Network(e56e2a0a-0a6d-4546-86ef-7bb333e829ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0befdbb1-af') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:42:45 user nova-compute[72362]: DEBUG nova.objects.instance [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lazy-loading 'pci_devices' on Instance uuid 37f4a735-db06-4ad9-81f8-1863330628f9 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:42:45 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:42:45 user nova-compute[72362]:   <uuid>37f4a735-db06-4ad9-81f8-1863330628f9</uuid>
Aug 09 10:42:45 user nova-compute[72362]:   <name>instance-0000002c</name>
Aug 09 10:42:45 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:42:45 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:42:45 user nova-compute[72362]:   <metadata>
Aug 09 10:42:45 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:42:45 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:42:45 user nova-compute[72362]:       <nova:name>tempest-AttachVolumeNegativeTest-server-77660331</nova:name>
Aug 09 10:42:45 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:42:45</nova:creationTime>
Aug 09 10:42:45 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:42:45 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:42:45 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:42:45 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:42:45 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:42:45 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:42:45 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:42:45 user nova-compute[72362]:       <nova:owner>
Aug 09 10:42:45 user nova-compute[72362]:         <nova:user uuid="bed469ff9d954891905c98bdf238c097">tempest-AttachVolumeNegativeTest-486756066-project-member</nova:user>
Aug 09 10:42:45 user nova-compute[72362]:         <nova:project uuid="980f1c36cab0449b949419cf495c16d5">tempest-AttachVolumeNegativeTest-486756066</nova:project>
Aug 09 10:42:45 user nova-compute[72362]:       </nova:owner>
Aug 09 10:42:45 user nova-compute[72362]:       <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:42:45 user nova-compute[72362]:       <nova:ports>
Aug 09 10:42:45 user nova-compute[72362]:         <nova:port uuid="0befdbb1-af32-4c72-880c-7cff448a3870">
Aug 09 10:42:45 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 10:42:45 user nova-compute[72362]:         </nova:port>
Aug 09 10:42:45 user nova-compute[72362]:       </nova:ports>
Aug 09 10:42:45 user nova-compute[72362]:     </nova:instance>
Aug 09 10:42:45 user nova-compute[72362]:   </metadata>
Aug 09 10:42:45 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:42:45 user nova-compute[72362]:     <system>
Aug 09 10:42:45 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:42:45 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:42:45 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:42:45 user nova-compute[72362]:       <entry name="serial">37f4a735-db06-4ad9-81f8-1863330628f9</entry>
Aug 09 10:42:45 user nova-compute[72362]:       <entry name="uuid">37f4a735-db06-4ad9-81f8-1863330628f9</entry>
Aug 09 10:42:45 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:42:45 user nova-compute[72362]:     </system>
Aug 09 10:42:45 user nova-compute[72362]:   </sysinfo>
Aug 09 10:42:45 user nova-compute[72362]:   <os>
Aug 09 10:42:45 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:42:45 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:42:45 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:42:45 user nova-compute[72362]:   </os>
Aug 09 10:42:45 user nova-compute[72362]:   <features>
Aug 09 10:42:45 user nova-compute[72362]:     <acpi/>
Aug 09 10:42:45 user nova-compute[72362]:     <apic/>
Aug 09 10:42:45 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:42:45 user nova-compute[72362]:   </features>
Aug 09 10:42:45 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:42:45 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:42:45 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:42:45 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:42:45 user nova-compute[72362]:   </clock>
Aug 09 10:42:45 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:42:45 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:42:45 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:42:45 user nova-compute[72362]:   </cpu>
Aug 09 10:42:45 user nova-compute[72362]:   <devices>
Aug 09 10:42:45 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:42:45 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:42:45 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/37f4a735-db06-4ad9-81f8-1863330628f9/disk"/>
Aug 09 10:42:45 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:42:45 user nova-compute[72362]:     </disk>
Aug 09 10:42:45 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:42:45 user nova-compute[72362]:       <mac address="fa:16:3e:86:29:60"/>
Aug 09 10:42:45 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:42:45 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:42:45 user nova-compute[72362]:       <target dev="tap0befdbb1-af"/>
Aug 09 10:42:45 user nova-compute[72362]:     </interface>
Aug 09 10:42:45 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:42:45 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/37f4a735-db06-4ad9-81f8-1863330628f9/console.log" append="off"/>
Aug 09 10:42:45 user nova-compute[72362]:     </serial>
Aug 09 10:42:45 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:42:45 user nova-compute[72362]:     <video>
Aug 09 10:42:45 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:42:45 user nova-compute[72362]:     </video>
Aug 09 10:42:45 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:42:45 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:42:45 user nova-compute[72362]:     </rng>
Aug 09 10:42:45 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:42:45 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:42:45 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:42:45 user nova-compute[72362]:     </memballoon>
Aug 09 10:42:45 user nova-compute[72362]:   </devices>
Aug 09 10:42:45 user nova-compute[72362]: </domain>
Aug 09 10:42:45 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:42:45 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:42:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-77660331',display_name='tempest-AttachVolumeNegativeTest-server-77660331',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-77660331',id=44,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGgMVyViMMF2ScZK8622aw2G9bObMCbXXWDUvTyw44Ybech0pxcN6fnk9Azza/cRndRIt26rpboadbbxE83QX7o5AOYJoXTlv5Le7WopUU8uYYBOGvu6VDsX0dLrKoFiQ==',key_name='tempest-keypair-298891728',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='980f1c36cab0449b949419cf495c16d5',ramdisk_id='',reservation_id='r-jqelp5a0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-486756066',owner_user_name='tempest-AttachVolumeNegativeTest-486756066-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:42:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bed469ff9d954891905c98bdf238c097',uuid=37f4a735-db06-4ad9-81f8-1863330628f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0befdbb1-af32-4c72-880c-7cff448a3870", "address": "fa:16:3e:86:29:60", "network": {"id": "e56e2a0a-0a6d-4546-86ef-7bb333e829ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1495216341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980f1c36cab0449b949419cf495c16d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0befdbb1-af", "ovs_interfaceid": "0befdbb1-af32-4c72-880c-7cff448a3870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:42:45 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Converting VIF {"id": "0befdbb1-af32-4c72-880c-7cff448a3870", "address": "fa:16:3e:86:29:60", "network": {"id": "e56e2a0a-0a6d-4546-86ef-7bb333e829ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1495216341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980f1c36cab0449b949419cf495c16d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0befdbb1-af", "ovs_interfaceid": "0befdbb1-af32-4c72-880c-7cff448a3870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:42:45 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:29:60,bridge_name='br-int',has_traffic_filtering=True,id=0befdbb1-af32-4c72-880c-7cff448a3870,network=Network(e56e2a0a-0a6d-4546-86ef-7bb333e829ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0befdbb1-af') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:42:45 user nova-compute[72362]: DEBUG os_vif [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:29:60,bridge_name='br-int',has_traffic_filtering=True,id=0befdbb1-af32-4c72-880c-7cff448a3870,network=Network(e56e2a0a-0a6d-4546-86ef-7bb333e829ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0befdbb1-af') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:42:45 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:45 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:42:45 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:42:45 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:45 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0befdbb1-af, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:42:45 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0befdbb1-af, col_values=(('external_ids', {'iface-id': '0befdbb1-af32-4c72-880c-7cff448a3870', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:29:60', 'vm-uuid': '37f4a735-db06-4ad9-81f8-1863330628f9'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:42:45 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:45 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:42:45 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:45 user nova-compute[72362]: INFO os_vif [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:29:60,bridge_name='br-int',has_traffic_filtering=True,id=0befdbb1-af32-4c72-880c-7cff448a3870,network=Network(e56e2a0a-0a6d-4546-86ef-7bb333e829ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0befdbb1-af')
Aug 09 10:42:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:42:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] No VIF found with MAC fa:16:3e:86:29:60, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:42:46 user nova-compute[72362]: DEBUG nova.network.neutron [req-52ad40fd-7cd5-485f-bdc9-03385cd0e5ff req-4069bd0a-4342-4922-976a-c9cedfb7600a service nova] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Updated VIF entry in instance network info cache for port 0befdbb1-af32-4c72-880c-7cff448a3870. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:42:46 user nova-compute[72362]: DEBUG nova.network.neutron [req-52ad40fd-7cd5-485f-bdc9-03385cd0e5ff req-4069bd0a-4342-4922-976a-c9cedfb7600a service nova] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Updating instance_info_cache with network_info: [{"id": "0befdbb1-af32-4c72-880c-7cff448a3870", "address": "fa:16:3e:86:29:60", "network": {"id": "e56e2a0a-0a6d-4546-86ef-7bb333e829ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1495216341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980f1c36cab0449b949419cf495c16d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0befdbb1-af", "ovs_interfaceid": "0befdbb1-af32-4c72-880c-7cff448a3870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:42:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-52ad40fd-7cd5-485f-bdc9-03385cd0e5ff req-4069bd0a-4342-4922-976a-c9cedfb7600a service nova] Releasing lock "refresh_cache-37f4a735-db06-4ad9-81f8-1863330628f9" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:42:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:47 user nova-compute[72362]: DEBUG nova.compute.manager [req-edf662ab-62fa-4f99-8246-a0b2f4d9360a req-36e69c7d-deb5-4979-b0f6-ff7e41df37ea service nova] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Received event network-vif-plugged-0befdbb1-af32-4c72-880c-7cff448a3870 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:42:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-edf662ab-62fa-4f99-8246-a0b2f4d9360a req-36e69c7d-deb5-4979-b0f6-ff7e41df37ea service nova] Acquiring lock "37f4a735-db06-4ad9-81f8-1863330628f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:42:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-edf662ab-62fa-4f99-8246-a0b2f4d9360a req-36e69c7d-deb5-4979-b0f6-ff7e41df37ea service nova] Lock "37f4a735-db06-4ad9-81f8-1863330628f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:42:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-edf662ab-62fa-4f99-8246-a0b2f4d9360a req-36e69c7d-deb5-4979-b0f6-ff7e41df37ea service nova] Lock "37f4a735-db06-4ad9-81f8-1863330628f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:42:47 user nova-compute[72362]: DEBUG nova.compute.manager [req-edf662ab-62fa-4f99-8246-a0b2f4d9360a req-36e69c7d-deb5-4979-b0f6-ff7e41df37ea service nova] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] No waiting events found dispatching network-vif-plugged-0befdbb1-af32-4c72-880c-7cff448a3870 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:42:47 user nova-compute[72362]: WARNING nova.compute.manager [req-edf662ab-62fa-4f99-8246-a0b2f4d9360a req-36e69c7d-deb5-4979-b0f6-ff7e41df37ea service nova] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Received unexpected event network-vif-plugged-0befdbb1-af32-4c72-880c-7cff448a3870 for instance with vm_state building and task_state spawning.
Aug 09 10:42:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:49 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577769.374269, 37f4a735-db06-4ad9-81f8-1863330628f9 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:42:49 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] VM Resumed (Lifecycle Event)
Aug 09 10:42:49 user nova-compute[72362]: DEBUG nova.compute.manager [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:42:49 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:42:49 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Instance spawned successfully.
Aug 09 10:42:49 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 10:42:49 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:42:49 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:42:49 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Found default for hw_cdrom_bus of ide {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:42:49 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Found default for hw_disk_bus of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:42:49 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:42:49 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:42:49 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Found default for hw_video_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:42:49 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Found default for hw_vif_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:42:49 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:42:49 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577769.376565, 37f4a735-db06-4ad9-81f8-1863330628f9 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:42:49 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] VM Started (Lifecycle Event)
Aug 09 10:42:49 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:42:49 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:42:49 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:42:49 user nova-compute[72362]: INFO nova.compute.manager [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Took 5.42 seconds to spawn the instance on the hypervisor.
Aug 09 10:42:49 user nova-compute[72362]: DEBUG nova.compute.manager [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:42:49 user nova-compute[72362]: INFO nova.compute.manager [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Took 6.09 seconds to build instance.
Aug 09 10:42:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-72c5ff01-ba44-4da7-bd47-b45fa8fd4801 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "37f4a735-db06-4ad9-81f8-1863330628f9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.195s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:42:49 user nova-compute[72362]: DEBUG nova.compute.manager [req-2e12198f-ba2d-4ea8-8b42-9fe39df96bd7 req-7b66b22e-2664-4f0c-9d93-f99ab336d9c6 service nova] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Received event network-vif-plugged-0befdbb1-af32-4c72-880c-7cff448a3870 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:42:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-2e12198f-ba2d-4ea8-8b42-9fe39df96bd7 req-7b66b22e-2664-4f0c-9d93-f99ab336d9c6 service nova] Acquiring lock "37f4a735-db06-4ad9-81f8-1863330628f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:42:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-2e12198f-ba2d-4ea8-8b42-9fe39df96bd7 req-7b66b22e-2664-4f0c-9d93-f99ab336d9c6 service nova] Lock "37f4a735-db06-4ad9-81f8-1863330628f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:42:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-2e12198f-ba2d-4ea8-8b42-9fe39df96bd7 req-7b66b22e-2664-4f0c-9d93-f99ab336d9c6 service nova] Lock "37f4a735-db06-4ad9-81f8-1863330628f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:42:49 user nova-compute[72362]: DEBUG nova.compute.manager [req-2e12198f-ba2d-4ea8-8b42-9fe39df96bd7 req-7b66b22e-2664-4f0c-9d93-f99ab336d9c6 service nova] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] No waiting events found dispatching network-vif-plugged-0befdbb1-af32-4c72-880c-7cff448a3870 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:42:49 user nova-compute[72362]: WARNING nova.compute.manager [req-2e12198f-ba2d-4ea8-8b42-9fe39df96bd7 req-7b66b22e-2664-4f0c-9d93-f99ab336d9c6 service nova] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Received unexpected event network-vif-plugged-0befdbb1-af32-4c72-880c-7cff448a3870 for instance with vm_state active and task_state None.
Aug 09 10:42:50 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:52 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:55 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:42:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:43:00 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:43:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:43:03 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:43:03 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Triggering sync for uuid cefe383b-978f-4391-baf6-3b3ad17e0083 {{(pid=72362) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 10:43:03 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Triggering sync for uuid 4296ca4c-1e3e-474f-98ba-9f947d333b8d {{(pid=72362) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 10:43:03 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Triggering sync for uuid 94aedd29-1832-4ff4-97ac-d70ed1775223 {{(pid=72362) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 10:43:03 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Triggering sync for uuid 902ed05f-84c3-40f2-a991-4a5264f5d972 {{(pid=72362) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 10:43:03 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Triggering sync for uuid 37f4a735-db06-4ad9-81f8-1863330628f9 {{(pid=72362) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 10:43:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "cefe383b-978f-4391-baf6-3b3ad17e0083" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:43:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "cefe383b-978f-4391-baf6-3b3ad17e0083" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:43:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "4296ca4c-1e3e-474f-98ba-9f947d333b8d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:43:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "4296ca4c-1e3e-474f-98ba-9f947d333b8d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:43:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "94aedd29-1832-4ff4-97ac-d70ed1775223" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:43:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "94aedd29-1832-4ff4-97ac-d70ed1775223" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:43:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "902ed05f-84c3-40f2-a991-4a5264f5d972" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:43:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "902ed05f-84c3-40f2-a991-4a5264f5d972" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:43:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "37f4a735-db06-4ad9-81f8-1863330628f9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:43:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "37f4a735-db06-4ad9-81f8-1863330628f9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:43:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "cefe383b-978f-4391-baf6-3b3ad17e0083" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:43:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "4296ca4c-1e3e-474f-98ba-9f947d333b8d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:43:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "94aedd29-1832-4ff4-97ac-d70ed1775223" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:43:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "902ed05f-84c3-40f2-a991-4a5264f5d972" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:43:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "37f4a735-db06-4ad9-81f8-1863330628f9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:43:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:43:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:43:09 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:43:09 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 10:43:10 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:43:11 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:43:11 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:43:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:43:12 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:43:13 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:43:13 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:43:15 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:43:15 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 10:43:15 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:43:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "refresh_cache-94aedd29-1832-4ff4-97ac-d70ed1775223" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:43:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquired lock "refresh_cache-94aedd29-1832-4ff4-97ac-d70ed1775223" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:43:16 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Forcefully refreshing network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 10:43:16 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Updating instance_info_cache with network_info: [{"id": "1a21fab7-2746-481c-8003-5f8e6d67ea2a", "address": "fa:16:3e:15:9c:15", "network": {"id": "362446ea-173c-4989-93f8-882088822208", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-499399633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f9d6a60f24d41deb91ae59189c62ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a21fab7-27", "ovs_interfaceid": "1a21fab7-2746-481c-8003-5f8e6d67ea2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:43:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Releasing lock "refresh_cache-94aedd29-1832-4ff4-97ac-d70ed1775223" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:43:16 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Updated the network info_cache for instance {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 10:43:16 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:43:17 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:43:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:43:22 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:43:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:43:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:43:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:43:23 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 10:43:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f4a735-db06-4ad9-81f8-1863330628f9/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:43:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f4a735-db06-4ad9-81f8-1863330628f9/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:43:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f4a735-db06-4ad9-81f8-1863330628f9/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:43:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f4a735-db06-4ad9-81f8-1863330628f9/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:43:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk.rescue --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:43:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:43:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk.rescue --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:43:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:43:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:43:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:43:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:43:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:43:23 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:43:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94aedd29-1832-4ff4-97ac-d70ed1775223/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:43:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94aedd29-1832-4ff4-97ac-d70ed1775223/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:43:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94aedd29-1832-4ff4-97ac-d70ed1775223/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:43:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94aedd29-1832-4ff4-97ac-d70ed1775223/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:43:24 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:43:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:43:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json" returned: 0 in 0.156s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:43:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:43:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:43:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:43:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:43:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:43:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:43:25 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:43:25 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:43:25 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=8144MB free_disk=25.067020416259766GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 10:43:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:43:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:43:25 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance cefe383b-978f-4391-baf6-3b3ad17e0083 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:43:25 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 4296ca4c-1e3e-474f-98ba-9f947d333b8d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:43:25 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 902ed05f-84c3-40f2-a991-4a5264f5d972 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:43:25 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 94aedd29-1832-4ff4-97ac-d70ed1775223 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:43:25 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 37f4a735-db06-4ad9-81f8-1863330628f9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:43:25 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 10:43:25 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 10:43:25 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:43:25 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:43:25 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 10:43:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.322s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:43:25 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:43:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:43:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:43:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:43:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:43:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:43:53 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:43:54 user nova-compute[72362]: DEBUG nova.compute.manager [req-455480cf-c114-4565-8773-b3c5d3d15931 req-76304349-e5e5-4d6c-9475-d683111e5b2a service nova] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Received event network-changed-cb19a9db-8c08-4ae0-b7ec-7dda0b276718 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:43:54 user nova-compute[72362]: DEBUG nova.compute.manager [req-455480cf-c114-4565-8773-b3c5d3d15931 req-76304349-e5e5-4d6c-9475-d683111e5b2a service nova] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Refreshing instance network info cache due to event network-changed-cb19a9db-8c08-4ae0-b7ec-7dda0b276718. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:43:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-455480cf-c114-4565-8773-b3c5d3d15931 req-76304349-e5e5-4d6c-9475-d683111e5b2a service nova] Acquiring lock "refresh_cache-902ed05f-84c3-40f2-a991-4a5264f5d972" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:43:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-455480cf-c114-4565-8773-b3c5d3d15931 req-76304349-e5e5-4d6c-9475-d683111e5b2a service nova] Acquired lock "refresh_cache-902ed05f-84c3-40f2-a991-4a5264f5d972" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:43:54 user nova-compute[72362]: DEBUG nova.network.neutron [req-455480cf-c114-4565-8773-b3c5d3d15931 req-76304349-e5e5-4d6c-9475-d683111e5b2a service nova] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Refreshing network info cache for port cb19a9db-8c08-4ae0-b7ec-7dda0b276718 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:43:55 user nova-compute[72362]: DEBUG nova.network.neutron [req-455480cf-c114-4565-8773-b3c5d3d15931 req-76304349-e5e5-4d6c-9475-d683111e5b2a service nova] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Updated VIF entry in instance network info cache for port cb19a9db-8c08-4ae0-b7ec-7dda0b276718. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:43:55 user nova-compute[72362]: DEBUG nova.network.neutron [req-455480cf-c114-4565-8773-b3c5d3d15931 req-76304349-e5e5-4d6c-9475-d683111e5b2a service nova] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Updating instance_info_cache with network_info: [{"id": "cb19a9db-8c08-4ae0-b7ec-7dda0b276718", "address": "fa:16:3e:96:5d:a5", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb19a9db-8c", "ovs_interfaceid": "cb19a9db-8c08-4ae0-b7ec-7dda0b276718", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:43:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-455480cf-c114-4565-8773-b3c5d3d15931 req-76304349-e5e5-4d6c-9475-d683111e5b2a service nova] Releasing lock "refresh_cache-902ed05f-84c3-40f2-a991-4a5264f5d972" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:43:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f25e5b7a-5f1b-43c0-8724-8726c4274383 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "902ed05f-84c3-40f2-a991-4a5264f5d972" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:43:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f25e5b7a-5f1b-43c0-8724-8726c4274383 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "902ed05f-84c3-40f2-a991-4a5264f5d972" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:43:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f25e5b7a-5f1b-43c0-8724-8726c4274383 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "902ed05f-84c3-40f2-a991-4a5264f5d972-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:43:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f25e5b7a-5f1b-43c0-8724-8726c4274383 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "902ed05f-84c3-40f2-a991-4a5264f5d972-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:43:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f25e5b7a-5f1b-43c0-8724-8726c4274383 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "902ed05f-84c3-40f2-a991-4a5264f5d972-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:43:55 user nova-compute[72362]: INFO nova.compute.manager [None req-f25e5b7a-5f1b-43c0-8724-8726c4274383 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Terminating instance
Aug 09 10:43:55 user nova-compute[72362]: DEBUG nova.compute.manager [None req-f25e5b7a-5f1b-43c0-8724-8726c4274383 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Start destroying the instance on the hypervisor. {{(pid=72362) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 10:43:55 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:43:55 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:43:55 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:43:55 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:43:55 user nova-compute[72362]: DEBUG nova.compute.manager [req-cb67bff8-f750-4b80-8910-6f4664173448 req-8a870678-10d4-4c04-8e6c-fba1ffc98d52 service nova] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Received event network-vif-unplugged-cb19a9db-8c08-4ae0-b7ec-7dda0b276718 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:43:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-cb67bff8-f750-4b80-8910-6f4664173448 req-8a870678-10d4-4c04-8e6c-fba1ffc98d52 service nova] Acquiring lock "902ed05f-84c3-40f2-a991-4a5264f5d972-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:43:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-cb67bff8-f750-4b80-8910-6f4664173448 req-8a870678-10d4-4c04-8e6c-fba1ffc98d52 service nova] Lock "902ed05f-84c3-40f2-a991-4a5264f5d972-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:43:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-cb67bff8-f750-4b80-8910-6f4664173448 req-8a870678-10d4-4c04-8e6c-fba1ffc98d52 service nova] Lock "902ed05f-84c3-40f2-a991-4a5264f5d972-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:43:55 user nova-compute[72362]: DEBUG nova.compute.manager [req-cb67bff8-f750-4b80-8910-6f4664173448 req-8a870678-10d4-4c04-8e6c-fba1ffc98d52 service nova] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] No waiting events found dispatching network-vif-unplugged-cb19a9db-8c08-4ae0-b7ec-7dda0b276718 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:43:55 user nova-compute[72362]: DEBUG nova.compute.manager [req-cb67bff8-f750-4b80-8910-6f4664173448 req-8a870678-10d4-4c04-8e6c-fba1ffc98d52 service nova] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Received event network-vif-unplugged-cb19a9db-8c08-4ae0-b7ec-7dda0b276718 for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:43:56 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Instance destroyed successfully.
Aug 09 10:43:56 user nova-compute[72362]: DEBUG nova.objects.instance [None req-f25e5b7a-5f1b-43c0-8724-8726c4274383 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lazy-loading 'resources' on Instance uuid 902ed05f-84c3-40f2-a991-4a5264f5d972 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-f25e5b7a-5f1b-43c0-8724-8726c4274383 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:42:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1427700819',display_name='tempest-TestVolumeBootPattern-server-1427700819',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1427700819',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHphUKjpMkPjhZoTYlVJxPOuywq6OJUJWcHduVoRu9b0hlVgGA5+i25KrjKtdJwPAqa6k/+4sAUFZLxd189pJwbl9oyVmaY/KLuastlFffcAKt/RqOFaRqRDbZFRQvHB1g==',key_name='tempest-TestVolumeBootPattern-1201178489',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:42:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='26e38599de0b4b06b723f5647a7fe121',ramdisk_id='',reservation_id='r-mw8ppfpw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1478436240',owner_user_name='tempest-TestVolumeBootPattern-1478436240-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:42:16Z,user_data=None,user_id='e96900e953f64d02bdb5d48f136133c3',uuid=902ed05f-84c3-40f2-a991-4a5264f5d972,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb19a9db-8c08-4ae0-b7ec-7dda0b276718", "address": "fa:16:3e:96:5d:a5", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb19a9db-8c", "ovs_interfaceid": "cb19a9db-8c08-4ae0-b7ec-7dda0b276718", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-f25e5b7a-5f1b-43c0-8724-8726c4274383 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Converting VIF {"id": "cb19a9db-8c08-4ae0-b7ec-7dda0b276718", "address": "fa:16:3e:96:5d:a5", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb19a9db-8c", "ovs_interfaceid": "cb19a9db-8c08-4ae0-b7ec-7dda0b276718", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-f25e5b7a-5f1b-43c0-8724-8726c4274383 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:5d:a5,bridge_name='br-int',has_traffic_filtering=True,id=cb19a9db-8c08-4ae0-b7ec-7dda0b276718,network=Network(b4a9e050-41f1-404a-bf5c-41421f034644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb19a9db-8c') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG os_vif [None req-f25e5b7a-5f1b-43c0-8724-8726c4274383 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:5d:a5,bridge_name='br-int',has_traffic_filtering=True,id=cb19a9db-8c08-4ae0-b7ec-7dda0b276718,network=Network(b4a9e050-41f1-404a-bf5c-41421f034644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb19a9db-8c') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb19a9db-8c, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:43:56 user nova-compute[72362]: INFO os_vif [None req-f25e5b7a-5f1b-43c0-8724-8726c4274383 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:5d:a5,bridge_name='br-int',has_traffic_filtering=True,id=cb19a9db-8c08-4ae0-b7ec-7dda0b276718,network=Network(b4a9e050-41f1-404a-bf5c-41421f034644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb19a9db-8c')
Aug 09 10:43:56 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f25e5b7a-5f1b-43c0-8724-8726c4274383 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25e5b7a-5f1b-43c0-8724-8726c4274383 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vPXkBflS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:43:56 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-f25e5b7a-5f1b-43c0-8724-8726c4274383 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:43:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-f25e5b7a-5f1b-43c0-8724-8726c4274383 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-f25e5b7a-5f1b-43c0-8724-8726c4274383 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25e5b7a-5f1b-43c0-8724-8726c4274383 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[16055907-bcd2-4adb-85d7-d6b7fa218162]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[08da6ecb-b82a-4f66-8db8-a66709be79fb]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25e5b7a-5f1b-43c0-8724-8726c4274383 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 (non-flash)
Aug 09 10:43:56 user nova-compute[72362]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33 (non-flash)
Aug 09 10:43:56 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25e5b7a-5f1b-43c0-8724-8726c4274383 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 (non-flash)
Aug 09 10:43:56 user nova-compute[72362]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33 (non-flash)
Aug 09 10:43:56 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25e5b7a-5f1b-43c0-8724-8726c4274383 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34f1126e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135'): ({'sdb'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-f25e5b7a-5f1b-43c0-8724-8726c4274383 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Removing single pathed devices sdb {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c17920-da23-4b76-ad59-4677a482ec02]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce462d5-f5ab-451f-9974-41c0c3fc76b8]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-f25e5b7a-5f1b-43c0-8724-8726c4274383 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Flushing IO for device /dev/sdb {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d8dc16-d3ea-4d8f-a73c-28618154a089]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-f25e5b7a-5f1b-43c0-8724-8726c4274383 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f14ad8-0a65-4167-b3b9-c6d5dfaf1957]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-f25e5b7a-5f1b-43c0-8724-8726c4274383 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-f25e5b7a-5f1b-43c0-8724-8726c4274383 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] SCSI volumes sdb have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25e5b7a-5f1b-43c0-8724-8726c4274383 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[785c2885-9d28-4171-bb95-9ced6acc2576]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25e5b7a-5f1b-43c0-8724-8726c4274383 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dfb0781-338e-477f-8ae4-436e7b4fdba2]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25e5b7a-5f1b-43c0-8724-8726c4274383 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135, portal: 172.16.0.220,3260]
Aug 09 10:43:56 user nova-compute[72362]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135, portal: 172.16.0.220,3260] successful.
Aug 09 10:43:56 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e923ec35-e72a-4be4-b052-6105edea3c8d]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25e5b7a-5f1b-43c0-8724-8726c4274383 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-f25e5b7a-5f1b-43c0-8724-8726c4274383 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25e5b7a-5f1b-43c0-8724-8726c4274383 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] <== disconnect_volume: return (270ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f25e5b7a-5f1b-43c0-8724-8726c4274383 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:43:56 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-f25e5b7a-5f1b-43c0-8724-8726c4274383 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Deleting instance files /opt/stack/data/nova/instances/902ed05f-84c3-40f2-a991-4a5264f5d972_del
Aug 09 10:43:56 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-f25e5b7a-5f1b-43c0-8724-8726c4274383 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Deletion of /opt/stack/data/nova/instances/902ed05f-84c3-40f2-a991-4a5264f5d972_del complete
Aug 09 10:43:56 user nova-compute[72362]: INFO nova.compute.manager [None req-f25e5b7a-5f1b-43c0-8724-8726c4274383 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Took 1.13 seconds to destroy the instance on the hypervisor.
Aug 09 10:43:56 user nova-compute[72362]: DEBUG oslo.service.loopingcall [None req-f25e5b7a-5f1b-43c0-8724-8726c4274383 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72362) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG nova.compute.manager [-] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Deallocating network for instance {{(pid=72362) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 10:43:56 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] deallocate_for_instance() {{(pid=72362) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 10:43:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:43:57 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:43:57 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Took 0.86 seconds to deallocate network for instance.
Aug 09 10:43:57 user nova-compute[72362]: DEBUG nova.compute.manager [req-33488820-b722-4f97-8c79-2064d1683353 req-d696372f-08bc-4f54-8364-8e34fbb95127 service nova] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Received event network-vif-deleted-cb19a9db-8c08-4ae0-b7ec-7dda0b276718 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:43:57 user nova-compute[72362]: DEBUG nova.compute.manager [req-cbfb88d4-bd40-4590-b3cf-ee583c2e09e2 req-fedc90fd-ae89-4ab2-b33e-4e7fcea53287 service nova] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Received event network-vif-plugged-cb19a9db-8c08-4ae0-b7ec-7dda0b276718 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:43:57 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-cbfb88d4-bd40-4590-b3cf-ee583c2e09e2 req-fedc90fd-ae89-4ab2-b33e-4e7fcea53287 service nova] Acquiring lock "902ed05f-84c3-40f2-a991-4a5264f5d972-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:43:57 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-cbfb88d4-bd40-4590-b3cf-ee583c2e09e2 req-fedc90fd-ae89-4ab2-b33e-4e7fcea53287 service nova] Lock "902ed05f-84c3-40f2-a991-4a5264f5d972-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:43:57 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-cbfb88d4-bd40-4590-b3cf-ee583c2e09e2 req-fedc90fd-ae89-4ab2-b33e-4e7fcea53287 service nova] Lock "902ed05f-84c3-40f2-a991-4a5264f5d972-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:43:57 user nova-compute[72362]: DEBUG nova.compute.manager [req-cbfb88d4-bd40-4590-b3cf-ee583c2e09e2 req-fedc90fd-ae89-4ab2-b33e-4e7fcea53287 service nova] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] No waiting events found dispatching network-vif-plugged-cb19a9db-8c08-4ae0-b7ec-7dda0b276718 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:43:57 user nova-compute[72362]: WARNING nova.compute.manager [req-cbfb88d4-bd40-4590-b3cf-ee583c2e09e2 req-fedc90fd-ae89-4ab2-b33e-4e7fcea53287 service nova] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Received unexpected event network-vif-plugged-cb19a9db-8c08-4ae0-b7ec-7dda0b276718 for instance with vm_state active and task_state deleting.
Aug 09 10:43:58 user nova-compute[72362]: INFO nova.compute.manager [None req-f25e5b7a-5f1b-43c0-8724-8726c4274383 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Took 0.73 seconds to detach 1 volumes for instance.
Aug 09 10:43:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f25e5b7a-5f1b-43c0-8724-8726c4274383 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:43:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f25e5b7a-5f1b-43c0-8724-8726c4274383 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:43:58 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-f25e5b7a-5f1b-43c0-8724-8726c4274383 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:43:58 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-f25e5b7a-5f1b-43c0-8724-8726c4274383 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:43:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f25e5b7a-5f1b-43c0-8724-8726c4274383 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.217s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:43:58 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-f25e5b7a-5f1b-43c0-8724-8726c4274383 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Deleted allocations for instance 902ed05f-84c3-40f2-a991-4a5264f5d972
Aug 09 10:43:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f25e5b7a-5f1b-43c0-8724-8726c4274383 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "902ed05f-84c3-40f2-a991-4a5264f5d972" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.112s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:43:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d8cb1aef-6248-45ef-8982-25dfaea7c0d5 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Acquiring lock "94aedd29-1832-4ff4-97ac-d70ed1775223" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:43:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d8cb1aef-6248-45ef-8982-25dfaea7c0d5 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "94aedd29-1832-4ff4-97ac-d70ed1775223" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:43:59 user nova-compute[72362]: INFO nova.compute.manager [None req-d8cb1aef-6248-45ef-8982-25dfaea7c0d5 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Detaching volume c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33
Aug 09 10:43:59 user nova-compute[72362]: INFO nova.virt.block_device [None req-d8cb1aef-6248-45ef-8982-25dfaea7c0d5 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Attempting to driver detach volume c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33 from mountpoint /dev/vdc
Aug 09 10:43:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-d8cb1aef-6248-45ef-8982-25dfaea7c0d5 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Attempting to detach device vdc from instance 94aedd29-1832-4ff4-97ac-d70ed1775223 from the persistent domain config. {{(pid=72362) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 10:43:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-d8cb1aef-6248-45ef-8982-25dfaea7c0d5 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 10:43:59 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:43:59 user nova-compute[72362]:   <source dev="/dev/sdc"/>
Aug 09 10:43:59 user nova-compute[72362]:   <target dev="vdc" bus="virtio"/>
Aug 09 10:43:59 user nova-compute[72362]:   <serial>c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33</serial>
Aug 09 10:43:59 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 10:43:59 user nova-compute[72362]: </disk>
Aug 09 10:43:59 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:43:59 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-d8cb1aef-6248-45ef-8982-25dfaea7c0d5 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Successfully detached device vdc from instance 94aedd29-1832-4ff4-97ac-d70ed1775223 from the persistent domain config.
Aug 09 10:43:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-d8cb1aef-6248-45ef-8982-25dfaea7c0d5 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 94aedd29-1832-4ff4-97ac-d70ed1775223 from the live domain config. {{(pid=72362) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 10:43:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-d8cb1aef-6248-45ef-8982-25dfaea7c0d5 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 10:43:59 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:43:59 user nova-compute[72362]:   <source dev="/dev/sdc"/>
Aug 09 10:43:59 user nova-compute[72362]:   <target dev="vdc" bus="virtio"/>
Aug 09 10:43:59 user nova-compute[72362]:   <serial>c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33</serial>
Aug 09 10:43:59 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 10:43:59 user nova-compute[72362]: </disk>
Aug 09 10:43:59 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:43:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Received event <DeviceRemovedEvent: 1691577839.6940324, 94aedd29-1832-4ff4-97ac-d70ed1775223 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72362) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 10:43:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-d8cb1aef-6248-45ef-8982-25dfaea7c0d5 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 94aedd29-1832-4ff4-97ac-d70ed1775223 {{(pid=72362) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 10:43:59 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-d8cb1aef-6248-45ef-8982-25dfaea7c0d5 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Successfully detached device vdc from instance 94aedd29-1832-4ff4-97ac-d70ed1775223 from the live domain config.
Aug 09 10:43:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8cb1aef-6248-45ef-8982-25dfaea7c0d5 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:43:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8cb1aef-6248-45ef-8982-25dfaea7c0d5 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pHcNtmnO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:43:59 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-d8cb1aef-6248-45ef-8982-25dfaea7c0d5 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:43:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-d8cb1aef-6248-45ef-8982-25dfaea7c0d5 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:43:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-d8cb1aef-6248-45ef-8982-25dfaea7c0d5 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:43:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8cb1aef-6248-45ef-8982-25dfaea7c0d5 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:43:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:43:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:43:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[345d853d-0e3f-40b3-a7ff-c4b3d9e5e69c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:43:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:43:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:43:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a436f762-5450-4e18-96ec-2bd0515274e1]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:43:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8cb1aef-6248-45ef-8982-25dfaea7c0d5 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33 (non-flash)
Aug 09 10:43:59 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:43:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8cb1aef-6248-45ef-8982-25dfaea7c0d5 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33 (non-flash)
Aug 09 10:43:59 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:43:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8cb1aef-6248-45ef-8982-25dfaea7c0d5 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e441b2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33'): ({'sdc'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:43:59 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-d8cb1aef-6248-45ef-8982-25dfaea7c0d5 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Removing single pathed devices sdc {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:43:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:43:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:43:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f38112c-efb5-4808-a4ae-1339cb7cb1e0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:43:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:43:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:43:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[2850ae17-8df4-47a1-8f3f-a12c06b9dbe7]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:43:59 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-d8cb1aef-6248-45ef-8982-25dfaea7c0d5 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Flushing IO for device /dev/sdc {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:43:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:43:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:43:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6b2762-113e-491e-9a75-26c458ba2aa4]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:43:59 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-d8cb1aef-6248-45ef-8982-25dfaea7c0d5 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:43:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:43:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:43:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6377d4-5a3e-4f87-8592-8d7817cdc6ef]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:43:59 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-d8cb1aef-6248-45ef-8982-25dfaea7c0d5 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:43:59 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-d8cb1aef-6248-45ef-8982-25dfaea7c0d5 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] SCSI volumes sdc have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:43:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8cb1aef-6248-45ef-8982-25dfaea7c0d5 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:43:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:43:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:43:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20b4a6c-b10c-4ab2-a970-df3e8054689e]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:43:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8cb1aef-6248-45ef-8982-25dfaea7c0d5 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:43:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33 -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:43:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:43:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9854fe5-7783-480a-97d4-f0299987cc3f]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:43:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8cb1aef-6248-45ef-8982-25dfaea7c0d5 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33, portal: 172.16.0.220,3260]
Aug 09 10:43:59 user nova-compute[72362]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33, portal: 172.16.0.220,3260] successful.
Aug 09 10:43:59 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:43:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33 -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:43:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4e0ceb8-fc45-4ba0-b3b9-6b923e6fda33 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:43:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2153ad5-44c7-4014-8413-eb23faed1b90]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:43:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8cb1aef-6248-45ef-8982-25dfaea7c0d5 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:43:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-d8cb1aef-6248-45ef-8982-25dfaea7c0d5 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.235s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:43:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8cb1aef-6248-45ef-8982-25dfaea7c0d5 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] <== disconnect_volume: return (236ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:43:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8cb1aef-6248-45ef-8982-25dfaea7c0d5 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:44:00 user nova-compute[72362]: DEBUG nova.objects.instance [None req-d8cb1aef-6248-45ef-8982-25dfaea7c0d5 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lazy-loading 'flavor' on Instance uuid 94aedd29-1832-4ff4-97ac-d70ed1775223 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:44:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d8cb1aef-6248-45ef-8982-25dfaea7c0d5 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "94aedd29-1832-4ff4-97ac-d70ed1775223" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.531s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:44:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:44:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:44:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:44:11 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691577836.2131634, 902ed05f-84c3-40f2-a991-4a5264f5d972 => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:44:11 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] VM Stopped (Lifecycle Event)
Aug 09 10:44:11 user nova-compute[72362]: DEBUG nova.compute.manager [None req-2ef40738-d599-497d-b1ea-e545f4315c19 None None] [instance: 902ed05f-84c3-40f2-a991-4a5264f5d972] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:44:11 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:44:13 user nova-compute[72362]: INFO nova.compute.manager [None req-1b97fbe7-1c29-4f83-bb10-1a6a76eaedd9 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Unrescuing
Aug 09 10:44:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1b97fbe7-1c29-4f83-bb10-1a6a76eaedd9 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Acquiring lock "refresh_cache-cefe383b-978f-4391-baf6-3b3ad17e0083" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:44:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1b97fbe7-1c29-4f83-bb10-1a6a76eaedd9 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Acquired lock "refresh_cache-cefe383b-978f-4391-baf6-3b3ad17e0083" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:44:13 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1b97fbe7-1c29-4f83-bb10-1a6a76eaedd9 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:44:14 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:44:14 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:44:14 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:44:14 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:44:14 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:44:14 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 10:44:14 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1b97fbe7-1c29-4f83-bb10-1a6a76eaedd9 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Updating instance_info_cache with network_info: [{"id": "1d14bbdf-8802-42b5-bd22-c6bd03a53761", "address": "fa:16:3e:fe:ee:4f", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d14bbdf-88", "ovs_interfaceid": "1d14bbdf-8802-42b5-bd22-c6bd03a53761", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:44:14 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1b97fbe7-1c29-4f83-bb10-1a6a76eaedd9 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Releasing lock "refresh_cache-cefe383b-978f-4391-baf6-3b3ad17e0083" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:44:14 user nova-compute[72362]: DEBUG nova.objects.instance [None req-1b97fbe7-1c29-4f83-bb10-1a6a76eaedd9 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lazy-loading 'flavor' on Instance uuid cefe383b-978f-4391-baf6-3b3ad17e0083 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:44:14 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:44:14 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:44:15 user nova-compute[72362]: DEBUG nova.compute.manager [req-d7cd688c-3996-4c6f-b3e8-f93f7b31e2c0 req-898b596b-1854-47f4-93c6-cbe0c35e08f9 service nova] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Received event network-vif-unplugged-1d14bbdf-8802-42b5-bd22-c6bd03a53761 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:44:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-d7cd688c-3996-4c6f-b3e8-f93f7b31e2c0 req-898b596b-1854-47f4-93c6-cbe0c35e08f9 service nova] Acquiring lock "cefe383b-978f-4391-baf6-3b3ad17e0083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:44:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-d7cd688c-3996-4c6f-b3e8-f93f7b31e2c0 req-898b596b-1854-47f4-93c6-cbe0c35e08f9 service nova] Lock "cefe383b-978f-4391-baf6-3b3ad17e0083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:44:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-d7cd688c-3996-4c6f-b3e8-f93f7b31e2c0 req-898b596b-1854-47f4-93c6-cbe0c35e08f9 service nova] Lock "cefe383b-978f-4391-baf6-3b3ad17e0083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:44:15 user nova-compute[72362]: DEBUG nova.compute.manager [req-d7cd688c-3996-4c6f-b3e8-f93f7b31e2c0 req-898b596b-1854-47f4-93c6-cbe0c35e08f9 service nova] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] No waiting events found dispatching network-vif-unplugged-1d14bbdf-8802-42b5-bd22-c6bd03a53761 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:44:15 user nova-compute[72362]: WARNING nova.compute.manager [req-d7cd688c-3996-4c6f-b3e8-f93f7b31e2c0 req-898b596b-1854-47f4-93c6-cbe0c35e08f9 service nova] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Received unexpected event network-vif-unplugged-1d14bbdf-8802-42b5-bd22-c6bd03a53761 for instance with vm_state rescued and task_state unrescuing.
Aug 09 10:44:15 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:44:15 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:44:15 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Instance destroyed successfully.
Aug 09 10:44:15 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:44:15 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 10:44:15 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Rebuilding the list of instances to heal {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 10:44:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "refresh_cache-cefe383b-978f-4391-baf6-3b3ad17e0083" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:44:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquired lock "refresh_cache-cefe383b-978f-4391-baf6-3b3ad17e0083" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:44:16 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Forcefully refreshing network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 10:44:16 user nova-compute[72362]: DEBUG nova.objects.instance [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lazy-loading 'info_cache' on Instance uuid cefe383b-978f-4391-baf6-3b3ad17e0083 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:44:16 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:44:16 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Updating instance_info_cache with network_info: [{"id": "1d14bbdf-8802-42b5-bd22-c6bd03a53761", "address": "fa:16:3e:fe:ee:4f", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d14bbdf-88", "ovs_interfaceid": "1d14bbdf-8802-42b5-bd22-c6bd03a53761", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:44:16 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Releasing lock "refresh_cache-cefe383b-978f-4391-baf6-3b3ad17e0083" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:44:16 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Updated the network info_cache for instance {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 10:44:16 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:44:16 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:44:16 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:44:16 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:44:16 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:44:16 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:44:17 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:44:17 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:44:17 user nova-compute[72362]: DEBUG nova.compute.manager [req-6cb8b609-bdf4-4465-bd14-cf19863b01d7 req-90764bd2-6ca7-4614-ad7d-ebdb66d79644 service nova] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Received event network-vif-plugged-1d14bbdf-8802-42b5-bd22-c6bd03a53761 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:44:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-6cb8b609-bdf4-4465-bd14-cf19863b01d7 req-90764bd2-6ca7-4614-ad7d-ebdb66d79644 service nova] Acquiring lock "cefe383b-978f-4391-baf6-3b3ad17e0083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:44:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-6cb8b609-bdf4-4465-bd14-cf19863b01d7 req-90764bd2-6ca7-4614-ad7d-ebdb66d79644 service nova] Lock "cefe383b-978f-4391-baf6-3b3ad17e0083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:44:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-6cb8b609-bdf4-4465-bd14-cf19863b01d7 req-90764bd2-6ca7-4614-ad7d-ebdb66d79644 service nova] Lock "cefe383b-978f-4391-baf6-3b3ad17e0083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:44:17 user nova-compute[72362]: DEBUG nova.compute.manager [req-6cb8b609-bdf4-4465-bd14-cf19863b01d7 req-90764bd2-6ca7-4614-ad7d-ebdb66d79644 service nova] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] No waiting events found dispatching network-vif-plugged-1d14bbdf-8802-42b5-bd22-c6bd03a53761 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:44:17 user nova-compute[72362]: WARNING nova.compute.manager [req-6cb8b609-bdf4-4465-bd14-cf19863b01d7 req-90764bd2-6ca7-4614-ad7d-ebdb66d79644 service nova] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Received unexpected event network-vif-plugged-1d14bbdf-8802-42b5-bd22-c6bd03a53761 for instance with vm_state rescued and task_state unrescuing.
Aug 09 10:44:17 user nova-compute[72362]: DEBUG nova.compute.manager [req-6cb8b609-bdf4-4465-bd14-cf19863b01d7 req-90764bd2-6ca7-4614-ad7d-ebdb66d79644 service nova] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Received event network-vif-plugged-1d14bbdf-8802-42b5-bd22-c6bd03a53761 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:44:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-6cb8b609-bdf4-4465-bd14-cf19863b01d7 req-90764bd2-6ca7-4614-ad7d-ebdb66d79644 service nova] Acquiring lock "cefe383b-978f-4391-baf6-3b3ad17e0083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:44:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-6cb8b609-bdf4-4465-bd14-cf19863b01d7 req-90764bd2-6ca7-4614-ad7d-ebdb66d79644 service nova] Lock "cefe383b-978f-4391-baf6-3b3ad17e0083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:44:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-6cb8b609-bdf4-4465-bd14-cf19863b01d7 req-90764bd2-6ca7-4614-ad7d-ebdb66d79644 service nova] Lock "cefe383b-978f-4391-baf6-3b3ad17e0083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:44:17 user nova-compute[72362]: DEBUG nova.compute.manager [req-6cb8b609-bdf4-4465-bd14-cf19863b01d7 req-90764bd2-6ca7-4614-ad7d-ebdb66d79644 service nova] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] No waiting events found dispatching network-vif-plugged-1d14bbdf-8802-42b5-bd22-c6bd03a53761 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:44:17 user nova-compute[72362]: WARNING nova.compute.manager [req-6cb8b609-bdf4-4465-bd14-cf19863b01d7 req-90764bd2-6ca7-4614-ad7d-ebdb66d79644 service nova] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Received unexpected event network-vif-plugged-1d14bbdf-8802-42b5-bd22-c6bd03a53761 for instance with vm_state rescued and task_state unrescuing.
Aug 09 10:44:17 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:44:18 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Removed pending event for cefe383b-978f-4391-baf6-3b3ad17e0083 due to event {{(pid=72362) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 10:44:18 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577858.902578, cefe383b-978f-4391-baf6-3b3ad17e0083 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:44:18 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] VM Resumed (Lifecycle Event)
Aug 09 10:44:18 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1b97fbe7-1c29-4f83-bb10-1a6a76eaedd9 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:44:18 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:44:18 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:44:18 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 09 10:44:18 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577858.9048016, cefe383b-978f-4391-baf6-3b3ad17e0083 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:44:18 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] VM Started (Lifecycle Event)
Aug 09 10:44:18 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:44:18 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:44:19 user nova-compute[72362]: DEBUG nova.compute.manager [req-4b208763-b10b-490c-870d-61e45cbc1938 req-5dbab9cc-9583-44ba-bab7-0420e2eba70a service nova] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Received event network-vif-plugged-1d14bbdf-8802-42b5-bd22-c6bd03a53761 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:44:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-4b208763-b10b-490c-870d-61e45cbc1938 req-5dbab9cc-9583-44ba-bab7-0420e2eba70a service nova] Acquiring lock "cefe383b-978f-4391-baf6-3b3ad17e0083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:44:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-4b208763-b10b-490c-870d-61e45cbc1938 req-5dbab9cc-9583-44ba-bab7-0420e2eba70a service nova] Lock "cefe383b-978f-4391-baf6-3b3ad17e0083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:44:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-4b208763-b10b-490c-870d-61e45cbc1938 req-5dbab9cc-9583-44ba-bab7-0420e2eba70a service nova] Lock "cefe383b-978f-4391-baf6-3b3ad17e0083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:44:19 user nova-compute[72362]: DEBUG nova.compute.manager [req-4b208763-b10b-490c-870d-61e45cbc1938 req-5dbab9cc-9583-44ba-bab7-0420e2eba70a service nova] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] No waiting events found dispatching network-vif-plugged-1d14bbdf-8802-42b5-bd22-c6bd03a53761 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:44:19 user nova-compute[72362]: WARNING nova.compute.manager [req-4b208763-b10b-490c-870d-61e45cbc1938 req-5dbab9cc-9583-44ba-bab7-0420e2eba70a service nova] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Received unexpected event network-vif-plugged-1d14bbdf-8802-42b5-bd22-c6bd03a53761 for instance with vm_state active and task_state None.
Aug 09 10:44:21 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:44:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:44:22 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:44:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:44:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:44:23 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:44:23 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 10:44:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f4a735-db06-4ad9-81f8-1863330628f9/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:44:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f4a735-db06-4ad9-81f8-1863330628f9/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:44:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f4a735-db06-4ad9-81f8-1863330628f9/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:44:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f4a735-db06-4ad9-81f8-1863330628f9/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:44:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:44:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:44:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:44:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:44:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94aedd29-1832-4ff4-97ac-d70ed1775223/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:44:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94aedd29-1832-4ff4-97ac-d70ed1775223/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:44:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94aedd29-1832-4ff4-97ac-d70ed1775223/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:44:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94aedd29-1832-4ff4-97ac-d70ed1775223/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:44:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:44:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:44:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:44:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:44:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:44:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:44:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:44:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:44:24 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:44:24 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:44:24 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=8462MB free_disk=25.065635681152344GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 10:44:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:44:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:44:25 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance cefe383b-978f-4391-baf6-3b3ad17e0083 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:44:25 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 4296ca4c-1e3e-474f-98ba-9f947d333b8d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:44:25 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 94aedd29-1832-4ff4-97ac-d70ed1775223 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:44:25 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 37f4a735-db06-4ad9-81f8-1863330628f9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:44:25 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 10:44:25 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 10:44:25 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:44:25 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:44:25 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 10:44:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.278s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:44:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:44:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:44:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:44:34 user nova-compute[72362]: DEBUG nova.compute.manager [req-2041733e-81d1-4940-91d4-3a972249050d req-b9ef6089-e8b3-42f9-9a7f-6d4208a296d2 service nova] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Received event network-changed-0befdbb1-af32-4c72-880c-7cff448a3870 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:44:34 user nova-compute[72362]: DEBUG nova.compute.manager [req-2041733e-81d1-4940-91d4-3a972249050d req-b9ef6089-e8b3-42f9-9a7f-6d4208a296d2 service nova] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Refreshing instance network info cache due to event network-changed-0befdbb1-af32-4c72-880c-7cff448a3870. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:44:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-2041733e-81d1-4940-91d4-3a972249050d req-b9ef6089-e8b3-42f9-9a7f-6d4208a296d2 service nova] Acquiring lock "refresh_cache-37f4a735-db06-4ad9-81f8-1863330628f9" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:44:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-2041733e-81d1-4940-91d4-3a972249050d req-b9ef6089-e8b3-42f9-9a7f-6d4208a296d2 service nova] Acquired lock "refresh_cache-37f4a735-db06-4ad9-81f8-1863330628f9" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:44:34 user nova-compute[72362]: DEBUG nova.network.neutron [req-2041733e-81d1-4940-91d4-3a972249050d req-b9ef6089-e8b3-42f9-9a7f-6d4208a296d2 service nova] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Refreshing network info cache for port 0befdbb1-af32-4c72-880c-7cff448a3870 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:44:35 user nova-compute[72362]: DEBUG nova.network.neutron [req-2041733e-81d1-4940-91d4-3a972249050d req-b9ef6089-e8b3-42f9-9a7f-6d4208a296d2 service nova] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Updated VIF entry in instance network info cache for port 0befdbb1-af32-4c72-880c-7cff448a3870. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:44:35 user nova-compute[72362]: DEBUG nova.network.neutron [req-2041733e-81d1-4940-91d4-3a972249050d req-b9ef6089-e8b3-42f9-9a7f-6d4208a296d2 service nova] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Updating instance_info_cache with network_info: [{"id": "0befdbb1-af32-4c72-880c-7cff448a3870", "address": "fa:16:3e:86:29:60", "network": {"id": "e56e2a0a-0a6d-4546-86ef-7bb333e829ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1495216341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980f1c36cab0449b949419cf495c16d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0befdbb1-af", "ovs_interfaceid": "0befdbb1-af32-4c72-880c-7cff448a3870", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:44:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-2041733e-81d1-4940-91d4-3a972249050d req-b9ef6089-e8b3-42f9-9a7f-6d4208a296d2 service nova] Releasing lock "refresh_cache-37f4a735-db06-4ad9-81f8-1863330628f9" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:44:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:44:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:44:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "37f4a735-db06-4ad9-81f8-1863330628f9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:44:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "37f4a735-db06-4ad9-81f8-1863330628f9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:44:38 user nova-compute[72362]: DEBUG nova.objects.instance [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lazy-loading 'flavor' on Instance uuid 37f4a735-db06-4ad9-81f8-1863330628f9 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:44:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "37f4a735-db06-4ad9-81f8-1863330628f9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:44:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "37f4a735-db06-4ad9-81f8-1863330628f9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:44:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "37f4a735-db06-4ad9-81f8-1863330628f9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:44:38 user nova-compute[72362]: INFO nova.compute.manager [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Attaching volume 49fa878b-fd74-4645-922e-474083245ae9 to /dev/vdb
Aug 09 10:44:38 user nova-compute[72362]: DEBUG os_brick.utils [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:44:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:44:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:44:38 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca64f24-6a22-4343-ac39-3c188dfb4560]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:44:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:44:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:44:38 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[276bcbaf-d86c-43ae-9924-915195e7400d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:44:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:44:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:44:38 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24f7e10-f938-4f51-8295-85a46010c99d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:44:38 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[522c4173-b519-4d29-bac4-9921264c42e9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:44:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:44:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:44:38 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:44:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:44:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:44:38 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:44:38 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[8167078d-8c24-4148-9132-8b45d2ed99e9]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:44:38 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:44:38 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:44:38 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:44:38 user nova-compute[72362]: DEBUG os_brick.utils [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:44:38 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Updating existing volume attachment record: 6562308a-9a21-424b-a9a7-b6f46ec85707 {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 10:44:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:44:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:44:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:44:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:44:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:49fa878b-fd74-4645-922e-474083245ae9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hgKsfUAH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:44:46 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:44:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:44:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:44:46 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:44:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49fa878b-fd74-4645-922e-474083245ae9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:44:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49fa878b-fd74-4645-922e-474083245ae9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:44:46 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:44:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49fa878b-fd74-4645-922e-474083245ae9 -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:44:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49fa878b-fd74-4645-922e-474083245ae9 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:44:46 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[496cdcf0-cfc3-4d96-91be-95c7b3ae4fed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:44:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:44:46 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:44:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49fa878b-fd74-4645-922e-474083245ae9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:44:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49fa878b-fd74-4645-922e-474083245ae9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:44:46 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[841dc129-5006-47c9-91f8-73729fa0982d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49fa878b-fd74-4645-922e-474083245ae9] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:44:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49fa878b-fd74-4645-922e-474083245ae9] added
Aug 09 10:44:46 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:44:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49fa878b-fd74-4645-922e-474083245ae9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:44:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49fa878b-fd74-4645-922e-474083245ae9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:44:46 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f70e784-d309-4d60-a3a0-2377a849493f]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:44:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:44:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49fa878b-fd74-4645-922e-474083245ae9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:44:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49fa878b-fd74-4645-922e-474083245ae9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:44:46 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0780d600-d357-47f9-8c5b-23d2891dcb2a]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:44:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:44:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49fa878b-fd74-4645-922e-474083245ae9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hgKsfUAH {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:44:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49fa878b-fd74-4645-922e-474083245ae9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hgKsfUAH" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:44:46 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[55dd013a-1fac-4247-b07c-0581ed836ff4]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:44:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hgKsfUAH'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:44:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49fa878b-fd74-4645-922e-474083245ae9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:44:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49fa878b-fd74-4645-922e-474083245ae9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:44:46 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e2acea-71f7-4c93-907d-240880c2e9c0]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:44:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:44:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:44:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:44:46 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[8444d299-da0f-43b7-9826-38d29a562550]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:44:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 10:44:46 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:44:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 10:44:46 user nova-compute[72362]:  {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:44:46 user nova-compute[72362]: WARNING os_brick.initiator.connectors.iscsi [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 10:44:46 user nova-compute[72362]: 
Aug 09 10:44:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49fa878b-fd74-4645-922e-474083245ae9 -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:44:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49fa878b-fd74-4645-922e-474083245ae9 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:44:46 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[23199149-8589-44fc-aefa-450b5515c918]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:49fa878b-fd74-4645-922e-474083245ae9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:49fa878b-fd74-4645-922e-474083245ae9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:44:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:49fa878b-fd74-4645-922e-474083245ae9, portal: 172.16.0.220,3260]
Aug 09 10:44:46 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:49fa878b-fd74-4645-922e-474083245ae9, portal: 172.16.0.220,3260] successful.
Aug 09 10:44:46 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:44:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49fa878b-fd74-4645-922e-474083245ae9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:44:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49fa878b-fd74-4645-922e-474083245ae9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:44:46 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64cc45d-a60a-4763-b8c7-3de3e470a340]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:44:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:44:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:44:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:44:46 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc6f801-93ac-413d-9187-8d85df30e269]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49fa878b-fd74-4645-922e-474083245ae9 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:44:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49fa878b-fd74-4645-922e-474083245ae9 (non-flash)
Aug 09 10:44:46 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:44:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49fa878b-fd74-4645-922e-474083245ae9 (non-flash)
Aug 09 10:44:46 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:44:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49fa878b-fd74-4645-922e-474083245ae9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:44:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:44:46 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:44:46 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:44:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:44:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:44:46 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[420ac6ef-f2c4-41f3-ae75-01869d16816b]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:44:46 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: None {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:44:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "ab34d860-52ba-4773-9f80-84930bbd06d0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:44:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "ab34d860-52ba-4773-9f80-84930bbd06d0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:44:47 user nova-compute[72362]: DEBUG nova.compute.manager [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Starting instance... {{(pid=72362) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 10:44:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:44:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:44:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:44:47 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:44:47 user nova-compute[72362]: INFO nova.compute.claims [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Claim successful on node user
Aug 09 10:44:47 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:44:47 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:44:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.264s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:44:47 user nova-compute[72362]: DEBUG nova.compute.manager [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Start building networks asynchronously for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 10:44:47 user nova-compute[72362]: DEBUG nova.compute.manager [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Allocating IP information in the background. {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 10:44:47 user nova-compute[72362]: DEBUG nova.network.neutron [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] allocate_for_instance() {{(pid=72362) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 10:44:47 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 10:44:47 user nova-compute[72362]: DEBUG nova.compute.manager [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Start building block device mappings for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 10:44:47 user nova-compute[72362]: INFO nova.virt.block_device [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Booting with volume b13e9f29-5849-486f-b75a-9520443d9135 at /dev/vda
Aug 09 10:44:47 user nova-compute[72362]: DEBUG nova.policy [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e96900e953f64d02bdb5d48f136133c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e38599de0b4b06b723f5647a7fe121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72362) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 10:44:47 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:44:47 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hgKsfUAH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:44:47 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:44:47 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '23331656166666465', 'path': '/dev/sdb'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:44:47 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23331656166666465', 'path': '/dev/sdb'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:44:47 user nova-compute[72362]: DEBUG nova.objects.instance [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lazy-loading 'flavor' on Instance uuid 37f4a735-db06-4ad9-81f8-1863330628f9 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:44:47 user nova-compute[72362]: DEBUG os_brick.utils [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:44:47 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 10:44:47 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:44:47 user nova-compute[72362]:   <source dev="/dev/sdb"/>
Aug 09 10:44:47 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:44:47 user nova-compute[72362]:   <serial>49fa878b-fd74-4645-922e-474083245ae9</serial>
Aug 09 10:44:47 user nova-compute[72362]: </disk>
Aug 09 10:44:47 user nova-compute[72362]:  {{(pid=72362) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 10:44:47 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:44:47 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:44:47 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa00849-48d8-4df7-bd0f-dece7612ec1b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:44:47 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:44:47 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:44:47 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ab87df-fbb0-4965-9bc8-10bcfe7f359d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:44:47 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:44:47 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:44:47 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c351e7-73c8-4e45-98de-b77c4826d1e9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:44:47 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e984ff0e-3206-45a9-9008-ebbcc1d537ea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:44:47 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:44:47 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:44:47 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:44:47 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:44:47 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:44:47 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:44:47 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[359bf2a5-5e22-49be-a52d-d30b38b9b7b1]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:44:47 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:44:47 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:44:47 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:44:47 user nova-compute[72362]: DEBUG os_brick.utils [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:44:47 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Updating existing volume attachment record: 6881ca38-6694-4226-bea2-be352f886423 {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 10:44:48 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:44:48 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:44:48 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] No VIF found with MAC fa:16:3e:86:29:60, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:44:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-a40f8d80-60d7-4a3d-93c9-1ce54ef3b54e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "37f4a735-db06-4ad9-81f8-1863330628f9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.820s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:44:48 user nova-compute[72362]: DEBUG nova.network.neutron [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Successfully created port: 221b0dc3-ded0-4875-8396-51d6013e2aea {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:44:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-93fd9b12-8032-448c-9337-3da46fb630e7 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "37f4a735-db06-4ad9-81f8-1863330628f9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:44:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-93fd9b12-8032-448c-9337-3da46fb630e7 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "37f4a735-db06-4ad9-81f8-1863330628f9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:44:48 user nova-compute[72362]: INFO nova.compute.manager [None req-93fd9b12-8032-448c-9337-3da46fb630e7 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Detaching volume 49fa878b-fd74-4645-922e-474083245ae9
Aug 09 10:44:48 user nova-compute[72362]: INFO nova.virt.block_device [None req-93fd9b12-8032-448c-9337-3da46fb630e7 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Attempting to driver detach volume 49fa878b-fd74-4645-922e-474083245ae9 from mountpoint /dev/vdb
Aug 09 10:44:48 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-93fd9b12-8032-448c-9337-3da46fb630e7 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Attempting to detach device vdb from instance 37f4a735-db06-4ad9-81f8-1863330628f9 from the persistent domain config. {{(pid=72362) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 10:44:48 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-93fd9b12-8032-448c-9337-3da46fb630e7 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 10:44:48 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:44:48 user nova-compute[72362]:   <source dev="/dev/sdb"/>
Aug 09 10:44:48 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:44:48 user nova-compute[72362]:   <serial>49fa878b-fd74-4645-922e-474083245ae9</serial>
Aug 09 10:44:48 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 10:44:48 user nova-compute[72362]: </disk>
Aug 09 10:44:48 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:44:48 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-93fd9b12-8032-448c-9337-3da46fb630e7 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Successfully detached device vdb from instance 37f4a735-db06-4ad9-81f8-1863330628f9 from the persistent domain config.
Aug 09 10:44:48 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-93fd9b12-8032-448c-9337-3da46fb630e7 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 37f4a735-db06-4ad9-81f8-1863330628f9 from the live domain config. {{(pid=72362) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 10:44:48 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-93fd9b12-8032-448c-9337-3da46fb630e7 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 10:44:48 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:44:48 user nova-compute[72362]:   <source dev="/dev/sdb"/>
Aug 09 10:44:48 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:44:48 user nova-compute[72362]:   <serial>49fa878b-fd74-4645-922e-474083245ae9</serial>
Aug 09 10:44:48 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 10:44:48 user nova-compute[72362]: </disk>
Aug 09 10:44:48 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG nova.network.neutron [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Successfully updated port: 221b0dc3-ded0-4875-8396-51d6013e2aea {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "refresh_cache-ab34d860-52ba-4773-9f80-84930bbd06d0" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquired lock "refresh_cache-ab34d860-52ba-4773-9f80-84930bbd06d0" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG nova.network.neutron [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG nova.compute.manager [req-98714eea-bfa3-4260-a42e-d9288e594ec6 req-1191b21f-2ff8-4e2c-bc11-c21650327461 service nova] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Received event network-changed-221b0dc3-ded0-4875-8396-51d6013e2aea {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG nova.compute.manager [req-98714eea-bfa3-4260-a42e-d9288e594ec6 req-1191b21f-2ff8-4e2c-bc11-c21650327461 service nova] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Refreshing instance network info cache due to event network-changed-221b0dc3-ded0-4875-8396-51d6013e2aea. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-98714eea-bfa3-4260-a42e-d9288e594ec6 req-1191b21f-2ff8-4e2c-bc11-c21650327461 service nova] Acquiring lock "refresh_cache-ab34d860-52ba-4773-9f80-84930bbd06d0" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG nova.network.neutron [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Received event <DeviceRemovedEvent: 1691577889.4199517, 37f4a735-db06-4ad9-81f8-1863330628f9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72362) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-93fd9b12-8032-448c-9337-3da46fb630e7 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 37f4a735-db06-4ad9-81f8-1863330628f9 {{(pid=72362) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 10:44:49 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-93fd9b12-8032-448c-9337-3da46fb630e7 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Successfully detached device vdb from instance 37f4a735-db06-4ad9-81f8-1863330628f9 from the live domain config.
Aug 09 10:44:49 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93fd9b12-8032-448c-9337-3da46fb630e7 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-93fd9b12-8032-448c-9337-3da46fb630e7 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:49fa878b-fd74-4645-922e-474083245ae9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hgKsfUAH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:44:49 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-93fd9b12-8032-448c-9337-3da46fb630e7 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:44:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-93fd9b12-8032-448c-9337-3da46fb630e7 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-93fd9b12-8032-448c-9337-3da46fb630e7 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-93fd9b12-8032-448c-9337-3da46fb630e7 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49fa878b-fd74-4645-922e-474083245ae9', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51fafe8-5ff6-43a7-b85d-b6f3f8fd0338]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49fa878b-fd74-4645-922e-474083245ae9\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[11359900-e1fd-43da-abfb-f020e32f27c7]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49fa878b-fd74-4645-922e-474083245ae9 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-93fd9b12-8032-448c-9337-3da46fb630e7 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49fa878b-fd74-4645-922e-474083245ae9 (non-flash)
Aug 09 10:44:49 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-93fd9b12-8032-448c-9337-3da46fb630e7 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49fa878b-fd74-4645-922e-474083245ae9 (non-flash)
Aug 09 10:44:49 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-93fd9b12-8032-448c-9337-3da46fb630e7 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e441b640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49fa878b-fd74-4645-922e-474083245ae9'): ({'sdb'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-93fd9b12-8032-448c-9337-3da46fb630e7 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Removing single pathed devices sdb {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-fea9331a-3654-454d-942c-af59cff7cbaf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Acquiring lock "94aedd29-1832-4ff4-97ac-d70ed1775223" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-fea9331a-3654-454d-942c-af59cff7cbaf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "94aedd29-1832-4ff4-97ac-d70ed1775223" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-fea9331a-3654-454d-942c-af59cff7cbaf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Acquiring lock "94aedd29-1832-4ff4-97ac-d70ed1775223-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-fea9331a-3654-454d-942c-af59cff7cbaf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "94aedd29-1832-4ff4-97ac-d70ed1775223-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-fea9331a-3654-454d-942c-af59cff7cbaf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "94aedd29-1832-4ff4-97ac-d70ed1775223-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:44:49 user nova-compute[72362]: INFO nova.compute.manager [None req-fea9331a-3654-454d-942c-af59cff7cbaf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Terminating instance
Aug 09 10:44:49 user nova-compute[72362]: DEBUG nova.compute.manager [None req-fea9331a-3654-454d-942c-af59cff7cbaf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Start destroying the instance on the hypervisor. {{(pid=72362) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd94789-885c-4379-aa40-9b1deba3dd11]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6b68ba-6101-447e-aad4-91e450c5dc31]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-93fd9b12-8032-448c-9337-3da46fb630e7 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Flushing IO for device /dev/sdb {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c65f875-4a45-4b64-b121-f29393cd0b9c]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-93fd9b12-8032-448c-9337-3da46fb630e7 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dee6cec-ab79-4d9e-a2b1-8d98f78f18e3]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-93fd9b12-8032-448c-9337-3da46fb630e7 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-93fd9b12-8032-448c-9337-3da46fb630e7 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] SCSI volumes sdb have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-93fd9b12-8032-448c-9337-3da46fb630e7 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49fa878b-fd74-4645-922e-474083245ae9')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49fa878b-fd74-4645-922e-474083245ae9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49fa878b-fd74-4645-922e-474083245ae9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d2d064-cf3f-4c8b-b682-47b3df4eff44]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-93fd9b12-8032-448c-9337-3da46fb630e7 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49fa878b-fd74-4645-922e-474083245ae9 -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49fa878b-fd74-4645-922e-474083245ae9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e76ca5-474f-4ce7-8d1f-af0f54923d98]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:49fa878b-fd74-4645-922e-474083245ae9, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:49fa878b-fd74-4645-922e-474083245ae9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-93fd9b12-8032-448c-9337-3da46fb630e7 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:49fa878b-fd74-4645-922e-474083245ae9, portal: 172.16.0.220,3260]
Aug 09 10:44:49 user nova-compute[72362]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:49fa878b-fd74-4645-922e-474083245ae9, portal: 172.16.0.220,3260] successful.
Aug 09 10:44:49 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49fa878b-fd74-4645-922e-474083245ae9 -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49fa878b-fd74-4645-922e-474083245ae9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce484c6e-0386-4143-878e-e0bee8147de9]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-93fd9b12-8032-448c-9337-3da46fb630e7 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-93fd9b12-8032-448c-9337-3da46fb630e7 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-93fd9b12-8032-448c-9337-3da46fb630e7 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] <== disconnect_volume: return (293ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93fd9b12-8032-448c-9337-3da46fb630e7 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG nova.compute.manager [req-872db667-a6e3-4e70-b370-75345a1ab35f req-26693bf9-a7e7-4418-b11c-8130b72885b4 service nova] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Received event network-vif-unplugged-1a21fab7-2746-481c-8003-5f8e6d67ea2a {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-872db667-a6e3-4e70-b370-75345a1ab35f req-26693bf9-a7e7-4418-b11c-8130b72885b4 service nova] Acquiring lock "94aedd29-1832-4ff4-97ac-d70ed1775223-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-872db667-a6e3-4e70-b370-75345a1ab35f req-26693bf9-a7e7-4418-b11c-8130b72885b4 service nova] Lock "94aedd29-1832-4ff4-97ac-d70ed1775223-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-872db667-a6e3-4e70-b370-75345a1ab35f req-26693bf9-a7e7-4418-b11c-8130b72885b4 service nova] Lock "94aedd29-1832-4ff4-97ac-d70ed1775223-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG nova.compute.manager [req-872db667-a6e3-4e70-b370-75345a1ab35f req-26693bf9-a7e7-4418-b11c-8130b72885b4 service nova] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] No waiting events found dispatching network-vif-unplugged-1a21fab7-2746-481c-8003-5f8e6d67ea2a {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG nova.compute.manager [req-872db667-a6e3-4e70-b370-75345a1ab35f req-26693bf9-a7e7-4418-b11c-8130b72885b4 service nova] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Received event network-vif-unplugged-1a21fab7-2746-481c-8003-5f8e6d67ea2a for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG nova.network.neutron [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Updating instance_info_cache with network_info: [{"id": "221b0dc3-ded0-4875-8396-51d6013e2aea", "address": "fa:16:3e:af:d6:64", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap221b0dc3-de", "ovs_interfaceid": "221b0dc3-ded0-4875-8396-51d6013e2aea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Releasing lock "refresh_cache-ab34d860-52ba-4773-9f80-84930bbd06d0" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG nova.compute.manager [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Instance network_info: |[{"id": "221b0dc3-ded0-4875-8396-51d6013e2aea", "address": "fa:16:3e:af:d6:64", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap221b0dc3-de", "ovs_interfaceid": "221b0dc3-ded0-4875-8396-51d6013e2aea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-98714eea-bfa3-4260-a42e-d9288e594ec6 req-1191b21f-2ff8-4e2c-bc11-c21650327461 service nova] Acquired lock "refresh_cache-ab34d860-52ba-4773-9f80-84930bbd06d0" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:44:49 user nova-compute[72362]: DEBUG nova.network.neutron [req-98714eea-bfa3-4260-a42e-d9288e594ec6 req-1191b21f-2ff8-4e2c-bc11-c21650327461 service nova] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Refreshing network info cache for port 221b0dc3-ded0-4875-8396-51d6013e2aea {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:44:50 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:44:50 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Instance destroyed successfully.
Aug 09 10:44:50 user nova-compute[72362]: DEBUG nova.objects.instance [None req-fea9331a-3654-454d-942c-af59cff7cbaf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lazy-loading 'resources' on Instance uuid 94aedd29-1832-4ff4-97ac-d70ed1775223 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:44:50 user nova-compute[72362]: DEBUG nova.network.neutron [req-98714eea-bfa3-4260-a42e-d9288e594ec6 req-1191b21f-2ff8-4e2c-bc11-c21650327461 service nova] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Updated VIF entry in instance network info cache for port 221b0dc3-ded0-4875-8396-51d6013e2aea. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:44:50 user nova-compute[72362]: DEBUG nova.network.neutron [req-98714eea-bfa3-4260-a42e-d9288e594ec6 req-1191b21f-2ff8-4e2c-bc11-c21650327461 service nova] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Updating instance_info_cache with network_info: [{"id": "221b0dc3-ded0-4875-8396-51d6013e2aea", "address": "fa:16:3e:af:d6:64", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap221b0dc3-de", "ovs_interfaceid": "221b0dc3-ded0-4875-8396-51d6013e2aea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:44:50 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-fea9331a-3654-454d-942c-af59cff7cbaf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T10:38:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-45479132',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-45479132',id=42,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4gqGqKEyEBtLFKXkQToz6Rf8n6KOiXPf3Pmm/FZvG/oFNArAk44bhIJ9jkn8xdUjvGEiVns4+ZB/U94N22x6mMs9rGyVQqC5j4GuVj1X/qyx9a2pFKko3raRd0CBAUyg==',key_name='tempest-keypair-631856663',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:42:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f9d6a60f24d41deb91ae59189c62ba2',ramdisk_id='',reservation_id='r-qaaj0twi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2139825844',owner_user_name='tempest-AttachVolumeShelveTestJSON-2139825844-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:42:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='299166afe21b4d3cac05fdb072a78a78',uuid=94aedd29-1832-4ff4-97ac-d70ed1775223,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1a21fab7-2746-481c-8003-5f8e6d67ea2a", "address": "fa:16:3e:15:9c:15", "network": {"id": "362446ea-173c-4989-93f8-882088822208", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-499399633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f9d6a60f24d41deb91ae59189c62ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a21fab7-27", "ovs_interfaceid": "1a21fab7-2746-481c-8003-5f8e6d67ea2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:44:50 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-fea9331a-3654-454d-942c-af59cff7cbaf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Converting VIF {"id": "1a21fab7-2746-481c-8003-5f8e6d67ea2a", "address": "fa:16:3e:15:9c:15", "network": {"id": "362446ea-173c-4989-93f8-882088822208", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-499399633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f9d6a60f24d41deb91ae59189c62ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a21fab7-27", "ovs_interfaceid": "1a21fab7-2746-481c-8003-5f8e6d67ea2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:44:50 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-fea9331a-3654-454d-942c-af59cff7cbaf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:9c:15,bridge_name='br-int',has_traffic_filtering=True,id=1a21fab7-2746-481c-8003-5f8e6d67ea2a,network=Network(362446ea-173c-4989-93f8-882088822208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a21fab7-27') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:44:50 user nova-compute[72362]: DEBUG os_vif [None req-fea9331a-3654-454d-942c-af59cff7cbaf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:9c:15,bridge_name='br-int',has_traffic_filtering=True,id=1a21fab7-2746-481c-8003-5f8e6d67ea2a,network=Network(362446ea-173c-4989-93f8-882088822208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a21fab7-27') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:44:50 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:44:50 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1a21fab7-27, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:44:50 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:44:50 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-98714eea-bfa3-4260-a42e-d9288e594ec6 req-1191b21f-2ff8-4e2c-bc11-c21650327461 service nova] Releasing lock "refresh_cache-ab34d860-52ba-4773-9f80-84930bbd06d0" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:44:50 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:44:50 user nova-compute[72362]: INFO os_vif [None req-fea9331a-3654-454d-942c-af59cff7cbaf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:9c:15,bridge_name='br-int',has_traffic_filtering=True,id=1a21fab7-2746-481c-8003-5f8e6d67ea2a,network=Network(362446ea-173c-4989-93f8-882088822208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a21fab7-27')
Aug 09 10:44:50 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-fea9331a-3654-454d-942c-af59cff7cbaf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Deleting instance files /opt/stack/data/nova/instances/94aedd29-1832-4ff4-97ac-d70ed1775223_del
Aug 09 10:44:50 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-fea9331a-3654-454d-942c-af59cff7cbaf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Deletion of /opt/stack/data/nova/instances/94aedd29-1832-4ff4-97ac-d70ed1775223_del complete
Aug 09 10:44:50 user nova-compute[72362]: INFO nova.compute.manager [None req-fea9331a-3654-454d-942c-af59cff7cbaf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 09 10:44:50 user nova-compute[72362]: DEBUG oslo.service.loopingcall [None req-fea9331a-3654-454d-942c-af59cff7cbaf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72362) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 10:44:50 user nova-compute[72362]: DEBUG nova.compute.manager [-] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Deallocating network for instance {{(pid=72362) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 10:44:50 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] deallocate_for_instance() {{(pid=72362) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 10:44:50 user nova-compute[72362]: DEBUG nova.objects.instance [None req-93fd9b12-8032-448c-9337-3da46fb630e7 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lazy-loading 'flavor' on Instance uuid 37f4a735-db06-4ad9-81f8-1863330628f9 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:44:50 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-93fd9b12-8032-448c-9337-3da46fb630e7 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "37f4a735-db06-4ad9-81f8-1863330628f9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.669s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:44:51 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:44:51 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Took 1.38 seconds to deallocate network for instance.
Aug 09 10:44:51 user nova-compute[72362]: DEBUG nova.compute.manager [req-9080717a-cde1-44de-a509-f825e9280303 req-68bbd156-5668-4afe-a2a4-f7233efbaf7a service nova] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Received event network-vif-deleted-1a21fab7-2746-481c-8003-5f8e6d67ea2a {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:44:51 user nova-compute[72362]: DEBUG nova.compute.manager [req-3831e782-77eb-4dde-a1a7-147bef84ba9b req-39d8caba-c79c-4a17-b4c5-541eef0c5e81 service nova] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Received event network-vif-plugged-1a21fab7-2746-481c-8003-5f8e6d67ea2a {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:44:51 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3831e782-77eb-4dde-a1a7-147bef84ba9b req-39d8caba-c79c-4a17-b4c5-541eef0c5e81 service nova] Acquiring lock "94aedd29-1832-4ff4-97ac-d70ed1775223-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:44:51 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3831e782-77eb-4dde-a1a7-147bef84ba9b req-39d8caba-c79c-4a17-b4c5-541eef0c5e81 service nova] Lock "94aedd29-1832-4ff4-97ac-d70ed1775223-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:44:51 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3831e782-77eb-4dde-a1a7-147bef84ba9b req-39d8caba-c79c-4a17-b4c5-541eef0c5e81 service nova] Lock "94aedd29-1832-4ff4-97ac-d70ed1775223-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:44:51 user nova-compute[72362]: DEBUG nova.compute.manager [req-3831e782-77eb-4dde-a1a7-147bef84ba9b req-39d8caba-c79c-4a17-b4c5-541eef0c5e81 service nova] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] No waiting events found dispatching network-vif-plugged-1a21fab7-2746-481c-8003-5f8e6d67ea2a {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:44:51 user nova-compute[72362]: WARNING nova.compute.manager [req-3831e782-77eb-4dde-a1a7-147bef84ba9b req-39d8caba-c79c-4a17-b4c5-541eef0c5e81 service nova] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Received unexpected event network-vif-plugged-1a21fab7-2746-481c-8003-5f8e6d67ea2a for instance with vm_state active and task_state deleting.
Aug 09 10:44:51 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-fea9331a-3654-454d-942c-af59cff7cbaf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:44:51 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-fea9331a-3654-454d-942c-af59cff7cbaf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:44:52 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-fea9331a-3654-454d-942c-af59cff7cbaf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:44:52 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-fea9331a-3654-454d-942c-af59cff7cbaf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:44:52 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-fea9331a-3654-454d-942c-af59cff7cbaf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.215s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:44:52 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-fea9331a-3654-454d-942c-af59cff7cbaf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Deleted allocations for instance 94aedd29-1832-4ff4-97ac-d70ed1775223
Aug 09 10:44:52 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:44:52 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-fea9331a-3654-454d-942c-af59cff7cbaf tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "94aedd29-1832-4ff4-97ac-d70ed1775223" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.671s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG nova.compute.manager [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Start spawning the instance on the hypervisor. {{(pid=72362) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:44:55 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Creating image(s)
Aug 09 10:44:55 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Did not create local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Ensure instance console log exists: /opt/stack/data/nova/instances/ab34d860-52ba-4773-9f80-84930bbd06d0/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Start _get_guest_xml network_info=[{"id": "221b0dc3-ded0-4875-8396-51d6013e2aea", "address": "fa:16:3e:af:d6:64", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap221b0dc3-de", "ovs_interfaceid": "221b0dc3-ded0-4875-8396-51d6013e2aea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '6881ca38-6694-4226-bea2-be352f886423', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vPXkBflS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ab34d860-52ba-4773-9f80-84930bbd06d0', 'attached_at': '', 'detached_at': '', 'volume_id': 'b13e9f29-5849-486f-b75a-9520443d9135', 'serial': 'b13e9f29-5849-486f-b75a-9520443d9135'}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:44:55 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:44:55 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:44:55 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vPXkBflS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:44:55 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:44:55 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:44:55 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:44:55 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:44:55 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:44:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58dd022-0c82-4a8b-8fce-b45fb5ab896f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:44:55 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[50bd86a4-c60d-448a-8539-0c2064966ada]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135] added
Aug 09 10:44:55 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88769bc-92c5-4e2a-b11a-08615d6b6134]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[096ce7ca-70dc-4347-a4ab-ac7f7d8ab9c4]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vPXkBflS {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vPXkBflS" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f08a43-3952-4110-ba70-01eefed677dd]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vPXkBflS'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f4653b-a7d5-47a9-968a-f20e37f2560d]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[251ff489-a319-456c-bed4-40489b57bf41]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 10:44:55 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 10:44:55 user nova-compute[72362]:  {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:44:55 user nova-compute[72362]: WARNING os_brick.initiator.connectors.iscsi [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 10:44:55 user nova-compute[72362]: 
Aug 09 10:44:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18a32f2-ff09-40cd-8436-1df84c2f1c05]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135, portal: 172.16.0.220,3260]
Aug 09 10:44:55 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135, portal: 172.16.0.220,3260] successful.
Aug 09 10:44:55 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87bc379-b81a-472a-bfeb-a1889e0300a8]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b79f12-2e2d-40aa-9439-554621639604]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 (non-flash)
Aug 09 10:44:55 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 (non-flash)
Aug 09 10:44:55 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:44:55 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:44:56 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:44:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:44:56 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:44:56 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f918d419-3b31-4c56-b977-3d26763ea272]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:44:56 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:44:56 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vPXkBflS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:44:57 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:44:57 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '26265313335396333', 'path': '/dev/sdb'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:44:57 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265313335396333', 'path': '/dev/sdb'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:44:57 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-40120364',display_name='tempest-TestVolumeBootPattern-server-40120364',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-40120364',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHphUKjpMkPjhZoTYlVJxPOuywq6OJUJWcHduVoRu9b0hlVgGA5+i25KrjKtdJwPAqa6k/+4sAUFZLxd189pJwbl9oyVmaY/KLuastlFffcAKt/RqOFaRqRDbZFRQvHB1g==',key_name='tempest-TestVolumeBootPattern-1201178489',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26e38599de0b4b06b723f5647a7fe121',ramdisk_id='',reservation_id='r-gd7ko0yp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1478436240',owner_user_name='tempest-TestVolumeBootPattern-1478436240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:44:48Z,user_data=None,user_id='e96900e953f64d02bdb5d48f136133c3',uuid=ab34d860-52ba-4773-9f80-84930bbd06d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "221b0dc3-ded0-4875-8396-51d6013e2aea", "address": "fa:16:3e:af:d6:64", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap221b0dc3-de", "ovs_interfaceid": "221b0dc3-ded0-4875-8396-51d6013e2aea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:44:57 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Converting VIF {"id": "221b0dc3-ded0-4875-8396-51d6013e2aea", "address": "fa:16:3e:af:d6:64", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap221b0dc3-de", "ovs_interfaceid": "221b0dc3-ded0-4875-8396-51d6013e2aea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:44:57 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:d6:64,bridge_name='br-int',has_traffic_filtering=True,id=221b0dc3-ded0-4875-8396-51d6013e2aea,network=Network(b4a9e050-41f1-404a-bf5c-41421f034644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap221b0dc3-de') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:44:57 user nova-compute[72362]: DEBUG nova.objects.instance [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lazy-loading 'pci_devices' on Instance uuid ab34d860-52ba-4773-9f80-84930bbd06d0 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:44:57 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:44:57 user nova-compute[72362]:   <uuid>ab34d860-52ba-4773-9f80-84930bbd06d0</uuid>
Aug 09 10:44:57 user nova-compute[72362]:   <name>instance-0000002d</name>
Aug 09 10:44:57 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:44:57 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:44:57 user nova-compute[72362]:   <metadata>
Aug 09 10:44:57 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:44:57 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:44:57 user nova-compute[72362]:       <nova:name>tempest-TestVolumeBootPattern-server-40120364</nova:name>
Aug 09 10:44:57 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:44:55</nova:creationTime>
Aug 09 10:44:57 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:44:57 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:44:57 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:44:57 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:44:57 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:44:57 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:44:57 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:44:57 user nova-compute[72362]:       <nova:owner>
Aug 09 10:44:57 user nova-compute[72362]:         <nova:user uuid="e96900e953f64d02bdb5d48f136133c3">tempest-TestVolumeBootPattern-1478436240-project-member</nova:user>
Aug 09 10:44:57 user nova-compute[72362]:         <nova:project uuid="26e38599de0b4b06b723f5647a7fe121">tempest-TestVolumeBootPattern-1478436240</nova:project>
Aug 09 10:44:57 user nova-compute[72362]:       </nova:owner>
Aug 09 10:44:57 user nova-compute[72362]:       <nova:ports>
Aug 09 10:44:57 user nova-compute[72362]:         <nova:port uuid="221b0dc3-ded0-4875-8396-51d6013e2aea">
Aug 09 10:44:57 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 10:44:57 user nova-compute[72362]:         </nova:port>
Aug 09 10:44:57 user nova-compute[72362]:       </nova:ports>
Aug 09 10:44:57 user nova-compute[72362]:     </nova:instance>
Aug 09 10:44:57 user nova-compute[72362]:   </metadata>
Aug 09 10:44:57 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:44:57 user nova-compute[72362]:     <system>
Aug 09 10:44:57 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:44:57 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:44:57 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:44:57 user nova-compute[72362]:       <entry name="serial">ab34d860-52ba-4773-9f80-84930bbd06d0</entry>
Aug 09 10:44:57 user nova-compute[72362]:       <entry name="uuid">ab34d860-52ba-4773-9f80-84930bbd06d0</entry>
Aug 09 10:44:57 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:44:57 user nova-compute[72362]:     </system>
Aug 09 10:44:57 user nova-compute[72362]:   </sysinfo>
Aug 09 10:44:57 user nova-compute[72362]:   <os>
Aug 09 10:44:57 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:44:57 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:44:57 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:44:57 user nova-compute[72362]:   </os>
Aug 09 10:44:57 user nova-compute[72362]:   <features>
Aug 09 10:44:57 user nova-compute[72362]:     <acpi/>
Aug 09 10:44:57 user nova-compute[72362]:     <apic/>
Aug 09 10:44:57 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:44:57 user nova-compute[72362]:   </features>
Aug 09 10:44:57 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:44:57 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:44:57 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:44:57 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:44:57 user nova-compute[72362]:   </clock>
Aug 09 10:44:57 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:44:57 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:44:57 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:44:57 user nova-compute[72362]:   </cpu>
Aug 09 10:44:57 user nova-compute[72362]:   <devices>
Aug 09 10:44:57 user nova-compute[72362]:     <disk type="block" device="disk">
Aug 09 10:44:57 user nova-compute[72362]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:44:57 user nova-compute[72362]:       <source dev="/dev/sdb"/>
Aug 09 10:44:57 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:44:57 user nova-compute[72362]:       <serial>b13e9f29-5849-486f-b75a-9520443d9135</serial>
Aug 09 10:44:57 user nova-compute[72362]:     </disk>
Aug 09 10:44:57 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:44:57 user nova-compute[72362]:       <mac address="fa:16:3e:af:d6:64"/>
Aug 09 10:44:57 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:44:57 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:44:57 user nova-compute[72362]:       <target dev="tap221b0dc3-de"/>
Aug 09 10:44:57 user nova-compute[72362]:     </interface>
Aug 09 10:44:57 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:44:57 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/ab34d860-52ba-4773-9f80-84930bbd06d0/console.log" append="off"/>
Aug 09 10:44:57 user nova-compute[72362]:     </serial>
Aug 09 10:44:57 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:44:57 user nova-compute[72362]:     <video>
Aug 09 10:44:57 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:44:57 user nova-compute[72362]:     </video>
Aug 09 10:44:57 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:44:57 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:44:57 user nova-compute[72362]:     </rng>
Aug 09 10:44:57 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:44:57 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:44:57 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:44:57 user nova-compute[72362]:     </memballoon>
Aug 09 10:44:57 user nova-compute[72362]:   </devices>
Aug 09 10:44:57 user nova-compute[72362]: </domain>
Aug 09 10:44:57 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:44:57 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-40120364',display_name='tempest-TestVolumeBootPattern-server-40120364',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-40120364',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHphUKjpMkPjhZoTYlVJxPOuywq6OJUJWcHduVoRu9b0hlVgGA5+i25KrjKtdJwPAqa6k/+4sAUFZLxd189pJwbl9oyVmaY/KLuastlFffcAKt/RqOFaRqRDbZFRQvHB1g==',key_name='tempest-TestVolumeBootPattern-1201178489',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26e38599de0b4b06b723f5647a7fe121',ramdisk_id='',reservation_id='r-gd7ko0yp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1478436240',owner_user_name='tempest-TestVolumeBootPattern-1478436240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:44:48Z,user_data=None,user_id='e96900e953f64d02bdb5d48f136133c3',uuid=ab34d860-52ba-4773-9f80-84930bbd06d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "221b0dc3-ded0-4875-8396-51d6013e2aea", "address": "fa:16:3e:af:d6:64", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap221b0dc3-de", "ovs_interfaceid": "221b0dc3-ded0-4875-8396-51d6013e2aea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:44:57 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Converting VIF {"id": "221b0dc3-ded0-4875-8396-51d6013e2aea", "address": "fa:16:3e:af:d6:64", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap221b0dc3-de", "ovs_interfaceid": "221b0dc3-ded0-4875-8396-51d6013e2aea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:44:57 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:d6:64,bridge_name='br-int',has_traffic_filtering=True,id=221b0dc3-ded0-4875-8396-51d6013e2aea,network=Network(b4a9e050-41f1-404a-bf5c-41421f034644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap221b0dc3-de') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:44:57 user nova-compute[72362]: DEBUG os_vif [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:d6:64,bridge_name='br-int',has_traffic_filtering=True,id=221b0dc3-ded0-4875-8396-51d6013e2aea,network=Network(b4a9e050-41f1-404a-bf5c-41421f034644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap221b0dc3-de') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:44:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:44:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:44:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:44:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:44:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap221b0dc3-de, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:44:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap221b0dc3-de, col_values=(('external_ids', {'iface-id': '221b0dc3-ded0-4875-8396-51d6013e2aea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:d6:64', 'vm-uuid': 'ab34d860-52ba-4773-9f80-84930bbd06d0'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:44:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:44:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:44:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:44:57 user nova-compute[72362]: INFO os_vif [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:d6:64,bridge_name='br-int',has_traffic_filtering=True,id=221b0dc3-ded0-4875-8396-51d6013e2aea,network=Network(b4a9e050-41f1-404a-bf5c-41421f034644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap221b0dc3-de')
Aug 09 10:44:57 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:44:57 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] No VIF found with MAC fa:16:3e:af:d6:64, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:44:58 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:44:58 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:44:58 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:44:58 user nova-compute[72362]: DEBUG nova.compute.manager [req-496faf29-536f-44eb-bc28-646a17c9e55b req-7e520528-169e-4e59-9d6a-765b046e92e2 service nova] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Received event network-vif-plugged-221b0dc3-ded0-4875-8396-51d6013e2aea {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:44:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-496faf29-536f-44eb-bc28-646a17c9e55b req-7e520528-169e-4e59-9d6a-765b046e92e2 service nova] Acquiring lock "ab34d860-52ba-4773-9f80-84930bbd06d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:44:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-496faf29-536f-44eb-bc28-646a17c9e55b req-7e520528-169e-4e59-9d6a-765b046e92e2 service nova] Lock "ab34d860-52ba-4773-9f80-84930bbd06d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:44:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-496faf29-536f-44eb-bc28-646a17c9e55b req-7e520528-169e-4e59-9d6a-765b046e92e2 service nova] Lock "ab34d860-52ba-4773-9f80-84930bbd06d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:44:58 user nova-compute[72362]: DEBUG nova.compute.manager [req-496faf29-536f-44eb-bc28-646a17c9e55b req-7e520528-169e-4e59-9d6a-765b046e92e2 service nova] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] No waiting events found dispatching network-vif-plugged-221b0dc3-ded0-4875-8396-51d6013e2aea {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:44:58 user nova-compute[72362]: WARNING nova.compute.manager [req-496faf29-536f-44eb-bc28-646a17c9e55b req-7e520528-169e-4e59-9d6a-765b046e92e2 service nova] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Received unexpected event network-vif-plugged-221b0dc3-ded0-4875-8396-51d6013e2aea for instance with vm_state building and task_state spawning.
Aug 09 10:44:58 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:44:58 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:44:58 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:45:00 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577900.4309783, ab34d860-52ba-4773-9f80-84930bbd06d0 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:45:00 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] VM Resumed (Lifecycle Event)
Aug 09 10:45:00 user nova-compute[72362]: DEBUG nova.compute.manager [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:45:00 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:45:00 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Instance spawned successfully.
Aug 09 10:45:00 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 10:45:00 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:45:00 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:45:00 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Found default for hw_cdrom_bus of ide {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:45:00 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Found default for hw_disk_bus of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:45:00 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:45:00 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:45:00 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Found default for hw_video_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:45:00 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Found default for hw_vif_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:45:00 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:45:00 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577900.4342737, ab34d860-52ba-4773-9f80-84930bbd06d0 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:45:00 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] VM Started (Lifecycle Event)
Aug 09 10:45:00 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:45:00 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:45:00 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:45:00 user nova-compute[72362]: INFO nova.compute.manager [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Took 4.86 seconds to spawn the instance on the hypervisor.
Aug 09 10:45:00 user nova-compute[72362]: DEBUG nova.compute.manager [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:45:00 user nova-compute[72362]: INFO nova.compute.manager [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Took 13.44 seconds to build instance.
Aug 09 10:45:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-fb909ebf-84f7-4ac7-8774-41a74bfb17bc tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "ab34d860-52ba-4773-9f80-84930bbd06d0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.527s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:45:00 user nova-compute[72362]: DEBUG nova.compute.manager [req-b4bd9e21-c4e0-40ad-b086-b1249622d7ad req-a7567936-2933-4762-b838-d304414d8a48 service nova] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Received event network-vif-plugged-221b0dc3-ded0-4875-8396-51d6013e2aea {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:45:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b4bd9e21-c4e0-40ad-b086-b1249622d7ad req-a7567936-2933-4762-b838-d304414d8a48 service nova] Acquiring lock "ab34d860-52ba-4773-9f80-84930bbd06d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:45:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b4bd9e21-c4e0-40ad-b086-b1249622d7ad req-a7567936-2933-4762-b838-d304414d8a48 service nova] Lock "ab34d860-52ba-4773-9f80-84930bbd06d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:45:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b4bd9e21-c4e0-40ad-b086-b1249622d7ad req-a7567936-2933-4762-b838-d304414d8a48 service nova] Lock "ab34d860-52ba-4773-9f80-84930bbd06d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:45:00 user nova-compute[72362]: DEBUG nova.compute.manager [req-b4bd9e21-c4e0-40ad-b086-b1249622d7ad req-a7567936-2933-4762-b838-d304414d8a48 service nova] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] No waiting events found dispatching network-vif-plugged-221b0dc3-ded0-4875-8396-51d6013e2aea {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:45:00 user nova-compute[72362]: WARNING nova.compute.manager [req-b4bd9e21-c4e0-40ad-b086-b1249622d7ad req-a7567936-2933-4762-b838-d304414d8a48 service nova] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Received unexpected event network-vif-plugged-221b0dc3-ded0-4875-8396-51d6013e2aea for instance with vm_state active and task_state None.
Aug 09 10:45:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:45:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:45:05 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691577890.2912695, 94aedd29-1832-4ff4-97ac-d70ed1775223 => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:45:05 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] VM Stopped (Lifecycle Event)
Aug 09 10:45:05 user nova-compute[72362]: DEBUG nova.compute.manager [None req-5556a2d2-6237-4096-9d4d-9961b95be606 None None] [instance: 94aedd29-1832-4ff4-97ac-d70ed1775223] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:45:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:45:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:45:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:45:16 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:45:16 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:45:16 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:45:16 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:45:16 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:45:16 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:45:16 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:45:16 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 10:45:16 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:45:16 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 10:45:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "refresh_cache-4296ca4c-1e3e-474f-98ba-9f947d333b8d" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:45:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquired lock "refresh_cache-4296ca4c-1e3e-474f-98ba-9f947d333b8d" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:45:17 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Forcefully refreshing network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 10:45:17 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:45:17 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:45:17 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 10:45:17 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 10:45:17 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 10:45:17 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:45:17 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:45:17 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Updating instance_info_cache with network_info: [{"id": "434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9", "address": "fa:16:3e:09:7c:97", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434ea21d-d4", "ovs_interfaceid": "434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:45:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Releasing lock "refresh_cache-4296ca4c-1e3e-474f-98ba-9f947d333b8d" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:45:17 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Updated the network info_cache for instance {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 10:45:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:45:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:45:22 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:45:22 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:45:22 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:45:22 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:45:22 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 10:45:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f4a735-db06-4ad9-81f8-1863330628f9/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:45:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f4a735-db06-4ad9-81f8-1863330628f9/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:45:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f4a735-db06-4ad9-81f8-1863330628f9/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:45:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f4a735-db06-4ad9-81f8-1863330628f9/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:45:23 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:45:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:45:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:45:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:45:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:45:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:45:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:45:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:45:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:45:23 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:45:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:45:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:45:24 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:45:24 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:45:24 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:45:24 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=8331MB free_disk=25.091224670410156GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 10:45:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:45:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:45:24 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance cefe383b-978f-4391-baf6-3b3ad17e0083 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:45:24 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 4296ca4c-1e3e-474f-98ba-9f947d333b8d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:45:24 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 37f4a735-db06-4ad9-81f8-1863330628f9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:45:24 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance ab34d860-52ba-4773-9f80-84930bbd06d0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:45:24 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 10:45:24 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 10:45:24 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:45:24 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:45:24 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 10:45:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.267s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:45:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:45:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:45:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:45:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:45:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:45:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 10:45:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 10:45:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 10:45:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:45:39 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3d372099-baf3-42d2-8d28-179981e2f329 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "37f4a735-db06-4ad9-81f8-1863330628f9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:45:39 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3d372099-baf3-42d2-8d28-179981e2f329 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "37f4a735-db06-4ad9-81f8-1863330628f9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:45:39 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3d372099-baf3-42d2-8d28-179981e2f329 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "37f4a735-db06-4ad9-81f8-1863330628f9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:45:39 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3d372099-baf3-42d2-8d28-179981e2f329 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "37f4a735-db06-4ad9-81f8-1863330628f9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:45:39 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3d372099-baf3-42d2-8d28-179981e2f329 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "37f4a735-db06-4ad9-81f8-1863330628f9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:45:39 user nova-compute[72362]: INFO nova.compute.manager [None req-3d372099-baf3-42d2-8d28-179981e2f329 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Terminating instance
Aug 09 10:45:39 user nova-compute[72362]: DEBUG nova.compute.manager [None req-3d372099-baf3-42d2-8d28-179981e2f329 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Start destroying the instance on the hypervisor. {{(pid=72362) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 10:45:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:45:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:45:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:45:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:45:40 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Instance destroyed successfully.
Aug 09 10:45:40 user nova-compute[72362]: DEBUG nova.objects.instance [None req-3d372099-baf3-42d2-8d28-179981e2f329 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lazy-loading 'resources' on Instance uuid 37f4a735-db06-4ad9-81f8-1863330628f9 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:45:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-3d372099-baf3-42d2-8d28-179981e2f329 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:42:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-77660331',display_name='tempest-AttachVolumeNegativeTest-server-77660331',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-77660331',id=44,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGgMVyViMMF2ScZK8622aw2G9bObMCbXXWDUvTyw44Ybech0pxcN6fnk9Azza/cRndRIt26rpboadbbxE83QX7o5AOYJoXTlv5Le7WopUU8uYYBOGvu6VDsX0dLrKoFiQ==',key_name='tempest-keypair-298891728',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:42:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='980f1c36cab0449b949419cf495c16d5',ramdisk_id='',reservation_id='r-jqelp5a0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-486756066',owner_user_name='tempest-AttachVolumeNegativeTest-486756066-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:42:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bed469ff9d954891905c98bdf238c097',uuid=37f4a735-db06-4ad9-81f8-1863330628f9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0befdbb1-af32-4c72-880c-7cff448a3870", "address": "fa:16:3e:86:29:60", "network": {"id": "e56e2a0a-0a6d-4546-86ef-7bb333e829ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1495216341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980f1c36cab0449b949419cf495c16d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0befdbb1-af", "ovs_interfaceid": "0befdbb1-af32-4c72-880c-7cff448a3870", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:45:40 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-3d372099-baf3-42d2-8d28-179981e2f329 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Converting VIF {"id": "0befdbb1-af32-4c72-880c-7cff448a3870", "address": "fa:16:3e:86:29:60", "network": {"id": "e56e2a0a-0a6d-4546-86ef-7bb333e829ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1495216341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980f1c36cab0449b949419cf495c16d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0befdbb1-af", "ovs_interfaceid": "0befdbb1-af32-4c72-880c-7cff448a3870", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:45:40 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-3d372099-baf3-42d2-8d28-179981e2f329 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:29:60,bridge_name='br-int',has_traffic_filtering=True,id=0befdbb1-af32-4c72-880c-7cff448a3870,network=Network(e56e2a0a-0a6d-4546-86ef-7bb333e829ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0befdbb1-af') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:45:40 user nova-compute[72362]: DEBUG os_vif [None req-3d372099-baf3-42d2-8d28-179981e2f329 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:29:60,bridge_name='br-int',has_traffic_filtering=True,id=0befdbb1-af32-4c72-880c-7cff448a3870,network=Network(e56e2a0a-0a6d-4546-86ef-7bb333e829ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0befdbb1-af') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:45:40 user nova-compute[72362]: DEBUG nova.compute.manager [req-1829b694-8fd7-4553-91f9-bd5bd083cce8 req-c2dc4169-ae64-4e21-a279-8d92d8c80a75 service nova] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Received event network-vif-unplugged-0befdbb1-af32-4c72-880c-7cff448a3870 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:45:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-1829b694-8fd7-4553-91f9-bd5bd083cce8 req-c2dc4169-ae64-4e21-a279-8d92d8c80a75 service nova] Acquiring lock "37f4a735-db06-4ad9-81f8-1863330628f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:45:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-1829b694-8fd7-4553-91f9-bd5bd083cce8 req-c2dc4169-ae64-4e21-a279-8d92d8c80a75 service nova] Lock "37f4a735-db06-4ad9-81f8-1863330628f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:45:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-1829b694-8fd7-4553-91f9-bd5bd083cce8 req-c2dc4169-ae64-4e21-a279-8d92d8c80a75 service nova] Lock "37f4a735-db06-4ad9-81f8-1863330628f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:45:40 user nova-compute[72362]: DEBUG nova.compute.manager [req-1829b694-8fd7-4553-91f9-bd5bd083cce8 req-c2dc4169-ae64-4e21-a279-8d92d8c80a75 service nova] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] No waiting events found dispatching network-vif-unplugged-0befdbb1-af32-4c72-880c-7cff448a3870 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:45:40 user nova-compute[72362]: DEBUG nova.compute.manager [req-1829b694-8fd7-4553-91f9-bd5bd083cce8 req-c2dc4169-ae64-4e21-a279-8d92d8c80a75 service nova] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Received event network-vif-unplugged-0befdbb1-af32-4c72-880c-7cff448a3870 for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:45:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:45:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0befdbb1-af, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:45:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:45:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:45:40 user nova-compute[72362]: INFO os_vif [None req-3d372099-baf3-42d2-8d28-179981e2f329 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:29:60,bridge_name='br-int',has_traffic_filtering=True,id=0befdbb1-af32-4c72-880c-7cff448a3870,network=Network(e56e2a0a-0a6d-4546-86ef-7bb333e829ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0befdbb1-af')
Aug 09 10:45:40 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-3d372099-baf3-42d2-8d28-179981e2f329 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Deleting instance files /opt/stack/data/nova/instances/37f4a735-db06-4ad9-81f8-1863330628f9_del
Aug 09 10:45:40 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-3d372099-baf3-42d2-8d28-179981e2f329 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Deletion of /opt/stack/data/nova/instances/37f4a735-db06-4ad9-81f8-1863330628f9_del complete
Aug 09 10:45:40 user nova-compute[72362]: INFO nova.compute.manager [None req-3d372099-baf3-42d2-8d28-179981e2f329 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 09 10:45:40 user nova-compute[72362]: DEBUG oslo.service.loopingcall [None req-3d372099-baf3-42d2-8d28-179981e2f329 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72362) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 10:45:40 user nova-compute[72362]: DEBUG nova.compute.manager [-] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Deallocating network for instance {{(pid=72362) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 10:45:40 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] deallocate_for_instance() {{(pid=72362) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 10:45:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:45:41 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:45:41 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Took 1.24 seconds to deallocate network for instance.
Aug 09 10:45:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3d372099-baf3-42d2-8d28-179981e2f329 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:45:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3d372099-baf3-42d2-8d28-179981e2f329 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:45:41 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-3d372099-baf3-42d2-8d28-179981e2f329 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:45:41 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-3d372099-baf3-42d2-8d28-179981e2f329 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:45:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3d372099-baf3-42d2-8d28-179981e2f329 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.179s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:45:41 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-3d372099-baf3-42d2-8d28-179981e2f329 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Deleted allocations for instance 37f4a735-db06-4ad9-81f8-1863330628f9
Aug 09 10:45:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3d372099-baf3-42d2-8d28-179981e2f329 tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "37f4a735-db06-4ad9-81f8-1863330628f9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.560s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:45:42 user nova-compute[72362]: DEBUG nova.compute.manager [req-77f11f40-16c7-476e-9f23-456f2411af22 req-8b892850-7ede-4a55-964d-18e632af5246 service nova] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Received event network-vif-plugged-0befdbb1-af32-4c72-880c-7cff448a3870 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:45:42 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-77f11f40-16c7-476e-9f23-456f2411af22 req-8b892850-7ede-4a55-964d-18e632af5246 service nova] Acquiring lock "37f4a735-db06-4ad9-81f8-1863330628f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:45:42 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-77f11f40-16c7-476e-9f23-456f2411af22 req-8b892850-7ede-4a55-964d-18e632af5246 service nova] Lock "37f4a735-db06-4ad9-81f8-1863330628f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:45:42 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-77f11f40-16c7-476e-9f23-456f2411af22 req-8b892850-7ede-4a55-964d-18e632af5246 service nova] Lock "37f4a735-db06-4ad9-81f8-1863330628f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:45:42 user nova-compute[72362]: DEBUG nova.compute.manager [req-77f11f40-16c7-476e-9f23-456f2411af22 req-8b892850-7ede-4a55-964d-18e632af5246 service nova] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] No waiting events found dispatching network-vif-plugged-0befdbb1-af32-4c72-880c-7cff448a3870 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:45:42 user nova-compute[72362]: WARNING nova.compute.manager [req-77f11f40-16c7-476e-9f23-456f2411af22 req-8b892850-7ede-4a55-964d-18e632af5246 service nova] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Received unexpected event network-vif-plugged-0befdbb1-af32-4c72-880c-7cff448a3870 for instance with vm_state deleted and task_state None.
Aug 09 10:45:42 user nova-compute[72362]: DEBUG nova.compute.manager [req-77f11f40-16c7-476e-9f23-456f2411af22 req-8b892850-7ede-4a55-964d-18e632af5246 service nova] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Received event network-vif-deleted-0befdbb1-af32-4c72-880c-7cff448a3870 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:45:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Acquiring lock "c9b8c0c6-7afc-4f0b-ba06-3eccd4726124" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:45:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "c9b8c0c6-7afc-4f0b-ba06-3eccd4726124" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:45:44 user nova-compute[72362]: DEBUG nova.compute.manager [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Starting instance... {{(pid=72362) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 10:45:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:45:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:45:44 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:45:44 user nova-compute[72362]: INFO nova.compute.claims [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Claim successful on node user
Aug 09 10:45:44 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:45:44 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:45:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.275s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:45:44 user nova-compute[72362]: DEBUG nova.compute.manager [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Start building networks asynchronously for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 10:45:44 user nova-compute[72362]: DEBUG nova.compute.manager [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Allocating IP information in the background. {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 10:45:44 user nova-compute[72362]: DEBUG nova.network.neutron [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] allocate_for_instance() {{(pid=72362) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 10:45:44 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 10:45:44 user nova-compute[72362]: DEBUG nova.compute.manager [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Start building block device mappings for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 10:45:44 user nova-compute[72362]: DEBUG nova.compute.manager [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Start spawning the instance on the hypervisor. {{(pid=72362) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 10:45:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:45:44 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Creating image(s)
Aug 09 10:45:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Acquiring lock "/opt/stack/data/nova/instances/c9b8c0c6-7afc-4f0b-ba06-3eccd4726124/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:45:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "/opt/stack/data/nova/instances/c9b8c0c6-7afc-4f0b-ba06-3eccd4726124/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:45:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "/opt/stack/data/nova/instances/c9b8c0c6-7afc-4f0b-ba06-3eccd4726124/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:45:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:45:44 user nova-compute[72362]: DEBUG nova.policy [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '299166afe21b4d3cac05fdb072a78a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9d6a60f24d41deb91ae59189c62ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72362) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 10:45:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.139s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:45:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Acquiring lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:45:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:45:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:45:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.140s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:45:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/c9b8c0c6-7afc-4f0b-ba06-3eccd4726124/disk 1073741824 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:45:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/c9b8c0c6-7afc-4f0b-ba06-3eccd4726124/disk 1073741824" returned: 0 in 0.050s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:45:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:45:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:45:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.144s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:45:45 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c9b8c0c6-7afc-4f0b-ba06-3eccd4726124/disk. size=1073741824 {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 10:45:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b8c0c6-7afc-4f0b-ba06-3eccd4726124/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:45:45 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:45:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b8c0c6-7afc-4f0b-ba06-3eccd4726124/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:45:45 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Cannot resize image /opt/stack/data/nova/instances/c9b8c0c6-7afc-4f0b-ba06-3eccd4726124/disk to a smaller size. {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 10:45:45 user nova-compute[72362]: DEBUG nova.objects.instance [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lazy-loading 'migration_context' on Instance uuid c9b8c0c6-7afc-4f0b-ba06-3eccd4726124 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:45:45 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Created local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 10:45:45 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Ensure instance console log exists: /opt/stack/data/nova/instances/c9b8c0c6-7afc-4f0b-ba06-3eccd4726124/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:45:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:45:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:45:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:45:45 user nova-compute[72362]: DEBUG nova.network.neutron [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Successfully created port: bba009ea-bb2e-4952-98ee-4dd1fb2649fc {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:45:46 user nova-compute[72362]: DEBUG nova.network.neutron [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Successfully updated port: bba009ea-bb2e-4952-98ee-4dd1fb2649fc {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:45:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Acquiring lock "refresh_cache-c9b8c0c6-7afc-4f0b-ba06-3eccd4726124" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:45:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Acquired lock "refresh_cache-c9b8c0c6-7afc-4f0b-ba06-3eccd4726124" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:45:46 user nova-compute[72362]: DEBUG nova.network.neutron [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:45:46 user nova-compute[72362]: DEBUG nova.compute.manager [req-6d61e7e2-3615-4570-986f-02ffde217d6e req-14d7f191-ad59-41eb-b8d1-f62482758378 service nova] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Received event network-changed-bba009ea-bb2e-4952-98ee-4dd1fb2649fc {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:45:46 user nova-compute[72362]: DEBUG nova.compute.manager [req-6d61e7e2-3615-4570-986f-02ffde217d6e req-14d7f191-ad59-41eb-b8d1-f62482758378 service nova] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Refreshing instance network info cache due to event network-changed-bba009ea-bb2e-4952-98ee-4dd1fb2649fc. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:45:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-6d61e7e2-3615-4570-986f-02ffde217d6e req-14d7f191-ad59-41eb-b8d1-f62482758378 service nova] Acquiring lock "refresh_cache-c9b8c0c6-7afc-4f0b-ba06-3eccd4726124" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:45:46 user nova-compute[72362]: DEBUG nova.network.neutron [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:45:46 user nova-compute[72362]: DEBUG nova.network.neutron [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Updating instance_info_cache with network_info: [{"id": "bba009ea-bb2e-4952-98ee-4dd1fb2649fc", "address": "fa:16:3e:5b:15:67", "network": {"id": "362446ea-173c-4989-93f8-882088822208", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-499399633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f9d6a60f24d41deb91ae59189c62ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba009ea-bb", "ovs_interfaceid": "bba009ea-bb2e-4952-98ee-4dd1fb2649fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:45:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Releasing lock "refresh_cache-c9b8c0c6-7afc-4f0b-ba06-3eccd4726124" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:45:46 user nova-compute[72362]: DEBUG nova.compute.manager [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Instance network_info: |[{"id": "bba009ea-bb2e-4952-98ee-4dd1fb2649fc", "address": "fa:16:3e:5b:15:67", "network": {"id": "362446ea-173c-4989-93f8-882088822208", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-499399633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f9d6a60f24d41deb91ae59189c62ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba009ea-bb", "ovs_interfaceid": "bba009ea-bb2e-4952-98ee-4dd1fb2649fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 10:45:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-6d61e7e2-3615-4570-986f-02ffde217d6e req-14d7f191-ad59-41eb-b8d1-f62482758378 service nova] Acquired lock "refresh_cache-c9b8c0c6-7afc-4f0b-ba06-3eccd4726124" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:45:46 user nova-compute[72362]: DEBUG nova.network.neutron [req-6d61e7e2-3615-4570-986f-02ffde217d6e req-14d7f191-ad59-41eb-b8d1-f62482758378 service nova] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Refreshing network info cache for port bba009ea-bb2e-4952-98ee-4dd1fb2649fc {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:45:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Start _get_guest_xml network_info=[{"id": "bba009ea-bb2e-4952-98ee-4dd1fb2649fc", "address": "fa:16:3e:5b:15:67", "network": {"id": "362446ea-173c-4989-93f8-882088822208", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-499399633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f9d6a60f24d41deb91ae59189c62ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba009ea-bb", "ovs_interfaceid": "bba009ea-bb2e-4952-98ee-4dd1fb2649fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': 'a08d1a11-49eb-4212-a351-e11ee9553b95'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:45:46 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:45:46 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:45:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:45:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:45:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:45:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:45:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:45:46 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:45:46 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:45:46 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:45:46 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:45:46 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:45:46 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:45:46 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:45:46 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:45:46 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:45:46 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:45:46 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:45:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:45:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1646693656',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1646693656',id=46,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/aGUSj56P3CF+AbqqVXGNF0P/OweU114ZrKxiQ7YSDnLkroHTWcMIUzf2DBS55CS9oLSk9ocs6C9FMw7qXL+rrCRRbxlx+Zy16d7Ch/20WCb8l2ERymAdmhPJHshV2cg==',key_name='tempest-keypair-1790414929',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f9d6a60f24d41deb91ae59189c62ba2',ramdisk_id='',reservation_id='r-9y258rcd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2139825844',owner_user_name='tempest-AttachVolumeShelveTestJSON-2139825844-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:45:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='299166afe21b4d3cac05fdb072a78a78',uuid=c9b8c0c6-7afc-4f0b-ba06-3eccd4726124,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bba009ea-bb2e-4952-98ee-4dd1fb2649fc", "address": "fa:16:3e:5b:15:67", "network": {"id": "362446ea-173c-4989-93f8-882088822208", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-499399633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f9d6a60f24d41deb91ae59189c62ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba009ea-bb", "ovs_interfaceid": "bba009ea-bb2e-4952-98ee-4dd1fb2649fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:45:46 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Converting VIF {"id": "bba009ea-bb2e-4952-98ee-4dd1fb2649fc", "address": "fa:16:3e:5b:15:67", "network": {"id": "362446ea-173c-4989-93f8-882088822208", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-499399633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f9d6a60f24d41deb91ae59189c62ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba009ea-bb", "ovs_interfaceid": "bba009ea-bb2e-4952-98ee-4dd1fb2649fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:45:46 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:15:67,bridge_name='br-int',has_traffic_filtering=True,id=bba009ea-bb2e-4952-98ee-4dd1fb2649fc,network=Network(362446ea-173c-4989-93f8-882088822208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbba009ea-bb') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:45:46 user nova-compute[72362]: DEBUG nova.objects.instance [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lazy-loading 'pci_devices' on Instance uuid c9b8c0c6-7afc-4f0b-ba06-3eccd4726124 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:45:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:45:46 user nova-compute[72362]:   <uuid>c9b8c0c6-7afc-4f0b-ba06-3eccd4726124</uuid>
Aug 09 10:45:46 user nova-compute[72362]:   <name>instance-0000002e</name>
Aug 09 10:45:46 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:45:46 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:45:46 user nova-compute[72362]:   <metadata>
Aug 09 10:45:46 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:45:46 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:45:46 user nova-compute[72362]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1646693656</nova:name>
Aug 09 10:45:46 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:45:46</nova:creationTime>
Aug 09 10:45:46 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:45:46 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:45:46 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:45:46 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:45:46 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:45:46 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:45:46 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:45:46 user nova-compute[72362]:       <nova:owner>
Aug 09 10:45:46 user nova-compute[72362]:         <nova:user uuid="299166afe21b4d3cac05fdb072a78a78">tempest-AttachVolumeShelveTestJSON-2139825844-project-member</nova:user>
Aug 09 10:45:46 user nova-compute[72362]:         <nova:project uuid="2f9d6a60f24d41deb91ae59189c62ba2">tempest-AttachVolumeShelveTestJSON-2139825844</nova:project>
Aug 09 10:45:46 user nova-compute[72362]:       </nova:owner>
Aug 09 10:45:46 user nova-compute[72362]:       <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:45:46 user nova-compute[72362]:       <nova:ports>
Aug 09 10:45:46 user nova-compute[72362]:         <nova:port uuid="bba009ea-bb2e-4952-98ee-4dd1fb2649fc">
Aug 09 10:45:46 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 09 10:45:46 user nova-compute[72362]:         </nova:port>
Aug 09 10:45:46 user nova-compute[72362]:       </nova:ports>
Aug 09 10:45:46 user nova-compute[72362]:     </nova:instance>
Aug 09 10:45:46 user nova-compute[72362]:   </metadata>
Aug 09 10:45:46 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:45:46 user nova-compute[72362]:     <system>
Aug 09 10:45:46 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:45:46 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:45:46 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:45:46 user nova-compute[72362]:       <entry name="serial">c9b8c0c6-7afc-4f0b-ba06-3eccd4726124</entry>
Aug 09 10:45:46 user nova-compute[72362]:       <entry name="uuid">c9b8c0c6-7afc-4f0b-ba06-3eccd4726124</entry>
Aug 09 10:45:46 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:45:46 user nova-compute[72362]:     </system>
Aug 09 10:45:46 user nova-compute[72362]:   </sysinfo>
Aug 09 10:45:46 user nova-compute[72362]:   <os>
Aug 09 10:45:46 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:45:46 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:45:46 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:45:46 user nova-compute[72362]:   </os>
Aug 09 10:45:46 user nova-compute[72362]:   <features>
Aug 09 10:45:46 user nova-compute[72362]:     <acpi/>
Aug 09 10:45:46 user nova-compute[72362]:     <apic/>
Aug 09 10:45:46 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:45:46 user nova-compute[72362]:   </features>
Aug 09 10:45:46 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:45:46 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:45:46 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:45:46 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:45:46 user nova-compute[72362]:   </clock>
Aug 09 10:45:46 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:45:46 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:45:46 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:45:46 user nova-compute[72362]:   </cpu>
Aug 09 10:45:46 user nova-compute[72362]:   <devices>
Aug 09 10:45:46 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:45:46 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:45:46 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/c9b8c0c6-7afc-4f0b-ba06-3eccd4726124/disk"/>
Aug 09 10:45:46 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:45:46 user nova-compute[72362]:     </disk>
Aug 09 10:45:46 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:45:46 user nova-compute[72362]:       <mac address="fa:16:3e:5b:15:67"/>
Aug 09 10:45:46 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:45:46 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:45:46 user nova-compute[72362]:       <target dev="tapbba009ea-bb"/>
Aug 09 10:45:46 user nova-compute[72362]:     </interface>
Aug 09 10:45:46 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:45:46 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/c9b8c0c6-7afc-4f0b-ba06-3eccd4726124/console.log" append="off"/>
Aug 09 10:45:46 user nova-compute[72362]:     </serial>
Aug 09 10:45:46 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:45:46 user nova-compute[72362]:     <video>
Aug 09 10:45:46 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:45:46 user nova-compute[72362]:     </video>
Aug 09 10:45:46 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:45:46 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:45:46 user nova-compute[72362]:     </rng>
Aug 09 10:45:46 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:45:46 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:45:46 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:45:46 user nova-compute[72362]:     </memballoon>
Aug 09 10:45:46 user nova-compute[72362]:   </devices>
Aug 09 10:45:46 user nova-compute[72362]: </domain>
Aug 09 10:45:46 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:45:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:45:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1646693656',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1646693656',id=46,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/aGUSj56P3CF+AbqqVXGNF0P/OweU114ZrKxiQ7YSDnLkroHTWcMIUzf2DBS55CS9oLSk9ocs6C9FMw7qXL+rrCRRbxlx+Zy16d7Ch/20WCb8l2ERymAdmhPJHshV2cg==',key_name='tempest-keypair-1790414929',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f9d6a60f24d41deb91ae59189c62ba2',ramdisk_id='',reservation_id='r-9y258rcd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2139825844',owner_user_name='tempest-AttachVolumeShelveTestJSON-2139825844-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:45:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='299166afe21b4d3cac05fdb072a78a78',uuid=c9b8c0c6-7afc-4f0b-ba06-3eccd4726124,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bba009ea-bb2e-4952-98ee-4dd1fb2649fc", "address": "fa:16:3e:5b:15:67", "network": {"id": "362446ea-173c-4989-93f8-882088822208", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-499399633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f9d6a60f24d41deb91ae59189c62ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba009ea-bb", "ovs_interfaceid": "bba009ea-bb2e-4952-98ee-4dd1fb2649fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:45:46 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Converting VIF {"id": "bba009ea-bb2e-4952-98ee-4dd1fb2649fc", "address": "fa:16:3e:5b:15:67", "network": {"id": "362446ea-173c-4989-93f8-882088822208", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-499399633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f9d6a60f24d41deb91ae59189c62ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba009ea-bb", "ovs_interfaceid": "bba009ea-bb2e-4952-98ee-4dd1fb2649fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:45:46 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:15:67,bridge_name='br-int',has_traffic_filtering=True,id=bba009ea-bb2e-4952-98ee-4dd1fb2649fc,network=Network(362446ea-173c-4989-93f8-882088822208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbba009ea-bb') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:45:46 user nova-compute[72362]: DEBUG os_vif [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:15:67,bridge_name='br-int',has_traffic_filtering=True,id=bba009ea-bb2e-4952-98ee-4dd1fb2649fc,network=Network(362446ea-173c-4989-93f8-882088822208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbba009ea-bb') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:45:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:45:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:45:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:45:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:45:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbba009ea-bb, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:45:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbba009ea-bb, col_values=(('external_ids', {'iface-id': 'bba009ea-bb2e-4952-98ee-4dd1fb2649fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:15:67', 'vm-uuid': 'c9b8c0c6-7afc-4f0b-ba06-3eccd4726124'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:45:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:45:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:45:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:45:46 user nova-compute[72362]: INFO os_vif [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:15:67,bridge_name='br-int',has_traffic_filtering=True,id=bba009ea-bb2e-4952-98ee-4dd1fb2649fc,network=Network(362446ea-173c-4989-93f8-882088822208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbba009ea-bb')
Aug 09 10:45:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:45:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] No VIF found with MAC fa:16:3e:5b:15:67, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:45:47 user nova-compute[72362]: DEBUG nova.network.neutron [req-6d61e7e2-3615-4570-986f-02ffde217d6e req-14d7f191-ad59-41eb-b8d1-f62482758378 service nova] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Updated VIF entry in instance network info cache for port bba009ea-bb2e-4952-98ee-4dd1fb2649fc. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:45:47 user nova-compute[72362]: DEBUG nova.network.neutron [req-6d61e7e2-3615-4570-986f-02ffde217d6e req-14d7f191-ad59-41eb-b8d1-f62482758378 service nova] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Updating instance_info_cache with network_info: [{"id": "bba009ea-bb2e-4952-98ee-4dd1fb2649fc", "address": "fa:16:3e:5b:15:67", "network": {"id": "362446ea-173c-4989-93f8-882088822208", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-499399633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f9d6a60f24d41deb91ae59189c62ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba009ea-bb", "ovs_interfaceid": "bba009ea-bb2e-4952-98ee-4dd1fb2649fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:45:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-6d61e7e2-3615-4570-986f-02ffde217d6e req-14d7f191-ad59-41eb-b8d1-f62482758378 service nova] Releasing lock "refresh_cache-c9b8c0c6-7afc-4f0b-ba06-3eccd4726124" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:45:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:45:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:45:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:45:48 user nova-compute[72362]: DEBUG nova.compute.manager [req-41818592-a2d3-44a0-b466-23fb57c3eb0a req-57b09159-01f6-4a9c-a728-f57e00e43c9c service nova] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Received event network-vif-plugged-bba009ea-bb2e-4952-98ee-4dd1fb2649fc {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:45:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-41818592-a2d3-44a0-b466-23fb57c3eb0a req-57b09159-01f6-4a9c-a728-f57e00e43c9c service nova] Acquiring lock "c9b8c0c6-7afc-4f0b-ba06-3eccd4726124-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:45:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-41818592-a2d3-44a0-b466-23fb57c3eb0a req-57b09159-01f6-4a9c-a728-f57e00e43c9c service nova] Lock "c9b8c0c6-7afc-4f0b-ba06-3eccd4726124-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:45:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-41818592-a2d3-44a0-b466-23fb57c3eb0a req-57b09159-01f6-4a9c-a728-f57e00e43c9c service nova] Lock "c9b8c0c6-7afc-4f0b-ba06-3eccd4726124-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:45:48 user nova-compute[72362]: DEBUG nova.compute.manager [req-41818592-a2d3-44a0-b466-23fb57c3eb0a req-57b09159-01f6-4a9c-a728-f57e00e43c9c service nova] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] No waiting events found dispatching network-vif-plugged-bba009ea-bb2e-4952-98ee-4dd1fb2649fc {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:45:48 user nova-compute[72362]: WARNING nova.compute.manager [req-41818592-a2d3-44a0-b466-23fb57c3eb0a req-57b09159-01f6-4a9c-a728-f57e00e43c9c service nova] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Received unexpected event network-vif-plugged-bba009ea-bb2e-4952-98ee-4dd1fb2649fc for instance with vm_state building and task_state spawning.
Aug 09 10:45:48 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:45:48 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:45:48 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:45:48 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:45:49 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577949.9211025, c9b8c0c6-7afc-4f0b-ba06-3eccd4726124 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:45:49 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] VM Resumed (Lifecycle Event)
Aug 09 10:45:49 user nova-compute[72362]: DEBUG nova.compute.manager [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:45:49 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:45:49 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Instance spawned successfully.
Aug 09 10:45:49 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 10:45:49 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:45:49 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:45:49 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Found default for hw_cdrom_bus of ide {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:45:49 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Found default for hw_disk_bus of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:45:49 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:45:49 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:45:49 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Found default for hw_video_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:45:49 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Found default for hw_vif_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:45:49 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:45:49 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577949.9226406, c9b8c0c6-7afc-4f0b-ba06-3eccd4726124 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:45:49 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] VM Started (Lifecycle Event)
Aug 09 10:45:49 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:45:49 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:45:50 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:45:50 user nova-compute[72362]: INFO nova.compute.manager [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Took 5.43 seconds to spawn the instance on the hypervisor.
Aug 09 10:45:50 user nova-compute[72362]: DEBUG nova.compute.manager [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:45:50 user nova-compute[72362]: DEBUG nova.compute.manager [req-8fc7bfe6-97f5-408d-b0aa-802143e3c696 req-eac8e300-a139-4a1c-8bed-30812b5f8a5e service nova] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Received event network-vif-plugged-bba009ea-bb2e-4952-98ee-4dd1fb2649fc {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:45:50 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8fc7bfe6-97f5-408d-b0aa-802143e3c696 req-eac8e300-a139-4a1c-8bed-30812b5f8a5e service nova] Acquiring lock "c9b8c0c6-7afc-4f0b-ba06-3eccd4726124-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:45:50 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8fc7bfe6-97f5-408d-b0aa-802143e3c696 req-eac8e300-a139-4a1c-8bed-30812b5f8a5e service nova] Lock "c9b8c0c6-7afc-4f0b-ba06-3eccd4726124-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:45:50 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8fc7bfe6-97f5-408d-b0aa-802143e3c696 req-eac8e300-a139-4a1c-8bed-30812b5f8a5e service nova] Lock "c9b8c0c6-7afc-4f0b-ba06-3eccd4726124-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:45:50 user nova-compute[72362]: DEBUG nova.compute.manager [req-8fc7bfe6-97f5-408d-b0aa-802143e3c696 req-eac8e300-a139-4a1c-8bed-30812b5f8a5e service nova] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] No waiting events found dispatching network-vif-plugged-bba009ea-bb2e-4952-98ee-4dd1fb2649fc {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:45:50 user nova-compute[72362]: WARNING nova.compute.manager [req-8fc7bfe6-97f5-408d-b0aa-802143e3c696 req-eac8e300-a139-4a1c-8bed-30812b5f8a5e service nova] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Received unexpected event network-vif-plugged-bba009ea-bb2e-4952-98ee-4dd1fb2649fc for instance with vm_state building and task_state spawning.
Aug 09 10:45:50 user nova-compute[72362]: INFO nova.compute.manager [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Took 6.05 seconds to build instance.
Aug 09 10:45:50 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-645c1f94-5487-49d9-8f55-727630ffb57f tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "c9b8c0c6-7afc-4f0b-ba06-3eccd4726124" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.155s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:45:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:45:52 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:45:55 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691577940.1013045, 37f4a735-db06-4ad9-81f8-1863330628f9 => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:45:55 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] VM Stopped (Lifecycle Event)
Aug 09 10:45:55 user nova-compute[72362]: DEBUG nova.compute.manager [None req-86da80ab-d264-461f-babc-f4d39f146c3f None None] [instance: 37f4a735-db06-4ad9-81f8-1863330628f9] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:45:56 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:46:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:46:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:46:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 10:46:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 10:46:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 10:46:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:46:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:46:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:46:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Acquiring lock "81ffae79-ce4c-440c-a157-ca922637aa67" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:46:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "81ffae79-ce4c-440c-a157-ca922637aa67" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:46:11 user nova-compute[72362]: DEBUG nova.compute.manager [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Starting instance... {{(pid=72362) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 10:46:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:46:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:46:11 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:46:11 user nova-compute[72362]: INFO nova.compute.claims [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Claim successful on node user
Aug 09 10:46:11 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:46:11 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:46:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.287s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:46:11 user nova-compute[72362]: DEBUG nova.compute.manager [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Start building networks asynchronously for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 10:46:11 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:46:11 user nova-compute[72362]: DEBUG nova.compute.manager [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Allocating IP information in the background. {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 10:46:11 user nova-compute[72362]: DEBUG nova.network.neutron [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] allocate_for_instance() {{(pid=72362) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 10:46:11 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 10:46:11 user nova-compute[72362]: DEBUG nova.compute.manager [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Start building block device mappings for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 10:46:11 user nova-compute[72362]: DEBUG nova.compute.manager [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Start spawning the instance on the hypervisor. {{(pid=72362) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 10:46:11 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:46:11 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Creating image(s)
Aug 09 10:46:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Acquiring lock "/opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:46:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "/opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:46:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "/opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:46:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:46:11 user nova-compute[72362]: DEBUG nova.policy [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1f5cb1727c864652a6873a38ec1f7bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac17209f912a4f248dd642be32a75ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72362) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 10:46:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.134s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:46:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Acquiring lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:46:11 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:46:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:46:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.135s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:46:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67/disk 1073741824 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:46:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:46:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67/disk 1073741824" returned: 0 in 0.143s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:46:12 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:46:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:46:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.129s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:46:12 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Checking if we can resize image /opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67/disk. size=1073741824 {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 10:46:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:46:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:46:12 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Cannot resize image /opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67/disk to a smaller size. {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 10:46:12 user nova-compute[72362]: DEBUG nova.objects.instance [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lazy-loading 'migration_context' on Instance uuid 81ffae79-ce4c-440c-a157-ca922637aa67 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:46:12 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Created local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 10:46:12 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Ensure instance console log exists: /opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:46:12 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:46:12 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:46:12 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:46:12 user nova-compute[72362]: DEBUG nova.network.neutron [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Successfully created port: 2040dc53-585b-4375-a169-539195f3f01a {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:46:13 user nova-compute[72362]: DEBUG nova.network.neutron [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Successfully updated port: 2040dc53-585b-4375-a169-539195f3f01a {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:46:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Acquiring lock "refresh_cache-81ffae79-ce4c-440c-a157-ca922637aa67" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:46:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Acquired lock "refresh_cache-81ffae79-ce4c-440c-a157-ca922637aa67" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:46:13 user nova-compute[72362]: DEBUG nova.network.neutron [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:46:13 user nova-compute[72362]: DEBUG nova.compute.manager [req-ee85f26d-39be-42d7-97b7-86e9389408fe req-51a0e7c9-44cb-4391-9480-5502dfe3cc01 service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Received event network-changed-2040dc53-585b-4375-a169-539195f3f01a {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:46:13 user nova-compute[72362]: DEBUG nova.compute.manager [req-ee85f26d-39be-42d7-97b7-86e9389408fe req-51a0e7c9-44cb-4391-9480-5502dfe3cc01 service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Refreshing instance network info cache due to event network-changed-2040dc53-585b-4375-a169-539195f3f01a. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:46:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ee85f26d-39be-42d7-97b7-86e9389408fe req-51a0e7c9-44cb-4391-9480-5502dfe3cc01 service nova] Acquiring lock "refresh_cache-81ffae79-ce4c-440c-a157-ca922637aa67" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:46:13 user nova-compute[72362]: DEBUG nova.network.neutron [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:46:13 user nova-compute[72362]: DEBUG nova.network.neutron [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Updating instance_info_cache with network_info: [{"id": "2040dc53-585b-4375-a169-539195f3f01a", "address": "fa:16:3e:bf:cc:bc", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2040dc53-58", "ovs_interfaceid": "2040dc53-585b-4375-a169-539195f3f01a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:46:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Releasing lock "refresh_cache-81ffae79-ce4c-440c-a157-ca922637aa67" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:46:13 user nova-compute[72362]: DEBUG nova.compute.manager [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Instance network_info: |[{"id": "2040dc53-585b-4375-a169-539195f3f01a", "address": "fa:16:3e:bf:cc:bc", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2040dc53-58", "ovs_interfaceid": "2040dc53-585b-4375-a169-539195f3f01a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 10:46:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ee85f26d-39be-42d7-97b7-86e9389408fe req-51a0e7c9-44cb-4391-9480-5502dfe3cc01 service nova] Acquired lock "refresh_cache-81ffae79-ce4c-440c-a157-ca922637aa67" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:46:13 user nova-compute[72362]: DEBUG nova.network.neutron [req-ee85f26d-39be-42d7-97b7-86e9389408fe req-51a0e7c9-44cb-4391-9480-5502dfe3cc01 service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Refreshing network info cache for port 2040dc53-585b-4375-a169-539195f3f01a {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:46:13 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Start _get_guest_xml network_info=[{"id": "2040dc53-585b-4375-a169-539195f3f01a", "address": "fa:16:3e:bf:cc:bc", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2040dc53-58", "ovs_interfaceid": "2040dc53-585b-4375-a169-539195f3f01a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': 'a08d1a11-49eb-4212-a351-e11ee9553b95'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:46:13 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:46:13 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:46:13 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:46:13 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:46:13 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:46:13 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:46:13 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:46:13 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:46:13 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:46:13 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:46:13 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:46:13 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:46:13 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:46:13 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:46:13 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:46:13 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:46:13 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:46:13 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:46:13 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:46:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1747996005',display_name='tempest-ServerRescueNegativeTestJSON-server-1747996005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1747996005',id=47,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9u+jSQAbl4/4M/00B4pWaL842BUe6igGo0u0lp/kfY2qPhzDf6WwQ0haooq3XCwTQ77Omf3HbZr8hbYJqu3EhEtcVeo53mlt3HO6yLEVEfybG3EqmsToBGkF14LFJC7A==',key_name='tempest-keypair-879942599',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac17209f912a4f248dd642be32a75ede',ramdisk_id='',reservation_id='r-pgibaoux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1453574557',owner_user_name='tempest-ServerRescueNegativeTestJSON-1453574557-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:46:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f5cb1727c864652a6873a38ec1f7bf7',uuid=81ffae79-ce4c-440c-a157-ca922637aa67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2040dc53-585b-4375-a169-539195f3f01a", "address": "fa:16:3e:bf:cc:bc", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2040dc53-58", "ovs_interfaceid": "2040dc53-585b-4375-a169-539195f3f01a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:46:13 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Converting VIF {"id": "2040dc53-585b-4375-a169-539195f3f01a", "address": "fa:16:3e:bf:cc:bc", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2040dc53-58", "ovs_interfaceid": "2040dc53-585b-4375-a169-539195f3f01a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:46:13 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:cc:bc,bridge_name='br-int',has_traffic_filtering=True,id=2040dc53-585b-4375-a169-539195f3f01a,network=Network(2f70b9cc-bc8f-46d8-9633-542cd881c89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2040dc53-58') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:46:13 user nova-compute[72362]: DEBUG nova.objects.instance [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lazy-loading 'pci_devices' on Instance uuid 81ffae79-ce4c-440c-a157-ca922637aa67 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:46:13 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:46:13 user nova-compute[72362]:   <uuid>81ffae79-ce4c-440c-a157-ca922637aa67</uuid>
Aug 09 10:46:13 user nova-compute[72362]:   <name>instance-0000002f</name>
Aug 09 10:46:13 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:46:13 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:46:13 user nova-compute[72362]:   <metadata>
Aug 09 10:46:13 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:46:13 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:46:13 user nova-compute[72362]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1747996005</nova:name>
Aug 09 10:46:13 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:46:13</nova:creationTime>
Aug 09 10:46:13 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:46:13 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:46:13 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:46:13 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:46:13 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:46:13 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:46:13 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:46:13 user nova-compute[72362]:       <nova:owner>
Aug 09 10:46:13 user nova-compute[72362]:         <nova:user uuid="1f5cb1727c864652a6873a38ec1f7bf7">tempest-ServerRescueNegativeTestJSON-1453574557-project-member</nova:user>
Aug 09 10:46:13 user nova-compute[72362]:         <nova:project uuid="ac17209f912a4f248dd642be32a75ede">tempest-ServerRescueNegativeTestJSON-1453574557</nova:project>
Aug 09 10:46:13 user nova-compute[72362]:       </nova:owner>
Aug 09 10:46:13 user nova-compute[72362]:       <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:46:13 user nova-compute[72362]:       <nova:ports>
Aug 09 10:46:13 user nova-compute[72362]:         <nova:port uuid="2040dc53-585b-4375-a169-539195f3f01a">
Aug 09 10:46:13 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 10:46:13 user nova-compute[72362]:         </nova:port>
Aug 09 10:46:13 user nova-compute[72362]:       </nova:ports>
Aug 09 10:46:13 user nova-compute[72362]:     </nova:instance>
Aug 09 10:46:13 user nova-compute[72362]:   </metadata>
Aug 09 10:46:13 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:46:13 user nova-compute[72362]:     <system>
Aug 09 10:46:13 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:46:13 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:46:13 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:46:13 user nova-compute[72362]:       <entry name="serial">81ffae79-ce4c-440c-a157-ca922637aa67</entry>
Aug 09 10:46:13 user nova-compute[72362]:       <entry name="uuid">81ffae79-ce4c-440c-a157-ca922637aa67</entry>
Aug 09 10:46:13 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:46:13 user nova-compute[72362]:     </system>
Aug 09 10:46:13 user nova-compute[72362]:   </sysinfo>
Aug 09 10:46:13 user nova-compute[72362]:   <os>
Aug 09 10:46:13 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:46:13 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:46:13 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:46:13 user nova-compute[72362]:   </os>
Aug 09 10:46:13 user nova-compute[72362]:   <features>
Aug 09 10:46:13 user nova-compute[72362]:     <acpi/>
Aug 09 10:46:13 user nova-compute[72362]:     <apic/>
Aug 09 10:46:13 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:46:13 user nova-compute[72362]:   </features>
Aug 09 10:46:13 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:46:13 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:46:13 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:46:13 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:46:13 user nova-compute[72362]:   </clock>
Aug 09 10:46:13 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:46:13 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:46:13 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:46:13 user nova-compute[72362]:   </cpu>
Aug 09 10:46:13 user nova-compute[72362]:   <devices>
Aug 09 10:46:13 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:46:13 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:46:13 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67/disk"/>
Aug 09 10:46:13 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:46:13 user nova-compute[72362]:     </disk>
Aug 09 10:46:13 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:46:13 user nova-compute[72362]:       <mac address="fa:16:3e:bf:cc:bc"/>
Aug 09 10:46:13 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:46:13 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:46:13 user nova-compute[72362]:       <target dev="tap2040dc53-58"/>
Aug 09 10:46:13 user nova-compute[72362]:     </interface>
Aug 09 10:46:13 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:46:13 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67/console.log" append="off"/>
Aug 09 10:46:13 user nova-compute[72362]:     </serial>
Aug 09 10:46:13 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:46:13 user nova-compute[72362]:     <video>
Aug 09 10:46:13 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:46:13 user nova-compute[72362]:     </video>
Aug 09 10:46:13 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:46:13 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:46:13 user nova-compute[72362]:     </rng>
Aug 09 10:46:13 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:46:13 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:46:13 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:46:13 user nova-compute[72362]:     </memballoon>
Aug 09 10:46:13 user nova-compute[72362]:   </devices>
Aug 09 10:46:13 user nova-compute[72362]: </domain>
Aug 09 10:46:13 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:46:13 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:46:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1747996005',display_name='tempest-ServerRescueNegativeTestJSON-server-1747996005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1747996005',id=47,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9u+jSQAbl4/4M/00B4pWaL842BUe6igGo0u0lp/kfY2qPhzDf6WwQ0haooq3XCwTQ77Omf3HbZr8hbYJqu3EhEtcVeo53mlt3HO6yLEVEfybG3EqmsToBGkF14LFJC7A==',key_name='tempest-keypair-879942599',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac17209f912a4f248dd642be32a75ede',ramdisk_id='',reservation_id='r-pgibaoux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1453574557',owner_user_name='tempest-ServerRescueNegativeTestJSON-1453574557-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:46:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f5cb1727c864652a6873a38ec1f7bf7',uuid=81ffae79-ce4c-440c-a157-ca922637aa67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2040dc53-585b-4375-a169-539195f3f01a", "address": "fa:16:3e:bf:cc:bc", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2040dc53-58", "ovs_interfaceid": "2040dc53-585b-4375-a169-539195f3f01a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:46:13 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Converting VIF {"id": "2040dc53-585b-4375-a169-539195f3f01a", "address": "fa:16:3e:bf:cc:bc", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2040dc53-58", "ovs_interfaceid": "2040dc53-585b-4375-a169-539195f3f01a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:46:13 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:cc:bc,bridge_name='br-int',has_traffic_filtering=True,id=2040dc53-585b-4375-a169-539195f3f01a,network=Network(2f70b9cc-bc8f-46d8-9633-542cd881c89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2040dc53-58') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:46:13 user nova-compute[72362]: DEBUG os_vif [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:cc:bc,bridge_name='br-int',has_traffic_filtering=True,id=2040dc53-585b-4375-a169-539195f3f01a,network=Network(2f70b9cc-bc8f-46d8-9633-542cd881c89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2040dc53-58') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:46:13 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:46:13 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:46:13 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:46:13 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:46:13 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2040dc53-58, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:46:13 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2040dc53-58, col_values=(('external_ids', {'iface-id': '2040dc53-585b-4375-a169-539195f3f01a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:cc:bc', 'vm-uuid': '81ffae79-ce4c-440c-a157-ca922637aa67'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:46:13 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:46:13 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:46:13 user nova-compute[72362]: INFO os_vif [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:cc:bc,bridge_name='br-int',has_traffic_filtering=True,id=2040dc53-585b-4375-a169-539195f3f01a,network=Network(2f70b9cc-bc8f-46d8-9633-542cd881c89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2040dc53-58')
Aug 09 10:46:14 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:46:14 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] No VIF found with MAC fa:16:3e:bf:cc:bc, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:46:14 user nova-compute[72362]: DEBUG nova.network.neutron [req-ee85f26d-39be-42d7-97b7-86e9389408fe req-51a0e7c9-44cb-4391-9480-5502dfe3cc01 service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Updated VIF entry in instance network info cache for port 2040dc53-585b-4375-a169-539195f3f01a. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:46:14 user nova-compute[72362]: DEBUG nova.network.neutron [req-ee85f26d-39be-42d7-97b7-86e9389408fe req-51a0e7c9-44cb-4391-9480-5502dfe3cc01 service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Updating instance_info_cache with network_info: [{"id": "2040dc53-585b-4375-a169-539195f3f01a", "address": "fa:16:3e:bf:cc:bc", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2040dc53-58", "ovs_interfaceid": "2040dc53-585b-4375-a169-539195f3f01a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:46:14 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ee85f26d-39be-42d7-97b7-86e9389408fe req-51a0e7c9-44cb-4391-9480-5502dfe3cc01 service nova] Releasing lock "refresh_cache-81ffae79-ce4c-440c-a157-ca922637aa67" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:46:15 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:46:15 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:46:15 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:46:15 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:46:15 user nova-compute[72362]: DEBUG nova.compute.manager [req-9c178be3-d489-4e72-ab8c-5484bc7be7d5 req-89015562-2ba7-4606-a0a5-50c66c5fedaf service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Received event network-vif-plugged-2040dc53-585b-4375-a169-539195f3f01a {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:46:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-9c178be3-d489-4e72-ab8c-5484bc7be7d5 req-89015562-2ba7-4606-a0a5-50c66c5fedaf service nova] Acquiring lock "81ffae79-ce4c-440c-a157-ca922637aa67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:46:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-9c178be3-d489-4e72-ab8c-5484bc7be7d5 req-89015562-2ba7-4606-a0a5-50c66c5fedaf service nova] Lock "81ffae79-ce4c-440c-a157-ca922637aa67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:46:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-9c178be3-d489-4e72-ab8c-5484bc7be7d5 req-89015562-2ba7-4606-a0a5-50c66c5fedaf service nova] Lock "81ffae79-ce4c-440c-a157-ca922637aa67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:46:15 user nova-compute[72362]: DEBUG nova.compute.manager [req-9c178be3-d489-4e72-ab8c-5484bc7be7d5 req-89015562-2ba7-4606-a0a5-50c66c5fedaf service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] No waiting events found dispatching network-vif-plugged-2040dc53-585b-4375-a169-539195f3f01a {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:46:15 user nova-compute[72362]: WARNING nova.compute.manager [req-9c178be3-d489-4e72-ab8c-5484bc7be7d5 req-89015562-2ba7-4606-a0a5-50c66c5fedaf service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Received unexpected event network-vif-plugged-2040dc53-585b-4375-a169-539195f3f01a for instance with vm_state building and task_state spawning.
Aug 09 10:46:15 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:46:16 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:46:16 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:46:16 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:46:16 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 10:46:16 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:46:16 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:46:16 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:46:17 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:46:17 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577977.3577178, 81ffae79-ce4c-440c-a157-ca922637aa67 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:46:17 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] VM Resumed (Lifecycle Event)
Aug 09 10:46:17 user nova-compute[72362]: DEBUG nova.compute.manager [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:46:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:46:17 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Instance spawned successfully.
Aug 09 10:46:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 10:46:17 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:46:17 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:46:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Found default for hw_cdrom_bus of ide {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:46:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Found default for hw_disk_bus of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:46:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:46:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:46:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Found default for hw_video_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:46:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Found default for hw_vif_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:46:17 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:46:17 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691577977.3593202, 81ffae79-ce4c-440c-a157-ca922637aa67 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:46:17 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] VM Started (Lifecycle Event)
Aug 09 10:46:17 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:46:17 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:46:17 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:46:17 user nova-compute[72362]: INFO nova.compute.manager [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Took 5.71 seconds to spawn the instance on the hypervisor.
Aug 09 10:46:17 user nova-compute[72362]: DEBUG nova.compute.manager [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:46:17 user nova-compute[72362]: DEBUG nova.compute.manager [req-905778f4-a47f-418e-a15b-1dd81dac011f req-28d35cc8-dfaa-4f1a-b394-604817bf53a3 service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Received event network-vif-plugged-2040dc53-585b-4375-a169-539195f3f01a {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:46:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-905778f4-a47f-418e-a15b-1dd81dac011f req-28d35cc8-dfaa-4f1a-b394-604817bf53a3 service nova] Acquiring lock "81ffae79-ce4c-440c-a157-ca922637aa67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:46:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-905778f4-a47f-418e-a15b-1dd81dac011f req-28d35cc8-dfaa-4f1a-b394-604817bf53a3 service nova] Lock "81ffae79-ce4c-440c-a157-ca922637aa67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:46:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-905778f4-a47f-418e-a15b-1dd81dac011f req-28d35cc8-dfaa-4f1a-b394-604817bf53a3 service nova] Lock "81ffae79-ce4c-440c-a157-ca922637aa67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:46:17 user nova-compute[72362]: DEBUG nova.compute.manager [req-905778f4-a47f-418e-a15b-1dd81dac011f req-28d35cc8-dfaa-4f1a-b394-604817bf53a3 service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] No waiting events found dispatching network-vif-plugged-2040dc53-585b-4375-a169-539195f3f01a {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:46:17 user nova-compute[72362]: WARNING nova.compute.manager [req-905778f4-a47f-418e-a15b-1dd81dac011f req-28d35cc8-dfaa-4f1a-b394-604817bf53a3 service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Received unexpected event network-vif-plugged-2040dc53-585b-4375-a169-539195f3f01a for instance with vm_state active and task_state None.
Aug 09 10:46:17 user nova-compute[72362]: INFO nova.compute.manager [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Took 6.31 seconds to build instance.
Aug 09 10:46:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-9b22838e-4d1b-494c-b5a5-9510268c00d8 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "81ffae79-ce4c-440c-a157-ca922637aa67" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.395s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:46:17 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:46:18 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:46:18 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:46:18 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 10:46:19 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Didn't find any instances for network info cache update. {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 10:46:20 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:46:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:46:23 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:46:24 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:46:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:46:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:46:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:46:25 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 10:46:25 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:46:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:46:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:46:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:46:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:46:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:46:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:46:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:46:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:46:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:46:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:46:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:46:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:46:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:46:26 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:46:26 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:46:26 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:46:26 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b8c0c6-7afc-4f0b-ba06-3eccd4726124/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:46:26 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b8c0c6-7afc-4f0b-ba06-3eccd4726124/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:46:26 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b8c0c6-7afc-4f0b-ba06-3eccd4726124/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:46:26 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b8c0c6-7afc-4f0b-ba06-3eccd4726124/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:46:26 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:46:26 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:46:26 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=8249MB free_disk=25.087875366210938GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 10:46:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:46:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:46:27 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance cefe383b-978f-4391-baf6-3b3ad17e0083 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:46:27 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 4296ca4c-1e3e-474f-98ba-9f947d333b8d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:46:27 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance ab34d860-52ba-4773-9f80-84930bbd06d0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:46:27 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance c9b8c0c6-7afc-4f0b-ba06-3eccd4726124 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:46:27 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 81ffae79-ce4c-440c-a157-ca922637aa67 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:46:27 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 10:46:27 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 10:46:27 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:46:27 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:46:27 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 10:46:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.381s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:46:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:46:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:46:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "b1b76bf2-10c2-41e7-bb51-4be3cdc70649" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:46:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "b1b76bf2-10c2-41e7-bb51-4be3cdc70649" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:46:33 user nova-compute[72362]: DEBUG nova.compute.manager [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Starting instance... {{(pid=72362) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 10:46:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:46:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:46:33 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:46:33 user nova-compute[72362]: INFO nova.compute.claims [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Claim successful on node user
Aug 09 10:46:33 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:46:33 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:46:33 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:46:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.341s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:46:34 user nova-compute[72362]: DEBUG nova.compute.manager [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Start building networks asynchronously for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 10:46:34 user nova-compute[72362]: DEBUG nova.compute.manager [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Allocating IP information in the background. {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 10:46:34 user nova-compute[72362]: DEBUG nova.network.neutron [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] allocate_for_instance() {{(pid=72362) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 10:46:34 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 10:46:34 user nova-compute[72362]: DEBUG nova.compute.manager [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Start building block device mappings for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 10:46:34 user nova-compute[72362]: DEBUG nova.policy [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bed469ff9d954891905c98bdf238c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980f1c36cab0449b949419cf495c16d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72362) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 10:46:34 user nova-compute[72362]: DEBUG nova.compute.manager [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Start spawning the instance on the hypervisor. {{(pid=72362) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 10:46:34 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:46:34 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Creating image(s)
Aug 09 10:46:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "/opt/stack/data/nova/instances/b1b76bf2-10c2-41e7-bb51-4be3cdc70649/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:46:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "/opt/stack/data/nova/instances/b1b76bf2-10c2-41e7-bb51-4be3cdc70649/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:46:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "/opt/stack/data/nova/instances/b1b76bf2-10c2-41e7-bb51-4be3cdc70649/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:46:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:46:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.133s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:46:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:46:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:46:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:46:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.147s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:46:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/b1b76bf2-10c2-41e7-bb51-4be3cdc70649/disk 1073741824 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:46:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/b1b76bf2-10c2-41e7-bb51-4be3cdc70649/disk 1073741824" returned: 0 in 0.052s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:46:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:46:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:46:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.131s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:46:34 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b1b76bf2-10c2-41e7-bb51-4be3cdc70649/disk. size=1073741824 {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 10:46:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1b76bf2-10c2-41e7-bb51-4be3cdc70649/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:46:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1b76bf2-10c2-41e7-bb51-4be3cdc70649/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:46:34 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Cannot resize image /opt/stack/data/nova/instances/b1b76bf2-10c2-41e7-bb51-4be3cdc70649/disk to a smaller size. {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 10:46:34 user nova-compute[72362]: DEBUG nova.objects.instance [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lazy-loading 'migration_context' on Instance uuid b1b76bf2-10c2-41e7-bb51-4be3cdc70649 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:46:34 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Created local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 10:46:34 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Ensure instance console log exists: /opt/stack/data/nova/instances/b1b76bf2-10c2-41e7-bb51-4be3cdc70649/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:46:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:46:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:46:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:46:34 user nova-compute[72362]: DEBUG nova.network.neutron [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Successfully created port: 87c03a9a-d79a-47d2-9890-ebc571cd89e7 {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:46:36 user nova-compute[72362]: DEBUG nova.network.neutron [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Successfully updated port: 87c03a9a-d79a-47d2-9890-ebc571cd89e7 {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:46:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "refresh_cache-b1b76bf2-10c2-41e7-bb51-4be3cdc70649" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:46:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquired lock "refresh_cache-b1b76bf2-10c2-41e7-bb51-4be3cdc70649" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:46:36 user nova-compute[72362]: DEBUG nova.network.neutron [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:46:36 user nova-compute[72362]: DEBUG nova.compute.manager [req-e27b8b26-e70e-4d29-a751-48228bf8b655 req-2792802b-46a0-4c68-a2f5-9635c0645ce2 service nova] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Received event network-changed-87c03a9a-d79a-47d2-9890-ebc571cd89e7 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:46:36 user nova-compute[72362]: DEBUG nova.compute.manager [req-e27b8b26-e70e-4d29-a751-48228bf8b655 req-2792802b-46a0-4c68-a2f5-9635c0645ce2 service nova] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Refreshing instance network info cache due to event network-changed-87c03a9a-d79a-47d2-9890-ebc571cd89e7. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:46:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e27b8b26-e70e-4d29-a751-48228bf8b655 req-2792802b-46a0-4c68-a2f5-9635c0645ce2 service nova] Acquiring lock "refresh_cache-b1b76bf2-10c2-41e7-bb51-4be3cdc70649" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:46:36 user nova-compute[72362]: DEBUG nova.network.neutron [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:46:36 user nova-compute[72362]: DEBUG nova.network.neutron [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Updating instance_info_cache with network_info: [{"id": "87c03a9a-d79a-47d2-9890-ebc571cd89e7", "address": "fa:16:3e:2a:03:e8", "network": {"id": "e56e2a0a-0a6d-4546-86ef-7bb333e829ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1495216341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980f1c36cab0449b949419cf495c16d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87c03a9a-d7", "ovs_interfaceid": "87c03a9a-d79a-47d2-9890-ebc571cd89e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:46:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Releasing lock "refresh_cache-b1b76bf2-10c2-41e7-bb51-4be3cdc70649" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:46:36 user nova-compute[72362]: DEBUG nova.compute.manager [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Instance network_info: |[{"id": "87c03a9a-d79a-47d2-9890-ebc571cd89e7", "address": "fa:16:3e:2a:03:e8", "network": {"id": "e56e2a0a-0a6d-4546-86ef-7bb333e829ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1495216341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980f1c36cab0449b949419cf495c16d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87c03a9a-d7", "ovs_interfaceid": "87c03a9a-d79a-47d2-9890-ebc571cd89e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 10:46:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e27b8b26-e70e-4d29-a751-48228bf8b655 req-2792802b-46a0-4c68-a2f5-9635c0645ce2 service nova] Acquired lock "refresh_cache-b1b76bf2-10c2-41e7-bb51-4be3cdc70649" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:46:36 user nova-compute[72362]: DEBUG nova.network.neutron [req-e27b8b26-e70e-4d29-a751-48228bf8b655 req-2792802b-46a0-4c68-a2f5-9635c0645ce2 service nova] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Refreshing network info cache for port 87c03a9a-d79a-47d2-9890-ebc571cd89e7 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:46:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Start _get_guest_xml network_info=[{"id": "87c03a9a-d79a-47d2-9890-ebc571cd89e7", "address": "fa:16:3e:2a:03:e8", "network": {"id": "e56e2a0a-0a6d-4546-86ef-7bb333e829ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1495216341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980f1c36cab0449b949419cf495c16d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87c03a9a-d7", "ovs_interfaceid": "87c03a9a-d79a-47d2-9890-ebc571cd89e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': 'a08d1a11-49eb-4212-a351-e11ee9553b95'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:46:36 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:46:36 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:46:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:46:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:46:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:46:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:46:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:46:36 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:46:36 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:46:36 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:46:36 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:46:36 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:46:36 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:46:36 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:46:36 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:46:36 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:46:36 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:46:36 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:46:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:46:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1068960077',display_name='tempest-AttachVolumeNegativeTest-server-1068960077',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1068960077',id=48,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBINLYvZhFp2HKk4JykMv2xkICt3deACrncuG96Gs7Ge3BDi0lfs3BtD5fNsJoELC3VeU+8gFiq5p8iU4ruXRtls0CE3CzWGeKxP5NpeTsyYqLHRgJZI32cpEsZU+BkQMGA==',key_name='tempest-keypair-226076808',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='980f1c36cab0449b949419cf495c16d5',ramdisk_id='',reservation_id='r-2ilp9bpy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-486756066',owner_user_name='tempest-AttachVolumeNegativeTest-486756066-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:46:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bed469ff9d954891905c98bdf238c097',uuid=b1b76bf2-10c2-41e7-bb51-4be3cdc70649,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87c03a9a-d79a-47d2-9890-ebc571cd89e7", "address": "fa:16:3e:2a:03:e8", "network": {"id": "e56e2a0a-0a6d-4546-86ef-7bb333e829ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1495216341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980f1c36cab0449b949419cf495c16d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87c03a9a-d7", "ovs_interfaceid": "87c03a9a-d79a-47d2-9890-ebc571cd89e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:46:36 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Converting VIF {"id": "87c03a9a-d79a-47d2-9890-ebc571cd89e7", "address": "fa:16:3e:2a:03:e8", "network": {"id": "e56e2a0a-0a6d-4546-86ef-7bb333e829ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1495216341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980f1c36cab0449b949419cf495c16d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87c03a9a-d7", "ovs_interfaceid": "87c03a9a-d79a-47d2-9890-ebc571cd89e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:46:36 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:03:e8,bridge_name='br-int',has_traffic_filtering=True,id=87c03a9a-d79a-47d2-9890-ebc571cd89e7,network=Network(e56e2a0a-0a6d-4546-86ef-7bb333e829ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87c03a9a-d7') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:46:36 user nova-compute[72362]: DEBUG nova.objects.instance [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lazy-loading 'pci_devices' on Instance uuid b1b76bf2-10c2-41e7-bb51-4be3cdc70649 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:46:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:46:36 user nova-compute[72362]:   <uuid>b1b76bf2-10c2-41e7-bb51-4be3cdc70649</uuid>
Aug 09 10:46:36 user nova-compute[72362]:   <name>instance-00000030</name>
Aug 09 10:46:36 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:46:36 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:46:36 user nova-compute[72362]:   <metadata>
Aug 09 10:46:36 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:46:36 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:46:36 user nova-compute[72362]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1068960077</nova:name>
Aug 09 10:46:36 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:46:36</nova:creationTime>
Aug 09 10:46:36 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:46:36 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:46:36 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:46:36 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:46:36 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:46:36 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:46:36 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:46:36 user nova-compute[72362]:       <nova:owner>
Aug 09 10:46:36 user nova-compute[72362]:         <nova:user uuid="bed469ff9d954891905c98bdf238c097">tempest-AttachVolumeNegativeTest-486756066-project-member</nova:user>
Aug 09 10:46:36 user nova-compute[72362]:         <nova:project uuid="980f1c36cab0449b949419cf495c16d5">tempest-AttachVolumeNegativeTest-486756066</nova:project>
Aug 09 10:46:36 user nova-compute[72362]:       </nova:owner>
Aug 09 10:46:36 user nova-compute[72362]:       <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:46:36 user nova-compute[72362]:       <nova:ports>
Aug 09 10:46:36 user nova-compute[72362]:         <nova:port uuid="87c03a9a-d79a-47d2-9890-ebc571cd89e7">
Aug 09 10:46:36 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 10:46:36 user nova-compute[72362]:         </nova:port>
Aug 09 10:46:36 user nova-compute[72362]:       </nova:ports>
Aug 09 10:46:36 user nova-compute[72362]:     </nova:instance>
Aug 09 10:46:36 user nova-compute[72362]:   </metadata>
Aug 09 10:46:36 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:46:36 user nova-compute[72362]:     <system>
Aug 09 10:46:36 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:46:36 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:46:36 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:46:36 user nova-compute[72362]:       <entry name="serial">b1b76bf2-10c2-41e7-bb51-4be3cdc70649</entry>
Aug 09 10:46:36 user nova-compute[72362]:       <entry name="uuid">b1b76bf2-10c2-41e7-bb51-4be3cdc70649</entry>
Aug 09 10:46:36 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:46:36 user nova-compute[72362]:     </system>
Aug 09 10:46:36 user nova-compute[72362]:   </sysinfo>
Aug 09 10:46:36 user nova-compute[72362]:   <os>
Aug 09 10:46:36 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:46:36 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:46:36 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:46:36 user nova-compute[72362]:   </os>
Aug 09 10:46:36 user nova-compute[72362]:   <features>
Aug 09 10:46:36 user nova-compute[72362]:     <acpi/>
Aug 09 10:46:36 user nova-compute[72362]:     <apic/>
Aug 09 10:46:36 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:46:36 user nova-compute[72362]:   </features>
Aug 09 10:46:36 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:46:36 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:46:36 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:46:36 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:46:36 user nova-compute[72362]:   </clock>
Aug 09 10:46:36 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:46:36 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:46:36 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:46:36 user nova-compute[72362]:   </cpu>
Aug 09 10:46:36 user nova-compute[72362]:   <devices>
Aug 09 10:46:36 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:46:36 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:46:36 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/b1b76bf2-10c2-41e7-bb51-4be3cdc70649/disk"/>
Aug 09 10:46:36 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:46:36 user nova-compute[72362]:     </disk>
Aug 09 10:46:36 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:46:36 user nova-compute[72362]:       <mac address="fa:16:3e:2a:03:e8"/>
Aug 09 10:46:36 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:46:36 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:46:36 user nova-compute[72362]:       <target dev="tap87c03a9a-d7"/>
Aug 09 10:46:36 user nova-compute[72362]:     </interface>
Aug 09 10:46:36 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:46:36 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/b1b76bf2-10c2-41e7-bb51-4be3cdc70649/console.log" append="off"/>
Aug 09 10:46:36 user nova-compute[72362]:     </serial>
Aug 09 10:46:36 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:46:36 user nova-compute[72362]:     <video>
Aug 09 10:46:36 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:46:36 user nova-compute[72362]:     </video>
Aug 09 10:46:36 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:46:36 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:46:36 user nova-compute[72362]:     </rng>
Aug 09 10:46:36 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:46:36 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:46:36 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:46:36 user nova-compute[72362]:     </memballoon>
Aug 09 10:46:36 user nova-compute[72362]:   </devices>
Aug 09 10:46:36 user nova-compute[72362]: </domain>
Aug 09 10:46:36 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:46:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:46:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1068960077',display_name='tempest-AttachVolumeNegativeTest-server-1068960077',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1068960077',id=48,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBINLYvZhFp2HKk4JykMv2xkICt3deACrncuG96Gs7Ge3BDi0lfs3BtD5fNsJoELC3VeU+8gFiq5p8iU4ruXRtls0CE3CzWGeKxP5NpeTsyYqLHRgJZI32cpEsZU+BkQMGA==',key_name='tempest-keypair-226076808',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='980f1c36cab0449b949419cf495c16d5',ramdisk_id='',reservation_id='r-2ilp9bpy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-486756066',owner_user_name='tempest-AttachVolumeNegativeTest-486756066-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:46:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bed469ff9d954891905c98bdf238c097',uuid=b1b76bf2-10c2-41e7-bb51-4be3cdc70649,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87c03a9a-d79a-47d2-9890-ebc571cd89e7", "address": "fa:16:3e:2a:03:e8", "network": {"id": "e56e2a0a-0a6d-4546-86ef-7bb333e829ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1495216341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980f1c36cab0449b949419cf495c16d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87c03a9a-d7", "ovs_interfaceid": "87c03a9a-d79a-47d2-9890-ebc571cd89e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:46:36 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Converting VIF {"id": "87c03a9a-d79a-47d2-9890-ebc571cd89e7", "address": "fa:16:3e:2a:03:e8", "network": {"id": "e56e2a0a-0a6d-4546-86ef-7bb333e829ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1495216341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980f1c36cab0449b949419cf495c16d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87c03a9a-d7", "ovs_interfaceid": "87c03a9a-d79a-47d2-9890-ebc571cd89e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:46:36 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:03:e8,bridge_name='br-int',has_traffic_filtering=True,id=87c03a9a-d79a-47d2-9890-ebc571cd89e7,network=Network(e56e2a0a-0a6d-4546-86ef-7bb333e829ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87c03a9a-d7') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:46:36 user nova-compute[72362]: DEBUG os_vif [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:03:e8,bridge_name='br-int',has_traffic_filtering=True,id=87c03a9a-d79a-47d2-9890-ebc571cd89e7,network=Network(e56e2a0a-0a6d-4546-86ef-7bb333e829ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87c03a9a-d7') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:46:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:46:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:46:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:46:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:46:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap87c03a9a-d7, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:46:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap87c03a9a-d7, col_values=(('external_ids', {'iface-id': '87c03a9a-d79a-47d2-9890-ebc571cd89e7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:03:e8', 'vm-uuid': 'b1b76bf2-10c2-41e7-bb51-4be3cdc70649'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:46:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:46:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:46:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:46:36 user nova-compute[72362]: INFO os_vif [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:03:e8,bridge_name='br-int',has_traffic_filtering=True,id=87c03a9a-d79a-47d2-9890-ebc571cd89e7,network=Network(e56e2a0a-0a6d-4546-86ef-7bb333e829ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87c03a9a-d7')
Aug 09 10:46:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:46:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] No VIF found with MAC fa:16:3e:2a:03:e8, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:46:36 user nova-compute[72362]: DEBUG nova.network.neutron [req-e27b8b26-e70e-4d29-a751-48228bf8b655 req-2792802b-46a0-4c68-a2f5-9635c0645ce2 service nova] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Updated VIF entry in instance network info cache for port 87c03a9a-d79a-47d2-9890-ebc571cd89e7. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:46:36 user nova-compute[72362]: DEBUG nova.network.neutron [req-e27b8b26-e70e-4d29-a751-48228bf8b655 req-2792802b-46a0-4c68-a2f5-9635c0645ce2 service nova] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Updating instance_info_cache with network_info: [{"id": "87c03a9a-d79a-47d2-9890-ebc571cd89e7", "address": "fa:16:3e:2a:03:e8", "network": {"id": "e56e2a0a-0a6d-4546-86ef-7bb333e829ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1495216341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980f1c36cab0449b949419cf495c16d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87c03a9a-d7", "ovs_interfaceid": "87c03a9a-d79a-47d2-9890-ebc571cd89e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:46:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e27b8b26-e70e-4d29-a751-48228bf8b655 req-2792802b-46a0-4c68-a2f5-9635c0645ce2 service nova] Releasing lock "refresh_cache-b1b76bf2-10c2-41e7-bb51-4be3cdc70649" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:46:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:46:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:46:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:46:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:46:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:46:38 user nova-compute[72362]: DEBUG nova.compute.manager [req-2250b122-2462-4890-b712-804c7cc115d7 req-0ad4c846-a735-41c5-b595-2c6a50e775d1 service nova] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Received event network-vif-plugged-87c03a9a-d79a-47d2-9890-ebc571cd89e7 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:46:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-2250b122-2462-4890-b712-804c7cc115d7 req-0ad4c846-a735-41c5-b595-2c6a50e775d1 service nova] Acquiring lock "b1b76bf2-10c2-41e7-bb51-4be3cdc70649-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:46:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-2250b122-2462-4890-b712-804c7cc115d7 req-0ad4c846-a735-41c5-b595-2c6a50e775d1 service nova] Lock "b1b76bf2-10c2-41e7-bb51-4be3cdc70649-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:46:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-2250b122-2462-4890-b712-804c7cc115d7 req-0ad4c846-a735-41c5-b595-2c6a50e775d1 service nova] Lock "b1b76bf2-10c2-41e7-bb51-4be3cdc70649-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:46:38 user nova-compute[72362]: DEBUG nova.compute.manager [req-2250b122-2462-4890-b712-804c7cc115d7 req-0ad4c846-a735-41c5-b595-2c6a50e775d1 service nova] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] No waiting events found dispatching network-vif-plugged-87c03a9a-d79a-47d2-9890-ebc571cd89e7 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:46:38 user nova-compute[72362]: WARNING nova.compute.manager [req-2250b122-2462-4890-b712-804c7cc115d7 req-0ad4c846-a735-41c5-b595-2c6a50e775d1 service nova] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Received unexpected event network-vif-plugged-87c03a9a-d79a-47d2-9890-ebc571cd89e7 for instance with vm_state building and task_state spawning.
Aug 09 10:46:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:46:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:46:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:46:39 user nova-compute[72362]: DEBUG nova.compute.manager [req-10651203-133f-48ad-8645-5357cf31024b req-7f9e1b35-ecfa-454a-9c1b-e04549f4f1d7 service nova] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Received event network-changed-221b0dc3-ded0-4875-8396-51d6013e2aea {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:46:39 user nova-compute[72362]: DEBUG nova.compute.manager [req-10651203-133f-48ad-8645-5357cf31024b req-7f9e1b35-ecfa-454a-9c1b-e04549f4f1d7 service nova] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Refreshing instance network info cache due to event network-changed-221b0dc3-ded0-4875-8396-51d6013e2aea. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:46:39 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-10651203-133f-48ad-8645-5357cf31024b req-7f9e1b35-ecfa-454a-9c1b-e04549f4f1d7 service nova] Acquiring lock "refresh_cache-ab34d860-52ba-4773-9f80-84930bbd06d0" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:46:39 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-10651203-133f-48ad-8645-5357cf31024b req-7f9e1b35-ecfa-454a-9c1b-e04549f4f1d7 service nova] Acquired lock "refresh_cache-ab34d860-52ba-4773-9f80-84930bbd06d0" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:46:39 user nova-compute[72362]: DEBUG nova.network.neutron [req-10651203-133f-48ad-8645-5357cf31024b req-7f9e1b35-ecfa-454a-9c1b-e04549f4f1d7 service nova] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Refreshing network info cache for port 221b0dc3-ded0-4875-8396-51d6013e2aea {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:46:39 user nova-compute[72362]: DEBUG nova.network.neutron [req-10651203-133f-48ad-8645-5357cf31024b req-7f9e1b35-ecfa-454a-9c1b-e04549f4f1d7 service nova] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Updated VIF entry in instance network info cache for port 221b0dc3-ded0-4875-8396-51d6013e2aea. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:46:39 user nova-compute[72362]: DEBUG nova.network.neutron [req-10651203-133f-48ad-8645-5357cf31024b req-7f9e1b35-ecfa-454a-9c1b-e04549f4f1d7 service nova] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Updating instance_info_cache with network_info: [{"id": "221b0dc3-ded0-4875-8396-51d6013e2aea", "address": "fa:16:3e:af:d6:64", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap221b0dc3-de", "ovs_interfaceid": "221b0dc3-ded0-4875-8396-51d6013e2aea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:46:39 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-10651203-133f-48ad-8645-5357cf31024b req-7f9e1b35-ecfa-454a-9c1b-e04549f4f1d7 service nova] Releasing lock "refresh_cache-ab34d860-52ba-4773-9f80-84930bbd06d0" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:46:40 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691578000.1039984, b1b76bf2-10c2-41e7-bb51-4be3cdc70649 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:46:40 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] VM Resumed (Lifecycle Event)
Aug 09 10:46:40 user nova-compute[72362]: DEBUG nova.compute.manager [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:46:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:46:40 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Instance spawned successfully.
Aug 09 10:46:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 10:46:40 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:46:40 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:46:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Found default for hw_cdrom_bus of ide {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:46:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Found default for hw_disk_bus of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:46:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:46:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:46:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Found default for hw_video_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:46:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Found default for hw_vif_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:46:40 user nova-compute[72362]: DEBUG nova.compute.manager [req-88613694-781a-4f4b-8f0e-88d208c8461b req-746ac9d8-ea6f-4c9a-9e8b-ec14388a0135 service nova] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Received event network-vif-plugged-87c03a9a-d79a-47d2-9890-ebc571cd89e7 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:46:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-88613694-781a-4f4b-8f0e-88d208c8461b req-746ac9d8-ea6f-4c9a-9e8b-ec14388a0135 service nova] Acquiring lock "b1b76bf2-10c2-41e7-bb51-4be3cdc70649-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:46:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-88613694-781a-4f4b-8f0e-88d208c8461b req-746ac9d8-ea6f-4c9a-9e8b-ec14388a0135 service nova] Lock "b1b76bf2-10c2-41e7-bb51-4be3cdc70649-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:46:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-88613694-781a-4f4b-8f0e-88d208c8461b req-746ac9d8-ea6f-4c9a-9e8b-ec14388a0135 service nova] Lock "b1b76bf2-10c2-41e7-bb51-4be3cdc70649-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:46:40 user nova-compute[72362]: DEBUG nova.compute.manager [req-88613694-781a-4f4b-8f0e-88d208c8461b req-746ac9d8-ea6f-4c9a-9e8b-ec14388a0135 service nova] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] No waiting events found dispatching network-vif-plugged-87c03a9a-d79a-47d2-9890-ebc571cd89e7 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:46:40 user nova-compute[72362]: WARNING nova.compute.manager [req-88613694-781a-4f4b-8f0e-88d208c8461b req-746ac9d8-ea6f-4c9a-9e8b-ec14388a0135 service nova] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Received unexpected event network-vif-plugged-87c03a9a-d79a-47d2-9890-ebc571cd89e7 for instance with vm_state building and task_state spawning.
Aug 09 10:46:40 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:46:40 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691578000.1057856, b1b76bf2-10c2-41e7-bb51-4be3cdc70649 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:46:40 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] VM Started (Lifecycle Event)
Aug 09 10:46:40 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:46:40 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:46:40 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:46:40 user nova-compute[72362]: INFO nova.compute.manager [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Took 6.01 seconds to spawn the instance on the hypervisor.
Aug 09 10:46:40 user nova-compute[72362]: DEBUG nova.compute.manager [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:46:40 user nova-compute[72362]: INFO nova.compute.manager [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Took 6.73 seconds to build instance.
Aug 09 10:46:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-903da7cd-6a72-4422-8bfb-c58d939ee0ac tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "b1b76bf2-10c2-41e7-bb51-4be3cdc70649" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.831s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:46:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:46:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:46:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:46:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:46:51 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "28daf5f4-214d-440c-bcd6-45f626c40852" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:46:51 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "28daf5f4-214d-440c-bcd6-45f626c40852" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:46:51 user nova-compute[72362]: DEBUG nova.compute.manager [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Starting instance... {{(pid=72362) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 10:46:51 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:46:51 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:46:51 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:46:51 user nova-compute[72362]: INFO nova.compute.claims [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Claim successful on node user
Aug 09 10:46:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:46:51 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:46:51 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:46:51 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.323s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:46:51 user nova-compute[72362]: DEBUG nova.compute.manager [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Start building networks asynchronously for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 10:46:51 user nova-compute[72362]: DEBUG nova.compute.manager [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Allocating IP information in the background. {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 10:46:51 user nova-compute[72362]: DEBUG nova.network.neutron [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] allocate_for_instance() {{(pid=72362) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 10:46:51 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 10:46:51 user nova-compute[72362]: DEBUG nova.compute.manager [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Start building block device mappings for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 10:46:51 user nova-compute[72362]: INFO nova.virt.block_device [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Booting with volume 3bdbad03-f774-48cc-b987-0e0d8eb5556a at /dev/vda
Aug 09 10:46:51 user nova-compute[72362]: DEBUG nova.policy [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e96900e953f64d02bdb5d48f136133c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e38599de0b4b06b723f5647a7fe121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72362) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 10:46:51 user nova-compute[72362]: DEBUG os_brick.utils [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:46:51 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:46:51 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:46:51 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d11a9f0-cee6-42de-b8e9-6e0023dd05f5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:46:51 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:46:51 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:46:51 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[7165a8e3-9c10-4cd8-9984-3198cb6cab0a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:46:51 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:46:51 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:46:51 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0cfe94e-26af-4209-af30-e6c66558d38a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:46:51 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8be2573-c9fd-4a5b-bc0e-d45d4a7db0de]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:46:51 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:46:51 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:46:51 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:46:51 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:46:52 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:46:52 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:46:52 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3097acf2-16e3-433b-8bac-d79e0cb8a659]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:46:52 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:46:52 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:46:52 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:46:52 user nova-compute[72362]: DEBUG os_brick.utils [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:46:52 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Updating existing volume attachment record: 29604091-2b2c-4484-ab83-5592a807acfd {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 10:46:52 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:46:52 user nova-compute[72362]: DEBUG nova.network.neutron [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Successfully created port: 27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3 {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:46:54 user nova-compute[72362]: DEBUG nova.network.neutron [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Successfully updated port: 27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3 {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:46:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "refresh_cache-28daf5f4-214d-440c-bcd6-45f626c40852" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:46:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquired lock "refresh_cache-28daf5f4-214d-440c-bcd6-45f626c40852" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:46:54 user nova-compute[72362]: DEBUG nova.network.neutron [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:46:54 user nova-compute[72362]: DEBUG nova.compute.manager [req-361042f5-2c19-4d88-a24d-129d22badf2c req-bb7677f8-d3f3-47b3-8147-579b74b80222 service nova] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Received event network-changed-27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:46:54 user nova-compute[72362]: DEBUG nova.compute.manager [req-361042f5-2c19-4d88-a24d-129d22badf2c req-bb7677f8-d3f3-47b3-8147-579b74b80222 service nova] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Refreshing instance network info cache due to event network-changed-27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:46:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-361042f5-2c19-4d88-a24d-129d22badf2c req-bb7677f8-d3f3-47b3-8147-579b74b80222 service nova] Acquiring lock "refresh_cache-28daf5f4-214d-440c-bcd6-45f626c40852" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:46:54 user nova-compute[72362]: DEBUG nova.network.neutron [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:46:54 user nova-compute[72362]: DEBUG nova.network.neutron [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Updating instance_info_cache with network_info: [{"id": "27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3", "address": "fa:16:3e:09:d5:d7", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27572bc7-19", "ovs_interfaceid": "27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:46:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Releasing lock "refresh_cache-28daf5f4-214d-440c-bcd6-45f626c40852" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:46:54 user nova-compute[72362]: DEBUG nova.compute.manager [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Instance network_info: |[{"id": "27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3", "address": "fa:16:3e:09:d5:d7", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27572bc7-19", "ovs_interfaceid": "27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 10:46:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-361042f5-2c19-4d88-a24d-129d22badf2c req-bb7677f8-d3f3-47b3-8147-579b74b80222 service nova] Acquired lock "refresh_cache-28daf5f4-214d-440c-bcd6-45f626c40852" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:46:54 user nova-compute[72362]: DEBUG nova.network.neutron [req-361042f5-2c19-4d88-a24d-129d22badf2c req-bb7677f8-d3f3-47b3-8147-579b74b80222 service nova] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Refreshing network info cache for port 27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:46:54 user nova-compute[72362]: DEBUG nova.network.neutron [req-361042f5-2c19-4d88-a24d-129d22badf2c req-bb7677f8-d3f3-47b3-8147-579b74b80222 service nova] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Updated VIF entry in instance network info cache for port 27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:46:54 user nova-compute[72362]: DEBUG nova.network.neutron [req-361042f5-2c19-4d88-a24d-129d22badf2c req-bb7677f8-d3f3-47b3-8147-579b74b80222 service nova] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Updating instance_info_cache with network_info: [{"id": "27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3", "address": "fa:16:3e:09:d5:d7", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27572bc7-19", "ovs_interfaceid": "27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:46:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-361042f5-2c19-4d88-a24d-129d22badf2c req-bb7677f8-d3f3-47b3-8147-579b74b80222 service nova] Releasing lock "refresh_cache-28daf5f4-214d-440c-bcd6-45f626c40852" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:46:56 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:46:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:47:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:47:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG nova.compute.manager [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Start spawning the instance on the hypervisor. {{(pid=72362) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:47:05 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Creating image(s)
Aug 09 10:47:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Did not create local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Ensure instance console log exists: /opt/stack/data/nova/instances/28daf5f4-214d-440c-bcd6-45f626c40852/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Start _get_guest_xml network_info=[{"id": "27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3", "address": "fa:16:3e:09:d5:d7", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27572bc7-19", "ovs_interfaceid": "27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '29604091-2b2c-4484-ab83-5592a807acfd', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FYvpZVoe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '28daf5f4-214d-440c-bcd6-45f626c40852', 'attached_at': '', 'detached_at': '', 'volume_id': '3bdbad03-f774-48cc-b987-0e0d8eb5556a', 'serial': '3bdbad03-f774-48cc-b987-0e0d8eb5556a'}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:47:05 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:47:05 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:47:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FYvpZVoe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:47:05 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:47:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:47:05 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:47:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:47:05 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:47:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3547f41-c60d-4eea-a00a-38d660d7747e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:47:05 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1cb752-fb96-4822-895d-f0d2d2d24508]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a] added
Aug 09 10:47:05 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6a98c1-573f-4d78-b186-d87245d4cb52]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb27bee-d47c-471b-9f69-135bf18974b8]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FYvpZVoe {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FYvpZVoe" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93cf9a3-bdad-4462-ac4a-70a459a8bee0]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FYvpZVoe'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf796e5-f5ff-4cf0-a574-b47593063206]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[76843250-5932-4ed1-af5f-657c82862e0d]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 (non-flash)
Aug 09 10:47:05 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 (non-flash)
Aug 09 10:47:05 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[77fad2d0-7d42-4d5b-86e5-ebadc4af1e08]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a, portal: 172.16.0.220,3260]
Aug 09 10:47:05 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a, portal: 172.16.0.220,3260] successful.
Aug 09 10:47:05 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0099ce-0a41-4470-96d8-7042fbb12340]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c880231b-0bb6-4cef-83db-b3c7a583597d]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 (non-flash)
Aug 09 10:47:05 user nova-compute[72362]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a (non-flash)
Aug 09 10:47:05 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 (non-flash)
Aug 09 10:47:05 user nova-compute[72362]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a (non-flash)
Aug 09 10:47:05 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[76829a5c-bcba-472c-929d-5a635863a4bd]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:47:05 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FYvpZVoe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:47:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:47:06 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:47:06 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23336353766316632', 'path': '/dev/sdc'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:47:06 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336353766316632', 'path': '/dev/sdc'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:47:06 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:46:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2098959833',display_name='tempest-TestVolumeBootPattern-server-2098959833',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2098959833',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHphUKjpMkPjhZoTYlVJxPOuywq6OJUJWcHduVoRu9b0hlVgGA5+i25KrjKtdJwPAqa6k/+4sAUFZLxd189pJwbl9oyVmaY/KLuastlFffcAKt/RqOFaRqRDbZFRQvHB1g==',key_name='tempest-TestVolumeBootPattern-1201178489',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26e38599de0b4b06b723f5647a7fe121',ramdisk_id='',reservation_id='r-z7s3rt1u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1478436240',owner_user_name='tempest-TestVolumeBootPattern-1478436240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:46:52Z,user_data=None,user_id='e96900e953f64d02bdb5d48f136133c3',uuid=28daf5f4-214d-440c-bcd6-45f626c40852,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3", "address": "fa:16:3e:09:d5:d7", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27572bc7-19", "ovs_interfaceid": "27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:47:06 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Converting VIF {"id": "27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3", "address": "fa:16:3e:09:d5:d7", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27572bc7-19", "ovs_interfaceid": "27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:47:06 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:d5:d7,bridge_name='br-int',has_traffic_filtering=True,id=27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3,network=Network(b4a9e050-41f1-404a-bf5c-41421f034644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27572bc7-19') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:47:06 user nova-compute[72362]: DEBUG nova.objects.instance [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lazy-loading 'pci_devices' on Instance uuid 28daf5f4-214d-440c-bcd6-45f626c40852 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:47:06 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:47:06 user nova-compute[72362]:   <uuid>28daf5f4-214d-440c-bcd6-45f626c40852</uuid>
Aug 09 10:47:06 user nova-compute[72362]:   <name>instance-00000031</name>
Aug 09 10:47:06 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:47:06 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:47:06 user nova-compute[72362]:   <metadata>
Aug 09 10:47:06 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:47:06 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:47:06 user nova-compute[72362]:       <nova:name>tempest-TestVolumeBootPattern-server-2098959833</nova:name>
Aug 09 10:47:06 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:47:05</nova:creationTime>
Aug 09 10:47:06 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:47:06 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:47:06 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:47:06 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:47:06 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:47:06 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:47:06 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:47:06 user nova-compute[72362]:       <nova:owner>
Aug 09 10:47:06 user nova-compute[72362]:         <nova:user uuid="e96900e953f64d02bdb5d48f136133c3">tempest-TestVolumeBootPattern-1478436240-project-member</nova:user>
Aug 09 10:47:06 user nova-compute[72362]:         <nova:project uuid="26e38599de0b4b06b723f5647a7fe121">tempest-TestVolumeBootPattern-1478436240</nova:project>
Aug 09 10:47:06 user nova-compute[72362]:       </nova:owner>
Aug 09 10:47:06 user nova-compute[72362]:       <nova:ports>
Aug 09 10:47:06 user nova-compute[72362]:         <nova:port uuid="27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3">
Aug 09 10:47:06 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 09 10:47:06 user nova-compute[72362]:         </nova:port>
Aug 09 10:47:06 user nova-compute[72362]:       </nova:ports>
Aug 09 10:47:06 user nova-compute[72362]:     </nova:instance>
Aug 09 10:47:06 user nova-compute[72362]:   </metadata>
Aug 09 10:47:06 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:47:06 user nova-compute[72362]:     <system>
Aug 09 10:47:06 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:47:06 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:47:06 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:47:06 user nova-compute[72362]:       <entry name="serial">28daf5f4-214d-440c-bcd6-45f626c40852</entry>
Aug 09 10:47:06 user nova-compute[72362]:       <entry name="uuid">28daf5f4-214d-440c-bcd6-45f626c40852</entry>
Aug 09 10:47:06 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:47:06 user nova-compute[72362]:     </system>
Aug 09 10:47:06 user nova-compute[72362]:   </sysinfo>
Aug 09 10:47:06 user nova-compute[72362]:   <os>
Aug 09 10:47:06 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:47:06 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:47:06 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:47:06 user nova-compute[72362]:   </os>
Aug 09 10:47:06 user nova-compute[72362]:   <features>
Aug 09 10:47:06 user nova-compute[72362]:     <acpi/>
Aug 09 10:47:06 user nova-compute[72362]:     <apic/>
Aug 09 10:47:06 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:47:06 user nova-compute[72362]:   </features>
Aug 09 10:47:06 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:47:06 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:47:06 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:47:06 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:47:06 user nova-compute[72362]:   </clock>
Aug 09 10:47:06 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:47:06 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:47:06 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:47:06 user nova-compute[72362]:   </cpu>
Aug 09 10:47:06 user nova-compute[72362]:   <devices>
Aug 09 10:47:06 user nova-compute[72362]:     <disk type="block" device="disk">
Aug 09 10:47:06 user nova-compute[72362]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:47:06 user nova-compute[72362]:       <source dev="/dev/sdc"/>
Aug 09 10:47:06 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:47:06 user nova-compute[72362]:       <serial>3bdbad03-f774-48cc-b987-0e0d8eb5556a</serial>
Aug 09 10:47:06 user nova-compute[72362]:     </disk>
Aug 09 10:47:06 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:47:06 user nova-compute[72362]:       <mac address="fa:16:3e:09:d5:d7"/>
Aug 09 10:47:06 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:47:06 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:47:06 user nova-compute[72362]:       <target dev="tap27572bc7-19"/>
Aug 09 10:47:06 user nova-compute[72362]:     </interface>
Aug 09 10:47:06 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:47:06 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/28daf5f4-214d-440c-bcd6-45f626c40852/console.log" append="off"/>
Aug 09 10:47:06 user nova-compute[72362]:     </serial>
Aug 09 10:47:06 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:47:06 user nova-compute[72362]:     <video>
Aug 09 10:47:06 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:47:06 user nova-compute[72362]:     </video>
Aug 09 10:47:06 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:47:06 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:47:06 user nova-compute[72362]:     </rng>
Aug 09 10:47:06 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:47:06 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:47:06 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:47:06 user nova-compute[72362]:     </memballoon>
Aug 09 10:47:06 user nova-compute[72362]:   </devices>
Aug 09 10:47:06 user nova-compute[72362]: </domain>
Aug 09 10:47:06 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:47:06 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:46:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2098959833',display_name='tempest-TestVolumeBootPattern-server-2098959833',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2098959833',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHphUKjpMkPjhZoTYlVJxPOuywq6OJUJWcHduVoRu9b0hlVgGA5+i25KrjKtdJwPAqa6k/+4sAUFZLxd189pJwbl9oyVmaY/KLuastlFffcAKt/RqOFaRqRDbZFRQvHB1g==',key_name='tempest-TestVolumeBootPattern-1201178489',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26e38599de0b4b06b723f5647a7fe121',ramdisk_id='',reservation_id='r-z7s3rt1u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1478436240',owner_user_name='tempest-TestVolumeBootPattern-1478436240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:46:52Z,user_data=None,user_id='e96900e953f64d02bdb5d48f136133c3',uuid=28daf5f4-214d-440c-bcd6-45f626c40852,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3", "address": "fa:16:3e:09:d5:d7", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27572bc7-19", "ovs_interfaceid": "27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:47:06 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Converting VIF {"id": "27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3", "address": "fa:16:3e:09:d5:d7", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27572bc7-19", "ovs_interfaceid": "27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:47:06 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:d5:d7,bridge_name='br-int',has_traffic_filtering=True,id=27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3,network=Network(b4a9e050-41f1-404a-bf5c-41421f034644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27572bc7-19') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:47:06 user nova-compute[72362]: DEBUG os_vif [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:d5:d7,bridge_name='br-int',has_traffic_filtering=True,id=27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3,network=Network(b4a9e050-41f1-404a-bf5c-41421f034644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27572bc7-19') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:47:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:47:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:47:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:47:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:47:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27572bc7-19, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:47:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap27572bc7-19, col_values=(('external_ids', {'iface-id': '27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:d5:d7', 'vm-uuid': '28daf5f4-214d-440c-bcd6-45f626c40852'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:47:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:47:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:47:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:47:07 user nova-compute[72362]: INFO os_vif [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:d5:d7,bridge_name='br-int',has_traffic_filtering=True,id=27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3,network=Network(b4a9e050-41f1-404a-bf5c-41421f034644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27572bc7-19')
Aug 09 10:47:07 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:47:07 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] No VIF found with MAC fa:16:3e:09:d5:d7, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:47:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:47:08 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:47:08 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:47:08 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:47:08 user nova-compute[72362]: DEBUG nova.compute.manager [req-e971b2dc-b318-4458-bf97-4e8707c872e9 req-e4de0322-a507-4856-affb-3cb5561968e2 service nova] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Received event network-vif-plugged-27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:47:08 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e971b2dc-b318-4458-bf97-4e8707c872e9 req-e4de0322-a507-4856-affb-3cb5561968e2 service nova] Acquiring lock "28daf5f4-214d-440c-bcd6-45f626c40852-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:47:08 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e971b2dc-b318-4458-bf97-4e8707c872e9 req-e4de0322-a507-4856-affb-3cb5561968e2 service nova] Lock "28daf5f4-214d-440c-bcd6-45f626c40852-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:47:08 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e971b2dc-b318-4458-bf97-4e8707c872e9 req-e4de0322-a507-4856-affb-3cb5561968e2 service nova] Lock "28daf5f4-214d-440c-bcd6-45f626c40852-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:47:08 user nova-compute[72362]: DEBUG nova.compute.manager [req-e971b2dc-b318-4458-bf97-4e8707c872e9 req-e4de0322-a507-4856-affb-3cb5561968e2 service nova] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] No waiting events found dispatching network-vif-plugged-27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:47:08 user nova-compute[72362]: WARNING nova.compute.manager [req-e971b2dc-b318-4458-bf97-4e8707c872e9 req-e4de0322-a507-4856-affb-3cb5561968e2 service nova] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Received unexpected event network-vif-plugged-27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3 for instance with vm_state building and task_state spawning.
Aug 09 10:47:08 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:47:08 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:47:10 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691578030.3459806, 28daf5f4-214d-440c-bcd6-45f626c40852 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:47:10 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] VM Resumed (Lifecycle Event)
Aug 09 10:47:10 user nova-compute[72362]: DEBUG nova.compute.manager [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:47:10 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:47:10 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Instance spawned successfully.
Aug 09 10:47:10 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 10:47:10 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:47:10 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:47:10 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Found default for hw_cdrom_bus of ide {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:47:10 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Found default for hw_disk_bus of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:47:10 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:47:10 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:47:10 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Found default for hw_video_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:47:10 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Found default for hw_vif_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:47:10 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:47:10 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691578030.3473577, 28daf5f4-214d-440c-bcd6-45f626c40852 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:47:10 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] VM Started (Lifecycle Event)
Aug 09 10:47:10 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:47:10 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:47:10 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:47:10 user nova-compute[72362]: INFO nova.compute.manager [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Took 4.89 seconds to spawn the instance on the hypervisor.
Aug 09 10:47:10 user nova-compute[72362]: DEBUG nova.compute.manager [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:47:10 user nova-compute[72362]: DEBUG nova.compute.manager [req-b0a4ab92-2861-4701-883f-16ffe6227944 req-2103e69f-ddd5-4b38-addd-260b6286966c service nova] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Received event network-vif-plugged-27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:47:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b0a4ab92-2861-4701-883f-16ffe6227944 req-2103e69f-ddd5-4b38-addd-260b6286966c service nova] Acquiring lock "28daf5f4-214d-440c-bcd6-45f626c40852-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:47:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b0a4ab92-2861-4701-883f-16ffe6227944 req-2103e69f-ddd5-4b38-addd-260b6286966c service nova] Lock "28daf5f4-214d-440c-bcd6-45f626c40852-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:47:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b0a4ab92-2861-4701-883f-16ffe6227944 req-2103e69f-ddd5-4b38-addd-260b6286966c service nova] Lock "28daf5f4-214d-440c-bcd6-45f626c40852-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:47:10 user nova-compute[72362]: DEBUG nova.compute.manager [req-b0a4ab92-2861-4701-883f-16ffe6227944 req-2103e69f-ddd5-4b38-addd-260b6286966c service nova] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] No waiting events found dispatching network-vif-plugged-27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:47:10 user nova-compute[72362]: WARNING nova.compute.manager [req-b0a4ab92-2861-4701-883f-16ffe6227944 req-2103e69f-ddd5-4b38-addd-260b6286966c service nova] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Received unexpected event network-vif-plugged-27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3 for instance with vm_state building and task_state spawning.
Aug 09 10:47:10 user nova-compute[72362]: INFO nova.compute.manager [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Took 19.28 seconds to build instance.
Aug 09 10:47:10 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-829be6d7-2bca-4d04-b5d5-6886fa95ebe7 tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "28daf5f4-214d-440c-bcd6-45f626c40852" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.372s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:47:11 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:47:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:47:16 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:47:17 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:47:17 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:47:17 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:47:17 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:47:17 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 10:47:18 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:47:18 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:47:18 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 10:47:18 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Rebuilding the list of instances to heal {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 10:47:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "refresh_cache-cefe383b-978f-4391-baf6-3b3ad17e0083" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:47:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquired lock "refresh_cache-cefe383b-978f-4391-baf6-3b3ad17e0083" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:47:19 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Forcefully refreshing network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 10:47:19 user nova-compute[72362]: DEBUG nova.objects.instance [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lazy-loading 'info_cache' on Instance uuid cefe383b-978f-4391-baf6-3b3ad17e0083 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:47:19 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Updating instance_info_cache with network_info: [{"id": "1d14bbdf-8802-42b5-bd22-c6bd03a53761", "address": "fa:16:3e:fe:ee:4f", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d14bbdf-88", "ovs_interfaceid": "1d14bbdf-8802-42b5-bd22-c6bd03a53761", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:47:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Releasing lock "refresh_cache-cefe383b-978f-4391-baf6-3b3ad17e0083" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:47:19 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Updated the network info_cache for instance {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 10:47:19 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:47:19 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:47:19 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:47:19 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:47:19 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Cleaning up deleted instances {{(pid=72362) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 10:47:20 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] There are 0 instances to clean {{(pid=72362) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 10:47:21 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:47:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:47:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 10:47:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 10:47:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 10:47:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:47:26 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:47:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:47:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:47:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 10:47:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 10:47:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 10:47:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:47:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:47:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:47:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:47:27 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 10:47:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1b76bf2-10c2-41e7-bb51-4be3cdc70649/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:47:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:47:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1b76bf2-10c2-41e7-bb51-4be3cdc70649/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:47:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1b76bf2-10c2-41e7-bb51-4be3cdc70649/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:47:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1b76bf2-10c2-41e7-bb51-4be3cdc70649/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:47:27 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:47:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:47:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:47:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:47:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:47:27 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:47:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:47:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:47:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:47:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:47:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:47:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:47:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:47:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:47:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:47:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:47:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:47:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:47:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b8c0c6-7afc-4f0b-ba06-3eccd4726124/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:47:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b8c0c6-7afc-4f0b-ba06-3eccd4726124/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:47:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b8c0c6-7afc-4f0b-ba06-3eccd4726124/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:47:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b8c0c6-7afc-4f0b-ba06-3eccd4726124/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:47:29 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:47:29 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:47:29 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=8027MB free_disk=25.021175384521484GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 10:47:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:47:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:47:29 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance cefe383b-978f-4391-baf6-3b3ad17e0083 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:47:29 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 4296ca4c-1e3e-474f-98ba-9f947d333b8d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:47:29 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance ab34d860-52ba-4773-9f80-84930bbd06d0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:47:29 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance c9b8c0c6-7afc-4f0b-ba06-3eccd4726124 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:47:29 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 81ffae79-ce4c-440c-a157-ca922637aa67 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:47:29 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance b1b76bf2-10c2-41e7-bb51-4be3cdc70649 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:47:29 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 28daf5f4-214d-440c-bcd6-45f626c40852 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:47:29 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 10:47:29 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 10:47:29 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Refreshing inventories for resource provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 10:47:29 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Updating ProviderTree inventory for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 10:47:29 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Updating inventory in ProviderTree for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 10:47:29 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Refreshing aggregate associations for resource provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d, aggregates: None {{(pid=72362) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 10:47:29 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Refreshing trait associations for resource provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE41,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=72362) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 10:47:29 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:47:29 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:47:29 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 10:47:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.508s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:47:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:47:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:47:35 user nova-compute[72362]: DEBUG nova.compute.manager [req-2268cff4-9453-4b0f-bf31-fc86392741c0 req-3324ceb2-60b9-43a4-b354-46d483de6b65 service nova] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Received event network-changed-bba009ea-bb2e-4952-98ee-4dd1fb2649fc {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:47:35 user nova-compute[72362]: DEBUG nova.compute.manager [req-2268cff4-9453-4b0f-bf31-fc86392741c0 req-3324ceb2-60b9-43a4-b354-46d483de6b65 service nova] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Refreshing instance network info cache due to event network-changed-bba009ea-bb2e-4952-98ee-4dd1fb2649fc. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:47:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-2268cff4-9453-4b0f-bf31-fc86392741c0 req-3324ceb2-60b9-43a4-b354-46d483de6b65 service nova] Acquiring lock "refresh_cache-c9b8c0c6-7afc-4f0b-ba06-3eccd4726124" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:47:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-2268cff4-9453-4b0f-bf31-fc86392741c0 req-3324ceb2-60b9-43a4-b354-46d483de6b65 service nova] Acquired lock "refresh_cache-c9b8c0c6-7afc-4f0b-ba06-3eccd4726124" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:47:35 user nova-compute[72362]: DEBUG nova.network.neutron [req-2268cff4-9453-4b0f-bf31-fc86392741c0 req-3324ceb2-60b9-43a4-b354-46d483de6b65 service nova] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Refreshing network info cache for port bba009ea-bb2e-4952-98ee-4dd1fb2649fc {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:47:35 user nova-compute[72362]: DEBUG nova.network.neutron [req-2268cff4-9453-4b0f-bf31-fc86392741c0 req-3324ceb2-60b9-43a4-b354-46d483de6b65 service nova] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Updated VIF entry in instance network info cache for port bba009ea-bb2e-4952-98ee-4dd1fb2649fc. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:47:35 user nova-compute[72362]: DEBUG nova.network.neutron [req-2268cff4-9453-4b0f-bf31-fc86392741c0 req-3324ceb2-60b9-43a4-b354-46d483de6b65 service nova] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Updating instance_info_cache with network_info: [{"id": "bba009ea-bb2e-4952-98ee-4dd1fb2649fc", "address": "fa:16:3e:5b:15:67", "network": {"id": "362446ea-173c-4989-93f8-882088822208", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-499399633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f9d6a60f24d41deb91ae59189c62ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba009ea-bb", "ovs_interfaceid": "bba009ea-bb2e-4952-98ee-4dd1fb2649fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:47:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-2268cff4-9453-4b0f-bf31-fc86392741c0 req-3324ceb2-60b9-43a4-b354-46d483de6b65 service nova] Releasing lock "refresh_cache-c9b8c0c6-7afc-4f0b-ba06-3eccd4726124" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:47:36 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:47:36 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72362) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 10:47:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:47:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:47:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-47cc6b61-c9f1-47a6-a21c-e327817117fb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Acquiring lock "c9b8c0c6-7afc-4f0b-ba06-3eccd4726124" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:47:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-47cc6b61-c9f1-47a6-a21c-e327817117fb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "c9b8c0c6-7afc-4f0b-ba06-3eccd4726124" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:47:41 user nova-compute[72362]: INFO nova.compute.manager [None req-47cc6b61-c9f1-47a6-a21c-e327817117fb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Shelving
Aug 09 10:47:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:47:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:47:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:47:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:47:41 user nova-compute[72362]: DEBUG nova.compute.manager [req-8da60e38-1fc7-461f-adc4-f5b62a6847cb req-74727bd9-c929-4a5c-8b8f-b15736ceee37 service nova] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Received event network-vif-unplugged-bba009ea-bb2e-4952-98ee-4dd1fb2649fc {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:47:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8da60e38-1fc7-461f-adc4-f5b62a6847cb req-74727bd9-c929-4a5c-8b8f-b15736ceee37 service nova] Acquiring lock "c9b8c0c6-7afc-4f0b-ba06-3eccd4726124-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:47:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8da60e38-1fc7-461f-adc4-f5b62a6847cb req-74727bd9-c929-4a5c-8b8f-b15736ceee37 service nova] Lock "c9b8c0c6-7afc-4f0b-ba06-3eccd4726124-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:47:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8da60e38-1fc7-461f-adc4-f5b62a6847cb req-74727bd9-c929-4a5c-8b8f-b15736ceee37 service nova] Lock "c9b8c0c6-7afc-4f0b-ba06-3eccd4726124-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:47:41 user nova-compute[72362]: DEBUG nova.compute.manager [req-8da60e38-1fc7-461f-adc4-f5b62a6847cb req-74727bd9-c929-4a5c-8b8f-b15736ceee37 service nova] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] No waiting events found dispatching network-vif-unplugged-bba009ea-bb2e-4952-98ee-4dd1fb2649fc {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:47:41 user nova-compute[72362]: WARNING nova.compute.manager [req-8da60e38-1fc7-461f-adc4-f5b62a6847cb req-74727bd9-c929-4a5c-8b8f-b15736ceee37 service nova] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Received unexpected event network-vif-unplugged-bba009ea-bb2e-4952-98ee-4dd1fb2649fc for instance with vm_state active and task_state shelving.
Aug 09 10:47:41 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Instance destroyed successfully.
Aug 09 10:47:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:47:41 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-47cc6b61-c9f1-47a6-a21c-e327817117fb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Beginning cold snapshot process
Aug 09 10:47:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:47:42 user nova-compute[72362]: DEBUG nova.privsep.utils [None req-47cc6b61-c9f1-47a6-a21c-e327817117fb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72362) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 10:47:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-47cc6b61-c9f1-47a6-a21c-e327817117fb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/c9b8c0c6-7afc-4f0b-ba06-3eccd4726124/disk /opt/stack/data/nova/instances/snapshots/tmpdj78hzlu/f21a10c15dd24b4fbf5d76ca9b095d36 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:47:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:47:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-47cc6b61-c9f1-47a6-a21c-e327817117fb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/c9b8c0c6-7afc-4f0b-ba06-3eccd4726124/disk /opt/stack/data/nova/instances/snapshots/tmpdj78hzlu/f21a10c15dd24b4fbf5d76ca9b095d36" returned: 0 in 0.681s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:47:42 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-47cc6b61-c9f1-47a6-a21c-e327817117fb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Snapshot extracted, beginning image upload
Aug 09 10:47:43 user nova-compute[72362]: DEBUG nova.compute.manager [req-cf75f292-2085-4144-99a3-9dd2deada0ae req-2e794492-b572-4fc7-b28e-b6663dd02770 service nova] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Received event network-vif-plugged-bba009ea-bb2e-4952-98ee-4dd1fb2649fc {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:47:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-cf75f292-2085-4144-99a3-9dd2deada0ae req-2e794492-b572-4fc7-b28e-b6663dd02770 service nova] Acquiring lock "c9b8c0c6-7afc-4f0b-ba06-3eccd4726124-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:47:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-cf75f292-2085-4144-99a3-9dd2deada0ae req-2e794492-b572-4fc7-b28e-b6663dd02770 service nova] Lock "c9b8c0c6-7afc-4f0b-ba06-3eccd4726124-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:47:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-cf75f292-2085-4144-99a3-9dd2deada0ae req-2e794492-b572-4fc7-b28e-b6663dd02770 service nova] Lock "c9b8c0c6-7afc-4f0b-ba06-3eccd4726124-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:47:43 user nova-compute[72362]: DEBUG nova.compute.manager [req-cf75f292-2085-4144-99a3-9dd2deada0ae req-2e794492-b572-4fc7-b28e-b6663dd02770 service nova] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] No waiting events found dispatching network-vif-plugged-bba009ea-bb2e-4952-98ee-4dd1fb2649fc {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:47:43 user nova-compute[72362]: WARNING nova.compute.manager [req-cf75f292-2085-4144-99a3-9dd2deada0ae req-2e794492-b572-4fc7-b28e-b6663dd02770 service nova] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Received unexpected event network-vif-plugged-bba009ea-bb2e-4952-98ee-4dd1fb2649fc for instance with vm_state active and task_state shelving_image_uploading.
Aug 09 10:47:45 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-47cc6b61-c9f1-47a6-a21c-e327817117fb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Snapshot image upload complete
Aug 09 10:47:45 user nova-compute[72362]: DEBUG nova.compute.manager [None req-47cc6b61-c9f1-47a6-a21c-e327817117fb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:47:45 user nova-compute[72362]: INFO nova.compute.manager [None req-47cc6b61-c9f1-47a6-a21c-e327817117fb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Shelve offloading
Aug 09 10:47:45 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Instance destroyed successfully.
Aug 09 10:47:45 user nova-compute[72362]: DEBUG nova.compute.manager [None req-47cc6b61-c9f1-47a6-a21c-e327817117fb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:47:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-47cc6b61-c9f1-47a6-a21c-e327817117fb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Acquiring lock "refresh_cache-c9b8c0c6-7afc-4f0b-ba06-3eccd4726124" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:47:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-47cc6b61-c9f1-47a6-a21c-e327817117fb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Acquired lock "refresh_cache-c9b8c0c6-7afc-4f0b-ba06-3eccd4726124" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:47:45 user nova-compute[72362]: DEBUG nova.network.neutron [None req-47cc6b61-c9f1-47a6-a21c-e327817117fb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:47:45 user nova-compute[72362]: DEBUG nova.network.neutron [None req-47cc6b61-c9f1-47a6-a21c-e327817117fb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Updating instance_info_cache with network_info: [{"id": "bba009ea-bb2e-4952-98ee-4dd1fb2649fc", "address": "fa:16:3e:5b:15:67", "network": {"id": "362446ea-173c-4989-93f8-882088822208", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-499399633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f9d6a60f24d41deb91ae59189c62ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba009ea-bb", "ovs_interfaceid": "bba009ea-bb2e-4952-98ee-4dd1fb2649fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:47:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-47cc6b61-c9f1-47a6-a21c-e327817117fb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Releasing lock "refresh_cache-c9b8c0c6-7afc-4f0b-ba06-3eccd4726124" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:47:46 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Instance destroyed successfully.
Aug 09 10:47:46 user nova-compute[72362]: DEBUG nova.objects.instance [None req-47cc6b61-c9f1-47a6-a21c-e327817117fb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lazy-loading 'resources' on Instance uuid c9b8c0c6-7afc-4f0b-ba06-3eccd4726124 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:47:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-47cc6b61-c9f1-47a6-a21c-e327817117fb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:45:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1646693656',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1646693656',id=46,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/aGUSj56P3CF+AbqqVXGNF0P/OweU114ZrKxiQ7YSDnLkroHTWcMIUzf2DBS55CS9oLSk9ocs6C9FMw7qXL+rrCRRbxlx+Zy16d7Ch/20WCb8l2ERymAdmhPJHshV2cg==',key_name='tempest-keypair-1790414929',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:45:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2f9d6a60f24d41deb91ae59189c62ba2',ramdisk_id='',reservation_id='r-9y258rcd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2139825844',owner_user_name='tempest-AttachVolumeShelveTestJSON-2139825844-project-member',shelved_at='2023-08-09T10:47:45.051167',shelved_host='user',shelved_image_id='afc2010a-5c4e-4edb-b27d-5acad402f861'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:47:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='299166afe21b4d3cac05fdb072a78a78',uuid=c9b8c0c6-7afc-4f0b-ba06-3eccd4726124,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "bba009ea-bb2e-4952-98ee-4dd1fb2649fc", "address": "fa:16:3e:5b:15:67", "network": {"id": "362446ea-173c-4989-93f8-882088822208", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-499399633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f9d6a60f24d41deb91ae59189c62ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba009ea-bb", "ovs_interfaceid": "bba009ea-bb2e-4952-98ee-4dd1fb2649fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:47:46 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-47cc6b61-c9f1-47a6-a21c-e327817117fb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Converting VIF {"id": "bba009ea-bb2e-4952-98ee-4dd1fb2649fc", "address": "fa:16:3e:5b:15:67", "network": {"id": "362446ea-173c-4989-93f8-882088822208", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-499399633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f9d6a60f24d41deb91ae59189c62ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba009ea-bb", "ovs_interfaceid": "bba009ea-bb2e-4952-98ee-4dd1fb2649fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:47:46 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-47cc6b61-c9f1-47a6-a21c-e327817117fb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:15:67,bridge_name='br-int',has_traffic_filtering=True,id=bba009ea-bb2e-4952-98ee-4dd1fb2649fc,network=Network(362446ea-173c-4989-93f8-882088822208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbba009ea-bb') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:47:46 user nova-compute[72362]: DEBUG os_vif [None req-47cc6b61-c9f1-47a6-a21c-e327817117fb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:15:67,bridge_name='br-int',has_traffic_filtering=True,id=bba009ea-bb2e-4952-98ee-4dd1fb2649fc,network=Network(362446ea-173c-4989-93f8-882088822208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbba009ea-bb') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:47:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:47:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbba009ea-bb, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:47:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:47:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:47:46 user nova-compute[72362]: INFO os_vif [None req-47cc6b61-c9f1-47a6-a21c-e327817117fb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:15:67,bridge_name='br-int',has_traffic_filtering=True,id=bba009ea-bb2e-4952-98ee-4dd1fb2649fc,network=Network(362446ea-173c-4989-93f8-882088822208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbba009ea-bb')
Aug 09 10:47:46 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-47cc6b61-c9f1-47a6-a21c-e327817117fb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Deleting instance files /opt/stack/data/nova/instances/c9b8c0c6-7afc-4f0b-ba06-3eccd4726124_del
Aug 09 10:47:46 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-47cc6b61-c9f1-47a6-a21c-e327817117fb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Deletion of /opt/stack/data/nova/instances/c9b8c0c6-7afc-4f0b-ba06-3eccd4726124_del complete
Aug 09 10:47:46 user nova-compute[72362]: DEBUG nova.compute.manager [req-48667dbb-3b40-456b-881a-a548aa672831 req-e128cd17-f94d-4462-b4a7-927fc44066d6 service nova] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Received event network-changed-bba009ea-bb2e-4952-98ee-4dd1fb2649fc {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:47:46 user nova-compute[72362]: DEBUG nova.compute.manager [req-48667dbb-3b40-456b-881a-a548aa672831 req-e128cd17-f94d-4462-b4a7-927fc44066d6 service nova] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Refreshing instance network info cache due to event network-changed-bba009ea-bb2e-4952-98ee-4dd1fb2649fc. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:47:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-48667dbb-3b40-456b-881a-a548aa672831 req-e128cd17-f94d-4462-b4a7-927fc44066d6 service nova] Acquiring lock "refresh_cache-c9b8c0c6-7afc-4f0b-ba06-3eccd4726124" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:47:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-48667dbb-3b40-456b-881a-a548aa672831 req-e128cd17-f94d-4462-b4a7-927fc44066d6 service nova] Acquired lock "refresh_cache-c9b8c0c6-7afc-4f0b-ba06-3eccd4726124" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:47:46 user nova-compute[72362]: DEBUG nova.network.neutron [req-48667dbb-3b40-456b-881a-a548aa672831 req-e128cd17-f94d-4462-b4a7-927fc44066d6 service nova] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Refreshing network info cache for port bba009ea-bb2e-4952-98ee-4dd1fb2649fc {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:47:46 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-47cc6b61-c9f1-47a6-a21c-e327817117fb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Deleted allocations for instance c9b8c0c6-7afc-4f0b-ba06-3eccd4726124
Aug 09 10:47:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-47cc6b61-c9f1-47a6-a21c-e327817117fb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:47:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-47cc6b61-c9f1-47a6-a21c-e327817117fb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:47:46 user nova-compute[72362]: DEBUG nova.objects.instance [None req-47cc6b61-c9f1-47a6-a21c-e327817117fb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lazy-loading 'numa_topology' on Instance uuid c9b8c0c6-7afc-4f0b-ba06-3eccd4726124 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:47:46 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-47cc6b61-c9f1-47a6-a21c-e327817117fb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:47:46 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-47cc6b61-c9f1-47a6-a21c-e327817117fb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:47:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-47cc6b61-c9f1-47a6-a21c-e327817117fb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.232s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:47:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-47cc6b61-c9f1-47a6-a21c-e327817117fb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "c9b8c0c6-7afc-4f0b-ba06-3eccd4726124" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.421s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:47:46 user nova-compute[72362]: DEBUG nova.network.neutron [req-48667dbb-3b40-456b-881a-a548aa672831 req-e128cd17-f94d-4462-b4a7-927fc44066d6 service nova] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Updated VIF entry in instance network info cache for port bba009ea-bb2e-4952-98ee-4dd1fb2649fc. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:47:46 user nova-compute[72362]: DEBUG nova.network.neutron [req-48667dbb-3b40-456b-881a-a548aa672831 req-e128cd17-f94d-4462-b4a7-927fc44066d6 service nova] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Updating instance_info_cache with network_info: [{"id": "bba009ea-bb2e-4952-98ee-4dd1fb2649fc", "address": "fa:16:3e:5b:15:67", "network": {"id": "362446ea-173c-4989-93f8-882088822208", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-499399633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f9d6a60f24d41deb91ae59189c62ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapbba009ea-bb", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:47:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-48667dbb-3b40-456b-881a-a548aa672831 req-e128cd17-f94d-4462-b4a7-927fc44066d6 service nova] Releasing lock "refresh_cache-c9b8c0c6-7afc-4f0b-ba06-3eccd4726124" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:47:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:47:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:47:52 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:47:56 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:47:56 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691578061.846578, c9b8c0c6-7afc-4f0b-ba06-3eccd4726124 => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:47:56 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] VM Stopped (Lifecycle Event)
Aug 09 10:47:56 user nova-compute[72362]: DEBUG nova.compute.manager [None req-b725015f-49d0-43ce-9109-9621ff35f40a None None] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:48:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:48:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:48:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 10:48:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 10:48:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 10:48:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:48:02 user nova-compute[72362]: DEBUG nova.compute.manager [req-ffaf6f74-2818-4e68-9c62-dd70d902d561 req-de6b3362-0d3f-4396-95e1-548a99423140 service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Received event network-changed-2040dc53-585b-4375-a169-539195f3f01a {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:48:02 user nova-compute[72362]: DEBUG nova.compute.manager [req-ffaf6f74-2818-4e68-9c62-dd70d902d561 req-de6b3362-0d3f-4396-95e1-548a99423140 service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Refreshing instance network info cache due to event network-changed-2040dc53-585b-4375-a169-539195f3f01a. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:48:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ffaf6f74-2818-4e68-9c62-dd70d902d561 req-de6b3362-0d3f-4396-95e1-548a99423140 service nova] Acquiring lock "refresh_cache-81ffae79-ce4c-440c-a157-ca922637aa67" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:48:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ffaf6f74-2818-4e68-9c62-dd70d902d561 req-de6b3362-0d3f-4396-95e1-548a99423140 service nova] Acquired lock "refresh_cache-81ffae79-ce4c-440c-a157-ca922637aa67" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:48:02 user nova-compute[72362]: DEBUG nova.network.neutron [req-ffaf6f74-2818-4e68-9c62-dd70d902d561 req-de6b3362-0d3f-4396-95e1-548a99423140 service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Refreshing network info cache for port 2040dc53-585b-4375-a169-539195f3f01a {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:48:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-9ff7b3ff-fdba-45af-8563-d39c5a0634e2 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Acquiring lock "81ffae79-ce4c-440c-a157-ca922637aa67" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:48:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-9ff7b3ff-fdba-45af-8563-d39c5a0634e2 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "81ffae79-ce4c-440c-a157-ca922637aa67" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:48:02 user nova-compute[72362]: DEBUG nova.objects.instance [None req-9ff7b3ff-fdba-45af-8563-d39c5a0634e2 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lazy-loading 'flavor' on Instance uuid 81ffae79-ce4c-440c-a157-ca922637aa67 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:48:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-9ff7b3ff-fdba-45af-8563-d39c5a0634e2 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "81ffae79-ce4c-440c-a157-ca922637aa67" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.191s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:48:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-9ff7b3ff-fdba-45af-8563-d39c5a0634e2 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Acquiring lock "81ffae79-ce4c-440c-a157-ca922637aa67" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:48:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-9ff7b3ff-fdba-45af-8563-d39c5a0634e2 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "81ffae79-ce4c-440c-a157-ca922637aa67" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:48:03 user nova-compute[72362]: INFO nova.compute.manager [None req-9ff7b3ff-fdba-45af-8563-d39c5a0634e2 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Attaching volume 6b21c1c3-2c34-42af-b62a-f06bbf1b21bd to /dev/vdb
Aug 09 10:48:03 user nova-compute[72362]: DEBUG nova.network.neutron [req-ffaf6f74-2818-4e68-9c62-dd70d902d561 req-de6b3362-0d3f-4396-95e1-548a99423140 service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Updated VIF entry in instance network info cache for port 2040dc53-585b-4375-a169-539195f3f01a. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:48:03 user nova-compute[72362]: DEBUG nova.network.neutron [req-ffaf6f74-2818-4e68-9c62-dd70d902d561 req-de6b3362-0d3f-4396-95e1-548a99423140 service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Updating instance_info_cache with network_info: [{"id": "2040dc53-585b-4375-a169-539195f3f01a", "address": "fa:16:3e:bf:cc:bc", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2040dc53-58", "ovs_interfaceid": "2040dc53-585b-4375-a169-539195f3f01a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:48:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ffaf6f74-2818-4e68-9c62-dd70d902d561 req-de6b3362-0d3f-4396-95e1-548a99423140 service nova] Releasing lock "refresh_cache-81ffae79-ce4c-440c-a157-ca922637aa67" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:48:03 user nova-compute[72362]: DEBUG os_brick.utils [None req-9ff7b3ff-fdba-45af-8563-d39c5a0634e2 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:48:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:03 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaef2d11-3dcb-4432-9d22-7e441deea7d0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:48:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:03 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e1e448-e2c1-4c8b-9d07-8573ad68d7bb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:48:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:03 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b2848d-a03a-41b1-b61c-db79a283e5cf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:48:03 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d2cd7f-706d-4319-8a92-6ffd4c6eea1e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:48:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-9ff7b3ff-fdba-45af-8563-d39c5a0634e2 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-9ff7b3ff-fdba-45af-8563-d39c5a0634e2 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:48:03 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ff7b3ff-fdba-45af-8563-d39c5a0634e2 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:48:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:03 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:48:03 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:48:03 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[566617d4-e335-4d48-b706-009da43db5b6]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:48:03 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-9ff7b3ff-fdba-45af-8563-d39c5a0634e2 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:48:03 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-9ff7b3ff-fdba-45af-8563-d39c5a0634e2 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:48:03 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-9ff7b3ff-fdba-45af-8563-d39c5a0634e2 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:48:03 user nova-compute[72362]: DEBUG os_brick.utils [None req-9ff7b3ff-fdba-45af-8563-d39c5a0634e2 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:48:03 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-9ff7b3ff-fdba-45af-8563-d39c5a0634e2 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Updating existing volume attachment record: 4fad4b27-74eb-42c5-9f5d-a400cbc0904b {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 10:48:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:48:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ff7b3ff-fdba-45af-8563-d39c5a0634e2 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff7b3ff-fdba-45af-8563-d39c5a0634e2 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YgWwRsmd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:48:11 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-9ff7b3ff-fdba-45af-8563-d39c5a0634e2 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:48:11 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-9ff7b3ff-fdba-45af-8563-d39c5a0634e2 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-9ff7b3ff-fdba-45af-8563-d39c5a0634e2 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:48:11 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-9ff7b3ff-fdba-45af-8563-d39c5a0634e2 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:48:11 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-9ff7b3ff-fdba-45af-8563-d39c5a0634e2 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-9ff7b3ff-fdba-45af-8563-d39c5a0634e2 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:48:11 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-9ff7b3ff-fdba-45af-8563-d39c5a0634e2 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:48:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d1bf40-b9d2-42cb-82ad-f19e08e65d81]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff7b3ff-fdba-45af-8563-d39c5a0634e2 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:48:11 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[807ed6b9-5d25-4bab-922c-20964d4a463d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff7b3ff-fdba-45af-8563-d39c5a0634e2 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd] added
Aug 09 10:48:11 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc08e3e-9183-4ea5-8fcb-9d703a4a3ed1]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff7b3ff-fdba-45af-8563-d39c5a0634e2 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c901147d-434d-4510-9d13-98811805fbc3]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff7b3ff-fdba-45af-8563-d39c5a0634e2 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YgWwRsmd {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YgWwRsmd" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee9eb27-40ed-488b-aaaf-cbc878cfe424]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff7b3ff-fdba-45af-8563-d39c5a0634e2 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YgWwRsmd'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2ad4cd-0d59-4087-9793-657fc8c6047b]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff7b3ff-fdba-45af-8563-d39c5a0634e2 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5584cdb-1766-4875-b78b-49ea96a3bc37]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff7b3ff-fdba-45af-8563-d39c5a0634e2 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 (non-flash)
Aug 09 10:48:11 user nova-compute[72362]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a (non-flash)
Aug 09 10:48:11 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff7b3ff-fdba-45af-8563-d39c5a0634e2 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 (non-flash)
Aug 09 10:48:11 user nova-compute[72362]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a (non-flash)
Aug 09 10:48:11 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df4f0e8-3fa0-499a-aa6c-e0570c1af2bf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff7b3ff-fdba-45af-8563-d39c5a0634e2 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd, portal: 172.16.0.220,3260]
Aug 09 10:48:11 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd, portal: 172.16.0.220,3260] successful.
Aug 09 10:48:11 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[831c4b02-85ed-44f9-88e5-9f30ddfb7197]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff7b3ff-fdba-45af-8563-d39c5a0634e2 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad10870c-c3d0-4b8c-b2ad-33ef27cebf11]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff7b3ff-fdba-45af-8563-d39c5a0634e2 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 (non-flash)
Aug 09 10:48:11 user nova-compute[72362]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a (non-flash)
Aug 09 10:48:11 user nova-compute[72362]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd (non-flash)
Aug 09 10:48:11 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff7b3ff-fdba-45af-8563-d39c5a0634e2 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 (non-flash)
Aug 09 10:48:11 user nova-compute[72362]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a (non-flash)
Aug 09 10:48:11 user nova-compute[72362]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd (non-flash)
Aug 09 10:48:11 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-9ff7b3ff-fdba-45af-8563-d39c5a0634e2 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff7b3ff-fdba-45af-8563-d39c5a0634e2 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-9ff7b3ff-fdba-45af-8563-d39c5a0634e2 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] HCTL ('35', '-', '-', 0) found on session 58 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-9ff7b3ff-fdba-45af-8563-d39c5a0634e2 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb217eb-e6b7-45b0-902f-9a1155a449e2]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:48:11 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-9ff7b3ff-fdba-45af-8563-d39c5a0634e2 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Searching for a device in session 58 and hctl ['35', '*', '*', 0] yield: None {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:48:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:48:12 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-9ff7b3ff-fdba-45af-8563-d39c5a0634e2 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Searching for a device in session 58 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:48:12 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff7b3ff-fdba-45af-8563-d39c5a0634e2 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YgWwRsmd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:48:12 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-9ff7b3ff-fdba-45af-8563-d39c5a0634e2 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:48:12 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff7b3ff-fdba-45af-8563-d39c5a0634e2 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23766346237393061', 'path': '/dev/sdd'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:48:12 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ff7b3ff-fdba-45af-8563-d39c5a0634e2 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766346237393061', 'path': '/dev/sdd'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:48:12 user nova-compute[72362]: DEBUG nova.objects.instance [None req-9ff7b3ff-fdba-45af-8563-d39c5a0634e2 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lazy-loading 'flavor' on Instance uuid 81ffae79-ce4c-440c-a157-ca922637aa67 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:48:12 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-9ff7b3ff-fdba-45af-8563-d39c5a0634e2 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 10:48:12 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:48:12 user nova-compute[72362]:   <source dev="/dev/sdd"/>
Aug 09 10:48:12 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:48:12 user nova-compute[72362]:   <serial>6b21c1c3-2c34-42af-b62a-f06bbf1b21bd</serial>
Aug 09 10:48:12 user nova-compute[72362]: </disk>
Aug 09 10:48:12 user nova-compute[72362]:  {{(pid=72362) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 10:48:13 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-9ff7b3ff-fdba-45af-8563-d39c5a0634e2 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:48:13 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-9ff7b3ff-fdba-45af-8563-d39c5a0634e2 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:48:13 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-9ff7b3ff-fdba-45af-8563-d39c5a0634e2 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] No VIF found with MAC fa:16:3e:bf:cc:bc, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:48:13 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-9ff7b3ff-fdba-45af-8563-d39c5a0634e2 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "81ffae79-ce4c-440c-a157-ca922637aa67" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.170s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:48:14 user nova-compute[72362]: INFO nova.compute.manager [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Rescuing
Aug 09 10:48:14 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Acquiring lock "refresh_cache-81ffae79-ce4c-440c-a157-ca922637aa67" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:48:14 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Acquired lock "refresh_cache-81ffae79-ce4c-440c-a157-ca922637aa67" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:48:14 user nova-compute[72362]: DEBUG nova.network.neutron [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:48:14 user nova-compute[72362]: DEBUG nova.network.neutron [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Updating instance_info_cache with network_info: [{"id": "2040dc53-585b-4375-a169-539195f3f01a", "address": "fa:16:3e:bf:cc:bc", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2040dc53-58", "ovs_interfaceid": "2040dc53-585b-4375-a169-539195f3f01a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:48:14 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Releasing lock "refresh_cache-81ffae79-ce4c-440c-a157-ca922637aa67" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:48:14 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:48:14 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 10:48:14 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:48:15 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:48:15 user nova-compute[72362]: DEBUG nova.compute.manager [req-c2f66668-6fc1-4f9f-be46-eb71f5775c01 req-286c52c7-4d82-4442-8ea1-5ab54a126ec1 service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Received event network-vif-unplugged-2040dc53-585b-4375-a169-539195f3f01a {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:48:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c2f66668-6fc1-4f9f-be46-eb71f5775c01 req-286c52c7-4d82-4442-8ea1-5ab54a126ec1 service nova] Acquiring lock "81ffae79-ce4c-440c-a157-ca922637aa67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:48:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c2f66668-6fc1-4f9f-be46-eb71f5775c01 req-286c52c7-4d82-4442-8ea1-5ab54a126ec1 service nova] Lock "81ffae79-ce4c-440c-a157-ca922637aa67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:48:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c2f66668-6fc1-4f9f-be46-eb71f5775c01 req-286c52c7-4d82-4442-8ea1-5ab54a126ec1 service nova] Lock "81ffae79-ce4c-440c-a157-ca922637aa67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:48:15 user nova-compute[72362]: DEBUG nova.compute.manager [req-c2f66668-6fc1-4f9f-be46-eb71f5775c01 req-286c52c7-4d82-4442-8ea1-5ab54a126ec1 service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] No waiting events found dispatching network-vif-unplugged-2040dc53-585b-4375-a169-539195f3f01a {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:48:15 user nova-compute[72362]: WARNING nova.compute.manager [req-c2f66668-6fc1-4f9f-be46-eb71f5775c01 req-286c52c7-4d82-4442-8ea1-5ab54a126ec1 service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Received unexpected event network-vif-unplugged-2040dc53-585b-4375-a169-539195f3f01a for instance with vm_state active and task_state rescuing.
Aug 09 10:48:15 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:48:15 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:48:15 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Instance destroyed successfully.
Aug 09 10:48:15 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Attempting rescue
Aug 09 10:48:15 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72362) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 09 10:48:15 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Instance directory exists: not creating {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 10:48:15 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Creating image(s)
Aug 09 10:48:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Acquiring lock "/opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:48:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "/opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:48:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "/opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:48:15 user nova-compute[72362]: DEBUG nova.objects.instance [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lazy-loading 'trusted_certs' on Instance uuid 81ffae79-ce4c-440c-a157-ca922637aa67 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:48:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Acquiring lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:48:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:48:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.139s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67/disk.rescue {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67/disk.rescue" returned: 0 in 0.068s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:15 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:48:15 user nova-compute[72362]: DEBUG nova.objects.instance [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lazy-loading 'migration_context' on Instance uuid 81ffae79-ce4c-440c-a157-ca922637aa67 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:48:15 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Created local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 10:48:15 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Start _get_guest_xml network_info=[{"id": "2040dc53-585b-4375-a169-539195f3f01a", "address": "fa:16:3e:bf:cc:bc", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "vif_mac": "fa:16:3e:bf:cc:bc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2040dc53-58", "ovs_interfaceid": "2040dc53-585b-4375-a169-539195f3f01a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a08d1a11-49eb-4212-a351-e11ee9553b95', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:48:15 user nova-compute[72362]: DEBUG nova.objects.instance [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lazy-loading 'resources' on Instance uuid 81ffae79-ce4c-440c-a157-ca922637aa67 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:48:15 user nova-compute[72362]: DEBUG nova.objects.instance [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lazy-loading 'numa_topology' on Instance uuid 81ffae79-ce4c-440c-a157-ca922637aa67 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:48:15 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:48:15 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:48:16 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:48:16 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:48:16 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:48:16 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:48:16 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:48:16 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:48:16 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:48:16 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:48:16 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:48:16 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:48:16 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:48:16 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:48:16 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:48:16 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:48:16 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:48:16 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:48:16 user nova-compute[72362]: DEBUG nova.objects.instance [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lazy-loading 'vcpu_model' on Instance uuid 81ffae79-ce4c-440c-a157-ca922637aa67 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:48:16 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:46:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1747996005',display_name='tempest-ServerRescueNegativeTestJSON-server-1747996005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1747996005',id=47,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9u+jSQAbl4/4M/00B4pWaL842BUe6igGo0u0lp/kfY2qPhzDf6WwQ0haooq3XCwTQ77Omf3HbZr8hbYJqu3EhEtcVeo53mlt3HO6yLEVEfybG3EqmsToBGkF14LFJC7A==',key_name='tempest-keypair-879942599',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:46:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac17209f912a4f248dd642be32a75ede',ramdisk_id='',reservation_id='r-pgibaoux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1453574557',owner_user_name='tempest-ServerRescueNegativeTestJSON-1453574557-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:46:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f5cb1727c864652a6873a38ec1f7bf7',uuid=81ffae79-ce4c-440c-a157-ca922637aa67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2040dc53-585b-4375-a169-539195f3f01a", "address": "fa:16:3e:bf:cc:bc", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "vif_mac": "fa:16:3e:bf:cc:bc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2040dc53-58", "ovs_interfaceid": "2040dc53-585b-4375-a169-539195f3f01a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:48:16 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Converting VIF {"id": "2040dc53-585b-4375-a169-539195f3f01a", "address": "fa:16:3e:bf:cc:bc", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "vif_mac": "fa:16:3e:bf:cc:bc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2040dc53-58", "ovs_interfaceid": "2040dc53-585b-4375-a169-539195f3f01a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:48:16 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:cc:bc,bridge_name='br-int',has_traffic_filtering=True,id=2040dc53-585b-4375-a169-539195f3f01a,network=Network(2f70b9cc-bc8f-46d8-9633-542cd881c89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2040dc53-58') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:48:16 user nova-compute[72362]: DEBUG nova.objects.instance [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lazy-loading 'pci_devices' on Instance uuid 81ffae79-ce4c-440c-a157-ca922637aa67 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:48:16 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:48:16 user nova-compute[72362]:   <uuid>81ffae79-ce4c-440c-a157-ca922637aa67</uuid>
Aug 09 10:48:16 user nova-compute[72362]:   <name>instance-0000002f</name>
Aug 09 10:48:16 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:48:16 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:48:16 user nova-compute[72362]:   <metadata>
Aug 09 10:48:16 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:48:16 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:48:16 user nova-compute[72362]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1747996005</nova:name>
Aug 09 10:48:16 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:48:15</nova:creationTime>
Aug 09 10:48:16 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:48:16 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:48:16 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:48:16 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:48:16 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:48:16 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:48:16 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:48:16 user nova-compute[72362]:       <nova:owner>
Aug 09 10:48:16 user nova-compute[72362]:         <nova:user uuid="1f5cb1727c864652a6873a38ec1f7bf7">tempest-ServerRescueNegativeTestJSON-1453574557-project-member</nova:user>
Aug 09 10:48:16 user nova-compute[72362]:         <nova:project uuid="ac17209f912a4f248dd642be32a75ede">tempest-ServerRescueNegativeTestJSON-1453574557</nova:project>
Aug 09 10:48:16 user nova-compute[72362]:       </nova:owner>
Aug 09 10:48:16 user nova-compute[72362]:       <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 10:48:16 user nova-compute[72362]:       <nova:ports>
Aug 09 10:48:16 user nova-compute[72362]:         <nova:port uuid="2040dc53-585b-4375-a169-539195f3f01a">
Aug 09 10:48:16 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 10:48:16 user nova-compute[72362]:         </nova:port>
Aug 09 10:48:16 user nova-compute[72362]:       </nova:ports>
Aug 09 10:48:16 user nova-compute[72362]:     </nova:instance>
Aug 09 10:48:16 user nova-compute[72362]:   </metadata>
Aug 09 10:48:16 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:48:16 user nova-compute[72362]:     <system>
Aug 09 10:48:16 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:48:16 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:48:16 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:48:16 user nova-compute[72362]:       <entry name="serial">81ffae79-ce4c-440c-a157-ca922637aa67</entry>
Aug 09 10:48:16 user nova-compute[72362]:       <entry name="uuid">81ffae79-ce4c-440c-a157-ca922637aa67</entry>
Aug 09 10:48:16 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:48:16 user nova-compute[72362]:     </system>
Aug 09 10:48:16 user nova-compute[72362]:   </sysinfo>
Aug 09 10:48:16 user nova-compute[72362]:   <os>
Aug 09 10:48:16 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:48:16 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:48:16 user nova-compute[72362]:   </os>
Aug 09 10:48:16 user nova-compute[72362]:   <features>
Aug 09 10:48:16 user nova-compute[72362]:     <acpi/>
Aug 09 10:48:16 user nova-compute[72362]:     <apic/>
Aug 09 10:48:16 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:48:16 user nova-compute[72362]:   </features>
Aug 09 10:48:16 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:48:16 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:48:16 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:48:16 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:48:16 user nova-compute[72362]:   </clock>
Aug 09 10:48:16 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:48:16 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:48:16 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:48:16 user nova-compute[72362]:   </cpu>
Aug 09 10:48:16 user nova-compute[72362]:   <devices>
Aug 09 10:48:16 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:48:16 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:48:16 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67/disk.rescue"/>
Aug 09 10:48:16 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:48:16 user nova-compute[72362]:     </disk>
Aug 09 10:48:16 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:48:16 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:48:16 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67/disk"/>
Aug 09 10:48:16 user nova-compute[72362]:       <target dev="vdb" bus="virtio"/>
Aug 09 10:48:16 user nova-compute[72362]:     </disk>
Aug 09 10:48:16 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:48:16 user nova-compute[72362]:       <mac address="fa:16:3e:bf:cc:bc"/>
Aug 09 10:48:16 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:48:16 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:48:16 user nova-compute[72362]:       <target dev="tap2040dc53-58"/>
Aug 09 10:48:16 user nova-compute[72362]:     </interface>
Aug 09 10:48:16 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:48:16 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67/console.log" append="off"/>
Aug 09 10:48:16 user nova-compute[72362]:     </serial>
Aug 09 10:48:16 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:48:16 user nova-compute[72362]:     <video>
Aug 09 10:48:16 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:48:16 user nova-compute[72362]:     </video>
Aug 09 10:48:16 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:48:16 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:48:16 user nova-compute[72362]:     </rng>
Aug 09 10:48:16 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:48:16 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:48:16 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:48:16 user nova-compute[72362]:     </memballoon>
Aug 09 10:48:16 user nova-compute[72362]:   </devices>
Aug 09 10:48:16 user nova-compute[72362]: </domain>
Aug 09 10:48:16 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:48:16 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Instance destroyed successfully.
Aug 09 10:48:16 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:48:16 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:48:16 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] No VIF found with MAC fa:16:3e:bf:cc:bc, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:48:16 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:48:16 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:48:16 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:48:17 user nova-compute[72362]: DEBUG nova.compute.manager [req-62e459dc-980f-4713-a0d9-fd17e0012971 req-f06c8fd7-e684-4886-9837-8acae8300717 service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Received event network-vif-plugged-2040dc53-585b-4375-a169-539195f3f01a {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:48:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-62e459dc-980f-4713-a0d9-fd17e0012971 req-f06c8fd7-e684-4886-9837-8acae8300717 service nova] Acquiring lock "81ffae79-ce4c-440c-a157-ca922637aa67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:48:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-62e459dc-980f-4713-a0d9-fd17e0012971 req-f06c8fd7-e684-4886-9837-8acae8300717 service nova] Lock "81ffae79-ce4c-440c-a157-ca922637aa67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:48:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-62e459dc-980f-4713-a0d9-fd17e0012971 req-f06c8fd7-e684-4886-9837-8acae8300717 service nova] Lock "81ffae79-ce4c-440c-a157-ca922637aa67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:48:17 user nova-compute[72362]: DEBUG nova.compute.manager [req-62e459dc-980f-4713-a0d9-fd17e0012971 req-f06c8fd7-e684-4886-9837-8acae8300717 service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] No waiting events found dispatching network-vif-plugged-2040dc53-585b-4375-a169-539195f3f01a {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:48:17 user nova-compute[72362]: WARNING nova.compute.manager [req-62e459dc-980f-4713-a0d9-fd17e0012971 req-f06c8fd7-e684-4886-9837-8acae8300717 service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Received unexpected event network-vif-plugged-2040dc53-585b-4375-a169-539195f3f01a for instance with vm_state active and task_state rescuing.
Aug 09 10:48:17 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:48:17 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:48:17 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:48:17 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:48:18 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:48:18 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 10:48:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "refresh_cache-4296ca4c-1e3e-474f-98ba-9f947d333b8d" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:48:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquired lock "refresh_cache-4296ca4c-1e3e-474f-98ba-9f947d333b8d" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:48:19 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Forcefully refreshing network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 10:48:19 user nova-compute[72362]: DEBUG nova.compute.manager [req-878f228b-b8d8-41a8-a6d9-d86c16573b31 req-fdd8b8e2-de03-4f34-895c-0ba58146e242 service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Received event network-vif-plugged-2040dc53-585b-4375-a169-539195f3f01a {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:48:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-878f228b-b8d8-41a8-a6d9-d86c16573b31 req-fdd8b8e2-de03-4f34-895c-0ba58146e242 service nova] Acquiring lock "81ffae79-ce4c-440c-a157-ca922637aa67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:48:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-878f228b-b8d8-41a8-a6d9-d86c16573b31 req-fdd8b8e2-de03-4f34-895c-0ba58146e242 service nova] Lock "81ffae79-ce4c-440c-a157-ca922637aa67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:48:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-878f228b-b8d8-41a8-a6d9-d86c16573b31 req-fdd8b8e2-de03-4f34-895c-0ba58146e242 service nova] Lock "81ffae79-ce4c-440c-a157-ca922637aa67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:48:19 user nova-compute[72362]: DEBUG nova.compute.manager [req-878f228b-b8d8-41a8-a6d9-d86c16573b31 req-fdd8b8e2-de03-4f34-895c-0ba58146e242 service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] No waiting events found dispatching network-vif-plugged-2040dc53-585b-4375-a169-539195f3f01a {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:48:19 user nova-compute[72362]: WARNING nova.compute.manager [req-878f228b-b8d8-41a8-a6d9-d86c16573b31 req-fdd8b8e2-de03-4f34-895c-0ba58146e242 service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Received unexpected event network-vif-plugged-2040dc53-585b-4375-a169-539195f3f01a for instance with vm_state active and task_state rescuing.
Aug 09 10:48:19 user nova-compute[72362]: DEBUG nova.compute.manager [req-878f228b-b8d8-41a8-a6d9-d86c16573b31 req-fdd8b8e2-de03-4f34-895c-0ba58146e242 service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Received event network-vif-plugged-2040dc53-585b-4375-a169-539195f3f01a {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:48:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-878f228b-b8d8-41a8-a6d9-d86c16573b31 req-fdd8b8e2-de03-4f34-895c-0ba58146e242 service nova] Acquiring lock "81ffae79-ce4c-440c-a157-ca922637aa67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:48:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-878f228b-b8d8-41a8-a6d9-d86c16573b31 req-fdd8b8e2-de03-4f34-895c-0ba58146e242 service nova] Lock "81ffae79-ce4c-440c-a157-ca922637aa67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:48:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-878f228b-b8d8-41a8-a6d9-d86c16573b31 req-fdd8b8e2-de03-4f34-895c-0ba58146e242 service nova] Lock "81ffae79-ce4c-440c-a157-ca922637aa67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:48:19 user nova-compute[72362]: DEBUG nova.compute.manager [req-878f228b-b8d8-41a8-a6d9-d86c16573b31 req-fdd8b8e2-de03-4f34-895c-0ba58146e242 service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] No waiting events found dispatching network-vif-plugged-2040dc53-585b-4375-a169-539195f3f01a {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:48:19 user nova-compute[72362]: WARNING nova.compute.manager [req-878f228b-b8d8-41a8-a6d9-d86c16573b31 req-fdd8b8e2-de03-4f34-895c-0ba58146e242 service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Received unexpected event network-vif-plugged-2040dc53-585b-4375-a169-539195f3f01a for instance with vm_state active and task_state rescuing.
Aug 09 10:48:19 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Updating instance_info_cache with network_info: [{"id": "434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9", "address": "fa:16:3e:09:7c:97", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434ea21d-d4", "ovs_interfaceid": "434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:48:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Releasing lock "refresh_cache-4296ca4c-1e3e-474f-98ba-9f947d333b8d" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:48:19 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Updated the network info_cache for instance {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 10:48:19 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:48:19 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Removed pending event for 81ffae79-ce4c-440c-a157-ca922637aa67 due to event {{(pid=72362) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 10:48:19 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691578099.5668755, 81ffae79-ce4c-440c-a157-ca922637aa67 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:48:19 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] VM Resumed (Lifecycle Event)
Aug 09 10:48:19 user nova-compute[72362]: DEBUG nova.compute.manager [None req-f62ff91b-2874-42fb-96b4-e7e2d414efbb tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:48:19 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:48:19 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:48:19 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 10:48:19 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691578099.5682738, 81ffae79-ce4c-440c-a157-ca922637aa67 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:48:19 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] VM Started (Lifecycle Event)
Aug 09 10:48:19 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:48:19 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:48:19 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:48:20 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:48:20 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:48:21 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:48:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:48:22 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:48:24 user nova-compute[72362]: DEBUG nova.compute.manager [req-59a89e06-e7da-469a-9d51-70f05318eeb2 req-f8208e04-e00e-4446-96ed-c0dd1d71a94e service nova] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Received event network-changed-87c03a9a-d79a-47d2-9890-ebc571cd89e7 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:48:24 user nova-compute[72362]: DEBUG nova.compute.manager [req-59a89e06-e7da-469a-9d51-70f05318eeb2 req-f8208e04-e00e-4446-96ed-c0dd1d71a94e service nova] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Refreshing instance network info cache due to event network-changed-87c03a9a-d79a-47d2-9890-ebc571cd89e7. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:48:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-59a89e06-e7da-469a-9d51-70f05318eeb2 req-f8208e04-e00e-4446-96ed-c0dd1d71a94e service nova] Acquiring lock "refresh_cache-b1b76bf2-10c2-41e7-bb51-4be3cdc70649" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:48:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-59a89e06-e7da-469a-9d51-70f05318eeb2 req-f8208e04-e00e-4446-96ed-c0dd1d71a94e service nova] Acquired lock "refresh_cache-b1b76bf2-10c2-41e7-bb51-4be3cdc70649" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:48:24 user nova-compute[72362]: DEBUG nova.network.neutron [req-59a89e06-e7da-469a-9d51-70f05318eeb2 req-f8208e04-e00e-4446-96ed-c0dd1d71a94e service nova] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Refreshing network info cache for port 87c03a9a-d79a-47d2-9890-ebc571cd89e7 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:48:25 user nova-compute[72362]: DEBUG nova.network.neutron [req-59a89e06-e7da-469a-9d51-70f05318eeb2 req-f8208e04-e00e-4446-96ed-c0dd1d71a94e service nova] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Updated VIF entry in instance network info cache for port 87c03a9a-d79a-47d2-9890-ebc571cd89e7. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:48:25 user nova-compute[72362]: DEBUG nova.network.neutron [req-59a89e06-e7da-469a-9d51-70f05318eeb2 req-f8208e04-e00e-4446-96ed-c0dd1d71a94e service nova] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Updating instance_info_cache with network_info: [{"id": "87c03a9a-d79a-47d2-9890-ebc571cd89e7", "address": "fa:16:3e:2a:03:e8", "network": {"id": "e56e2a0a-0a6d-4546-86ef-7bb333e829ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1495216341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980f1c36cab0449b949419cf495c16d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87c03a9a-d7", "ovs_interfaceid": "87c03a9a-d79a-47d2-9890-ebc571cd89e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:48:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-59a89e06-e7da-469a-9d51-70f05318eeb2 req-f8208e04-e00e-4446-96ed-c0dd1d71a94e service nova] Releasing lock "refresh_cache-b1b76bf2-10c2-41e7-bb51-4be3cdc70649" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:48:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:48:26 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:48:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:48:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:48:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:48:27 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 10:48:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1b76bf2-10c2-41e7-bb51-4be3cdc70649/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:48:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1b76bf2-10c2-41e7-bb51-4be3cdc70649/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1b76bf2-10c2-41e7-bb51-4be3cdc70649/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1b76bf2-10c2-41e7-bb51-4be3cdc70649/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:27 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:48:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:27 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:48:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67/disk.rescue --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67/disk.rescue --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67/disk (vdb) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:48:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-309e28da-71a9-4bb7-8709-24c4d3d6079b tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "b1b76bf2-10c2-41e7-bb51-4be3cdc70649" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:48:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-309e28da-71a9-4bb7-8709-24c4d3d6079b tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "b1b76bf2-10c2-41e7-bb51-4be3cdc70649" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:48:28 user nova-compute[72362]: DEBUG nova.objects.instance [None req-309e28da-71a9-4bb7-8709-24c4d3d6079b tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lazy-loading 'flavor' on Instance uuid b1b76bf2-10c2-41e7-bb51-4be3cdc70649 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:48:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-309e28da-71a9-4bb7-8709-24c4d3d6079b tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "b1b76bf2-10c2-41e7-bb51-4be3cdc70649" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:48:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-309e28da-71a9-4bb7-8709-24c4d3d6079b tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "b1b76bf2-10c2-41e7-bb51-4be3cdc70649" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:48:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-309e28da-71a9-4bb7-8709-24c4d3d6079b tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "b1b76bf2-10c2-41e7-bb51-4be3cdc70649" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:48:28 user nova-compute[72362]: INFO nova.compute.manager [None req-309e28da-71a9-4bb7-8709-24c4d3d6079b tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Attaching volume d6f8888b-268c-42c4-b375-9ff14d405f05 to /dev/vdb
Aug 09 10:48:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:28 user nova-compute[72362]: DEBUG os_brick.utils [None req-309e28da-71a9-4bb7-8709-24c4d3d6079b tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:48:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:28 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad6136f-5be6-4e53-9ef4-9f9de9fdaabe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:48:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:28 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b7ed6d-c890-48e7-b2b0-04d762af322c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:48:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:28 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c196b42-c5e2-46d6-8489-51887386dd8b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:48:28 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebeb9960-7719-4306-a20f-7e41898356ce]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:48:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-309e28da-71a9-4bb7-8709-24c4d3d6079b tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-309e28da-71a9-4bb7-8709-24c4d3d6079b tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:48:28 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-309e28da-71a9-4bb7-8709-24c4d3d6079b tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:48:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:48:28 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:48:28 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[1adb5a20-954c-48b5-a913-0bf7866ad748]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:48:28 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-309e28da-71a9-4bb7-8709-24c4d3d6079b tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:48:28 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-309e28da-71a9-4bb7-8709-24c4d3d6079b tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:48:28 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-309e28da-71a9-4bb7-8709-24c4d3d6079b tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:48:28 user nova-compute[72362]: DEBUG os_brick.utils [None req-309e28da-71a9-4bb7-8709-24c4d3d6079b tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:48:28 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-309e28da-71a9-4bb7-8709-24c4d3d6079b tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Updating existing volume attachment record: 979f6e18-8368-4f11-8b87-38e85e82d140 {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 10:48:29 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:48:29 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:48:29 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=8119MB free_disk=24.99791717529297GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 10:48:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:48:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:48:29 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance cefe383b-978f-4391-baf6-3b3ad17e0083 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:48:29 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 4296ca4c-1e3e-474f-98ba-9f947d333b8d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:48:29 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance ab34d860-52ba-4773-9f80-84930bbd06d0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:48:29 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 81ffae79-ce4c-440c-a157-ca922637aa67 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:48:29 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance b1b76bf2-10c2-41e7-bb51-4be3cdc70649 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:48:29 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 28daf5f4-214d-440c-bcd6-45f626c40852 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:48:29 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 10:48:29 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 10:48:29 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:48:29 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:48:29 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 10:48:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.317s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:48:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:48:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:48:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-309e28da-71a9-4bb7-8709-24c4d3d6079b tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-309e28da-71a9-4bb7-8709-24c4d3d6079b tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d6f8888b-268c-42c4-b375-9ff14d405f05'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bRjniGAN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:48:37 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-309e28da-71a9-4bb7-8709-24c4d3d6079b tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:48:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-309e28da-71a9-4bb7-8709-24c4d3d6079b tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-309e28da-71a9-4bb7-8709-24c4d3d6079b tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:48:37 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-309e28da-71a9-4bb7-8709-24c4d3d6079b tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:48:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-309e28da-71a9-4bb7-8709-24c4d3d6079b tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6f8888b-268c-42c4-b375-9ff14d405f05" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-309e28da-71a9-4bb7-8709-24c4d3d6079b tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6f8888b-268c-42c4-b375-9ff14d405f05" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:48:37 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-309e28da-71a9-4bb7-8709-24c4d3d6079b tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:48:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6f8888b-268c-42c4-b375-9ff14d405f05 -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6f8888b-268c-42c4-b375-9ff14d405f05 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a447e941-5807-446b-a03b-1d6e82118e43]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-309e28da-71a9-4bb7-8709-24c4d3d6079b tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:48:37 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6f8888b-268c-42c4-b375-9ff14d405f05 -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6f8888b-268c-42c4-b375-9ff14d405f05 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae9f4f4-b9b0-45fc-940a-31d5071f2110]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6f8888b-268c-42c4-b375-9ff14d405f05] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-309e28da-71a9-4bb7-8709-24c4d3d6079b tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6f8888b-268c-42c4-b375-9ff14d405f05] added
Aug 09 10:48:37 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6f8888b-268c-42c4-b375-9ff14d405f05 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6f8888b-268c-42c4-b375-9ff14d405f05 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[923b013e-b83c-4b5a-a944-756e29f7cea3]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-309e28da-71a9-4bb7-8709-24c4d3d6079b tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6f8888b-268c-42c4-b375-9ff14d405f05 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6f8888b-268c-42c4-b375-9ff14d405f05 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b7e0dc-7fec-44b5-81dc-7ce781018e7a]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-309e28da-71a9-4bb7-8709-24c4d3d6079b tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6f8888b-268c-42c4-b375-9ff14d405f05 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bRjniGAN {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6f8888b-268c-42c4-b375-9ff14d405f05 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bRjniGAN" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d510a8e6-6a8e-4256-b8cb-86dcde939578]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-309e28da-71a9-4bb7-8709-24c4d3d6079b tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bRjniGAN'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6f8888b-268c-42c4-b375-9ff14d405f05 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6f8888b-268c-42c4-b375-9ff14d405f05 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea01ce6-1063-4d5c-a4ec-90de9f949773]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-309e28da-71a9-4bb7-8709-24c4d3d6079b tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ef79b8-2d64-4028-8ec3-307a94a17db8]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-309e28da-71a9-4bb7-8709-24c4d3d6079b tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 (non-flash)
Aug 09 10:48:37 user nova-compute[72362]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a (non-flash)
Aug 09 10:48:37 user nova-compute[72362]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd (non-flash)
Aug 09 10:48:37 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-309e28da-71a9-4bb7-8709-24c4d3d6079b tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 (non-flash)
Aug 09 10:48:37 user nova-compute[72362]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a (non-flash)
Aug 09 10:48:37 user nova-compute[72362]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd (non-flash)
Aug 09 10:48:37 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6f8888b-268c-42c4-b375-9ff14d405f05 -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6f8888b-268c-42c4-b375-9ff14d405f05 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ebfd87-5613-4960-8620-d228d4055072]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6f8888b-268c-42c4-b375-9ff14d405f05, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d6f8888b-268c-42c4-b375-9ff14d405f05, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-309e28da-71a9-4bb7-8709-24c4d3d6079b tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6f8888b-268c-42c4-b375-9ff14d405f05, portal: 172.16.0.220,3260]
Aug 09 10:48:37 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:d6f8888b-268c-42c4-b375-9ff14d405f05, portal: 172.16.0.220,3260] successful.
Aug 09 10:48:37 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6f8888b-268c-42c4-b375-9ff14d405f05 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6f8888b-268c-42c4-b375-9ff14d405f05 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ecf923-41b3-4b6e-8440-f56032e2bfe5]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-309e28da-71a9-4bb7-8709-24c4d3d6079b tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2cbb060-b9b9-4ce0-8c9e-8864fb52ca25]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6f8888b-268c-42c4-b375-9ff14d405f05 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-309e28da-71a9-4bb7-8709-24c4d3d6079b tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 (non-flash)
Aug 09 10:48:37 user nova-compute[72362]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a (non-flash)
Aug 09 10:48:37 user nova-compute[72362]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd (non-flash)
Aug 09 10:48:37 user nova-compute[72362]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6f8888b-268c-42c4-b375-9ff14d405f05 (non-flash)
Aug 09 10:48:37 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-309e28da-71a9-4bb7-8709-24c4d3d6079b tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 (non-flash)
Aug 09 10:48:37 user nova-compute[72362]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a (non-flash)
Aug 09 10:48:37 user nova-compute[72362]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd (non-flash)
Aug 09 10:48:37 user nova-compute[72362]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6f8888b-268c-42c4-b375-9ff14d405f05 (non-flash)
Aug 09 10:48:37 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-309e28da-71a9-4bb7-8709-24c4d3d6079b tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6f8888b-268c-42c4-b375-9ff14d405f05" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-309e28da-71a9-4bb7-8709-24c4d3d6079b tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-309e28da-71a9-4bb7-8709-24c4d3d6079b tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] HCTL ('36', '-', '-', 0) found on session 59 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-309e28da-71a9-4bb7-8709-24c4d3d6079b tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dddac28-732a-493c-a31d-ef8e0bb24164]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-309e28da-71a9-4bb7-8709-24c4d3d6079b tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Searching for a device in session 59 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:48:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-309e28da-71a9-4bb7-8709-24c4d3d6079b tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bRjniGAN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:48:38 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-309e28da-71a9-4bb7-8709-24c4d3d6079b tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:48:38 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-309e28da-71a9-4bb7-8709-24c4d3d6079b tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '26463303836363232', 'path': '/dev/sde'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:48:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-309e28da-71a9-4bb7-8709-24c4d3d6079b tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463303836363232', 'path': '/dev/sde'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:48:38 user nova-compute[72362]: DEBUG nova.objects.instance [None req-309e28da-71a9-4bb7-8709-24c4d3d6079b tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lazy-loading 'flavor' on Instance uuid b1b76bf2-10c2-41e7-bb51-4be3cdc70649 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:48:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-309e28da-71a9-4bb7-8709-24c4d3d6079b tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 10:48:38 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:48:38 user nova-compute[72362]:   <source dev="/dev/sde"/>
Aug 09 10:48:38 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:48:38 user nova-compute[72362]:   <serial>d6f8888b-268c-42c4-b375-9ff14d405f05</serial>
Aug 09 10:48:38 user nova-compute[72362]: </disk>
Aug 09 10:48:38 user nova-compute[72362]:  {{(pid=72362) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 10:48:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-309e28da-71a9-4bb7-8709-24c4d3d6079b tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:48:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-309e28da-71a9-4bb7-8709-24c4d3d6079b tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:48:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-309e28da-71a9-4bb7-8709-24c4d3d6079b tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] No VIF found with MAC fa:16:3e:2a:03:e8, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:48:39 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-309e28da-71a9-4bb7-8709-24c4d3d6079b tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "b1b76bf2-10c2-41e7-bb51-4be3cdc70649" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.539s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:48:39 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-40d92904-7dbf-4e2b-8ae6-bdaa30cc51bd tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "b1b76bf2-10c2-41e7-bb51-4be3cdc70649" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:48:39 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-40d92904-7dbf-4e2b-8ae6-bdaa30cc51bd tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "b1b76bf2-10c2-41e7-bb51-4be3cdc70649" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:48:39 user nova-compute[72362]: INFO nova.compute.manager [None req-40d92904-7dbf-4e2b-8ae6-bdaa30cc51bd tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Detaching volume d6f8888b-268c-42c4-b375-9ff14d405f05
Aug 09 10:48:39 user nova-compute[72362]: INFO nova.virt.block_device [None req-40d92904-7dbf-4e2b-8ae6-bdaa30cc51bd tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Attempting to driver detach volume d6f8888b-268c-42c4-b375-9ff14d405f05 from mountpoint /dev/vdb
Aug 09 10:48:39 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-40d92904-7dbf-4e2b-8ae6-bdaa30cc51bd tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Attempting to detach device vdb from instance b1b76bf2-10c2-41e7-bb51-4be3cdc70649 from the persistent domain config. {{(pid=72362) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 10:48:39 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-40d92904-7dbf-4e2b-8ae6-bdaa30cc51bd tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 10:48:39 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:48:39 user nova-compute[72362]:   <source dev="/dev/sde"/>
Aug 09 10:48:39 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:48:39 user nova-compute[72362]:   <serial>d6f8888b-268c-42c4-b375-9ff14d405f05</serial>
Aug 09 10:48:39 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 10:48:39 user nova-compute[72362]: </disk>
Aug 09 10:48:39 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:48:39 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-40d92904-7dbf-4e2b-8ae6-bdaa30cc51bd tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Successfully detached device vdb from instance b1b76bf2-10c2-41e7-bb51-4be3cdc70649 from the persistent domain config.
Aug 09 10:48:39 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-40d92904-7dbf-4e2b-8ae6-bdaa30cc51bd tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b1b76bf2-10c2-41e7-bb51-4be3cdc70649 from the live domain config. {{(pid=72362) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 10:48:39 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-40d92904-7dbf-4e2b-8ae6-bdaa30cc51bd tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 10:48:39 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:48:39 user nova-compute[72362]:   <source dev="/dev/sde"/>
Aug 09 10:48:39 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:48:39 user nova-compute[72362]:   <serial>d6f8888b-268c-42c4-b375-9ff14d405f05</serial>
Aug 09 10:48:39 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 10:48:39 user nova-compute[72362]: </disk>
Aug 09 10:48:39 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:48:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Received event <DeviceRemovedEvent: 1691578120.1148875, b1b76bf2-10c2-41e7-bb51-4be3cdc70649 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72362) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 10:48:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-40d92904-7dbf-4e2b-8ae6-bdaa30cc51bd tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b1b76bf2-10c2-41e7-bb51-4be3cdc70649 {{(pid=72362) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 10:48:40 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-40d92904-7dbf-4e2b-8ae6-bdaa30cc51bd tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Successfully detached device vdb from instance b1b76bf2-10c2-41e7-bb51-4be3cdc70649 from the live domain config.
Aug 09 10:48:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40d92904-7dbf-4e2b-8ae6-bdaa30cc51bd tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:48:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d92904-7dbf-4e2b-8ae6-bdaa30cc51bd tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:d6f8888b-268c-42c4-b375-9ff14d405f05'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bRjniGAN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:48:40 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-40d92904-7dbf-4e2b-8ae6-bdaa30cc51bd tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:48:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-40d92904-7dbf-4e2b-8ae6-bdaa30cc51bd tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:48:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-40d92904-7dbf-4e2b-8ae6-bdaa30cc51bd tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:48:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d92904-7dbf-4e2b-8ae6-bdaa30cc51bd tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6f8888b-268c-42c4-b375-9ff14d405f05', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:48:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:40 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[249cce75-79e1-4ab7-9db7-185802da5f9a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6f8888b-268c-42c4-b375-9ff14d405f05\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:48:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:40 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6e0ebb-b431-4098-a42b-9e01b55f7264]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6f8888b-268c-42c4-b375-9ff14d405f05 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:48:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d92904-7dbf-4e2b-8ae6-bdaa30cc51bd tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 (non-flash)
Aug 09 10:48:40 user nova-compute[72362]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a (non-flash)
Aug 09 10:48:40 user nova-compute[72362]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd (non-flash)
Aug 09 10:48:40 user nova-compute[72362]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6f8888b-268c-42c4-b375-9ff14d405f05 (non-flash)
Aug 09 10:48:40 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:48:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d92904-7dbf-4e2b-8ae6-bdaa30cc51bd tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 (non-flash)
Aug 09 10:48:40 user nova-compute[72362]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a (non-flash)
Aug 09 10:48:40 user nova-compute[72362]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd (non-flash)
Aug 09 10:48:40 user nova-compute[72362]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6f8888b-268c-42c4-b375-9ff14d405f05 (non-flash)
Aug 09 10:48:40 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:48:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d92904-7dbf-4e2b-8ae6-bdaa30cc51bd tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e4306170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6f8888b-268c-42c4-b375-9ff14d405f05'): ({'sde'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:48:40 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-40d92904-7dbf-4e2b-8ae6-bdaa30cc51bd tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Removing single pathed devices sde {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:48:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:40 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ae2fde-0fed-4b65-9e54-608062fba556]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:48:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:40 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d047c17f-3d54-48fa-8a62-739b5f858ac0]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:48:40 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-40d92904-7dbf-4e2b-8ae6-bdaa30cc51bd tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Flushing IO for device /dev/sde {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:48:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:40 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b874bd-3e4b-42aa-a877-88b5c41a08a3]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:48:40 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-40d92904-7dbf-4e2b-8ae6-bdaa30cc51bd tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:48:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:40 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4d2aeb-3dab-4910-b563-09571aa8f122]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:48:40 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-40d92904-7dbf-4e2b-8ae6-bdaa30cc51bd tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:48:40 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-40d92904-7dbf-4e2b-8ae6-bdaa30cc51bd tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] SCSI volumes sde have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:48:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d92904-7dbf-4e2b-8ae6-bdaa30cc51bd tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6f8888b-268c-42c4-b375-9ff14d405f05')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:48:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6f8888b-268c-42c4-b375-9ff14d405f05 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6f8888b-268c-42c4-b375-9ff14d405f05 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:40 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5310ad42-d90c-48f1-8dfc-cf5f26b03134]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:48:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d92904-7dbf-4e2b-8ae6-bdaa30cc51bd tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:48:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6f8888b-268c-42c4-b375-9ff14d405f05 -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6f8888b-268c-42c4-b375-9ff14d405f05 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:40 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6cdd2b-79a9-4cc7-9566-c64c0d656db4]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:d6f8888b-268c-42c4-b375-9ff14d405f05, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:d6f8888b-268c-42c4-b375-9ff14d405f05, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:48:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d92904-7dbf-4e2b-8ae6-bdaa30cc51bd tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:d6f8888b-268c-42c4-b375-9ff14d405f05, portal: 172.16.0.220,3260]
Aug 09 10:48:40 user nova-compute[72362]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:d6f8888b-268c-42c4-b375-9ff14d405f05, portal: 172.16.0.220,3260] successful.
Aug 09 10:48:40 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:48:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6f8888b-268c-42c4-b375-9ff14d405f05 -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6f8888b-268c-42c4-b375-9ff14d405f05 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:40 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6923471-d2d9-4e94-8f56-d02155a61cb5]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:48:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d92904-7dbf-4e2b-8ae6-bdaa30cc51bd tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:48:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-40d92904-7dbf-4e2b-8ae6-bdaa30cc51bd tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:48:40 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d92904-7dbf-4e2b-8ae6-bdaa30cc51bd tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] <== disconnect_volume: return (286ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:48:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40d92904-7dbf-4e2b-8ae6-bdaa30cc51bd tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:48:41 user nova-compute[72362]: DEBUG nova.objects.instance [None req-40d92904-7dbf-4e2b-8ae6-bdaa30cc51bd tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lazy-loading 'flavor' on Instance uuid b1b76bf2-10c2-41e7-bb51-4be3cdc70649 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:48:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-40d92904-7dbf-4e2b-8ae6-bdaa30cc51bd tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "b1b76bf2-10c2-41e7-bb51-4be3cdc70649" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.682s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:48:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:48:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:48:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:48:43 user nova-compute[72362]: DEBUG nova.compute.manager [req-dfb49b9e-a7b5-4ec1-9ce3-a05e786926d1 req-705818db-43d9-400b-8374-abd47394370e service nova] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Received event network-changed-27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:48:43 user nova-compute[72362]: DEBUG nova.compute.manager [req-dfb49b9e-a7b5-4ec1-9ce3-a05e786926d1 req-705818db-43d9-400b-8374-abd47394370e service nova] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Refreshing instance network info cache due to event network-changed-27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:48:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-dfb49b9e-a7b5-4ec1-9ce3-a05e786926d1 req-705818db-43d9-400b-8374-abd47394370e service nova] Acquiring lock "refresh_cache-28daf5f4-214d-440c-bcd6-45f626c40852" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:48:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-dfb49b9e-a7b5-4ec1-9ce3-a05e786926d1 req-705818db-43d9-400b-8374-abd47394370e service nova] Acquired lock "refresh_cache-28daf5f4-214d-440c-bcd6-45f626c40852" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:48:43 user nova-compute[72362]: DEBUG nova.network.neutron [req-dfb49b9e-a7b5-4ec1-9ce3-a05e786926d1 req-705818db-43d9-400b-8374-abd47394370e service nova] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Refreshing network info cache for port 27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:48:43 user nova-compute[72362]: DEBUG nova.network.neutron [req-dfb49b9e-a7b5-4ec1-9ce3-a05e786926d1 req-705818db-43d9-400b-8374-abd47394370e service nova] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Updated VIF entry in instance network info cache for port 27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:48:43 user nova-compute[72362]: DEBUG nova.network.neutron [req-dfb49b9e-a7b5-4ec1-9ce3-a05e786926d1 req-705818db-43d9-400b-8374-abd47394370e service nova] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Updating instance_info_cache with network_info: [{"id": "27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3", "address": "fa:16:3e:09:d5:d7", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27572bc7-19", "ovs_interfaceid": "27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:48:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-dfb49b9e-a7b5-4ec1-9ce3-a05e786926d1 req-705818db-43d9-400b-8374-abd47394370e service nova] Releasing lock "refresh_cache-28daf5f4-214d-440c-bcd6-45f626c40852" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:48:44 user nova-compute[72362]: DEBUG nova.compute.manager [req-b9a67d43-2e71-4e34-ba97-d9429d6e529a req-b944d297-4739-4778-859c-3f031f25271c service nova] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Received event network-changed-27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:48:44 user nova-compute[72362]: DEBUG nova.compute.manager [req-b9a67d43-2e71-4e34-ba97-d9429d6e529a req-b944d297-4739-4778-859c-3f031f25271c service nova] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Refreshing instance network info cache due to event network-changed-27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:48:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b9a67d43-2e71-4e34-ba97-d9429d6e529a req-b944d297-4739-4778-859c-3f031f25271c service nova] Acquiring lock "refresh_cache-28daf5f4-214d-440c-bcd6-45f626c40852" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:48:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b9a67d43-2e71-4e34-ba97-d9429d6e529a req-b944d297-4739-4778-859c-3f031f25271c service nova] Acquired lock "refresh_cache-28daf5f4-214d-440c-bcd6-45f626c40852" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:48:44 user nova-compute[72362]: DEBUG nova.network.neutron [req-b9a67d43-2e71-4e34-ba97-d9429d6e529a req-b944d297-4739-4778-859c-3f031f25271c service nova] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Refreshing network info cache for port 27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:48:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5d79e82e-a3f9-44f7-b6f4-8ef488bea74b tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "28daf5f4-214d-440c-bcd6-45f626c40852" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:48:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5d79e82e-a3f9-44f7-b6f4-8ef488bea74b tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "28daf5f4-214d-440c-bcd6-45f626c40852" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:48:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5d79e82e-a3f9-44f7-b6f4-8ef488bea74b tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "28daf5f4-214d-440c-bcd6-45f626c40852-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:48:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5d79e82e-a3f9-44f7-b6f4-8ef488bea74b tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "28daf5f4-214d-440c-bcd6-45f626c40852-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:48:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5d79e82e-a3f9-44f7-b6f4-8ef488bea74b tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "28daf5f4-214d-440c-bcd6-45f626c40852-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:48:44 user nova-compute[72362]: INFO nova.compute.manager [None req-5d79e82e-a3f9-44f7-b6f4-8ef488bea74b tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Terminating instance
Aug 09 10:48:44 user nova-compute[72362]: DEBUG nova.compute.manager [None req-5d79e82e-a3f9-44f7-b6f4-8ef488bea74b tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Start destroying the instance on the hypervisor. {{(pid=72362) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 10:48:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:48:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:48:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:48:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:48:44 user nova-compute[72362]: DEBUG nova.compute.manager [req-ddab0d10-5dba-46e4-891e-51df12247924 req-89412076-a6e1-4a2c-9287-5806259df720 service nova] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Received event network-vif-unplugged-27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:48:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ddab0d10-5dba-46e4-891e-51df12247924 req-89412076-a6e1-4a2c-9287-5806259df720 service nova] Acquiring lock "28daf5f4-214d-440c-bcd6-45f626c40852-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:48:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ddab0d10-5dba-46e4-891e-51df12247924 req-89412076-a6e1-4a2c-9287-5806259df720 service nova] Lock "28daf5f4-214d-440c-bcd6-45f626c40852-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:48:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ddab0d10-5dba-46e4-891e-51df12247924 req-89412076-a6e1-4a2c-9287-5806259df720 service nova] Lock "28daf5f4-214d-440c-bcd6-45f626c40852-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:48:44 user nova-compute[72362]: DEBUG nova.compute.manager [req-ddab0d10-5dba-46e4-891e-51df12247924 req-89412076-a6e1-4a2c-9287-5806259df720 service nova] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] No waiting events found dispatching network-vif-unplugged-27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:48:44 user nova-compute[72362]: DEBUG nova.compute.manager [req-ddab0d10-5dba-46e4-891e-51df12247924 req-89412076-a6e1-4a2c-9287-5806259df720 service nova] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Received event network-vif-unplugged-27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3 for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:48:44 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Instance destroyed successfully.
Aug 09 10:48:44 user nova-compute[72362]: DEBUG nova.objects.instance [None req-5d79e82e-a3f9-44f7-b6f4-8ef488bea74b tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lazy-loading 'resources' on Instance uuid 28daf5f4-214d-440c-bcd6-45f626c40852 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:48:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-5d79e82e-a3f9-44f7-b6f4-8ef488bea74b tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:46:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2098959833',display_name='tempest-TestVolumeBootPattern-server-2098959833',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2098959833',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHphUKjpMkPjhZoTYlVJxPOuywq6OJUJWcHduVoRu9b0hlVgGA5+i25KrjKtdJwPAqa6k/+4sAUFZLxd189pJwbl9oyVmaY/KLuastlFffcAKt/RqOFaRqRDbZFRQvHB1g==',key_name='tempest-TestVolumeBootPattern-1201178489',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:47:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='26e38599de0b4b06b723f5647a7fe121',ramdisk_id='',reservation_id='r-z7s3rt1u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1478436240',owner_user_name='tempest-TestVolumeBootPattern-1478436240-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:47:11Z,user_data=None,user_id='e96900e953f64d02bdb5d48f136133c3',uuid=28daf5f4-214d-440c-bcd6-45f626c40852,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3", "address": "fa:16:3e:09:d5:d7", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27572bc7-19", "ovs_interfaceid": "27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:48:44 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-5d79e82e-a3f9-44f7-b6f4-8ef488bea74b tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Converting VIF {"id": "27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3", "address": "fa:16:3e:09:d5:d7", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27572bc7-19", "ovs_interfaceid": "27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:48:44 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-5d79e82e-a3f9-44f7-b6f4-8ef488bea74b tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:d5:d7,bridge_name='br-int',has_traffic_filtering=True,id=27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3,network=Network(b4a9e050-41f1-404a-bf5c-41421f034644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27572bc7-19') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:48:44 user nova-compute[72362]: DEBUG os_vif [None req-5d79e82e-a3f9-44f7-b6f4-8ef488bea74b tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:d5:d7,bridge_name='br-int',has_traffic_filtering=True,id=27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3,network=Network(b4a9e050-41f1-404a-bf5c-41421f034644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27572bc7-19') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:48:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:48:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27572bc7-19, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:48:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:48:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:48:44 user nova-compute[72362]: INFO os_vif [None req-5d79e82e-a3f9-44f7-b6f4-8ef488bea74b tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:d5:d7,bridge_name='br-int',has_traffic_filtering=True,id=27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3,network=Network(b4a9e050-41f1-404a-bf5c-41421f034644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27572bc7-19')
Aug 09 10:48:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d79e82e-a3f9-44f7-b6f4-8ef488bea74b tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:48:44 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d79e82e-a3f9-44f7-b6f4-8ef488bea74b tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FYvpZVoe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:48:44 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-5d79e82e-a3f9-44f7-b6f4-8ef488bea74b tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:48:44 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-5d79e82e-a3f9-44f7-b6f4-8ef488bea74b tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:48:44 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-5d79e82e-a3f9-44f7-b6f4-8ef488bea74b tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:48:44 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d79e82e-a3f9-44f7-b6f4-8ef488bea74b tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:48:44 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:45 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb0f411-bf6f-4240-930f-e2bcf60e7abe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:48:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:45 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[617adfd9-e1e3-4e43-ba5b-20c455a50caa]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:48:45 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d79e82e-a3f9-44f7-b6f4-8ef488bea74b tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 (non-flash)
Aug 09 10:48:45 user nova-compute[72362]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a (non-flash)
Aug 09 10:48:45 user nova-compute[72362]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd (non-flash)
Aug 09 10:48:45 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:48:45 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d79e82e-a3f9-44f7-b6f4-8ef488bea74b tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 (non-flash)
Aug 09 10:48:45 user nova-compute[72362]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a (non-flash)
Aug 09 10:48:45 user nova-compute[72362]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd (non-flash)
Aug 09 10:48:45 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:48:45 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d79e82e-a3f9-44f7-b6f4-8ef488bea74b tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e45def80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a'): ({'sdc'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:48:45 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-5d79e82e-a3f9-44f7-b6f4-8ef488bea74b tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Removing single pathed devices sdc {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:48:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:45 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c76460-a55a-4a67-b9fb-da0b4f41e11b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:48:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:45 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[582ba975-2e75-4d02-98e1-07cadd68f6e8]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:48:45 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-5d79e82e-a3f9-44f7-b6f4-8ef488bea74b tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Flushing IO for device /dev/sdc {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:48:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:45 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d7f942-4e16-481a-a896-81bb5c0dacbf]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:48:45 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-5d79e82e-a3f9-44f7-b6f4-8ef488bea74b tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:48:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:45 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5a04cb-67f8-458a-823a-90045c9ea497]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:48:45 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-5d79e82e-a3f9-44f7-b6f4-8ef488bea74b tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:48:45 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-5d79e82e-a3f9-44f7-b6f4-8ef488bea74b tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] SCSI volumes sdc have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:48:45 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d79e82e-a3f9-44f7-b6f4-8ef488bea74b tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:48:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:45 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88c07cc-86ee-4618-984b-983e4581db28]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:48:45 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d79e82e-a3f9-44f7-b6f4-8ef488bea74b tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:48:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:45 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce732427-1f2b-4103-b7d3-8beec88fca5e]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:48:45 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d79e82e-a3f9-44f7-b6f4-8ef488bea74b tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a, portal: 172.16.0.220,3260]
Aug 09 10:48:45 user nova-compute[72362]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a, portal: 172.16.0.220,3260] successful.
Aug 09 10:48:45 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:48:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:48:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bdbad03-f774-48cc-b987-0e0d8eb5556a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:48:45 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9cd8d4b-b770-4f17-bf03-d632a5f3fe12]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:48:45 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d79e82e-a3f9-44f7-b6f4-8ef488bea74b tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:48:45 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-5d79e82e-a3f9-44f7-b6f4-8ef488bea74b tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:48:45 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d79e82e-a3f9-44f7-b6f4-8ef488bea74b tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] <== disconnect_volume: return (294ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:48:45 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d79e82e-a3f9-44f7-b6f4-8ef488bea74b tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:48:45 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-5d79e82e-a3f9-44f7-b6f4-8ef488bea74b tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Deleting instance files /opt/stack/data/nova/instances/28daf5f4-214d-440c-bcd6-45f626c40852_del
Aug 09 10:48:45 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-5d79e82e-a3f9-44f7-b6f4-8ef488bea74b tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Deletion of /opt/stack/data/nova/instances/28daf5f4-214d-440c-bcd6-45f626c40852_del complete
Aug 09 10:48:45 user nova-compute[72362]: INFO nova.compute.manager [None req-5d79e82e-a3f9-44f7-b6f4-8ef488bea74b tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Took 1.20 seconds to destroy the instance on the hypervisor.
Aug 09 10:48:45 user nova-compute[72362]: DEBUG oslo.service.loopingcall [None req-5d79e82e-a3f9-44f7-b6f4-8ef488bea74b tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72362) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 10:48:45 user nova-compute[72362]: DEBUG nova.compute.manager [-] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Deallocating network for instance {{(pid=72362) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 10:48:45 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] deallocate_for_instance() {{(pid=72362) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 10:48:45 user nova-compute[72362]: DEBUG nova.network.neutron [req-b9a67d43-2e71-4e34-ba97-d9429d6e529a req-b944d297-4739-4778-859c-3f031f25271c service nova] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Updated VIF entry in instance network info cache for port 27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:48:45 user nova-compute[72362]: DEBUG nova.network.neutron [req-b9a67d43-2e71-4e34-ba97-d9429d6e529a req-b944d297-4739-4778-859c-3f031f25271c service nova] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Updating instance_info_cache with network_info: [{"id": "27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3", "address": "fa:16:3e:09:d5:d7", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27572bc7-19", "ovs_interfaceid": "27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:48:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b9a67d43-2e71-4e34-ba97-d9429d6e529a req-b944d297-4739-4778-859c-3f031f25271c service nova] Releasing lock "refresh_cache-28daf5f4-214d-440c-bcd6-45f626c40852" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:48:45 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:48:45 user nova-compute[72362]: DEBUG nova.compute.manager [req-fd54dc6b-b0c9-4022-8b98-619b7e09dc4d req-3badcf74-9e59-4650-84b8-ce09be1271ea service nova] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Received event network-vif-deleted-27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:48:45 user nova-compute[72362]: INFO nova.compute.manager [req-fd54dc6b-b0c9-4022-8b98-619b7e09dc4d req-3badcf74-9e59-4650-84b8-ce09be1271ea service nova] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Neutron deleted interface 27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3; detaching it from the instance and deleting it from the info cache
Aug 09 10:48:45 user nova-compute[72362]: DEBUG nova.network.neutron [req-fd54dc6b-b0c9-4022-8b98-619b7e09dc4d req-3badcf74-9e59-4650-84b8-ce09be1271ea service nova] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:48:46 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Took 0.60 seconds to deallocate network for instance.
Aug 09 10:48:46 user nova-compute[72362]: DEBUG nova.compute.manager [req-fd54dc6b-b0c9-4022-8b98-619b7e09dc4d req-3badcf74-9e59-4650-84b8-ce09be1271ea service nova] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Detach interface failed, port_id=27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3, reason: Instance 28daf5f4-214d-440c-bcd6-45f626c40852 could not be found. {{(pid=72362) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 10:48:46 user nova-compute[72362]: INFO nova.compute.manager [None req-5d79e82e-a3f9-44f7-b6f4-8ef488bea74b tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Took 0.75 seconds to detach 1 volumes for instance.
Aug 09 10:48:46 user nova-compute[72362]: DEBUG nova.compute.manager [req-05d6b96b-3b49-4618-86a0-3945f67ec20a req-68bb32b5-411d-434a-86ab-45ca76f70a88 service nova] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Received event network-vif-plugged-27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:48:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-05d6b96b-3b49-4618-86a0-3945f67ec20a req-68bb32b5-411d-434a-86ab-45ca76f70a88 service nova] Acquiring lock "28daf5f4-214d-440c-bcd6-45f626c40852-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:48:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-05d6b96b-3b49-4618-86a0-3945f67ec20a req-68bb32b5-411d-434a-86ab-45ca76f70a88 service nova] Lock "28daf5f4-214d-440c-bcd6-45f626c40852-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:48:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-05d6b96b-3b49-4618-86a0-3945f67ec20a req-68bb32b5-411d-434a-86ab-45ca76f70a88 service nova] Lock "28daf5f4-214d-440c-bcd6-45f626c40852-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:48:46 user nova-compute[72362]: DEBUG nova.compute.manager [req-05d6b96b-3b49-4618-86a0-3945f67ec20a req-68bb32b5-411d-434a-86ab-45ca76f70a88 service nova] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] No waiting events found dispatching network-vif-plugged-27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:48:46 user nova-compute[72362]: WARNING nova.compute.manager [req-05d6b96b-3b49-4618-86a0-3945f67ec20a req-68bb32b5-411d-434a-86ab-45ca76f70a88 service nova] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Received unexpected event network-vif-plugged-27572bc7-19d3-4f7e-92d8-4c3f97dbe3a3 for instance with vm_state active and task_state deleting.
Aug 09 10:48:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5d79e82e-a3f9-44f7-b6f4-8ef488bea74b tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:48:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5d79e82e-a3f9-44f7-b6f4-8ef488bea74b tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:48:46 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-5d79e82e-a3f9-44f7-b6f4-8ef488bea74b tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:48:46 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-5d79e82e-a3f9-44f7-b6f4-8ef488bea74b tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:48:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5d79e82e-a3f9-44f7-b6f4-8ef488bea74b tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.209s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:48:47 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-5d79e82e-a3f9-44f7-b6f4-8ef488bea74b tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Deleted allocations for instance 28daf5f4-214d-440c-bcd6-45f626c40852
Aug 09 10:48:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5d79e82e-a3f9-44f7-b6f4-8ef488bea74b tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "28daf5f4-214d-440c-bcd6-45f626c40852" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.933s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:48:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:48:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:48:54 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:48:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:48:59 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691578124.938565, 28daf5f4-214d-440c-bcd6-45f626c40852 => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:48:59 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] VM Stopped (Lifecycle Event)
Aug 09 10:48:59 user nova-compute[72362]: DEBUG nova.compute.manager [None req-12e4cc2f-1a9f-416e-b525-b99733da34af None None] [instance: 28daf5f4-214d-440c-bcd6-45f626c40852] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:48:59 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:49:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:49:09 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:49:14 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:49:18 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:49:18 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:49:18 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:49:18 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 10:49:18 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:49:18 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 10:49:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "refresh_cache-ab34d860-52ba-4773-9f80-84930bbd06d0" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:49:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquired lock "refresh_cache-ab34d860-52ba-4773-9f80-84930bbd06d0" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:49:19 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Forcefully refreshing network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 10:49:19 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Updating instance_info_cache with network_info: [{"id": "221b0dc3-ded0-4875-8396-51d6013e2aea", "address": "fa:16:3e:af:d6:64", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap221b0dc3-de", "ovs_interfaceid": "221b0dc3-ded0-4875-8396-51d6013e2aea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:49:19 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Releasing lock "refresh_cache-ab34d860-52ba-4773-9f80-84930bbd06d0" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:49:19 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Updated the network info_cache for instance {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 10:49:19 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:49:20 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:49:21 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:49:21 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:49:21 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:49:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:49:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:49:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 10:49:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 10:49:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 10:49:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:49:26 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:49:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:49:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:49:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:49:27 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 10:49:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1b76bf2-10c2-41e7-bb51-4be3cdc70649/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:49:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1b76bf2-10c2-41e7-bb51-4be3cdc70649/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:49:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1b76bf2-10c2-41e7-bb51-4be3cdc70649/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:49:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1b76bf2-10c2-41e7-bb51-4be3cdc70649/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:49:27 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:49:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:49:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:49:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:49:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:49:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67/disk.rescue --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:49:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:49:27 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67/disk.rescue --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:49:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:49:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67/disk (vdb) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:49:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:49:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json" returned: 0 in 0.152s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:49:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:49:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:49:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:49:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:49:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:49:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:49:29 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:49:29 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:49:29 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=8312MB free_disk=24.996376037597656GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 10:49:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:49:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:49:29 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance cefe383b-978f-4391-baf6-3b3ad17e0083 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:49:29 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 4296ca4c-1e3e-474f-98ba-9f947d333b8d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:49:29 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance ab34d860-52ba-4773-9f80-84930bbd06d0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:49:29 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 81ffae79-ce4c-440c-a157-ca922637aa67 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:49:29 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance b1b76bf2-10c2-41e7-bb51-4be3cdc70649 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:49:29 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 10:49:29 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 10:49:29 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:49:29 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:49:29 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 10:49:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.300s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:49:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-10635944-abf0-420c-8c1d-8cac99028c0e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "b1b76bf2-10c2-41e7-bb51-4be3cdc70649" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:49:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-10635944-abf0-420c-8c1d-8cac99028c0e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "b1b76bf2-10c2-41e7-bb51-4be3cdc70649" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:49:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-10635944-abf0-420c-8c1d-8cac99028c0e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "b1b76bf2-10c2-41e7-bb51-4be3cdc70649-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:49:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-10635944-abf0-420c-8c1d-8cac99028c0e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "b1b76bf2-10c2-41e7-bb51-4be3cdc70649-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:49:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-10635944-abf0-420c-8c1d-8cac99028c0e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "b1b76bf2-10c2-41e7-bb51-4be3cdc70649-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:49:29 user nova-compute[72362]: INFO nova.compute.manager [None req-10635944-abf0-420c-8c1d-8cac99028c0e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Terminating instance
Aug 09 10:49:29 user nova-compute[72362]: DEBUG nova.compute.manager [None req-10635944-abf0-420c-8c1d-8cac99028c0e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Start destroying the instance on the hypervisor. {{(pid=72362) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 10:49:29 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:49:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:49:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:49:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:49:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:49:30 user nova-compute[72362]: DEBUG nova.compute.manager [req-6a0774c9-8c73-4784-a735-5469b607c785 req-634f4fd7-471a-48ec-bec3-5434ab133617 service nova] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Received event network-vif-unplugged-87c03a9a-d79a-47d2-9890-ebc571cd89e7 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:49:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-6a0774c9-8c73-4784-a735-5469b607c785 req-634f4fd7-471a-48ec-bec3-5434ab133617 service nova] Acquiring lock "b1b76bf2-10c2-41e7-bb51-4be3cdc70649-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:49:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-6a0774c9-8c73-4784-a735-5469b607c785 req-634f4fd7-471a-48ec-bec3-5434ab133617 service nova] Lock "b1b76bf2-10c2-41e7-bb51-4be3cdc70649-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:49:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-6a0774c9-8c73-4784-a735-5469b607c785 req-634f4fd7-471a-48ec-bec3-5434ab133617 service nova] Lock "b1b76bf2-10c2-41e7-bb51-4be3cdc70649-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:49:30 user nova-compute[72362]: DEBUG nova.compute.manager [req-6a0774c9-8c73-4784-a735-5469b607c785 req-634f4fd7-471a-48ec-bec3-5434ab133617 service nova] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] No waiting events found dispatching network-vif-unplugged-87c03a9a-d79a-47d2-9890-ebc571cd89e7 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:49:30 user nova-compute[72362]: DEBUG nova.compute.manager [req-6a0774c9-8c73-4784-a735-5469b607c785 req-634f4fd7-471a-48ec-bec3-5434ab133617 service nova] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Received event network-vif-unplugged-87c03a9a-d79a-47d2-9890-ebc571cd89e7 for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:49:30 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Instance destroyed successfully.
Aug 09 10:49:30 user nova-compute[72362]: DEBUG nova.objects.instance [None req-10635944-abf0-420c-8c1d-8cac99028c0e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lazy-loading 'resources' on Instance uuid b1b76bf2-10c2-41e7-bb51-4be3cdc70649 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:49:30 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-10635944-abf0-420c-8c1d-8cac99028c0e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:46:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1068960077',display_name='tempest-AttachVolumeNegativeTest-server-1068960077',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1068960077',id=48,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBINLYvZhFp2HKk4JykMv2xkICt3deACrncuG96Gs7Ge3BDi0lfs3BtD5fNsJoELC3VeU+8gFiq5p8iU4ruXRtls0CE3CzWGeKxP5NpeTsyYqLHRgJZI32cpEsZU+BkQMGA==',key_name='tempest-keypair-226076808',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:46:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='980f1c36cab0449b949419cf495c16d5',ramdisk_id='',reservation_id='r-2ilp9bpy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-486756066',owner_user_name='tempest-AttachVolumeNegativeTest-486756066-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:46:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bed469ff9d954891905c98bdf238c097',uuid=b1b76bf2-10c2-41e7-bb51-4be3cdc70649,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87c03a9a-d79a-47d2-9890-ebc571cd89e7", "address": "fa:16:3e:2a:03:e8", "network": {"id": "e56e2a0a-0a6d-4546-86ef-7bb333e829ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1495216341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980f1c36cab0449b949419cf495c16d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87c03a9a-d7", "ovs_interfaceid": "87c03a9a-d79a-47d2-9890-ebc571cd89e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:49:30 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-10635944-abf0-420c-8c1d-8cac99028c0e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Converting VIF {"id": "87c03a9a-d79a-47d2-9890-ebc571cd89e7", "address": "fa:16:3e:2a:03:e8", "network": {"id": "e56e2a0a-0a6d-4546-86ef-7bb333e829ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1495216341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980f1c36cab0449b949419cf495c16d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87c03a9a-d7", "ovs_interfaceid": "87c03a9a-d79a-47d2-9890-ebc571cd89e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:49:30 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-10635944-abf0-420c-8c1d-8cac99028c0e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:03:e8,bridge_name='br-int',has_traffic_filtering=True,id=87c03a9a-d79a-47d2-9890-ebc571cd89e7,network=Network(e56e2a0a-0a6d-4546-86ef-7bb333e829ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87c03a9a-d7') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:49:30 user nova-compute[72362]: DEBUG os_vif [None req-10635944-abf0-420c-8c1d-8cac99028c0e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:03:e8,bridge_name='br-int',has_traffic_filtering=True,id=87c03a9a-d79a-47d2-9890-ebc571cd89e7,network=Network(e56e2a0a-0a6d-4546-86ef-7bb333e829ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87c03a9a-d7') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:49:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:49:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap87c03a9a-d7, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:49:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:49:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:49:30 user nova-compute[72362]: INFO os_vif [None req-10635944-abf0-420c-8c1d-8cac99028c0e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:03:e8,bridge_name='br-int',has_traffic_filtering=True,id=87c03a9a-d79a-47d2-9890-ebc571cd89e7,network=Network(e56e2a0a-0a6d-4546-86ef-7bb333e829ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87c03a9a-d7')
Aug 09 10:49:30 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-10635944-abf0-420c-8c1d-8cac99028c0e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Deleting instance files /opt/stack/data/nova/instances/b1b76bf2-10c2-41e7-bb51-4be3cdc70649_del
Aug 09 10:49:30 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-10635944-abf0-420c-8c1d-8cac99028c0e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Deletion of /opt/stack/data/nova/instances/b1b76bf2-10c2-41e7-bb51-4be3cdc70649_del complete
Aug 09 10:49:30 user nova-compute[72362]: INFO nova.compute.manager [None req-10635944-abf0-420c-8c1d-8cac99028c0e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 09 10:49:30 user nova-compute[72362]: DEBUG oslo.service.loopingcall [None req-10635944-abf0-420c-8c1d-8cac99028c0e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72362) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 10:49:30 user nova-compute[72362]: DEBUG nova.compute.manager [-] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Deallocating network for instance {{(pid=72362) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 10:49:30 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] deallocate_for_instance() {{(pid=72362) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 10:49:32 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:49:32 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Took 1.28 seconds to deallocate network for instance.
Aug 09 10:49:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-10635944-abf0-420c-8c1d-8cac99028c0e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:49:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-10635944-abf0-420c-8c1d-8cac99028c0e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:49:32 user nova-compute[72362]: DEBUG nova.compute.manager [req-41f98c57-fbe6-4cf9-a21e-e6494e2aa370 req-24e93d1a-96ff-40eb-8633-67fcf4ef1b3c service nova] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Received event network-vif-plugged-87c03a9a-d79a-47d2-9890-ebc571cd89e7 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:49:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-41f98c57-fbe6-4cf9-a21e-e6494e2aa370 req-24e93d1a-96ff-40eb-8633-67fcf4ef1b3c service nova] Acquiring lock "b1b76bf2-10c2-41e7-bb51-4be3cdc70649-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:49:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-41f98c57-fbe6-4cf9-a21e-e6494e2aa370 req-24e93d1a-96ff-40eb-8633-67fcf4ef1b3c service nova] Lock "b1b76bf2-10c2-41e7-bb51-4be3cdc70649-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:49:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-41f98c57-fbe6-4cf9-a21e-e6494e2aa370 req-24e93d1a-96ff-40eb-8633-67fcf4ef1b3c service nova] Lock "b1b76bf2-10c2-41e7-bb51-4be3cdc70649-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:49:32 user nova-compute[72362]: DEBUG nova.compute.manager [req-41f98c57-fbe6-4cf9-a21e-e6494e2aa370 req-24e93d1a-96ff-40eb-8633-67fcf4ef1b3c service nova] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] No waiting events found dispatching network-vif-plugged-87c03a9a-d79a-47d2-9890-ebc571cd89e7 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:49:32 user nova-compute[72362]: WARNING nova.compute.manager [req-41f98c57-fbe6-4cf9-a21e-e6494e2aa370 req-24e93d1a-96ff-40eb-8633-67fcf4ef1b3c service nova] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Received unexpected event network-vif-plugged-87c03a9a-d79a-47d2-9890-ebc571cd89e7 for instance with vm_state deleted and task_state None.
Aug 09 10:49:32 user nova-compute[72362]: DEBUG nova.compute.manager [req-41f98c57-fbe6-4cf9-a21e-e6494e2aa370 req-24e93d1a-96ff-40eb-8633-67fcf4ef1b3c service nova] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Received event network-vif-deleted-87c03a9a-d79a-47d2-9890-ebc571cd89e7 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:49:32 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-10635944-abf0-420c-8c1d-8cac99028c0e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:49:32 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-10635944-abf0-420c-8c1d-8cac99028c0e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:49:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-10635944-abf0-420c-8c1d-8cac99028c0e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.255s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:49:32 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-10635944-abf0-420c-8c1d-8cac99028c0e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Deleted allocations for instance b1b76bf2-10c2-41e7-bb51-4be3cdc70649
Aug 09 10:49:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-10635944-abf0-420c-8c1d-8cac99028c0e tempest-AttachVolumeNegativeTest-486756066 tempest-AttachVolumeNegativeTest-486756066-project-member] Lock "b1b76bf2-10c2-41e7-bb51-4be3cdc70649" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.609s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:49:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Acquiring lock "c9b8c0c6-7afc-4f0b-ba06-3eccd4726124" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:49:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "c9b8c0c6-7afc-4f0b-ba06-3eccd4726124" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:49:34 user nova-compute[72362]: INFO nova.compute.manager [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Unshelving
Aug 09 10:49:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:49:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:49:34 user nova-compute[72362]: DEBUG nova.objects.instance [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lazy-loading 'pci_requests' on Instance uuid c9b8c0c6-7afc-4f0b-ba06-3eccd4726124 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:49:34 user nova-compute[72362]: DEBUG nova.objects.instance [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lazy-loading 'numa_topology' on Instance uuid c9b8c0c6-7afc-4f0b-ba06-3eccd4726124 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:49:34 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:49:34 user nova-compute[72362]: INFO nova.compute.claims [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Claim successful on node user
Aug 09 10:49:34 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:49:34 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:49:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.314s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:49:34 user nova-compute[72362]: INFO nova.network.neutron [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Updating port bba009ea-bb2e-4952-98ee-4dd1fb2649fc with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 09 10:49:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Acquiring lock "refresh_cache-c9b8c0c6-7afc-4f0b-ba06-3eccd4726124" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:49:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Acquired lock "refresh_cache-c9b8c0c6-7afc-4f0b-ba06-3eccd4726124" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:49:35 user nova-compute[72362]: DEBUG nova.network.neutron [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:49:35 user nova-compute[72362]: DEBUG nova.compute.manager [req-fb255e2d-6858-4f57-b6ba-32f9a6be3533 req-9f568910-415b-4d25-a580-06ac4febe3b2 service nova] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Received event network-changed-bba009ea-bb2e-4952-98ee-4dd1fb2649fc {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:49:35 user nova-compute[72362]: DEBUG nova.compute.manager [req-fb255e2d-6858-4f57-b6ba-32f9a6be3533 req-9f568910-415b-4d25-a580-06ac4febe3b2 service nova] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Refreshing instance network info cache due to event network-changed-bba009ea-bb2e-4952-98ee-4dd1fb2649fc. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:49:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-fb255e2d-6858-4f57-b6ba-32f9a6be3533 req-9f568910-415b-4d25-a580-06ac4febe3b2 service nova] Acquiring lock "refresh_cache-c9b8c0c6-7afc-4f0b-ba06-3eccd4726124" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:49:35 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:49:35 user nova-compute[72362]: DEBUG nova.network.neutron [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Updating instance_info_cache with network_info: [{"id": "bba009ea-bb2e-4952-98ee-4dd1fb2649fc", "address": "fa:16:3e:5b:15:67", "network": {"id": "362446ea-173c-4989-93f8-882088822208", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-499399633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f9d6a60f24d41deb91ae59189c62ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba009ea-bb", "ovs_interfaceid": "bba009ea-bb2e-4952-98ee-4dd1fb2649fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:49:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Releasing lock "refresh_cache-c9b8c0c6-7afc-4f0b-ba06-3eccd4726124" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:49:35 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:49:35 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Creating image(s)
Aug 09 10:49:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Acquiring lock "/opt/stack/data/nova/instances/c9b8c0c6-7afc-4f0b-ba06-3eccd4726124/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:49:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "/opt/stack/data/nova/instances/c9b8c0c6-7afc-4f0b-ba06-3eccd4726124/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:49:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "/opt/stack/data/nova/instances/c9b8c0c6-7afc-4f0b-ba06-3eccd4726124/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:49:35 user nova-compute[72362]: DEBUG nova.objects.instance [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lazy-loading 'trusted_certs' on Instance uuid c9b8c0c6-7afc-4f0b-ba06-3eccd4726124 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:49:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-fb255e2d-6858-4f57-b6ba-32f9a6be3533 req-9f568910-415b-4d25-a580-06ac4febe3b2 service nova] Acquired lock "refresh_cache-c9b8c0c6-7afc-4f0b-ba06-3eccd4726124" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:49:35 user nova-compute[72362]: DEBUG nova.network.neutron [req-fb255e2d-6858-4f57-b6ba-32f9a6be3533 req-9f568910-415b-4d25-a580-06ac4febe3b2 service nova] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Refreshing network info cache for port bba009ea-bb2e-4952-98ee-4dd1fb2649fc {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:49:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Acquiring lock "b90259d0562f3f8ff5c4e2da83e1b8f7ef781857" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:49:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "b90259d0562f3f8ff5c4e2da83e1b8f7ef781857" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:49:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b90259d0562f3f8ff5c4e2da83e1b8f7ef781857.part --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:49:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b90259d0562f3f8ff5c4e2da83e1b8f7ef781857.part --force-share --output=json" returned: 0 in 0.134s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:49:36 user nova-compute[72362]: DEBUG nova.virt.images [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] afc2010a-5c4e-4edb-b27d-5acad402f861 was qcow2, converting to raw {{(pid=72362) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 10:49:36 user nova-compute[72362]: DEBUG nova.privsep.utils [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72362) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 10:49:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b90259d0562f3f8ff5c4e2da83e1b8f7ef781857.part /opt/stack/data/nova/instances/_base/b90259d0562f3f8ff5c4e2da83e1b8f7ef781857.converted {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:49:37 user nova-compute[72362]: DEBUG nova.network.neutron [req-fb255e2d-6858-4f57-b6ba-32f9a6be3533 req-9f568910-415b-4d25-a580-06ac4febe3b2 service nova] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Updated VIF entry in instance network info cache for port bba009ea-bb2e-4952-98ee-4dd1fb2649fc. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:49:37 user nova-compute[72362]: DEBUG nova.network.neutron [req-fb255e2d-6858-4f57-b6ba-32f9a6be3533 req-9f568910-415b-4d25-a580-06ac4febe3b2 service nova] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Updating instance_info_cache with network_info: [{"id": "bba009ea-bb2e-4952-98ee-4dd1fb2649fc", "address": "fa:16:3e:5b:15:67", "network": {"id": "362446ea-173c-4989-93f8-882088822208", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-499399633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f9d6a60f24d41deb91ae59189c62ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba009ea-bb", "ovs_interfaceid": "bba009ea-bb2e-4952-98ee-4dd1fb2649fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:49:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-fb255e2d-6858-4f57-b6ba-32f9a6be3533 req-9f568910-415b-4d25-a580-06ac4febe3b2 service nova] Releasing lock "refresh_cache-c9b8c0c6-7afc-4f0b-ba06-3eccd4726124" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:49:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b90259d0562f3f8ff5c4e2da83e1b8f7ef781857.part /opt/stack/data/nova/instances/_base/b90259d0562f3f8ff5c4e2da83e1b8f7ef781857.converted" returned: 0 in 0.610s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:49:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b90259d0562f3f8ff5c4e2da83e1b8f7ef781857.converted --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:49:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b90259d0562f3f8ff5c4e2da83e1b8f7ef781857.converted --force-share --output=json" returned: 0 in 0.138s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:49:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "b90259d0562f3f8ff5c4e2da83e1b8f7ef781857" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.800s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:49:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b90259d0562f3f8ff5c4e2da83e1b8f7ef781857 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:49:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b90259d0562f3f8ff5c4e2da83e1b8f7ef781857 --force-share --output=json" returned: 0 in 0.131s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:49:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Acquiring lock "b90259d0562f3f8ff5c4e2da83e1b8f7ef781857" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:49:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "b90259d0562f3f8ff5c4e2da83e1b8f7ef781857" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:49:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b90259d0562f3f8ff5c4e2da83e1b8f7ef781857 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:49:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b90259d0562f3f8ff5c4e2da83e1b8f7ef781857 --force-share --output=json" returned: 0 in 0.150s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:49:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b90259d0562f3f8ff5c4e2da83e1b8f7ef781857,backing_fmt=raw /opt/stack/data/nova/instances/c9b8c0c6-7afc-4f0b-ba06-3eccd4726124/disk 1073741824 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:49:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b90259d0562f3f8ff5c4e2da83e1b8f7ef781857,backing_fmt=raw /opt/stack/data/nova/instances/c9b8c0c6-7afc-4f0b-ba06-3eccd4726124/disk 1073741824" returned: 0 in 0.062s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:49:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "b90259d0562f3f8ff5c4e2da83e1b8f7ef781857" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.218s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:49:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b90259d0562f3f8ff5c4e2da83e1b8f7ef781857 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:49:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b90259d0562f3f8ff5c4e2da83e1b8f7ef781857 --force-share --output=json" returned: 0 in 0.138s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:49:38 user nova-compute[72362]: DEBUG nova.objects.instance [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lazy-loading 'migration_context' on Instance uuid c9b8c0c6-7afc-4f0b-ba06-3eccd4726124 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:49:38 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Rebasing disk image.
Aug 09 10:49:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:49:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.133s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:49:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 -F raw /opt/stack/data/nova/instances/c9b8c0c6-7afc-4f0b-ba06-3eccd4726124/disk {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:49:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 -F raw /opt/stack/data/nova/instances/c9b8c0c6-7afc-4f0b-ba06-3eccd4726124/disk" returned: 0 in 2.264s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:49:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Created local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 10:49:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Ensure instance console log exists: /opt/stack/data/nova/instances/c9b8c0c6-7afc-4f0b-ba06-3eccd4726124/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:49:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:49:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:49:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:49:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Start _get_guest_xml network_info=[{"id": "bba009ea-bb2e-4952-98ee-4dd1fb2649fc", "address": "fa:16:3e:5b:15:67", "network": {"id": "362446ea-173c-4989-93f8-882088822208", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-499399633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f9d6a60f24d41deb91ae59189c62ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba009ea-bb", "ovs_interfaceid": "bba009ea-bb2e-4952-98ee-4dd1fb2649fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='7d0cd378c00160ecf63502dcdcbb00ee',container_format='bare',created_at=2023-08-09T10:47:41Z,direct_url=<?>,disk_format='qcow2',id=afc2010a-5c4e-4edb-b27d-5acad402f861,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1646693656-shelved',owner='2f9d6a60f24d41deb91ae59189c62ba2',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-09T10:47:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': 'a08d1a11-49eb-4212-a351-e11ee9553b95'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:49:40 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:49:40 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:49:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:49:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:49:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:49:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:49:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:49:40 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='7d0cd378c00160ecf63502dcdcbb00ee',container_format='bare',created_at=2023-08-09T10:47:41Z,direct_url=<?>,disk_format='qcow2',id=afc2010a-5c4e-4edb-b27d-5acad402f861,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1646693656-shelved',owner='2f9d6a60f24d41deb91ae59189c62ba2',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-09T10:47:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:49:40 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:49:40 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:49:40 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:49:40 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:49:40 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:49:40 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:49:40 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:49:40 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:49:40 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:49:40 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:49:40 user nova-compute[72362]: DEBUG nova.objects.instance [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lazy-loading 'vcpu_model' on Instance uuid c9b8c0c6-7afc-4f0b-ba06-3eccd4726124 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:49:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:49:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T10:45:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1646693656',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1646693656',id=46,image_ref='afc2010a-5c4e-4edb-b27d-5acad402f861',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1790414929',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:45:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2f9d6a60f24d41deb91ae59189c62ba2',ramdisk_id='',reservation_id='r-9y258rcd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2139825844',owner_user_name='tempest-AttachVolumeShelveTestJSON-2139825844-project-member',shelved_at='2023-08-09T10:47:45.051167',shelved_host='user',shelved_image_id='afc2010a-5c4e-4edb-b27d-5acad402f861'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:49:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='299166afe21b4d3cac05fdb072a78a78',uuid=c9b8c0c6-7afc-4f0b-ba06-3eccd4726124,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "bba009ea-bb2e-4952-98ee-4dd1fb2649fc", "address": "fa:16:3e:5b:15:67", "network": {"id": "362446ea-173c-4989-93f8-882088822208", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-499399633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f9d6a60f24d41deb91ae59189c62ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba009ea-bb", "ovs_interfaceid": "bba009ea-bb2e-4952-98ee-4dd1fb2649fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:49:40 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Converting VIF {"id": "bba009ea-bb2e-4952-98ee-4dd1fb2649fc", "address": "fa:16:3e:5b:15:67", "network": {"id": "362446ea-173c-4989-93f8-882088822208", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-499399633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f9d6a60f24d41deb91ae59189c62ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba009ea-bb", "ovs_interfaceid": "bba009ea-bb2e-4952-98ee-4dd1fb2649fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:49:40 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:15:67,bridge_name='br-int',has_traffic_filtering=True,id=bba009ea-bb2e-4952-98ee-4dd1fb2649fc,network=Network(362446ea-173c-4989-93f8-882088822208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbba009ea-bb') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:49:40 user nova-compute[72362]: DEBUG nova.objects.instance [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lazy-loading 'pci_devices' on Instance uuid c9b8c0c6-7afc-4f0b-ba06-3eccd4726124 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:49:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:49:40 user nova-compute[72362]:   <uuid>c9b8c0c6-7afc-4f0b-ba06-3eccd4726124</uuid>
Aug 09 10:49:40 user nova-compute[72362]:   <name>instance-0000002e</name>
Aug 09 10:49:40 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:49:40 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:49:40 user nova-compute[72362]:   <metadata>
Aug 09 10:49:40 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:49:40 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:49:40 user nova-compute[72362]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1646693656</nova:name>
Aug 09 10:49:40 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:49:40</nova:creationTime>
Aug 09 10:49:40 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:49:40 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:49:40 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:49:40 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:49:40 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:49:40 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:49:40 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:49:40 user nova-compute[72362]:       <nova:owner>
Aug 09 10:49:40 user nova-compute[72362]:         <nova:user uuid="299166afe21b4d3cac05fdb072a78a78">tempest-AttachVolumeShelveTestJSON-2139825844-project-member</nova:user>
Aug 09 10:49:40 user nova-compute[72362]:         <nova:project uuid="2f9d6a60f24d41deb91ae59189c62ba2">tempest-AttachVolumeShelveTestJSON-2139825844</nova:project>
Aug 09 10:49:40 user nova-compute[72362]:       </nova:owner>
Aug 09 10:49:40 user nova-compute[72362]:       <nova:root type="image" uuid="afc2010a-5c4e-4edb-b27d-5acad402f861"/>
Aug 09 10:49:40 user nova-compute[72362]:       <nova:ports>
Aug 09 10:49:40 user nova-compute[72362]:         <nova:port uuid="bba009ea-bb2e-4952-98ee-4dd1fb2649fc">
Aug 09 10:49:40 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 09 10:49:40 user nova-compute[72362]:         </nova:port>
Aug 09 10:49:40 user nova-compute[72362]:       </nova:ports>
Aug 09 10:49:40 user nova-compute[72362]:     </nova:instance>
Aug 09 10:49:40 user nova-compute[72362]:   </metadata>
Aug 09 10:49:40 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:49:40 user nova-compute[72362]:     <system>
Aug 09 10:49:40 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:49:40 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:49:40 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:49:40 user nova-compute[72362]:       <entry name="serial">c9b8c0c6-7afc-4f0b-ba06-3eccd4726124</entry>
Aug 09 10:49:40 user nova-compute[72362]:       <entry name="uuid">c9b8c0c6-7afc-4f0b-ba06-3eccd4726124</entry>
Aug 09 10:49:40 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:49:40 user nova-compute[72362]:     </system>
Aug 09 10:49:40 user nova-compute[72362]:   </sysinfo>
Aug 09 10:49:40 user nova-compute[72362]:   <os>
Aug 09 10:49:40 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:49:40 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:49:40 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:49:40 user nova-compute[72362]:   </os>
Aug 09 10:49:40 user nova-compute[72362]:   <features>
Aug 09 10:49:40 user nova-compute[72362]:     <acpi/>
Aug 09 10:49:40 user nova-compute[72362]:     <apic/>
Aug 09 10:49:40 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:49:40 user nova-compute[72362]:   </features>
Aug 09 10:49:40 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:49:40 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:49:40 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:49:40 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:49:40 user nova-compute[72362]:   </clock>
Aug 09 10:49:40 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:49:40 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:49:40 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:49:40 user nova-compute[72362]:   </cpu>
Aug 09 10:49:40 user nova-compute[72362]:   <devices>
Aug 09 10:49:40 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:49:40 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:49:40 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/c9b8c0c6-7afc-4f0b-ba06-3eccd4726124/disk"/>
Aug 09 10:49:40 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:49:40 user nova-compute[72362]:     </disk>
Aug 09 10:49:40 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:49:40 user nova-compute[72362]:       <mac address="fa:16:3e:5b:15:67"/>
Aug 09 10:49:40 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:49:40 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:49:40 user nova-compute[72362]:       <target dev="tapbba009ea-bb"/>
Aug 09 10:49:40 user nova-compute[72362]:     </interface>
Aug 09 10:49:40 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:49:40 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/c9b8c0c6-7afc-4f0b-ba06-3eccd4726124/console.log" append="off"/>
Aug 09 10:49:40 user nova-compute[72362]:     </serial>
Aug 09 10:49:40 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:49:40 user nova-compute[72362]:     <video>
Aug 09 10:49:40 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:49:40 user nova-compute[72362]:     </video>
Aug 09 10:49:40 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:49:40 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:49:40 user nova-compute[72362]:     </rng>
Aug 09 10:49:40 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:49:40 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:49:40 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:49:40 user nova-compute[72362]:     </memballoon>
Aug 09 10:49:40 user nova-compute[72362]:   </devices>
Aug 09 10:49:40 user nova-compute[72362]: </domain>
Aug 09 10:49:40 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:49:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T10:45:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1646693656',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1646693656',id=46,image_ref='afc2010a-5c4e-4edb-b27d-5acad402f861',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1790414929',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:45:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2f9d6a60f24d41deb91ae59189c62ba2',ramdisk_id='',reservation_id='r-9y258rcd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2139825844',owner_user_name='tempest-AttachVolumeShelveTestJSON-2139825844-project-member',shelved_at='2023-08-09T10:47:45.051167',shelved_host='user',shelved_image_id='afc2010a-5c4e-4edb-b27d-5acad402f861'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:49:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='299166afe21b4d3cac05fdb072a78a78',uuid=c9b8c0c6-7afc-4f0b-ba06-3eccd4726124,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "bba009ea-bb2e-4952-98ee-4dd1fb2649fc", "address": "fa:16:3e:5b:15:67", "network": {"id": "362446ea-173c-4989-93f8-882088822208", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-499399633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f9d6a60f24d41deb91ae59189c62ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba009ea-bb", "ovs_interfaceid": "bba009ea-bb2e-4952-98ee-4dd1fb2649fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:49:40 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Converting VIF {"id": "bba009ea-bb2e-4952-98ee-4dd1fb2649fc", "address": "fa:16:3e:5b:15:67", "network": {"id": "362446ea-173c-4989-93f8-882088822208", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-499399633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f9d6a60f24d41deb91ae59189c62ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba009ea-bb", "ovs_interfaceid": "bba009ea-bb2e-4952-98ee-4dd1fb2649fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:49:40 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:15:67,bridge_name='br-int',has_traffic_filtering=True,id=bba009ea-bb2e-4952-98ee-4dd1fb2649fc,network=Network(362446ea-173c-4989-93f8-882088822208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbba009ea-bb') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:49:40 user nova-compute[72362]: DEBUG os_vif [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:15:67,bridge_name='br-int',has_traffic_filtering=True,id=bba009ea-bb2e-4952-98ee-4dd1fb2649fc,network=Network(362446ea-173c-4989-93f8-882088822208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbba009ea-bb') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:49:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:49:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:49:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:49:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:49:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbba009ea-bb, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:49:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbba009ea-bb, col_values=(('external_ids', {'iface-id': 'bba009ea-bb2e-4952-98ee-4dd1fb2649fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:15:67', 'vm-uuid': 'c9b8c0c6-7afc-4f0b-ba06-3eccd4726124'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:49:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:49:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:49:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:49:40 user nova-compute[72362]: INFO os_vif [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:15:67,bridge_name='br-int',has_traffic_filtering=True,id=bba009ea-bb2e-4952-98ee-4dd1fb2649fc,network=Network(362446ea-173c-4989-93f8-882088822208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbba009ea-bb')
Aug 09 10:49:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:49:40 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] No VIF found with MAC fa:16:3e:5b:15:67, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:49:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:49:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:49:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:49:42 user nova-compute[72362]: DEBUG nova.compute.manager [req-bb4e9820-034c-498c-9df6-c20d9a30d346 req-38000e24-d2c4-46f5-8216-72e7eee12d09 service nova] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Received event network-vif-plugged-bba009ea-bb2e-4952-98ee-4dd1fb2649fc {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:49:42 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-bb4e9820-034c-498c-9df6-c20d9a30d346 req-38000e24-d2c4-46f5-8216-72e7eee12d09 service nova] Acquiring lock "c9b8c0c6-7afc-4f0b-ba06-3eccd4726124-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:49:42 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-bb4e9820-034c-498c-9df6-c20d9a30d346 req-38000e24-d2c4-46f5-8216-72e7eee12d09 service nova] Lock "c9b8c0c6-7afc-4f0b-ba06-3eccd4726124-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:49:42 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-bb4e9820-034c-498c-9df6-c20d9a30d346 req-38000e24-d2c4-46f5-8216-72e7eee12d09 service nova] Lock "c9b8c0c6-7afc-4f0b-ba06-3eccd4726124-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:49:42 user nova-compute[72362]: DEBUG nova.compute.manager [req-bb4e9820-034c-498c-9df6-c20d9a30d346 req-38000e24-d2c4-46f5-8216-72e7eee12d09 service nova] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] No waiting events found dispatching network-vif-plugged-bba009ea-bb2e-4952-98ee-4dd1fb2649fc {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:49:42 user nova-compute[72362]: WARNING nova.compute.manager [req-bb4e9820-034c-498c-9df6-c20d9a30d346 req-38000e24-d2c4-46f5-8216-72e7eee12d09 service nova] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Received unexpected event network-vif-plugged-bba009ea-bb2e-4952-98ee-4dd1fb2649fc for instance with vm_state shelved_offloaded and task_state spawning.
Aug 09 10:49:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:49:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:49:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:49:43 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:49:44 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691578184.5563009, c9b8c0c6-7afc-4f0b-ba06-3eccd4726124 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:49:44 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] VM Resumed (Lifecycle Event)
Aug 09 10:49:44 user nova-compute[72362]: DEBUG nova.compute.manager [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:49:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:49:44 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Instance spawned successfully.
Aug 09 10:49:44 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:49:44 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:49:44 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:49:44 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691578184.5604393, c9b8c0c6-7afc-4f0b-ba06-3eccd4726124 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:49:44 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] VM Started (Lifecycle Event)
Aug 09 10:49:44 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:49:44 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:49:44 user nova-compute[72362]: DEBUG nova.compute.manager [req-2aa64143-fb51-4c84-9eb4-80c7c37e5f66 req-f73fd5ee-5fc7-40b6-a46b-2973b636c98a service nova] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Received event network-vif-plugged-bba009ea-bb2e-4952-98ee-4dd1fb2649fc {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:49:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-2aa64143-fb51-4c84-9eb4-80c7c37e5f66 req-f73fd5ee-5fc7-40b6-a46b-2973b636c98a service nova] Acquiring lock "c9b8c0c6-7afc-4f0b-ba06-3eccd4726124-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:49:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-2aa64143-fb51-4c84-9eb4-80c7c37e5f66 req-f73fd5ee-5fc7-40b6-a46b-2973b636c98a service nova] Lock "c9b8c0c6-7afc-4f0b-ba06-3eccd4726124-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:49:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-2aa64143-fb51-4c84-9eb4-80c7c37e5f66 req-f73fd5ee-5fc7-40b6-a46b-2973b636c98a service nova] Lock "c9b8c0c6-7afc-4f0b-ba06-3eccd4726124-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:49:44 user nova-compute[72362]: DEBUG nova.compute.manager [req-2aa64143-fb51-4c84-9eb4-80c7c37e5f66 req-f73fd5ee-5fc7-40b6-a46b-2973b636c98a service nova] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] No waiting events found dispatching network-vif-plugged-bba009ea-bb2e-4952-98ee-4dd1fb2649fc {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:49:44 user nova-compute[72362]: WARNING nova.compute.manager [req-2aa64143-fb51-4c84-9eb4-80c7c37e5f66 req-f73fd5ee-5fc7-40b6-a46b-2973b636c98a service nova] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Received unexpected event network-vif-plugged-bba009ea-bb2e-4952-98ee-4dd1fb2649fc for instance with vm_state shelved_offloaded and task_state spawning.
Aug 09 10:49:44 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:49:44 user nova-compute[72362]: DEBUG nova.compute.manager [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:49:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-5ace27a3-a16f-4ab3-8b09-66338227a490 tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "c9b8c0c6-7afc-4f0b-ba06-3eccd4726124" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.746s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:49:45 user nova-compute[72362]: DEBUG nova.compute.manager [req-f41fad81-f5d6-4d3b-baf6-915f57e3ba97 req-dabf142e-cf8f-4be6-b115-bb10dd11ffe3 service nova] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Received event network-changed-221b0dc3-ded0-4875-8396-51d6013e2aea {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:49:45 user nova-compute[72362]: DEBUG nova.compute.manager [req-f41fad81-f5d6-4d3b-baf6-915f57e3ba97 req-dabf142e-cf8f-4be6-b115-bb10dd11ffe3 service nova] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Refreshing instance network info cache due to event network-changed-221b0dc3-ded0-4875-8396-51d6013e2aea. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:49:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f41fad81-f5d6-4d3b-baf6-915f57e3ba97 req-dabf142e-cf8f-4be6-b115-bb10dd11ffe3 service nova] Acquiring lock "refresh_cache-ab34d860-52ba-4773-9f80-84930bbd06d0" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:49:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f41fad81-f5d6-4d3b-baf6-915f57e3ba97 req-dabf142e-cf8f-4be6-b115-bb10dd11ffe3 service nova] Acquired lock "refresh_cache-ab34d860-52ba-4773-9f80-84930bbd06d0" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:49:45 user nova-compute[72362]: DEBUG nova.network.neutron [req-f41fad81-f5d6-4d3b-baf6-915f57e3ba97 req-dabf142e-cf8f-4be6-b115-bb10dd11ffe3 service nova] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Refreshing network info cache for port 221b0dc3-ded0-4875-8396-51d6013e2aea {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:49:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e18bbd75-7c0a-4c4f-9ba5-60169febea2e tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "ab34d860-52ba-4773-9f80-84930bbd06d0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:49:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e18bbd75-7c0a-4c4f-9ba5-60169febea2e tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "ab34d860-52ba-4773-9f80-84930bbd06d0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:49:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e18bbd75-7c0a-4c4f-9ba5-60169febea2e tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "ab34d860-52ba-4773-9f80-84930bbd06d0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:49:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e18bbd75-7c0a-4c4f-9ba5-60169febea2e tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "ab34d860-52ba-4773-9f80-84930bbd06d0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:49:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e18bbd75-7c0a-4c4f-9ba5-60169febea2e tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "ab34d860-52ba-4773-9f80-84930bbd06d0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:49:45 user nova-compute[72362]: INFO nova.compute.manager [None req-e18bbd75-7c0a-4c4f-9ba5-60169febea2e tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Terminating instance
Aug 09 10:49:45 user nova-compute[72362]: DEBUG nova.compute.manager [None req-e18bbd75-7c0a-4c4f-9ba5-60169febea2e tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Start destroying the instance on the hypervisor. {{(pid=72362) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 10:49:45 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691578170.7094743, b1b76bf2-10c2-41e7-bb51-4be3cdc70649 => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:49:45 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] VM Stopped (Lifecycle Event)
Aug 09 10:49:45 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:49:45 user nova-compute[72362]: DEBUG nova.compute.manager [None req-a445d128-07e5-468c-8a91-b963e5311af4 None None] [instance: b1b76bf2-10c2-41e7-bb51-4be3cdc70649] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:49:45 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:49:45 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:49:45 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:49:45 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:49:45 user nova-compute[72362]: DEBUG nova.network.neutron [req-f41fad81-f5d6-4d3b-baf6-915f57e3ba97 req-dabf142e-cf8f-4be6-b115-bb10dd11ffe3 service nova] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Updated VIF entry in instance network info cache for port 221b0dc3-ded0-4875-8396-51d6013e2aea. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:49:45 user nova-compute[72362]: DEBUG nova.network.neutron [req-f41fad81-f5d6-4d3b-baf6-915f57e3ba97 req-dabf142e-cf8f-4be6-b115-bb10dd11ffe3 service nova] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Updating instance_info_cache with network_info: [{"id": "221b0dc3-ded0-4875-8396-51d6013e2aea", "address": "fa:16:3e:af:d6:64", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap221b0dc3-de", "ovs_interfaceid": "221b0dc3-ded0-4875-8396-51d6013e2aea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f41fad81-f5d6-4d3b-baf6-915f57e3ba97 req-dabf142e-cf8f-4be6-b115-bb10dd11ffe3 service nova] Releasing lock "refresh_cache-ab34d860-52ba-4773-9f80-84930bbd06d0" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG nova.compute.manager [req-f9883be5-7d09-42ec-ad22-fc1ee6900f31 req-d4938b82-d801-470c-8a4d-a2d5d938b830 service nova] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Received event network-vif-unplugged-221b0dc3-ded0-4875-8396-51d6013e2aea {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f9883be5-7d09-42ec-ad22-fc1ee6900f31 req-d4938b82-d801-470c-8a4d-a2d5d938b830 service nova] Acquiring lock "ab34d860-52ba-4773-9f80-84930bbd06d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f9883be5-7d09-42ec-ad22-fc1ee6900f31 req-d4938b82-d801-470c-8a4d-a2d5d938b830 service nova] Lock "ab34d860-52ba-4773-9f80-84930bbd06d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f9883be5-7d09-42ec-ad22-fc1ee6900f31 req-d4938b82-d801-470c-8a4d-a2d5d938b830 service nova] Lock "ab34d860-52ba-4773-9f80-84930bbd06d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG nova.compute.manager [req-f9883be5-7d09-42ec-ad22-fc1ee6900f31 req-d4938b82-d801-470c-8a4d-a2d5d938b830 service nova] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] No waiting events found dispatching network-vif-unplugged-221b0dc3-ded0-4875-8396-51d6013e2aea {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG nova.compute.manager [req-f9883be5-7d09-42ec-ad22-fc1ee6900f31 req-d4938b82-d801-470c-8a4d-a2d5d938b830 service nova] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Received event network-vif-unplugged-221b0dc3-ded0-4875-8396-51d6013e2aea for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:49:46 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Instance destroyed successfully.
Aug 09 10:49:46 user nova-compute[72362]: DEBUG nova.objects.instance [None req-e18bbd75-7c0a-4c4f-9ba5-60169febea2e tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lazy-loading 'resources' on Instance uuid ab34d860-52ba-4773-9f80-84930bbd06d0 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-e18bbd75-7c0a-4c4f-9ba5-60169febea2e tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-40120364',display_name='tempest-TestVolumeBootPattern-server-40120364',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-40120364',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHphUKjpMkPjhZoTYlVJxPOuywq6OJUJWcHduVoRu9b0hlVgGA5+i25KrjKtdJwPAqa6k/+4sAUFZLxd189pJwbl9oyVmaY/KLuastlFffcAKt/RqOFaRqRDbZFRQvHB1g==',key_name='tempest-TestVolumeBootPattern-1201178489',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:45:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='26e38599de0b4b06b723f5647a7fe121',ramdisk_id='',reservation_id='r-gd7ko0yp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1478436240',owner_user_name='tempest-TestVolumeBootPattern-1478436240-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:45:01Z,user_data=None,user_id='e96900e953f64d02bdb5d48f136133c3',uuid=ab34d860-52ba-4773-9f80-84930bbd06d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "221b0dc3-ded0-4875-8396-51d6013e2aea", "address": "fa:16:3e:af:d6:64", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap221b0dc3-de", "ovs_interfaceid": "221b0dc3-ded0-4875-8396-51d6013e2aea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-e18bbd75-7c0a-4c4f-9ba5-60169febea2e tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Converting VIF {"id": "221b0dc3-ded0-4875-8396-51d6013e2aea", "address": "fa:16:3e:af:d6:64", "network": {"id": "b4a9e050-41f1-404a-bf5c-41421f034644", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529338572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26e38599de0b4b06b723f5647a7fe121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap221b0dc3-de", "ovs_interfaceid": "221b0dc3-ded0-4875-8396-51d6013e2aea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-e18bbd75-7c0a-4c4f-9ba5-60169febea2e tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:d6:64,bridge_name='br-int',has_traffic_filtering=True,id=221b0dc3-ded0-4875-8396-51d6013e2aea,network=Network(b4a9e050-41f1-404a-bf5c-41421f034644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap221b0dc3-de') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG os_vif [None req-e18bbd75-7c0a-4c4f-9ba5-60169febea2e tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:d6:64,bridge_name='br-int',has_traffic_filtering=True,id=221b0dc3-ded0-4875-8396-51d6013e2aea,network=Network(b4a9e050-41f1-404a-bf5c-41421f034644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap221b0dc3-de') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap221b0dc3-de, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:49:46 user nova-compute[72362]: INFO os_vif [None req-e18bbd75-7c0a-4c4f-9ba5-60169febea2e tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:d6:64,bridge_name='br-int',has_traffic_filtering=True,id=221b0dc3-ded0-4875-8396-51d6013e2aea,network=Network(b4a9e050-41f1-404a-bf5c-41421f034644),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap221b0dc3-de')
Aug 09 10:49:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e18bbd75-7c0a-4c4f-9ba5-60169febea2e tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-e18bbd75-7c0a-4c4f-9ba5-60169febea2e tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vPXkBflS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:49:46 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-e18bbd75-7c0a-4c4f-9ba5-60169febea2e tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:49:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-e18bbd75-7c0a-4c4f-9ba5-60169febea2e tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-e18bbd75-7c0a-4c4f-9ba5-60169febea2e tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-e18bbd75-7c0a-4c4f-9ba5-60169febea2e tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[74607135-6efc-41c8-b9a6-e021be602bcb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f706f7-957b-4079-b60f-78cac4fb5611]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-e18bbd75-7c0a-4c4f-9ba5-60169febea2e tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 (non-flash)
Aug 09 10:49:46 user nova-compute[72362]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd (non-flash)
Aug 09 10:49:46 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-e18bbd75-7c0a-4c4f-9ba5-60169febea2e tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 (non-flash)
Aug 09 10:49:46 user nova-compute[72362]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd (non-flash)
Aug 09 10:49:46 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-e18bbd75-7c0a-4c4f-9ba5-60169febea2e tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e45de5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135'): ({'sdb'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-e18bbd75-7c0a-4c4f-9ba5-60169febea2e tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Removing single pathed devices sdb {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b71f1ae-5730-485c-8713-9611caee83f9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca0b0c0-0747-4d71-8e87-a32625b01081]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-e18bbd75-7c0a-4c4f-9ba5-60169febea2e tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Flushing IO for device /dev/sdb {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d5c89b-dfec-42be-8746-b2d63f3e8845]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-e18bbd75-7c0a-4c4f-9ba5-60169febea2e tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d322d5a3-5023-4905-bdc6-757fec61278b]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-e18bbd75-7c0a-4c4f-9ba5-60169febea2e tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-e18bbd75-7c0a-4c4f-9ba5-60169febea2e tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] SCSI volumes sdb have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_b02b5c84', '/dev/disk/by-id/scsi-26265313335396333', '/dev/disk/by-id/scsi-1SCST_BIOb02b5c84-be1359c38f575224') {{(pid=84003) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[22742239-a4a9-4af5-8f27-ef1055bb9d7e]: (4, None) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-e18bbd75-7c0a-4c4f-9ba5-60169febea2e tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[84dce865-280e-4dec-bc38-6dd6940c6705]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-e18bbd75-7c0a-4c4f-9ba5-60169febea2e tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a7ae08-4915-415e-9112-b53e33c937e0]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-e18bbd75-7c0a-4c4f-9ba5-60169febea2e tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135, portal: 172.16.0.220,3260]
Aug 09 10:49:46 user nova-compute[72362]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135, portal: 172.16.0.220,3260] successful.
Aug 09 10:49:46 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b13e9f29-5849-486f-b75a-9520443d9135 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9432ad-cc76-4d9e-aa11-5ec8276e918c]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-e18bbd75-7c0a-4c4f-9ba5-60169febea2e tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-e18bbd75-7c0a-4c4f-9ba5-60169febea2e tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-e18bbd75-7c0a-4c4f-9ba5-60169febea2e tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] <== disconnect_volume: return (305ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e18bbd75-7c0a-4c4f-9ba5-60169febea2e tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:49:46 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-e18bbd75-7c0a-4c4f-9ba5-60169febea2e tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Deleting instance files /opt/stack/data/nova/instances/ab34d860-52ba-4773-9f80-84930bbd06d0_del
Aug 09 10:49:46 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-e18bbd75-7c0a-4c4f-9ba5-60169febea2e tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Deletion of /opt/stack/data/nova/instances/ab34d860-52ba-4773-9f80-84930bbd06d0_del complete
Aug 09 10:49:46 user nova-compute[72362]: INFO nova.compute.manager [None req-e18bbd75-7c0a-4c4f-9ba5-60169febea2e tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Took 1.17 seconds to destroy the instance on the hypervisor.
Aug 09 10:49:46 user nova-compute[72362]: DEBUG oslo.service.loopingcall [None req-e18bbd75-7c0a-4c4f-9ba5-60169febea2e tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72362) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG nova.compute.manager [-] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Deallocating network for instance {{(pid=72362) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 10:49:46 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] deallocate_for_instance() {{(pid=72362) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 10:49:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:49:47 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:49:47 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Took 0.53 seconds to deallocate network for instance.
Aug 09 10:49:47 user nova-compute[72362]: DEBUG nova.compute.manager [req-5d1fe032-7535-4320-a172-45c6e2de2cf8 req-d60e7e74-9f2d-4304-9285-f624e4fc5b79 service nova] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Received event network-vif-deleted-221b0dc3-ded0-4875-8396-51d6013e2aea {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:49:47 user nova-compute[72362]: INFO nova.compute.manager [req-5d1fe032-7535-4320-a172-45c6e2de2cf8 req-d60e7e74-9f2d-4304-9285-f624e4fc5b79 service nova] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Neutron deleted interface 221b0dc3-ded0-4875-8396-51d6013e2aea; detaching it from the instance and deleting it from the info cache
Aug 09 10:49:47 user nova-compute[72362]: DEBUG nova.network.neutron [req-5d1fe032-7535-4320-a172-45c6e2de2cf8 req-d60e7e74-9f2d-4304-9285-f624e4fc5b79 service nova] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:49:47 user nova-compute[72362]: DEBUG nova.compute.manager [req-5d1fe032-7535-4320-a172-45c6e2de2cf8 req-d60e7e74-9f2d-4304-9285-f624e4fc5b79 service nova] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Detach interface failed, port_id=221b0dc3-ded0-4875-8396-51d6013e2aea, reason: Instance ab34d860-52ba-4773-9f80-84930bbd06d0 could not be found. {{(pid=72362) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 10:49:48 user nova-compute[72362]: DEBUG nova.compute.manager [req-b4a9480d-b97b-4efd-94ee-a92219895b93 req-7afac956-a1d3-4f03-af04-abd818629a36 service nova] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Received event network-vif-plugged-221b0dc3-ded0-4875-8396-51d6013e2aea {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:49:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b4a9480d-b97b-4efd-94ee-a92219895b93 req-7afac956-a1d3-4f03-af04-abd818629a36 service nova] Acquiring lock "ab34d860-52ba-4773-9f80-84930bbd06d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:49:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b4a9480d-b97b-4efd-94ee-a92219895b93 req-7afac956-a1d3-4f03-af04-abd818629a36 service nova] Lock "ab34d860-52ba-4773-9f80-84930bbd06d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:49:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b4a9480d-b97b-4efd-94ee-a92219895b93 req-7afac956-a1d3-4f03-af04-abd818629a36 service nova] Lock "ab34d860-52ba-4773-9f80-84930bbd06d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:49:48 user nova-compute[72362]: DEBUG nova.compute.manager [req-b4a9480d-b97b-4efd-94ee-a92219895b93 req-7afac956-a1d3-4f03-af04-abd818629a36 service nova] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] No waiting events found dispatching network-vif-plugged-221b0dc3-ded0-4875-8396-51d6013e2aea {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:49:48 user nova-compute[72362]: WARNING nova.compute.manager [req-b4a9480d-b97b-4efd-94ee-a92219895b93 req-7afac956-a1d3-4f03-af04-abd818629a36 service nova] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Received unexpected event network-vif-plugged-221b0dc3-ded0-4875-8396-51d6013e2aea for instance with vm_state active and task_state deleting.
Aug 09 10:49:48 user nova-compute[72362]: INFO nova.compute.manager [None req-e18bbd75-7c0a-4c4f-9ba5-60169febea2e tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Took 0.74 seconds to detach 1 volumes for instance.
Aug 09 10:49:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e18bbd75-7c0a-4c4f-9ba5-60169febea2e tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:49:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e18bbd75-7c0a-4c4f-9ba5-60169febea2e tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:49:48 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-e18bbd75-7c0a-4c4f-9ba5-60169febea2e tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:49:48 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-e18bbd75-7c0a-4c4f-9ba5-60169febea2e tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:49:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e18bbd75-7c0a-4c4f-9ba5-60169febea2e tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.212s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:49:48 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-e18bbd75-7c0a-4c4f-9ba5-60169febea2e tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Deleted allocations for instance ab34d860-52ba-4773-9f80-84930bbd06d0
Aug 09 10:49:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e18bbd75-7c0a-4c4f-9ba5-60169febea2e tempest-TestVolumeBootPattern-1478436240 tempest-TestVolumeBootPattern-1478436240-project-member] Lock "ab34d860-52ba-4773-9f80-84930bbd06d0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.827s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:49:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:49:56 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:50:01 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691578186.4096801, ab34d860-52ba-4773-9f80-84930bbd06d0 => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:50:01 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] VM Stopped (Lifecycle Event)
Aug 09 10:50:01 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1f0817a2-12fd-4e11-bfd8-b02f8b9b4fd9 None None] [instance: ab34d860-52ba-4773-9f80-84930bbd06d0] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:50:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:50:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:50:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 10:50:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 10:50:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 10:50:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:50:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:50:05 user nova-compute[72362]: INFO nova.compute.manager [None req-e8e8d159-c797-47d1-a9ff-89d8b84d422e tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Unrescuing
Aug 09 10:50:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e8e8d159-c797-47d1-a9ff-89d8b84d422e tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Acquiring lock "refresh_cache-81ffae79-ce4c-440c-a157-ca922637aa67" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:50:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e8e8d159-c797-47d1-a9ff-89d8b84d422e tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Acquired lock "refresh_cache-81ffae79-ce4c-440c-a157-ca922637aa67" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:50:05 user nova-compute[72362]: DEBUG nova.network.neutron [None req-e8e8d159-c797-47d1-a9ff-89d8b84d422e tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:50:05 user nova-compute[72362]: DEBUG nova.network.neutron [None req-e8e8d159-c797-47d1-a9ff-89d8b84d422e tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Updating instance_info_cache with network_info: [{"id": "2040dc53-585b-4375-a169-539195f3f01a", "address": "fa:16:3e:bf:cc:bc", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2040dc53-58", "ovs_interfaceid": "2040dc53-585b-4375-a169-539195f3f01a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:50:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-e8e8d159-c797-47d1-a9ff-89d8b84d422e tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Releasing lock "refresh_cache-81ffae79-ce4c-440c-a157-ca922637aa67" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:50:05 user nova-compute[72362]: DEBUG nova.objects.instance [None req-e8e8d159-c797-47d1-a9ff-89d8b84d422e tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lazy-loading 'flavor' on Instance uuid 81ffae79-ce4c-440c-a157-ca922637aa67 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:50:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:50:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:50:05 user nova-compute[72362]: DEBUG nova.compute.manager [req-d52588a7-ae36-4b2d-891a-c7d936d0f959 req-c639642e-2e59-4b9e-8314-08318385753f service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Received event network-vif-unplugged-2040dc53-585b-4375-a169-539195f3f01a {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:50:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-d52588a7-ae36-4b2d-891a-c7d936d0f959 req-c639642e-2e59-4b9e-8314-08318385753f service nova] Acquiring lock "81ffae79-ce4c-440c-a157-ca922637aa67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:50:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-d52588a7-ae36-4b2d-891a-c7d936d0f959 req-c639642e-2e59-4b9e-8314-08318385753f service nova] Lock "81ffae79-ce4c-440c-a157-ca922637aa67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:50:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-d52588a7-ae36-4b2d-891a-c7d936d0f959 req-c639642e-2e59-4b9e-8314-08318385753f service nova] Lock "81ffae79-ce4c-440c-a157-ca922637aa67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:50:05 user nova-compute[72362]: DEBUG nova.compute.manager [req-d52588a7-ae36-4b2d-891a-c7d936d0f959 req-c639642e-2e59-4b9e-8314-08318385753f service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] No waiting events found dispatching network-vif-unplugged-2040dc53-585b-4375-a169-539195f3f01a {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:50:05 user nova-compute[72362]: WARNING nova.compute.manager [req-d52588a7-ae36-4b2d-891a-c7d936d0f959 req-c639642e-2e59-4b9e-8314-08318385753f service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Received unexpected event network-vif-unplugged-2040dc53-585b-4375-a169-539195f3f01a for instance with vm_state rescued and task_state unrescuing.
Aug 09 10:50:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:50:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:50:06 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Instance destroyed successfully.
Aug 09 10:50:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:50:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:50:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:50:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:50:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:50:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:50:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:50:07 user nova-compute[72362]: DEBUG nova.compute.manager [req-2cae4452-445a-4d3f-b91c-3aad74bfef00 req-9eb172b3-7b97-48f2-8cb7-273b46ccfdb8 service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Received event network-vif-plugged-2040dc53-585b-4375-a169-539195f3f01a {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:50:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-2cae4452-445a-4d3f-b91c-3aad74bfef00 req-9eb172b3-7b97-48f2-8cb7-273b46ccfdb8 service nova] Acquiring lock "81ffae79-ce4c-440c-a157-ca922637aa67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:50:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-2cae4452-445a-4d3f-b91c-3aad74bfef00 req-9eb172b3-7b97-48f2-8cb7-273b46ccfdb8 service nova] Lock "81ffae79-ce4c-440c-a157-ca922637aa67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:50:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-2cae4452-445a-4d3f-b91c-3aad74bfef00 req-9eb172b3-7b97-48f2-8cb7-273b46ccfdb8 service nova] Lock "81ffae79-ce4c-440c-a157-ca922637aa67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:50:07 user nova-compute[72362]: DEBUG nova.compute.manager [req-2cae4452-445a-4d3f-b91c-3aad74bfef00 req-9eb172b3-7b97-48f2-8cb7-273b46ccfdb8 service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] No waiting events found dispatching network-vif-plugged-2040dc53-585b-4375-a169-539195f3f01a {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:50:07 user nova-compute[72362]: WARNING nova.compute.manager [req-2cae4452-445a-4d3f-b91c-3aad74bfef00 req-9eb172b3-7b97-48f2-8cb7-273b46ccfdb8 service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Received unexpected event network-vif-plugged-2040dc53-585b-4375-a169-539195f3f01a for instance with vm_state rescued and task_state unrescuing.
Aug 09 10:50:07 user nova-compute[72362]: DEBUG nova.compute.manager [req-2cae4452-445a-4d3f-b91c-3aad74bfef00 req-9eb172b3-7b97-48f2-8cb7-273b46ccfdb8 service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Received event network-vif-plugged-2040dc53-585b-4375-a169-539195f3f01a {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:50:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-2cae4452-445a-4d3f-b91c-3aad74bfef00 req-9eb172b3-7b97-48f2-8cb7-273b46ccfdb8 service nova] Acquiring lock "81ffae79-ce4c-440c-a157-ca922637aa67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:50:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-2cae4452-445a-4d3f-b91c-3aad74bfef00 req-9eb172b3-7b97-48f2-8cb7-273b46ccfdb8 service nova] Lock "81ffae79-ce4c-440c-a157-ca922637aa67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:50:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-2cae4452-445a-4d3f-b91c-3aad74bfef00 req-9eb172b3-7b97-48f2-8cb7-273b46ccfdb8 service nova] Lock "81ffae79-ce4c-440c-a157-ca922637aa67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:50:07 user nova-compute[72362]: DEBUG nova.compute.manager [req-2cae4452-445a-4d3f-b91c-3aad74bfef00 req-9eb172b3-7b97-48f2-8cb7-273b46ccfdb8 service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] No waiting events found dispatching network-vif-plugged-2040dc53-585b-4375-a169-539195f3f01a {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:50:07 user nova-compute[72362]: WARNING nova.compute.manager [req-2cae4452-445a-4d3f-b91c-3aad74bfef00 req-9eb172b3-7b97-48f2-8cb7-273b46ccfdb8 service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Received unexpected event network-vif-plugged-2040dc53-585b-4375-a169-539195f3f01a for instance with vm_state rescued and task_state unrescuing.
Aug 09 10:50:09 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Removed pending event for 81ffae79-ce4c-440c-a157-ca922637aa67 due to event {{(pid=72362) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 10:50:09 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691578209.6810925, 81ffae79-ce4c-440c-a157-ca922637aa67 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:50:09 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] VM Resumed (Lifecycle Event)
Aug 09 10:50:09 user nova-compute[72362]: DEBUG nova.compute.manager [None req-e8e8d159-c797-47d1-a9ff-89d8b84d422e tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:50:09 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:50:09 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:50:09 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 09 10:50:09 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691578209.6845767, 81ffae79-ce4c-440c-a157-ca922637aa67 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:50:09 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] VM Started (Lifecycle Event)
Aug 09 10:50:09 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:50:09 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:50:09 user nova-compute[72362]: DEBUG nova.compute.manager [req-5f31b3dd-d5c4-4cab-a002-e9a3154adf99 req-5211f960-5570-442c-ac80-001464be41de service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Received event network-vif-plugged-2040dc53-585b-4375-a169-539195f3f01a {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:50:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-5f31b3dd-d5c4-4cab-a002-e9a3154adf99 req-5211f960-5570-442c-ac80-001464be41de service nova] Acquiring lock "81ffae79-ce4c-440c-a157-ca922637aa67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:50:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-5f31b3dd-d5c4-4cab-a002-e9a3154adf99 req-5211f960-5570-442c-ac80-001464be41de service nova] Lock "81ffae79-ce4c-440c-a157-ca922637aa67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:50:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-5f31b3dd-d5c4-4cab-a002-e9a3154adf99 req-5211f960-5570-442c-ac80-001464be41de service nova] Lock "81ffae79-ce4c-440c-a157-ca922637aa67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:50:09 user nova-compute[72362]: DEBUG nova.compute.manager [req-5f31b3dd-d5c4-4cab-a002-e9a3154adf99 req-5211f960-5570-442c-ac80-001464be41de service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] No waiting events found dispatching network-vif-plugged-2040dc53-585b-4375-a169-539195f3f01a {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:50:09 user nova-compute[72362]: WARNING nova.compute.manager [req-5f31b3dd-d5c4-4cab-a002-e9a3154adf99 req-5211f960-5570-442c-ac80-001464be41de service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Received unexpected event network-vif-plugged-2040dc53-585b-4375-a169-539195f3f01a for instance with vm_state active and task_state None.
Aug 09 10:50:11 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:50:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:50:16 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:50:20 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:50:20 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 10:50:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "refresh_cache-c9b8c0c6-7afc-4f0b-ba06-3eccd4726124" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:50:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquired lock "refresh_cache-c9b8c0c6-7afc-4f0b-ba06-3eccd4726124" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:50:20 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Forcefully refreshing network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 10:50:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:50:20 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Updating instance_info_cache with network_info: [{"id": "bba009ea-bb2e-4952-98ee-4dd1fb2649fc", "address": "fa:16:3e:5b:15:67", "network": {"id": "362446ea-173c-4989-93f8-882088822208", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-499399633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f9d6a60f24d41deb91ae59189c62ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba009ea-bb", "ovs_interfaceid": "bba009ea-bb2e-4952-98ee-4dd1fb2649fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:50:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Releasing lock "refresh_cache-c9b8c0c6-7afc-4f0b-ba06-3eccd4726124" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:50:20 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Updated the network info_cache for instance {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 10:50:20 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:50:20 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:50:20 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:50:20 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 10:50:21 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:50:21 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:50:22 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:50:22 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:50:22 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:50:23 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:50:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:50:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:50:27 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:50:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:50:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:50:28 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:50:28 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 10:50:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:50:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:50:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:50:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:50:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:50:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:50:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:50:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:50:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:50:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:50:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:50:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:50:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:50:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:50:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:50:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:50:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:50:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b8c0c6-7afc-4f0b-ba06-3eccd4726124/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:50:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b8c0c6-7afc-4f0b-ba06-3eccd4726124/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:50:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b8c0c6-7afc-4f0b-ba06-3eccd4726124/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:50:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9b8c0c6-7afc-4f0b-ba06-3eccd4726124/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:50:30 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:50:30 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:50:30 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=8381MB free_disk=24.996746063232422GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 10:50:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:50:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:50:30 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance cefe383b-978f-4391-baf6-3b3ad17e0083 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:50:30 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 4296ca4c-1e3e-474f-98ba-9f947d333b8d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:50:30 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 81ffae79-ce4c-440c-a157-ca922637aa67 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:50:30 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance c9b8c0c6-7afc-4f0b-ba06-3eccd4726124 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:50:30 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 10:50:30 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 10:50:30 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:50:30 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:50:30 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 10:50:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.281s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:50:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:50:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:50:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:50:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:50:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:50:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:50:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:50:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:50:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:50:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:50:56 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:51:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:51:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:51:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 10:51:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 10:51:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 10:51:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:51:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:51:11 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:51:16 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:51:21 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:51:21 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 10:51:21 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:51:21 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "refresh_cache-81ffae79-ce4c-440c-a157-ca922637aa67" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:51:21 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquired lock "refresh_cache-81ffae79-ce4c-440c-a157-ca922637aa67" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:51:21 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Forcefully refreshing network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 10:51:22 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Updating instance_info_cache with network_info: [{"id": "2040dc53-585b-4375-a169-539195f3f01a", "address": "fa:16:3e:bf:cc:bc", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2040dc53-58", "ovs_interfaceid": "2040dc53-585b-4375-a169-539195f3f01a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:51:22 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Releasing lock "refresh_cache-81ffae79-ce4c-440c-a157-ca922637aa67" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:51:22 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Updated the network info_cache for instance {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 10:51:22 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:51:22 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:51:22 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:51:22 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 10:51:22 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:51:23 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:51:23 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:51:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0e9bdb8b-be07-486a-b9b5-be008c6f87eb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Acquiring lock "c9b8c0c6-7afc-4f0b-ba06-3eccd4726124" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:51:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0e9bdb8b-be07-486a-b9b5-be008c6f87eb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "c9b8c0c6-7afc-4f0b-ba06-3eccd4726124" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:51:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0e9bdb8b-be07-486a-b9b5-be008c6f87eb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Acquiring lock "c9b8c0c6-7afc-4f0b-ba06-3eccd4726124-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:51:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0e9bdb8b-be07-486a-b9b5-be008c6f87eb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "c9b8c0c6-7afc-4f0b-ba06-3eccd4726124-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:51:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0e9bdb8b-be07-486a-b9b5-be008c6f87eb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "c9b8c0c6-7afc-4f0b-ba06-3eccd4726124-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:51:24 user nova-compute[72362]: INFO nova.compute.manager [None req-0e9bdb8b-be07-486a-b9b5-be008c6f87eb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Terminating instance
Aug 09 10:51:24 user nova-compute[72362]: DEBUG nova.compute.manager [None req-0e9bdb8b-be07-486a-b9b5-be008c6f87eb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Start destroying the instance on the hypervisor. {{(pid=72362) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 10:51:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:51:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:51:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:51:24 user nova-compute[72362]: DEBUG nova.compute.manager [req-0572a742-05e5-4919-909c-66cc3d0d7c61 req-8f5e4e62-7036-418e-a9f5-38cb7e4574e9 service nova] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Received event network-vif-unplugged-bba009ea-bb2e-4952-98ee-4dd1fb2649fc {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:51:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-0572a742-05e5-4919-909c-66cc3d0d7c61 req-8f5e4e62-7036-418e-a9f5-38cb7e4574e9 service nova] Acquiring lock "c9b8c0c6-7afc-4f0b-ba06-3eccd4726124-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:51:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-0572a742-05e5-4919-909c-66cc3d0d7c61 req-8f5e4e62-7036-418e-a9f5-38cb7e4574e9 service nova] Lock "c9b8c0c6-7afc-4f0b-ba06-3eccd4726124-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:51:24 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-0572a742-05e5-4919-909c-66cc3d0d7c61 req-8f5e4e62-7036-418e-a9f5-38cb7e4574e9 service nova] Lock "c9b8c0c6-7afc-4f0b-ba06-3eccd4726124-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:51:24 user nova-compute[72362]: DEBUG nova.compute.manager [req-0572a742-05e5-4919-909c-66cc3d0d7c61 req-8f5e4e62-7036-418e-a9f5-38cb7e4574e9 service nova] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] No waiting events found dispatching network-vif-unplugged-bba009ea-bb2e-4952-98ee-4dd1fb2649fc {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:51:24 user nova-compute[72362]: DEBUG nova.compute.manager [req-0572a742-05e5-4919-909c-66cc3d0d7c61 req-8f5e4e62-7036-418e-a9f5-38cb7e4574e9 service nova] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Received event network-vif-unplugged-bba009ea-bb2e-4952-98ee-4dd1fb2649fc for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:51:24 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:51:24 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Instance destroyed successfully.
Aug 09 10:51:24 user nova-compute[72362]: DEBUG nova.objects.instance [None req-0e9bdb8b-be07-486a-b9b5-be008c6f87eb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lazy-loading 'resources' on Instance uuid c9b8c0c6-7afc-4f0b-ba06-3eccd4726124 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:51:25 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-0e9bdb8b-be07-486a-b9b5-be008c6f87eb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T10:45:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1646693656',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1646693656',id=46,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/aGUSj56P3CF+AbqqVXGNF0P/OweU114ZrKxiQ7YSDnLkroHTWcMIUzf2DBS55CS9oLSk9ocs6C9FMw7qXL+rrCRRbxlx+Zy16d7Ch/20WCb8l2ERymAdmhPJHshV2cg==',key_name='tempest-keypair-1790414929',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:49:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f9d6a60f24d41deb91ae59189c62ba2',ramdisk_id='',reservation_id='r-9y258rcd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2139825844',owner_user_name='tempest-AttachVolumeShelveTestJSON-2139825844-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:49:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='299166afe21b4d3cac05fdb072a78a78',uuid=c9b8c0c6-7afc-4f0b-ba06-3eccd4726124,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bba009ea-bb2e-4952-98ee-4dd1fb2649fc", "address": "fa:16:3e:5b:15:67", "network": {"id": "362446ea-173c-4989-93f8-882088822208", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-499399633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f9d6a60f24d41deb91ae59189c62ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba009ea-bb", "ovs_interfaceid": "bba009ea-bb2e-4952-98ee-4dd1fb2649fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:51:25 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-0e9bdb8b-be07-486a-b9b5-be008c6f87eb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Converting VIF {"id": "bba009ea-bb2e-4952-98ee-4dd1fb2649fc", "address": "fa:16:3e:5b:15:67", "network": {"id": "362446ea-173c-4989-93f8-882088822208", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-499399633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f9d6a60f24d41deb91ae59189c62ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba009ea-bb", "ovs_interfaceid": "bba009ea-bb2e-4952-98ee-4dd1fb2649fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:51:25 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-0e9bdb8b-be07-486a-b9b5-be008c6f87eb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:15:67,bridge_name='br-int',has_traffic_filtering=True,id=bba009ea-bb2e-4952-98ee-4dd1fb2649fc,network=Network(362446ea-173c-4989-93f8-882088822208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbba009ea-bb') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:51:25 user nova-compute[72362]: DEBUG os_vif [None req-0e9bdb8b-be07-486a-b9b5-be008c6f87eb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:15:67,bridge_name='br-int',has_traffic_filtering=True,id=bba009ea-bb2e-4952-98ee-4dd1fb2649fc,network=Network(362446ea-173c-4989-93f8-882088822208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbba009ea-bb') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:51:25 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:51:25 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbba009ea-bb, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:51:25 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:51:25 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:51:25 user nova-compute[72362]: INFO os_vif [None req-0e9bdb8b-be07-486a-b9b5-be008c6f87eb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:15:67,bridge_name='br-int',has_traffic_filtering=True,id=bba009ea-bb2e-4952-98ee-4dd1fb2649fc,network=Network(362446ea-173c-4989-93f8-882088822208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbba009ea-bb')
Aug 09 10:51:25 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-0e9bdb8b-be07-486a-b9b5-be008c6f87eb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Deleting instance files /opt/stack/data/nova/instances/c9b8c0c6-7afc-4f0b-ba06-3eccd4726124_del
Aug 09 10:51:25 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-0e9bdb8b-be07-486a-b9b5-be008c6f87eb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Deletion of /opt/stack/data/nova/instances/c9b8c0c6-7afc-4f0b-ba06-3eccd4726124_del complete
Aug 09 10:51:25 user nova-compute[72362]: INFO nova.compute.manager [None req-0e9bdb8b-be07-486a-b9b5-be008c6f87eb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 09 10:51:25 user nova-compute[72362]: DEBUG oslo.service.loopingcall [None req-0e9bdb8b-be07-486a-b9b5-be008c6f87eb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72362) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 10:51:25 user nova-compute[72362]: DEBUG nova.compute.manager [-] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Deallocating network for instance {{(pid=72362) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 10:51:25 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] deallocate_for_instance() {{(pid=72362) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 10:51:26 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:51:26 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Took 1.09 seconds to deallocate network for instance.
Aug 09 10:51:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0e9bdb8b-be07-486a-b9b5-be008c6f87eb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:51:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0e9bdb8b-be07-486a-b9b5-be008c6f87eb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:51:26 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-0e9bdb8b-be07-486a-b9b5-be008c6f87eb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:51:26 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-0e9bdb8b-be07-486a-b9b5-be008c6f87eb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:51:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0e9bdb8b-be07-486a-b9b5-be008c6f87eb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.222s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:51:26 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-0e9bdb8b-be07-486a-b9b5-be008c6f87eb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Deleted allocations for instance c9b8c0c6-7afc-4f0b-ba06-3eccd4726124
Aug 09 10:51:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0e9bdb8b-be07-486a-b9b5-be008c6f87eb tempest-AttachVolumeShelveTestJSON-2139825844 tempest-AttachVolumeShelveTestJSON-2139825844-project-member] Lock "c9b8c0c6-7afc-4f0b-ba06-3eccd4726124" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.370s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:51:27 user nova-compute[72362]: DEBUG nova.compute.manager [req-5900c4f5-c8ea-40be-93db-b6f7ce4c9d1c req-a043f164-2c5d-4e41-bf27-ed7c24022f2f service nova] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Received event network-vif-plugged-bba009ea-bb2e-4952-98ee-4dd1fb2649fc {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:51:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-5900c4f5-c8ea-40be-93db-b6f7ce4c9d1c req-a043f164-2c5d-4e41-bf27-ed7c24022f2f service nova] Acquiring lock "c9b8c0c6-7afc-4f0b-ba06-3eccd4726124-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:51:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-5900c4f5-c8ea-40be-93db-b6f7ce4c9d1c req-a043f164-2c5d-4e41-bf27-ed7c24022f2f service nova] Lock "c9b8c0c6-7afc-4f0b-ba06-3eccd4726124-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:51:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-5900c4f5-c8ea-40be-93db-b6f7ce4c9d1c req-a043f164-2c5d-4e41-bf27-ed7c24022f2f service nova] Lock "c9b8c0c6-7afc-4f0b-ba06-3eccd4726124-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:51:27 user nova-compute[72362]: DEBUG nova.compute.manager [req-5900c4f5-c8ea-40be-93db-b6f7ce4c9d1c req-a043f164-2c5d-4e41-bf27-ed7c24022f2f service nova] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] No waiting events found dispatching network-vif-plugged-bba009ea-bb2e-4952-98ee-4dd1fb2649fc {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:51:27 user nova-compute[72362]: WARNING nova.compute.manager [req-5900c4f5-c8ea-40be-93db-b6f7ce4c9d1c req-a043f164-2c5d-4e41-bf27-ed7c24022f2f service nova] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Received unexpected event network-vif-plugged-bba009ea-bb2e-4952-98ee-4dd1fb2649fc for instance with vm_state deleted and task_state None.
Aug 09 10:51:27 user nova-compute[72362]: DEBUG nova.compute.manager [req-5900c4f5-c8ea-40be-93db-b6f7ce4c9d1c req-a043f164-2c5d-4e41-bf27-ed7c24022f2f service nova] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Received event network-vif-deleted-bba009ea-bb2e-4952-98ee-4dd1fb2649fc {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:51:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:51:27 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:51:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:51:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:51:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:51:27 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 10:51:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:51:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:51:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:51:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:51:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:51:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:51:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:51:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:51:28 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:51:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:51:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:51:28 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:51:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:51:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:51:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:51:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:51:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:51:29 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:51:29 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:51:29 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=8510MB free_disk=25.01335906982422GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 10:51:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:51:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:51:29 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance cefe383b-978f-4391-baf6-3b3ad17e0083 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:51:29 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 4296ca4c-1e3e-474f-98ba-9f947d333b8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:51:29 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 81ffae79-ce4c-440c-a157-ca922637aa67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:51:29 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 10:51:29 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 10:51:29 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:51:29 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:51:30 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 10:51:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.246s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:51:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:51:35 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:51:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:51:39 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691578284.9795637, c9b8c0c6-7afc-4f0b-ba06-3eccd4726124 => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:51:39 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] VM Stopped (Lifecycle Event)
Aug 09 10:51:40 user nova-compute[72362]: DEBUG nova.compute.manager [None req-a18dc133-a5bf-4719-ad31-4e762d8f0490 None None] [instance: c9b8c0c6-7afc-4f0b-ba06-3eccd4726124] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:51:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:51:45 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:51:45 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:51:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:51:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:51:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:51:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:51:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:51:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:51:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.imagecache [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Verify base images {{(pid=72362) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 09 10:51:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.imagecache [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Image id a08d1a11-49eb-4212-a351-e11ee9553b95 yields fingerprint 908b343131531a9dad1eb0a8dd5eaf3997822af4 {{(pid=72362) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 09 10:51:46 user nova-compute[72362]: INFO nova.virt.libvirt.imagecache [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] image a08d1a11-49eb-4212-a351-e11ee9553b95 at (/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4): checking
Aug 09 10:51:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.imagecache [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] image a08d1a11-49eb-4212-a351-e11ee9553b95 at (/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4): image is in use {{(pid=72362) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 09 10:51:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.imagecache [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=72362) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 09 10:51:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.imagecache [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] 81ffae79-ce4c-440c-a157-ca922637aa67 is a valid instance name {{(pid=72362) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 09 10:51:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.imagecache [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] 81ffae79-ce4c-440c-a157-ca922637aa67 has a disk file {{(pid=72362) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 09 10:51:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:51:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:51:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.imagecache [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 81ffae79-ce4c-440c-a157-ca922637aa67 is backed by 908b343131531a9dad1eb0a8dd5eaf3997822af4 {{(pid=72362) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 09 10:51:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.imagecache [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] 4296ca4c-1e3e-474f-98ba-9f947d333b8d is a valid instance name {{(pid=72362) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 09 10:51:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.imagecache [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] 4296ca4c-1e3e-474f-98ba-9f947d333b8d has a disk file {{(pid=72362) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 09 10:51:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:51:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:51:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.imagecache [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 4296ca4c-1e3e-474f-98ba-9f947d333b8d is backed by 908b343131531a9dad1eb0a8dd5eaf3997822af4 {{(pid=72362) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 09 10:51:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.imagecache [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] cefe383b-978f-4391-baf6-3b3ad17e0083 is a valid instance name {{(pid=72362) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 09 10:51:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.imagecache [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] cefe383b-978f-4391-baf6-3b3ad17e0083 has a disk file {{(pid=72362) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 09 10:51:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:51:46 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:51:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.imagecache [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance cefe383b-978f-4391-baf6-3b3ad17e0083 is backed by 908b343131531a9dad1eb0a8dd5eaf3997822af4 {{(pid=72362) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 09 10:51:46 user nova-compute[72362]: WARNING nova.virt.libvirt.imagecache [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Unknown base file: /opt/stack/data/nova/instances/_base/a2f35d8a814264d5d485adda5c238ff3daa61767
Aug 09 10:51:46 user nova-compute[72362]: WARNING nova.virt.libvirt.imagecache [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Unknown base file: /opt/stack/data/nova/instances/_base/8f0c4736f09434b24db2aa0bc408b8a1831106fe
Aug 09 10:51:46 user nova-compute[72362]: WARNING nova.virt.libvirt.imagecache [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Unknown base file: /opt/stack/data/nova/instances/_base/aeee70afff12b970079b47e5d5f6af18b42f60fa
Aug 09 10:51:46 user nova-compute[72362]: WARNING nova.virt.libvirt.imagecache [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Unknown base file: /opt/stack/data/nova/instances/_base/82f16d36bf0ae6e4ff0476166669ac0ab185d172
Aug 09 10:51:46 user nova-compute[72362]: WARNING nova.virt.libvirt.imagecache [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Unknown base file: /opt/stack/data/nova/instances/_base/444f801eda1801365973dad8fdd06f91be14bffa
Aug 09 10:51:46 user nova-compute[72362]: WARNING nova.virt.libvirt.imagecache [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Unknown base file: /opt/stack/data/nova/instances/_base/4247a6e5926a6adae5a036d931426b57f15c814b
Aug 09 10:51:46 user nova-compute[72362]: WARNING nova.virt.libvirt.imagecache [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b90259d0562f3f8ff5c4e2da83e1b8f7ef781857
Aug 09 10:51:46 user nova-compute[72362]: INFO nova.virt.libvirt.imagecache [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Active base files: /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4
Aug 09 10:51:46 user nova-compute[72362]: INFO nova.virt.libvirt.imagecache [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Removable base files: /opt/stack/data/nova/instances/_base/a2f35d8a814264d5d485adda5c238ff3daa61767 /opt/stack/data/nova/instances/_base/8f0c4736f09434b24db2aa0bc408b8a1831106fe /opt/stack/data/nova/instances/_base/aeee70afff12b970079b47e5d5f6af18b42f60fa /opt/stack/data/nova/instances/_base/82f16d36bf0ae6e4ff0476166669ac0ab185d172 /opt/stack/data/nova/instances/_base/444f801eda1801365973dad8fdd06f91be14bffa /opt/stack/data/nova/instances/_base/4247a6e5926a6adae5a036d931426b57f15c814b /opt/stack/data/nova/instances/_base/b90259d0562f3f8ff5c4e2da83e1b8f7ef781857
Aug 09 10:51:46 user nova-compute[72362]: INFO nova.virt.libvirt.imagecache [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a2f35d8a814264d5d485adda5c238ff3daa61767
Aug 09 10:51:46 user nova-compute[72362]: INFO nova.virt.libvirt.imagecache [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8f0c4736f09434b24db2aa0bc408b8a1831106fe
Aug 09 10:51:46 user nova-compute[72362]: INFO nova.virt.libvirt.imagecache [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/aeee70afff12b970079b47e5d5f6af18b42f60fa
Aug 09 10:51:46 user nova-compute[72362]: INFO nova.virt.libvirt.imagecache [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/82f16d36bf0ae6e4ff0476166669ac0ab185d172
Aug 09 10:51:46 user nova-compute[72362]: INFO nova.virt.libvirt.imagecache [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/444f801eda1801365973dad8fdd06f91be14bffa
Aug 09 10:51:46 user nova-compute[72362]: INFO nova.virt.libvirt.imagecache [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4247a6e5926a6adae5a036d931426b57f15c814b
Aug 09 10:51:46 user nova-compute[72362]: INFO nova.virt.libvirt.imagecache [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b90259d0562f3f8ff5c4e2da83e1b8f7ef781857
Aug 09 10:51:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.imagecache [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Verification complete {{(pid=72362) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 09 10:51:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.imagecache [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Verify swap images {{(pid=72362) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 09 10:51:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.imagecache [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Verify ephemeral images {{(pid=72362) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 09 10:51:50 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:51:55 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:51:56 user nova-compute[72362]: DEBUG nova.compute.manager [req-9eb038dc-8c2a-434a-a0bd-89f4337d4a82 req-98ac8e45-ff86-484b-b619-ce61457e3155 service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Received event network-changed-2040dc53-585b-4375-a169-539195f3f01a {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:51:56 user nova-compute[72362]: DEBUG nova.compute.manager [req-9eb038dc-8c2a-434a-a0bd-89f4337d4a82 req-98ac8e45-ff86-484b-b619-ce61457e3155 service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Refreshing instance network info cache due to event network-changed-2040dc53-585b-4375-a169-539195f3f01a. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:51:56 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-9eb038dc-8c2a-434a-a0bd-89f4337d4a82 req-98ac8e45-ff86-484b-b619-ce61457e3155 service nova] Acquiring lock "refresh_cache-81ffae79-ce4c-440c-a157-ca922637aa67" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:51:56 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-9eb038dc-8c2a-434a-a0bd-89f4337d4a82 req-98ac8e45-ff86-484b-b619-ce61457e3155 service nova] Acquired lock "refresh_cache-81ffae79-ce4c-440c-a157-ca922637aa67" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:51:56 user nova-compute[72362]: DEBUG nova.network.neutron [req-9eb038dc-8c2a-434a-a0bd-89f4337d4a82 req-98ac8e45-ff86-484b-b619-ce61457e3155 service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Refreshing network info cache for port 2040dc53-585b-4375-a169-539195f3f01a {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:51:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:51:57 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3ea1af92-0db1-4db2-86e0-a8a85dac80ba tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Acquiring lock "81ffae79-ce4c-440c-a157-ca922637aa67" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:51:57 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3ea1af92-0db1-4db2-86e0-a8a85dac80ba tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "81ffae79-ce4c-440c-a157-ca922637aa67" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:51:57 user nova-compute[72362]: DEBUG nova.network.neutron [req-9eb038dc-8c2a-434a-a0bd-89f4337d4a82 req-98ac8e45-ff86-484b-b619-ce61457e3155 service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Updated VIF entry in instance network info cache for port 2040dc53-585b-4375-a169-539195f3f01a. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:51:57 user nova-compute[72362]: DEBUG nova.network.neutron [req-9eb038dc-8c2a-434a-a0bd-89f4337d4a82 req-98ac8e45-ff86-484b-b619-ce61457e3155 service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Updating instance_info_cache with network_info: [{"id": "2040dc53-585b-4375-a169-539195f3f01a", "address": "fa:16:3e:bf:cc:bc", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2040dc53-58", "ovs_interfaceid": "2040dc53-585b-4375-a169-539195f3f01a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:51:57 user nova-compute[72362]: INFO nova.compute.manager [None req-3ea1af92-0db1-4db2-86e0-a8a85dac80ba tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Detaching volume 6b21c1c3-2c34-42af-b62a-f06bbf1b21bd
Aug 09 10:51:57 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-9eb038dc-8c2a-434a-a0bd-89f4337d4a82 req-98ac8e45-ff86-484b-b619-ce61457e3155 service nova] Releasing lock "refresh_cache-81ffae79-ce4c-440c-a157-ca922637aa67" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:51:57 user nova-compute[72362]: INFO nova.virt.block_device [None req-3ea1af92-0db1-4db2-86e0-a8a85dac80ba tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Attempting to driver detach volume 6b21c1c3-2c34-42af-b62a-f06bbf1b21bd from mountpoint /dev/vdb
Aug 09 10:51:57 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3ea1af92-0db1-4db2-86e0-a8a85dac80ba tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Attempting to detach device vdb from instance 81ffae79-ce4c-440c-a157-ca922637aa67 from the persistent domain config. {{(pid=72362) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 10:51:57 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-3ea1af92-0db1-4db2-86e0-a8a85dac80ba tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 10:51:57 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:51:57 user nova-compute[72362]:   <source dev="/dev/sdd"/>
Aug 09 10:51:57 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:51:57 user nova-compute[72362]:   <serial>6b21c1c3-2c34-42af-b62a-f06bbf1b21bd</serial>
Aug 09 10:51:57 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 10:51:57 user nova-compute[72362]: </disk>
Aug 09 10:51:57 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:51:57 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-3ea1af92-0db1-4db2-86e0-a8a85dac80ba tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Successfully detached device vdb from instance 81ffae79-ce4c-440c-a157-ca922637aa67 from the persistent domain config.
Aug 09 10:51:57 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3ea1af92-0db1-4db2-86e0-a8a85dac80ba tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 81ffae79-ce4c-440c-a157-ca922637aa67 from the live domain config. {{(pid=72362) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 10:51:57 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-3ea1af92-0db1-4db2-86e0-a8a85dac80ba tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 10:51:57 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:51:57 user nova-compute[72362]:   <source dev="/dev/sdd"/>
Aug 09 10:51:57 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:51:57 user nova-compute[72362]:   <serial>6b21c1c3-2c34-42af-b62a-f06bbf1b21bd</serial>
Aug 09 10:51:57 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 10:51:57 user nova-compute[72362]: </disk>
Aug 09 10:51:57 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 10:51:57 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Received event <DeviceRemovedEvent: 1691578317.9949563, 81ffae79-ce4c-440c-a157-ca922637aa67 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72362) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 10:51:58 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-3ea1af92-0db1-4db2-86e0-a8a85dac80ba tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 81ffae79-ce4c-440c-a157-ca922637aa67 {{(pid=72362) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 10:51:58 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-3ea1af92-0db1-4db2-86e0-a8a85dac80ba tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Successfully detached device vdb from instance 81ffae79-ce4c-440c-a157-ca922637aa67 from the live domain config.
Aug 09 10:51:58 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ea1af92-0db1-4db2-86e0-a8a85dac80ba tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:51:58 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea1af92-0db1-4db2-86e0-a8a85dac80ba tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YgWwRsmd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:51:58 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-3ea1af92-0db1-4db2-86e0-a8a85dac80ba tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:51:58 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-3ea1af92-0db1-4db2-86e0-a8a85dac80ba tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:51:58 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-3ea1af92-0db1-4db2-86e0-a8a85dac80ba tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:51:58 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea1af92-0db1-4db2-86e0-a8a85dac80ba tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:51:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:51:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:51:58 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e40449b-8822-4cc8-b2e1-3efa6ba0b0a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:51:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:51:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:51:58 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7d4c48-bd1e-45ec-bcc1-ba7116c51694]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:51:58 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea1af92-0db1-4db2-86e0-a8a85dac80ba tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd (non-flash)
Aug 09 10:51:58 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:51:58 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea1af92-0db1-4db2-86e0-a8a85dac80ba tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd (non-flash)
Aug 09 10:51:58 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:51:58 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea1af92-0db1-4db2-86e0-a8a85dac80ba tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e42e2170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd'): ({'sdd'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:51:58 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-3ea1af92-0db1-4db2-86e0-a8a85dac80ba tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Removing single pathed devices sdd {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:51:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:51:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:51:58 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[488cf67c-4534-415c-b275-4614fe5472aa]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:51:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:51:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:51:58 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[68dbdc6d-d4bc-420f-94b8-1ddc42992906]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:51:58 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-3ea1af92-0db1-4db2-86e0-a8a85dac80ba tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Flushing IO for device /dev/sdd {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:51:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:51:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:51:58 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[49741ad5-cf46-424a-afb8-0a216307aa18]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:51:58 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-3ea1af92-0db1-4db2-86e0-a8a85dac80ba tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:51:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:51:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.033s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:51:58 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f35f32-4877-4f6c-b331-ee24956c76c8]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:51:58 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-3ea1af92-0db1-4db2-86e0-a8a85dac80ba tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:51:58 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-3ea1af92-0db1-4db2-86e0-a8a85dac80ba tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] SCSI volumes sdd have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:51:58 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea1af92-0db1-4db2-86e0-a8a85dac80ba tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:51:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:51:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:51:58 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea606dd-9405-476e-8614-be21933933db]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:51:58 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea1af92-0db1-4db2-86e0-a8a85dac80ba tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:51:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:51:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:51:58 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9599274-adea-49dc-9fa8-b6f6f3512171]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:51:58 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea1af92-0db1-4db2-86e0-a8a85dac80ba tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd, portal: 172.16.0.220,3260]
Aug 09 10:51:58 user nova-compute[72362]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd, portal: 172.16.0.220,3260] successful.
Aug 09 10:51:58 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:51:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:51:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b21c1c3-2c34-42af-b62a-f06bbf1b21bd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:51:58 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[9837c171-ad72-4369-8920-12ed52018fbd]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:51:58 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea1af92-0db1-4db2-86e0-a8a85dac80ba tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:51:58 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-3ea1af92-0db1-4db2-86e0-a8a85dac80ba tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.252s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:51:58 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea1af92-0db1-4db2-86e0-a8a85dac80ba tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] <== disconnect_volume: return (255ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:51:58 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ea1af92-0db1-4db2-86e0-a8a85dac80ba tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:51:58 user nova-compute[72362]: DEBUG nova.compute.manager [req-b2335094-d43e-4ce7-aa79-e9f11401f160 req-260e83e0-5d48-48be-a966-86cc49aea528 service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Received event network-changed-2040dc53-585b-4375-a169-539195f3f01a {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:51:58 user nova-compute[72362]: DEBUG nova.compute.manager [req-b2335094-d43e-4ce7-aa79-e9f11401f160 req-260e83e0-5d48-48be-a966-86cc49aea528 service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Refreshing instance network info cache due to event network-changed-2040dc53-585b-4375-a169-539195f3f01a. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:51:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b2335094-d43e-4ce7-aa79-e9f11401f160 req-260e83e0-5d48-48be-a966-86cc49aea528 service nova] Acquiring lock "refresh_cache-81ffae79-ce4c-440c-a157-ca922637aa67" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:51:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b2335094-d43e-4ce7-aa79-e9f11401f160 req-260e83e0-5d48-48be-a966-86cc49aea528 service nova] Acquired lock "refresh_cache-81ffae79-ce4c-440c-a157-ca922637aa67" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:51:58 user nova-compute[72362]: DEBUG nova.network.neutron [req-b2335094-d43e-4ce7-aa79-e9f11401f160 req-260e83e0-5d48-48be-a966-86cc49aea528 service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Refreshing network info cache for port 2040dc53-585b-4375-a169-539195f3f01a {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:51:59 user nova-compute[72362]: DEBUG nova.objects.instance [None req-3ea1af92-0db1-4db2-86e0-a8a85dac80ba tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lazy-loading 'flavor' on Instance uuid 81ffae79-ce4c-440c-a157-ca922637aa67 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:51:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-3ea1af92-0db1-4db2-86e0-a8a85dac80ba tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "81ffae79-ce4c-440c-a157-ca922637aa67" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.762s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:51:59 user nova-compute[72362]: DEBUG nova.network.neutron [req-b2335094-d43e-4ce7-aa79-e9f11401f160 req-260e83e0-5d48-48be-a966-86cc49aea528 service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Updated VIF entry in instance network info cache for port 2040dc53-585b-4375-a169-539195f3f01a. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:51:59 user nova-compute[72362]: DEBUG nova.network.neutron [req-b2335094-d43e-4ce7-aa79-e9f11401f160 req-260e83e0-5d48-48be-a966-86cc49aea528 service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Updating instance_info_cache with network_info: [{"id": "2040dc53-585b-4375-a169-539195f3f01a", "address": "fa:16:3e:bf:cc:bc", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2040dc53-58", "ovs_interfaceid": "2040dc53-585b-4375-a169-539195f3f01a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:51:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b2335094-d43e-4ce7-aa79-e9f11401f160 req-260e83e0-5d48-48be-a966-86cc49aea528 service nova] Releasing lock "refresh_cache-81ffae79-ce4c-440c-a157-ca922637aa67" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:52:00 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:52:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:52:10 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:52:15 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:52:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:52:20 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:52:20 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:52:20 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:52:20 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 10:52:21 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Didn't find any instances for network info cache update. {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 10:52:21 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:52:21 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 10:52:21 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:52:23 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:52:23 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:52:25 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:52:25 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:52:26 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:52:28 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:52:29 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:52:29 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:52:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:52:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:52:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:52:30 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 10:52:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:52:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:52:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:52:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:52:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:52:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:52:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:52:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:52:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:52:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:52:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:52:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:52:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:52:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:52:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:52:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:52:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:52:31 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:52:31 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:52:31 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=8656MB free_disk=25.00259017944336GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 10:52:31 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:52:31 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:52:31 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance cefe383b-978f-4391-baf6-3b3ad17e0083 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:52:31 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 4296ca4c-1e3e-474f-98ba-9f947d333b8d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:52:31 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 81ffae79-ce4c-440c-a157-ca922637aa67 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:52:31 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 10:52:31 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 10:52:31 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Refreshing inventories for resource provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 10:52:31 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Updating ProviderTree inventory for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 10:52:31 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Updating inventory in ProviderTree for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 10:52:32 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Refreshing aggregate associations for resource provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d, aggregates: None {{(pid=72362) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 10:52:32 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Refreshing trait associations for resource provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE41,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=72362) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 10:52:32 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:52:32 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:52:32 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 10:52:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.520s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:52:33 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:52:33 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Cleaning up deleted instances {{(pid=72362) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 10:52:33 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] There are 0 instances to clean {{(pid=72362) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 10:52:35 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:52:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:52:44 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:52:44 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72362) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 10:52:45 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:52:45 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:52:45 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 10:52:45 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 10:52:45 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 10:52:45 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:52:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:52:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-8043de75-c05a-43d7-a5fd-71a9e031b6e5 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Acquiring lock "81ffae79-ce4c-440c-a157-ca922637aa67" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:52:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-8043de75-c05a-43d7-a5fd-71a9e031b6e5 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "81ffae79-ce4c-440c-a157-ca922637aa67" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:52:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-8043de75-c05a-43d7-a5fd-71a9e031b6e5 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Acquiring lock "81ffae79-ce4c-440c-a157-ca922637aa67-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:52:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-8043de75-c05a-43d7-a5fd-71a9e031b6e5 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "81ffae79-ce4c-440c-a157-ca922637aa67-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:52:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-8043de75-c05a-43d7-a5fd-71a9e031b6e5 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "81ffae79-ce4c-440c-a157-ca922637aa67-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:52:47 user nova-compute[72362]: INFO nova.compute.manager [None req-8043de75-c05a-43d7-a5fd-71a9e031b6e5 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Terminating instance
Aug 09 10:52:47 user nova-compute[72362]: DEBUG nova.compute.manager [None req-8043de75-c05a-43d7-a5fd-71a9e031b6e5 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Start destroying the instance on the hypervisor. {{(pid=72362) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 10:52:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:52:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:52:48 user nova-compute[72362]: DEBUG nova.compute.manager [req-8bc7a5ee-0b7e-422a-a629-3ed6696a80aa req-47a6376b-3c28-4ce7-b812-bc5d172a1728 service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Received event network-vif-unplugged-2040dc53-585b-4375-a169-539195f3f01a {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:52:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8bc7a5ee-0b7e-422a-a629-3ed6696a80aa req-47a6376b-3c28-4ce7-b812-bc5d172a1728 service nova] Acquiring lock "81ffae79-ce4c-440c-a157-ca922637aa67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:52:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8bc7a5ee-0b7e-422a-a629-3ed6696a80aa req-47a6376b-3c28-4ce7-b812-bc5d172a1728 service nova] Lock "81ffae79-ce4c-440c-a157-ca922637aa67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:52:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8bc7a5ee-0b7e-422a-a629-3ed6696a80aa req-47a6376b-3c28-4ce7-b812-bc5d172a1728 service nova] Lock "81ffae79-ce4c-440c-a157-ca922637aa67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:52:48 user nova-compute[72362]: DEBUG nova.compute.manager [req-8bc7a5ee-0b7e-422a-a629-3ed6696a80aa req-47a6376b-3c28-4ce7-b812-bc5d172a1728 service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] No waiting events found dispatching network-vif-unplugged-2040dc53-585b-4375-a169-539195f3f01a {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:52:48 user nova-compute[72362]: DEBUG nova.compute.manager [req-8bc7a5ee-0b7e-422a-a629-3ed6696a80aa req-47a6376b-3c28-4ce7-b812-bc5d172a1728 service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Received event network-vif-unplugged-2040dc53-585b-4375-a169-539195f3f01a for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:52:48 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:52:48 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:52:48 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Instance destroyed successfully.
Aug 09 10:52:48 user nova-compute[72362]: DEBUG nova.objects.instance [None req-8043de75-c05a-43d7-a5fd-71a9e031b6e5 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lazy-loading 'resources' on Instance uuid 81ffae79-ce4c-440c-a157-ca922637aa67 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:52:48 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-8043de75-c05a-43d7-a5fd-71a9e031b6e5 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:46:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1747996005',display_name='tempest-ServerRescueNegativeTestJSON-server-1747996005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1747996005',id=47,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9u+jSQAbl4/4M/00B4pWaL842BUe6igGo0u0lp/kfY2qPhzDf6WwQ0haooq3XCwTQ77Omf3HbZr8hbYJqu3EhEtcVeo53mlt3HO6yLEVEfybG3EqmsToBGkF14LFJC7A==',key_name='tempest-keypair-879942599',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:48:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac17209f912a4f248dd642be32a75ede',ramdisk_id='',reservation_id='r-pgibaoux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1453574557',owner_user_name='tempest-ServerRescueNegativeTestJSON-1453574557-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:50:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f5cb1727c864652a6873a38ec1f7bf7',uuid=81ffae79-ce4c-440c-a157-ca922637aa67,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2040dc53-585b-4375-a169-539195f3f01a", "address": "fa:16:3e:bf:cc:bc", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2040dc53-58", "ovs_interfaceid": "2040dc53-585b-4375-a169-539195f3f01a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:52:48 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-8043de75-c05a-43d7-a5fd-71a9e031b6e5 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Converting VIF {"id": "2040dc53-585b-4375-a169-539195f3f01a", "address": "fa:16:3e:bf:cc:bc", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2040dc53-58", "ovs_interfaceid": "2040dc53-585b-4375-a169-539195f3f01a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:52:48 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-8043de75-c05a-43d7-a5fd-71a9e031b6e5 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:cc:bc,bridge_name='br-int',has_traffic_filtering=True,id=2040dc53-585b-4375-a169-539195f3f01a,network=Network(2f70b9cc-bc8f-46d8-9633-542cd881c89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2040dc53-58') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:52:48 user nova-compute[72362]: DEBUG os_vif [None req-8043de75-c05a-43d7-a5fd-71a9e031b6e5 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:cc:bc,bridge_name='br-int',has_traffic_filtering=True,id=2040dc53-585b-4375-a169-539195f3f01a,network=Network(2f70b9cc-bc8f-46d8-9633-542cd881c89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2040dc53-58') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:52:48 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:52:48 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2040dc53-58, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:52:48 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:52:48 user nova-compute[72362]: INFO os_vif [None req-8043de75-c05a-43d7-a5fd-71a9e031b6e5 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:cc:bc,bridge_name='br-int',has_traffic_filtering=True,id=2040dc53-585b-4375-a169-539195f3f01a,network=Network(2f70b9cc-bc8f-46d8-9633-542cd881c89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2040dc53-58')
Aug 09 10:52:48 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-8043de75-c05a-43d7-a5fd-71a9e031b6e5 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Deleting instance files /opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67_del
Aug 09 10:52:48 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-8043de75-c05a-43d7-a5fd-71a9e031b6e5 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Deletion of /opt/stack/data/nova/instances/81ffae79-ce4c-440c-a157-ca922637aa67_del complete
Aug 09 10:52:48 user nova-compute[72362]: INFO nova.compute.manager [None req-8043de75-c05a-43d7-a5fd-71a9e031b6e5 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 09 10:52:48 user nova-compute[72362]: DEBUG oslo.service.loopingcall [None req-8043de75-c05a-43d7-a5fd-71a9e031b6e5 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72362) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 10:52:48 user nova-compute[72362]: DEBUG nova.compute.manager [-] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Deallocating network for instance {{(pid=72362) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 10:52:48 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] deallocate_for_instance() {{(pid=72362) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 10:52:49 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:52:49 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Took 1.19 seconds to deallocate network for instance.
Aug 09 10:52:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-8043de75-c05a-43d7-a5fd-71a9e031b6e5 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:52:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-8043de75-c05a-43d7-a5fd-71a9e031b6e5 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:52:49 user nova-compute[72362]: DEBUG nova.compute.manager [req-78b8257e-9872-4489-b26e-a0037ca573ad req-4c5728fa-a6ca-4ed7-9bbc-9545e79a58cd service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Received event network-vif-deleted-2040dc53-585b-4375-a169-539195f3f01a {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:52:49 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-8043de75-c05a-43d7-a5fd-71a9e031b6e5 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:52:50 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-8043de75-c05a-43d7-a5fd-71a9e031b6e5 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:52:50 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-8043de75-c05a-43d7-a5fd-71a9e031b6e5 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.152s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:52:50 user nova-compute[72362]: DEBUG nova.compute.manager [req-ccffaa8b-db45-4a79-8788-91c9e8616079 req-895773c2-7fb2-4f68-ac55-fb91c9644411 service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Received event network-vif-plugged-2040dc53-585b-4375-a169-539195f3f01a {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:52:50 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ccffaa8b-db45-4a79-8788-91c9e8616079 req-895773c2-7fb2-4f68-ac55-fb91c9644411 service nova] Acquiring lock "81ffae79-ce4c-440c-a157-ca922637aa67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:52:50 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ccffaa8b-db45-4a79-8788-91c9e8616079 req-895773c2-7fb2-4f68-ac55-fb91c9644411 service nova] Lock "81ffae79-ce4c-440c-a157-ca922637aa67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:52:50 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-ccffaa8b-db45-4a79-8788-91c9e8616079 req-895773c2-7fb2-4f68-ac55-fb91c9644411 service nova] Lock "81ffae79-ce4c-440c-a157-ca922637aa67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:52:50 user nova-compute[72362]: DEBUG nova.compute.manager [req-ccffaa8b-db45-4a79-8788-91c9e8616079 req-895773c2-7fb2-4f68-ac55-fb91c9644411 service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] No waiting events found dispatching network-vif-plugged-2040dc53-585b-4375-a169-539195f3f01a {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:52:50 user nova-compute[72362]: WARNING nova.compute.manager [req-ccffaa8b-db45-4a79-8788-91c9e8616079 req-895773c2-7fb2-4f68-ac55-fb91c9644411 service nova] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Received unexpected event network-vif-plugged-2040dc53-585b-4375-a169-539195f3f01a for instance with vm_state deleted and task_state None.
Aug 09 10:52:50 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-8043de75-c05a-43d7-a5fd-71a9e031b6e5 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Deleted allocations for instance 81ffae79-ce4c-440c-a157-ca922637aa67
Aug 09 10:52:50 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-8043de75-c05a-43d7-a5fd-71a9e031b6e5 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "81ffae79-ce4c-440c-a157-ca922637aa67" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.369s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:52:53 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:52:58 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:53:03 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691578368.5280297, 81ffae79-ce4c-440c-a157-ca922637aa67 => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:53:03 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] VM Stopped (Lifecycle Event)
Aug 09 10:53:03 user nova-compute[72362]: DEBUG nova.compute.manager [None req-e1ec90d4-befc-48f5-99a3-557e5b772ac3 None None] [instance: 81ffae79-ce4c-440c-a157-ca922637aa67] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:53:03 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:53:07 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:53:07 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Triggering sync for uuid cefe383b-978f-4391-baf6-3b3ad17e0083 {{(pid=72362) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 10:53:07 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Triggering sync for uuid 4296ca4c-1e3e-474f-98ba-9f947d333b8d {{(pid=72362) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 10:53:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "cefe383b-978f-4391-baf6-3b3ad17e0083" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:53:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "cefe383b-978f-4391-baf6-3b3ad17e0083" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:53:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "4296ca4c-1e3e-474f-98ba-9f947d333b8d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:53:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "4296ca4c-1e3e-474f-98ba-9f947d333b8d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:53:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "4296ca4c-1e3e-474f-98ba-9f947d333b8d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:53:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "cefe383b-978f-4391-baf6-3b3ad17e0083" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:53:08 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:53:08 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:53:08 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 10:53:08 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 10:53:08 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 10:53:08 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:53:13 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:53:18 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:53:20 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:53:21 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:53:21 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 10:53:21 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Rebuilding the list of instances to heal {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 10:53:22 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "refresh_cache-cefe383b-978f-4391-baf6-3b3ad17e0083" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:53:22 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquired lock "refresh_cache-cefe383b-978f-4391-baf6-3b3ad17e0083" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:53:22 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Forcefully refreshing network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 10:53:22 user nova-compute[72362]: DEBUG nova.objects.instance [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lazy-loading 'info_cache' on Instance uuid cefe383b-978f-4391-baf6-3b3ad17e0083 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:53:22 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Updating instance_info_cache with network_info: [{"id": "1d14bbdf-8802-42b5-bd22-c6bd03a53761", "address": "fa:16:3e:fe:ee:4f", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d14bbdf-88", "ovs_interfaceid": "1d14bbdf-8802-42b5-bd22-c6bd03a53761", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:53:22 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Releasing lock "refresh_cache-cefe383b-978f-4391-baf6-3b3ad17e0083" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:53:22 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Updated the network info_cache for instance {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 10:53:22 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:53:22 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:53:22 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 10:53:23 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:53:23 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:53:24 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:53:25 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:53:27 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:53:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:53:30 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:53:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:53:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:53:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:53:30 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 10:53:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:53:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:53:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:53:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:53:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:53:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:53:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:53:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:53:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:53:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:53:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:53:31 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:53:32 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:53:32 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:53:32 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=8745MB free_disk=25.027843475341797GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 10:53:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:53:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:53:32 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance cefe383b-978f-4391-baf6-3b3ad17e0083 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:53:32 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 4296ca4c-1e3e-474f-98ba-9f947d333b8d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:53:32 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 10:53:32 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 10:53:32 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:53:32 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:53:32 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 10:53:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.232s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:53:33 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:53:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:53:43 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:53:48 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:53:53 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:53:55 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:53:56 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2b42b4be-a782-4c4b-8ecb-fea6963922e3 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Acquiring lock "4296ca4c-1e3e-474f-98ba-9f947d333b8d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:53:56 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2b42b4be-a782-4c4b-8ecb-fea6963922e3 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "4296ca4c-1e3e-474f-98ba-9f947d333b8d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:53:56 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2b42b4be-a782-4c4b-8ecb-fea6963922e3 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Acquiring lock "4296ca4c-1e3e-474f-98ba-9f947d333b8d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:53:56 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2b42b4be-a782-4c4b-8ecb-fea6963922e3 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "4296ca4c-1e3e-474f-98ba-9f947d333b8d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:53:56 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2b42b4be-a782-4c4b-8ecb-fea6963922e3 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "4296ca4c-1e3e-474f-98ba-9f947d333b8d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:53:56 user nova-compute[72362]: INFO nova.compute.manager [None req-2b42b4be-a782-4c4b-8ecb-fea6963922e3 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Terminating instance
Aug 09 10:53:56 user nova-compute[72362]: DEBUG nova.compute.manager [None req-2b42b4be-a782-4c4b-8ecb-fea6963922e3 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Start destroying the instance on the hypervisor. {{(pid=72362) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 10:53:56 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:53:56 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:53:56 user nova-compute[72362]: DEBUG nova.compute.manager [req-c40e2e5b-bd76-426c-abee-5889687d6d01 req-22bd091d-916c-4506-83a3-dffb3af56de3 service nova] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Received event network-vif-unplugged-434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:53:56 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c40e2e5b-bd76-426c-abee-5889687d6d01 req-22bd091d-916c-4506-83a3-dffb3af56de3 service nova] Acquiring lock "4296ca4c-1e3e-474f-98ba-9f947d333b8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:53:56 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c40e2e5b-bd76-426c-abee-5889687d6d01 req-22bd091d-916c-4506-83a3-dffb3af56de3 service nova] Lock "4296ca4c-1e3e-474f-98ba-9f947d333b8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:53:56 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-c40e2e5b-bd76-426c-abee-5889687d6d01 req-22bd091d-916c-4506-83a3-dffb3af56de3 service nova] Lock "4296ca4c-1e3e-474f-98ba-9f947d333b8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:53:56 user nova-compute[72362]: DEBUG nova.compute.manager [req-c40e2e5b-bd76-426c-abee-5889687d6d01 req-22bd091d-916c-4506-83a3-dffb3af56de3 service nova] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] No waiting events found dispatching network-vif-unplugged-434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:53:56 user nova-compute[72362]: DEBUG nova.compute.manager [req-c40e2e5b-bd76-426c-abee-5889687d6d01 req-22bd091d-916c-4506-83a3-dffb3af56de3 service nova] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Received event network-vif-unplugged-434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9 for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:53:56 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:53:56 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:53:57 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Instance destroyed successfully.
Aug 09 10:53:57 user nova-compute[72362]: DEBUG nova.objects.instance [None req-2b42b4be-a782-4c4b-8ecb-fea6963922e3 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lazy-loading 'resources' on Instance uuid 4296ca4c-1e3e-474f-98ba-9f947d333b8d {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:53:57 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-2b42b4be-a782-4c4b-8ecb-fea6963922e3 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:37:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1444056871',display_name='tempest-ServerRescueNegativeTestJSON-server-1444056871',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1444056871',id=39,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:39:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac17209f912a4f248dd642be32a75ede',ramdisk_id='',reservation_id='r-sfmqf8yu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1453574557',owner_user_name='tempest-ServerRescueNegativeTestJSON-1453574557-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:39:32Z,user_data=None,user_id='1f5cb1727c864652a6873a38ec1f7bf7',uuid=4296ca4c-1e3e-474f-98ba-9f947d333b8d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9", "address": "fa:16:3e:09:7c:97", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434ea21d-d4", "ovs_interfaceid": "434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:53:57 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-2b42b4be-a782-4c4b-8ecb-fea6963922e3 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Converting VIF {"id": "434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9", "address": "fa:16:3e:09:7c:97", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434ea21d-d4", "ovs_interfaceid": "434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:53:57 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-2b42b4be-a782-4c4b-8ecb-fea6963922e3 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:7c:97,bridge_name='br-int',has_traffic_filtering=True,id=434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9,network=Network(2f70b9cc-bc8f-46d8-9633-542cd881c89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap434ea21d-d4') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:53:57 user nova-compute[72362]: DEBUG os_vif [None req-2b42b4be-a782-4c4b-8ecb-fea6963922e3 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:7c:97,bridge_name='br-int',has_traffic_filtering=True,id=434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9,network=Network(2f70b9cc-bc8f-46d8-9633-542cd881c89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap434ea21d-d4') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:53:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:53:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap434ea21d-d4, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:53:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:53:57 user nova-compute[72362]: INFO os_vif [None req-2b42b4be-a782-4c4b-8ecb-fea6963922e3 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:7c:97,bridge_name='br-int',has_traffic_filtering=True,id=434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9,network=Network(2f70b9cc-bc8f-46d8-9633-542cd881c89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap434ea21d-d4')
Aug 09 10:53:57 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-2b42b4be-a782-4c4b-8ecb-fea6963922e3 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Deleting instance files /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d_del
Aug 09 10:53:57 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-2b42b4be-a782-4c4b-8ecb-fea6963922e3 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Deletion of /opt/stack/data/nova/instances/4296ca4c-1e3e-474f-98ba-9f947d333b8d_del complete
Aug 09 10:53:57 user nova-compute[72362]: INFO nova.compute.manager [None req-2b42b4be-a782-4c4b-8ecb-fea6963922e3 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Took 0.66 seconds to destroy the instance on the hypervisor.
Aug 09 10:53:57 user nova-compute[72362]: DEBUG oslo.service.loopingcall [None req-2b42b4be-a782-4c4b-8ecb-fea6963922e3 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72362) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 10:53:57 user nova-compute[72362]: DEBUG nova.compute.manager [-] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Deallocating network for instance {{(pid=72362) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 10:53:57 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] deallocate_for_instance() {{(pid=72362) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 10:53:57 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:53:57 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Took 0.53 seconds to deallocate network for instance.
Aug 09 10:53:57 user nova-compute[72362]: DEBUG nova.compute.manager [req-75831801-57f4-45f8-b202-13f4d3d40b87 req-18257a52-9a1f-4aa5-a582-657d11fe11de service nova] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Received event network-vif-deleted-434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:53:57 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2b42b4be-a782-4c4b-8ecb-fea6963922e3 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:53:57 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2b42b4be-a782-4c4b-8ecb-fea6963922e3 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:53:58 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-2b42b4be-a782-4c4b-8ecb-fea6963922e3 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:53:58 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-2b42b4be-a782-4c4b-8ecb-fea6963922e3 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:53:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2b42b4be-a782-4c4b-8ecb-fea6963922e3 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.147s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:53:58 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-2b42b4be-a782-4c4b-8ecb-fea6963922e3 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Deleted allocations for instance 4296ca4c-1e3e-474f-98ba-9f947d333b8d
Aug 09 10:53:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2b42b4be-a782-4c4b-8ecb-fea6963922e3 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "4296ca4c-1e3e-474f-98ba-9f947d333b8d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.520s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:53:58 user nova-compute[72362]: DEBUG nova.compute.manager [req-e6155835-ced9-49cf-9e68-ef7b3b3f3d94 req-b12b78cc-f93e-49ec-8dcf-ea984c309982 service nova] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Received event network-vif-plugged-434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:53:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e6155835-ced9-49cf-9e68-ef7b3b3f3d94 req-b12b78cc-f93e-49ec-8dcf-ea984c309982 service nova] Acquiring lock "4296ca4c-1e3e-474f-98ba-9f947d333b8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:53:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e6155835-ced9-49cf-9e68-ef7b3b3f3d94 req-b12b78cc-f93e-49ec-8dcf-ea984c309982 service nova] Lock "4296ca4c-1e3e-474f-98ba-9f947d333b8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:53:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e6155835-ced9-49cf-9e68-ef7b3b3f3d94 req-b12b78cc-f93e-49ec-8dcf-ea984c309982 service nova] Lock "4296ca4c-1e3e-474f-98ba-9f947d333b8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:53:58 user nova-compute[72362]: DEBUG nova.compute.manager [req-e6155835-ced9-49cf-9e68-ef7b3b3f3d94 req-b12b78cc-f93e-49ec-8dcf-ea984c309982 service nova] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] No waiting events found dispatching network-vif-plugged-434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:53:58 user nova-compute[72362]: WARNING nova.compute.manager [req-e6155835-ced9-49cf-9e68-ef7b3b3f3d94 req-b12b78cc-f93e-49ec-8dcf-ea984c309982 service nova] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Received unexpected event network-vif-plugged-434ea21d-d4ab-4ffc-9bf9-a9f1836e60f9 for instance with vm_state deleted and task_state None.
Aug 09 10:54:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:54:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:54:12 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691578437.2288659, 4296ca4c-1e3e-474f-98ba-9f947d333b8d => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:54:12 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] VM Stopped (Lifecycle Event)
Aug 09 10:54:12 user nova-compute[72362]: DEBUG nova.compute.manager [None req-fe3bef4a-db38-4cec-80fe-c331d786dbb1 None None] [instance: 4296ca4c-1e3e-474f-98ba-9f947d333b8d] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:54:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:54:17 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:54:17 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:54:17 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 10:54:17 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 10:54:17 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 10:54:17 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:54:21 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:54:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:54:22 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:54:22 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 10:54:22 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Didn't find any instances for network info cache update. {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 10:54:22 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:54:24 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:54:24 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 10:54:25 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:54:25 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:54:26 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:54:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:54:28 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:54:31 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:54:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:54:32 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:54:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:54:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:54:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:54:32 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 10:54:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:54:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:54:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:54:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:54:33 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:54:33 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:54:33 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=8801MB free_disk=25.046131134033203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 10:54:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:54:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:54:33 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance cefe383b-978f-4391-baf6-3b3ad17e0083 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:54:33 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 10:54:33 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 10:54:33 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:54:33 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:54:33 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 10:54:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.193s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:54:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:54:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:54:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:54:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7e868bac-c85e-4af9-addd-9a0d5dcd37b7 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Acquiring lock "cefe383b-978f-4391-baf6-3b3ad17e0083" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:54:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7e868bac-c85e-4af9-addd-9a0d5dcd37b7 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "cefe383b-978f-4391-baf6-3b3ad17e0083" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:54:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7e868bac-c85e-4af9-addd-9a0d5dcd37b7 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Acquiring lock "cefe383b-978f-4391-baf6-3b3ad17e0083-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:54:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7e868bac-c85e-4af9-addd-9a0d5dcd37b7 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "cefe383b-978f-4391-baf6-3b3ad17e0083-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:54:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7e868bac-c85e-4af9-addd-9a0d5dcd37b7 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "cefe383b-978f-4391-baf6-3b3ad17e0083-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:54:47 user nova-compute[72362]: INFO nova.compute.manager [None req-7e868bac-c85e-4af9-addd-9a0d5dcd37b7 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Terminating instance
Aug 09 10:54:47 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7e868bac-c85e-4af9-addd-9a0d5dcd37b7 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Start destroying the instance on the hypervisor. {{(pid=72362) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 10:54:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:54:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:54:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:54:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:54:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:54:47 user nova-compute[72362]: DEBUG nova.compute.manager [req-189f99de-79cf-402f-8735-d0c651ec9c6a req-e338ace4-0cc3-4469-952e-899e5fc20954 service nova] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Received event network-vif-unplugged-1d14bbdf-8802-42b5-bd22-c6bd03a53761 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:54:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-189f99de-79cf-402f-8735-d0c651ec9c6a req-e338ace4-0cc3-4469-952e-899e5fc20954 service nova] Acquiring lock "cefe383b-978f-4391-baf6-3b3ad17e0083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:54:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-189f99de-79cf-402f-8735-d0c651ec9c6a req-e338ace4-0cc3-4469-952e-899e5fc20954 service nova] Lock "cefe383b-978f-4391-baf6-3b3ad17e0083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:54:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-189f99de-79cf-402f-8735-d0c651ec9c6a req-e338ace4-0cc3-4469-952e-899e5fc20954 service nova] Lock "cefe383b-978f-4391-baf6-3b3ad17e0083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:54:47 user nova-compute[72362]: DEBUG nova.compute.manager [req-189f99de-79cf-402f-8735-d0c651ec9c6a req-e338ace4-0cc3-4469-952e-899e5fc20954 service nova] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] No waiting events found dispatching network-vif-unplugged-1d14bbdf-8802-42b5-bd22-c6bd03a53761 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:54:47 user nova-compute[72362]: DEBUG nova.compute.manager [req-189f99de-79cf-402f-8735-d0c651ec9c6a req-e338ace4-0cc3-4469-952e-899e5fc20954 service nova] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Received event network-vif-unplugged-1d14bbdf-8802-42b5-bd22-c6bd03a53761 for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 10:54:47 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Instance destroyed successfully.
Aug 09 10:54:47 user nova-compute[72362]: DEBUG nova.objects.instance [None req-7e868bac-c85e-4af9-addd-9a0d5dcd37b7 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lazy-loading 'resources' on Instance uuid cefe383b-978f-4391-baf6-3b3ad17e0083 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:54:47 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-7e868bac-c85e-4af9-addd-9a0d5dcd37b7 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:37:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1691599130',display_name='tempest-ServerRescueNegativeTestJSON-server-1691599130',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1691599130',id=38,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:42:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac17209f912a4f248dd642be32a75ede',ramdisk_id='',reservation_id='r-ofb1zx0f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1453574557',owner_user_name='tempest-ServerRescueNegativeTestJSON-1453574557-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:44:19Z,user_data=None,user_id='1f5cb1727c864652a6873a38ec1f7bf7',uuid=cefe383b-978f-4391-baf6-3b3ad17e0083,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d14bbdf-8802-42b5-bd22-c6bd03a53761", "address": "fa:16:3e:fe:ee:4f", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d14bbdf-88", "ovs_interfaceid": "1d14bbdf-8802-42b5-bd22-c6bd03a53761", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:54:47 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-7e868bac-c85e-4af9-addd-9a0d5dcd37b7 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Converting VIF {"id": "1d14bbdf-8802-42b5-bd22-c6bd03a53761", "address": "fa:16:3e:fe:ee:4f", "network": {"id": "2f70b9cc-bc8f-46d8-9633-542cd881c89f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-4354344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac17209f912a4f248dd642be32a75ede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d14bbdf-88", "ovs_interfaceid": "1d14bbdf-8802-42b5-bd22-c6bd03a53761", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:54:47 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-7e868bac-c85e-4af9-addd-9a0d5dcd37b7 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:ee:4f,bridge_name='br-int',has_traffic_filtering=True,id=1d14bbdf-8802-42b5-bd22-c6bd03a53761,network=Network(2f70b9cc-bc8f-46d8-9633-542cd881c89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d14bbdf-88') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:54:47 user nova-compute[72362]: DEBUG os_vif [None req-7e868bac-c85e-4af9-addd-9a0d5dcd37b7 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:ee:4f,bridge_name='br-int',has_traffic_filtering=True,id=1d14bbdf-8802-42b5-bd22-c6bd03a53761,network=Network(2f70b9cc-bc8f-46d8-9633-542cd881c89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d14bbdf-88') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:54:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:54:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d14bbdf-88, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:54:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:54:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:54:47 user nova-compute[72362]: INFO os_vif [None req-7e868bac-c85e-4af9-addd-9a0d5dcd37b7 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:ee:4f,bridge_name='br-int',has_traffic_filtering=True,id=1d14bbdf-8802-42b5-bd22-c6bd03a53761,network=Network(2f70b9cc-bc8f-46d8-9633-542cd881c89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d14bbdf-88')
Aug 09 10:54:47 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-7e868bac-c85e-4af9-addd-9a0d5dcd37b7 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Deleting instance files /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083_del
Aug 09 10:54:47 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-7e868bac-c85e-4af9-addd-9a0d5dcd37b7 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Deletion of /opt/stack/data/nova/instances/cefe383b-978f-4391-baf6-3b3ad17e0083_del complete
Aug 09 10:54:48 user nova-compute[72362]: INFO nova.compute.manager [None req-7e868bac-c85e-4af9-addd-9a0d5dcd37b7 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 09 10:54:48 user nova-compute[72362]: DEBUG oslo.service.loopingcall [None req-7e868bac-c85e-4af9-addd-9a0d5dcd37b7 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72362) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 10:54:48 user nova-compute[72362]: DEBUG nova.compute.manager [-] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Deallocating network for instance {{(pid=72362) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 10:54:48 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] deallocate_for_instance() {{(pid=72362) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 10:54:48 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:54:48 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Took 0.52 seconds to deallocate network for instance.
Aug 09 10:54:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7e868bac-c85e-4af9-addd-9a0d5dcd37b7 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:54:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7e868bac-c85e-4af9-addd-9a0d5dcd37b7 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:54:48 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-7e868bac-c85e-4af9-addd-9a0d5dcd37b7 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:54:48 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-7e868bac-c85e-4af9-addd-9a0d5dcd37b7 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:54:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7e868bac-c85e-4af9-addd-9a0d5dcd37b7 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.154s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:54:48 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-7e868bac-c85e-4af9-addd-9a0d5dcd37b7 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Deleted allocations for instance cefe383b-978f-4391-baf6-3b3ad17e0083
Aug 09 10:54:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-7e868bac-c85e-4af9-addd-9a0d5dcd37b7 tempest-ServerRescueNegativeTestJSON-1453574557 tempest-ServerRescueNegativeTestJSON-1453574557-project-member] Lock "cefe383b-978f-4391-baf6-3b3ad17e0083" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.750s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:54:49 user nova-compute[72362]: DEBUG nova.compute.manager [req-080d5544-4cfa-46b3-b1ab-ca40de1a8e15 req-952cd5d2-9a7a-43fe-ad32-1117d0e1b231 service nova] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Received event network-vif-plugged-1d14bbdf-8802-42b5-bd22-c6bd03a53761 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:54:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-080d5544-4cfa-46b3-b1ab-ca40de1a8e15 req-952cd5d2-9a7a-43fe-ad32-1117d0e1b231 service nova] Acquiring lock "cefe383b-978f-4391-baf6-3b3ad17e0083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:54:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-080d5544-4cfa-46b3-b1ab-ca40de1a8e15 req-952cd5d2-9a7a-43fe-ad32-1117d0e1b231 service nova] Lock "cefe383b-978f-4391-baf6-3b3ad17e0083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:54:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-080d5544-4cfa-46b3-b1ab-ca40de1a8e15 req-952cd5d2-9a7a-43fe-ad32-1117d0e1b231 service nova] Lock "cefe383b-978f-4391-baf6-3b3ad17e0083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:54:49 user nova-compute[72362]: DEBUG nova.compute.manager [req-080d5544-4cfa-46b3-b1ab-ca40de1a8e15 req-952cd5d2-9a7a-43fe-ad32-1117d0e1b231 service nova] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] No waiting events found dispatching network-vif-plugged-1d14bbdf-8802-42b5-bd22-c6bd03a53761 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:54:49 user nova-compute[72362]: WARNING nova.compute.manager [req-080d5544-4cfa-46b3-b1ab-ca40de1a8e15 req-952cd5d2-9a7a-43fe-ad32-1117d0e1b231 service nova] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Received unexpected event network-vif-plugged-1d14bbdf-8802-42b5-bd22-c6bd03a53761 for instance with vm_state deleted and task_state None.
Aug 09 10:54:49 user nova-compute[72362]: DEBUG nova.compute.manager [req-080d5544-4cfa-46b3-b1ab-ca40de1a8e15 req-952cd5d2-9a7a-43fe-ad32-1117d0e1b231 service nova] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Received event network-vif-deleted-1d14bbdf-8802-42b5-bd22-c6bd03a53761 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:54:52 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:54:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:55:02 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691578487.8900335, cefe383b-978f-4391-baf6-3b3ad17e0083 => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:55:02 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] VM Stopped (Lifecycle Event)
Aug 09 10:55:02 user nova-compute[72362]: DEBUG nova.compute.manager [None req-8ead50f0-102e-4643-b806-475caa004e64 None None] [instance: cefe383b-978f-4391-baf6-3b3ad17e0083] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:55:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:55:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:55:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 10:55:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 10:55:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 10:55:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:55:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:55:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:55:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:55:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 10:55:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 10:55:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 10:55:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:55:17 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:55:20 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:55:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:55:23 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:55:23 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 10:55:23 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Rebuilding the list of instances to heal {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 10:55:23 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Didn't find any instances for network info cache update. {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 10:55:23 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:55:25 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:55:25 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 10:55:26 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:55:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:55:27 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:55:27 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:55:30 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:55:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:55:32 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:55:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:55:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:55:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:55:33 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 10:55:33 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:55:33 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:55:33 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=8996MB free_disk=25.07339096069336GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 10:55:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:55:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:55:33 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 10:55:33 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 10:55:33 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:55:33 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:55:33 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 10:55:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.139s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:55:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:55:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:55:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:55:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:55:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:55:52 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:55:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:56:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:56:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:56:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:56:17 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:56:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:56:22 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:56:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:56:23 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:56:23 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 10:56:23 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Rebuilding the list of instances to heal {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 10:56:23 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Didn't find any instances for network info cache update. {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 10:56:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:56:24 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:56:26 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:56:26 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:56:26 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 10:56:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:56:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:56:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:56:28 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:56:29 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:56:30 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:56:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:56:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:56:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:56:33 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:56:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:56:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:56:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:56:34 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 10:56:34 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:56:34 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:56:34 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=9003MB free_disk=25.050750732421875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 10:56:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:56:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:56:34 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 10:56:34 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 10:56:34 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:56:34 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:56:34 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 10:56:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.143s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:56:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Acquiring lock "dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:56:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:56:35 user nova-compute[72362]: DEBUG nova.compute.manager [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Starting instance... {{(pid=72362) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 10:56:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:56:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:56:35 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 10:56:35 user nova-compute[72362]: INFO nova.compute.claims [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Claim successful on node user
Aug 09 10:56:35 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:56:35 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:56:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.198s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:56:35 user nova-compute[72362]: DEBUG nova.compute.manager [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Start building networks asynchronously for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 10:56:35 user nova-compute[72362]: DEBUG nova.compute.manager [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Allocating IP information in the background. {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 10:56:35 user nova-compute[72362]: DEBUG nova.network.neutron [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] allocate_for_instance() {{(pid=72362) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 10:56:35 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:56:35 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 10:56:35 user nova-compute[72362]: DEBUG nova.compute.manager [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Start building block device mappings for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 10:56:35 user nova-compute[72362]: DEBUG nova.compute.manager [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Start spawning the instance on the hypervisor. {{(pid=72362) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 10:56:35 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 10:56:35 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Creating image(s)
Aug 09 10:56:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Acquiring lock "/opt/stack/data/nova/instances/dd3c8516-66cf-4a07-bb05-3608fd2cb5c4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:56:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "/opt/stack/data/nova/instances/dd3c8516-66cf-4a07-bb05-3608fd2cb5c4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:56:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "/opt/stack/data/nova/instances/dd3c8516-66cf-4a07-bb05-3608fd2cb5c4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:56:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Acquiring lock "a41d4673be03dba18331fae3785d818ca8105baf" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:56:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "a41d4673be03dba18331fae3785d818ca8105baf" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:56:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a41d4673be03dba18331fae3785d818ca8105baf.part --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:56:36 user nova-compute[72362]: DEBUG nova.policy [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '191f1c4d430949899c90b08f00aefd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09af0e64509144b28ebccba3d90aee65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72362) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 10:56:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a41d4673be03dba18331fae3785d818ca8105baf.part --force-share --output=json" returned: 0 in 0.155s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:56:36 user nova-compute[72362]: DEBUG nova.virt.images [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] 87c9723c-ac63-4cff-bea1-0727e518ee00 was qcow2, converting to raw {{(pid=72362) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 10:56:36 user nova-compute[72362]: DEBUG nova.privsep.utils [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72362) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 10:56:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a41d4673be03dba18331fae3785d818ca8105baf.part /opt/stack/data/nova/instances/_base/a41d4673be03dba18331fae3785d818ca8105baf.converted {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:56:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a41d4673be03dba18331fae3785d818ca8105baf.part /opt/stack/data/nova/instances/_base/a41d4673be03dba18331fae3785d818ca8105baf.converted" returned: 0 in 0.271s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:56:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a41d4673be03dba18331fae3785d818ca8105baf.converted --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:56:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a41d4673be03dba18331fae3785d818ca8105baf.converted --force-share --output=json" returned: 0 in 0.136s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:56:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "a41d4673be03dba18331fae3785d818ca8105baf" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.102s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:56:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a41d4673be03dba18331fae3785d818ca8105baf --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:56:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a41d4673be03dba18331fae3785d818ca8105baf --force-share --output=json" returned: 0 in 0.138s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:56:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Acquiring lock "a41d4673be03dba18331fae3785d818ca8105baf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:56:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "a41d4673be03dba18331fae3785d818ca8105baf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:56:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a41d4673be03dba18331fae3785d818ca8105baf --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:56:37 user nova-compute[72362]: DEBUG nova.network.neutron [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Successfully created port: ce91bcdb-b008-45a9-9c68-5c596111091f {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 10:56:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a41d4673be03dba18331fae3785d818ca8105baf --force-share --output=json" returned: 0 in 0.146s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:56:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a41d4673be03dba18331fae3785d818ca8105baf,backing_fmt=raw /opt/stack/data/nova/instances/dd3c8516-66cf-4a07-bb05-3608fd2cb5c4/disk 1073741824 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:56:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a41d4673be03dba18331fae3785d818ca8105baf,backing_fmt=raw /opt/stack/data/nova/instances/dd3c8516-66cf-4a07-bb05-3608fd2cb5c4/disk 1073741824" returned: 0 in 0.054s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:56:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "a41d4673be03dba18331fae3785d818ca8105baf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:56:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a41d4673be03dba18331fae3785d818ca8105baf --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:56:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a41d4673be03dba18331fae3785d818ca8105baf --force-share --output=json" returned: 0 in 0.130s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:56:37 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dd3c8516-66cf-4a07-bb05-3608fd2cb5c4/disk. size=1073741824 {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 10:56:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd3c8516-66cf-4a07-bb05-3608fd2cb5c4/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:56:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:56:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd3c8516-66cf-4a07-bb05-3608fd2cb5c4/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:56:37 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Cannot resize image /opt/stack/data/nova/instances/dd3c8516-66cf-4a07-bb05-3608fd2cb5c4/disk to a smaller size. {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 10:56:37 user nova-compute[72362]: DEBUG nova.objects.instance [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lazy-loading 'migration_context' on Instance uuid dd3c8516-66cf-4a07-bb05-3608fd2cb5c4 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:56:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Created local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 10:56:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Ensure instance console log exists: /opt/stack/data/nova/instances/dd3c8516-66cf-4a07-bb05-3608fd2cb5c4/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 10:56:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:56:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:56:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:56:37 user nova-compute[72362]: DEBUG nova.network.neutron [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Successfully updated port: ce91bcdb-b008-45a9-9c68-5c596111091f {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 10:56:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Acquiring lock "refresh_cache-dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:56:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Acquired lock "refresh_cache-dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:56:37 user nova-compute[72362]: DEBUG nova.network.neutron [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:56:37 user nova-compute[72362]: DEBUG nova.compute.manager [req-31fe8264-9673-4ac7-9000-dda992075fae req-2627f358-ad8e-47dd-95b3-fd96947829f0 service nova] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Received event network-changed-ce91bcdb-b008-45a9-9c68-5c596111091f {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:56:37 user nova-compute[72362]: DEBUG nova.compute.manager [req-31fe8264-9673-4ac7-9000-dda992075fae req-2627f358-ad8e-47dd-95b3-fd96947829f0 service nova] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Refreshing instance network info cache due to event network-changed-ce91bcdb-b008-45a9-9c68-5c596111091f. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:56:37 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-31fe8264-9673-4ac7-9000-dda992075fae req-2627f358-ad8e-47dd-95b3-fd96947829f0 service nova] Acquiring lock "refresh_cache-dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:56:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:56:38 user nova-compute[72362]: DEBUG nova.network.neutron [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 10:56:38 user nova-compute[72362]: DEBUG nova.network.neutron [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Updating instance_info_cache with network_info: [{"id": "ce91bcdb-b008-45a9-9c68-5c596111091f", "address": "fa:16:3e:c4:3a:1b", "network": {"id": "f812ec4b-c0a0-4d6c-84e9-5b50199ad17a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2039781156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09af0e64509144b28ebccba3d90aee65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce91bcdb-b0", "ovs_interfaceid": "ce91bcdb-b008-45a9-9c68-5c596111091f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:56:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Releasing lock "refresh_cache-dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:56:38 user nova-compute[72362]: DEBUG nova.compute.manager [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Instance network_info: |[{"id": "ce91bcdb-b008-45a9-9c68-5c596111091f", "address": "fa:16:3e:c4:3a:1b", "network": {"id": "f812ec4b-c0a0-4d6c-84e9-5b50199ad17a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2039781156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09af0e64509144b28ebccba3d90aee65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce91bcdb-b0", "ovs_interfaceid": "ce91bcdb-b008-45a9-9c68-5c596111091f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 10:56:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-31fe8264-9673-4ac7-9000-dda992075fae req-2627f358-ad8e-47dd-95b3-fd96947829f0 service nova] Acquired lock "refresh_cache-dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:56:38 user nova-compute[72362]: DEBUG nova.network.neutron [req-31fe8264-9673-4ac7-9000-dda992075fae req-2627f358-ad8e-47dd-95b3-fd96947829f0 service nova] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Refreshing network info cache for port ce91bcdb-b008-45a9-9c68-5c596111091f {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:56:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Start _get_guest_xml network_info=[{"id": "ce91bcdb-b008-45a9-9c68-5c596111091f", "address": "fa:16:3e:c4:3a:1b", "network": {"id": "f812ec4b-c0a0-4d6c-84e9-5b50199ad17a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2039781156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09af0e64509144b28ebccba3d90aee65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce91bcdb-b0", "ovs_interfaceid": "ce91bcdb-b008-45a9-9c68-5c596111091f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:56:32Z,direct_url=<?>,disk_format='qcow2',id=87c9723c-ac63-4cff-bea1-0727e518ee00,min_disk=0,min_ram=0,name='tempest-scenario-img--1907943549',owner='09af0e64509144b28ebccba3d90aee65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:56:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': '87c9723c-ac63-4cff-bea1-0727e518ee00'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:56:38 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:56:38 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:56:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:56:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:56:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:56:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:56:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:56:38 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:56:32Z,direct_url=<?>,disk_format='qcow2',id=87c9723c-ac63-4cff-bea1-0727e518ee00,min_disk=0,min_ram=0,name='tempest-scenario-img--1907943549',owner='09af0e64509144b28ebccba3d90aee65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:56:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:56:38 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:56:38 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:56:38 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:56:38 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:56:38 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:56:38 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:56:38 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:56:38 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:56:38 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:56:38 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:56:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:56:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1983830734',display_name='tempest-TestMinimumBasicScenario-server-1983830734',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1983830734',id=50,image_ref='87c9723c-ac63-4cff-bea1-0727e518ee00',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjd7zo6+sqTrdhNBsHe4adte2ZBACSCbCQi6XDW4qOuoD6kQFT9u3zFYOeUMnHPxXBjhN6VslITy0d03mQLz3n5vC0674qFICJqzPR2oI6z11ZT1yVIQW5wYnWMD5SE4Q==',key_name='tempest-TestMinimumBasicScenario-230225336',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09af0e64509144b28ebccba3d90aee65',ramdisk_id='',reservation_id='r-0hkkepkh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='87c9723c-ac63-4cff-bea1-0727e518ee00',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-673917805',owner_user_name='tempest-TestMinimumBasicScenario-673917805-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:56:36Z,user_data=None,user_id='191f1c4d430949899c90b08f00aefd7e',uuid=dd3c8516-66cf-4a07-bb05-3608fd2cb5c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce91bcdb-b008-45a9-9c68-5c596111091f", "address": "fa:16:3e:c4:3a:1b", "network": {"id": "f812ec4b-c0a0-4d6c-84e9-5b50199ad17a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2039781156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09af0e64509144b28ebccba3d90aee65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce91bcdb-b0", "ovs_interfaceid": "ce91bcdb-b008-45a9-9c68-5c596111091f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:56:38 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Converting VIF {"id": "ce91bcdb-b008-45a9-9c68-5c596111091f", "address": "fa:16:3e:c4:3a:1b", "network": {"id": "f812ec4b-c0a0-4d6c-84e9-5b50199ad17a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2039781156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09af0e64509144b28ebccba3d90aee65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce91bcdb-b0", "ovs_interfaceid": "ce91bcdb-b008-45a9-9c68-5c596111091f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:56:38 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:3a:1b,bridge_name='br-int',has_traffic_filtering=True,id=ce91bcdb-b008-45a9-9c68-5c596111091f,network=Network(f812ec4b-c0a0-4d6c-84e9-5b50199ad17a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce91bcdb-b0') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:56:38 user nova-compute[72362]: DEBUG nova.objects.instance [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lazy-loading 'pci_devices' on Instance uuid dd3c8516-66cf-4a07-bb05-3608fd2cb5c4 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:56:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:56:38 user nova-compute[72362]:   <uuid>dd3c8516-66cf-4a07-bb05-3608fd2cb5c4</uuid>
Aug 09 10:56:38 user nova-compute[72362]:   <name>instance-00000032</name>
Aug 09 10:56:38 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:56:38 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:56:38 user nova-compute[72362]:   <metadata>
Aug 09 10:56:38 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:56:38 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:56:38 user nova-compute[72362]:       <nova:name>tempest-TestMinimumBasicScenario-server-1983830734</nova:name>
Aug 09 10:56:38 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:56:38</nova:creationTime>
Aug 09 10:56:38 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:56:38 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:56:38 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:56:38 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:56:38 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:56:38 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:56:38 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:56:38 user nova-compute[72362]:       <nova:owner>
Aug 09 10:56:38 user nova-compute[72362]:         <nova:user uuid="191f1c4d430949899c90b08f00aefd7e">tempest-TestMinimumBasicScenario-673917805-project-member</nova:user>
Aug 09 10:56:38 user nova-compute[72362]:         <nova:project uuid="09af0e64509144b28ebccba3d90aee65">tempest-TestMinimumBasicScenario-673917805</nova:project>
Aug 09 10:56:38 user nova-compute[72362]:       </nova:owner>
Aug 09 10:56:38 user nova-compute[72362]:       <nova:root type="image" uuid="87c9723c-ac63-4cff-bea1-0727e518ee00"/>
Aug 09 10:56:38 user nova-compute[72362]:       <nova:ports>
Aug 09 10:56:38 user nova-compute[72362]:         <nova:port uuid="ce91bcdb-b008-45a9-9c68-5c596111091f">
Aug 09 10:56:38 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 10:56:38 user nova-compute[72362]:         </nova:port>
Aug 09 10:56:38 user nova-compute[72362]:       </nova:ports>
Aug 09 10:56:38 user nova-compute[72362]:     </nova:instance>
Aug 09 10:56:38 user nova-compute[72362]:   </metadata>
Aug 09 10:56:38 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:56:38 user nova-compute[72362]:     <system>
Aug 09 10:56:38 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:56:38 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:56:38 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:56:38 user nova-compute[72362]:       <entry name="serial">dd3c8516-66cf-4a07-bb05-3608fd2cb5c4</entry>
Aug 09 10:56:38 user nova-compute[72362]:       <entry name="uuid">dd3c8516-66cf-4a07-bb05-3608fd2cb5c4</entry>
Aug 09 10:56:38 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:56:38 user nova-compute[72362]:     </system>
Aug 09 10:56:38 user nova-compute[72362]:   </sysinfo>
Aug 09 10:56:38 user nova-compute[72362]:   <os>
Aug 09 10:56:38 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:56:38 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:56:38 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:56:38 user nova-compute[72362]:   </os>
Aug 09 10:56:38 user nova-compute[72362]:   <features>
Aug 09 10:56:38 user nova-compute[72362]:     <acpi/>
Aug 09 10:56:38 user nova-compute[72362]:     <apic/>
Aug 09 10:56:38 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:56:38 user nova-compute[72362]:   </features>
Aug 09 10:56:38 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:56:38 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:56:38 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:56:38 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:56:38 user nova-compute[72362]:   </clock>
Aug 09 10:56:38 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:56:38 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:56:38 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:56:38 user nova-compute[72362]:   </cpu>
Aug 09 10:56:38 user nova-compute[72362]:   <devices>
Aug 09 10:56:38 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:56:38 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:56:38 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/dd3c8516-66cf-4a07-bb05-3608fd2cb5c4/disk"/>
Aug 09 10:56:38 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:56:38 user nova-compute[72362]:     </disk>
Aug 09 10:56:38 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:56:38 user nova-compute[72362]:       <mac address="fa:16:3e:c4:3a:1b"/>
Aug 09 10:56:38 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:56:38 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:56:38 user nova-compute[72362]:       <target dev="tapce91bcdb-b0"/>
Aug 09 10:56:38 user nova-compute[72362]:     </interface>
Aug 09 10:56:38 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:56:38 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/dd3c8516-66cf-4a07-bb05-3608fd2cb5c4/console.log" append="off"/>
Aug 09 10:56:38 user nova-compute[72362]:     </serial>
Aug 09 10:56:38 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:56:38 user nova-compute[72362]:     <video>
Aug 09 10:56:38 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:56:38 user nova-compute[72362]:     </video>
Aug 09 10:56:38 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:56:38 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:56:38 user nova-compute[72362]:     </rng>
Aug 09 10:56:38 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:56:38 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:56:38 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:56:38 user nova-compute[72362]:     </memballoon>
Aug 09 10:56:38 user nova-compute[72362]:   </devices>
Aug 09 10:56:38 user nova-compute[72362]: </domain>
Aug 09 10:56:38 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:56:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:56:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1983830734',display_name='tempest-TestMinimumBasicScenario-server-1983830734',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1983830734',id=50,image_ref='87c9723c-ac63-4cff-bea1-0727e518ee00',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjd7zo6+sqTrdhNBsHe4adte2ZBACSCbCQi6XDW4qOuoD6kQFT9u3zFYOeUMnHPxXBjhN6VslITy0d03mQLz3n5vC0674qFICJqzPR2oI6z11ZT1yVIQW5wYnWMD5SE4Q==',key_name='tempest-TestMinimumBasicScenario-230225336',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09af0e64509144b28ebccba3d90aee65',ramdisk_id='',reservation_id='r-0hkkepkh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='87c9723c-ac63-4cff-bea1-0727e518ee00',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-673917805',owner_user_name='tempest-TestMinimumBasicScenario-673917805-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:56:36Z,user_data=None,user_id='191f1c4d430949899c90b08f00aefd7e',uuid=dd3c8516-66cf-4a07-bb05-3608fd2cb5c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce91bcdb-b008-45a9-9c68-5c596111091f", "address": "fa:16:3e:c4:3a:1b", "network": {"id": "f812ec4b-c0a0-4d6c-84e9-5b50199ad17a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2039781156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09af0e64509144b28ebccba3d90aee65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce91bcdb-b0", "ovs_interfaceid": "ce91bcdb-b008-45a9-9c68-5c596111091f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:56:38 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Converting VIF {"id": "ce91bcdb-b008-45a9-9c68-5c596111091f", "address": "fa:16:3e:c4:3a:1b", "network": {"id": "f812ec4b-c0a0-4d6c-84e9-5b50199ad17a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2039781156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09af0e64509144b28ebccba3d90aee65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce91bcdb-b0", "ovs_interfaceid": "ce91bcdb-b008-45a9-9c68-5c596111091f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:56:38 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:3a:1b,bridge_name='br-int',has_traffic_filtering=True,id=ce91bcdb-b008-45a9-9c68-5c596111091f,network=Network(f812ec4b-c0a0-4d6c-84e9-5b50199ad17a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce91bcdb-b0') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:56:38 user nova-compute[72362]: DEBUG os_vif [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:3a:1b,bridge_name='br-int',has_traffic_filtering=True,id=ce91bcdb-b008-45a9-9c68-5c596111091f,network=Network(f812ec4b-c0a0-4d6c-84e9-5b50199ad17a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce91bcdb-b0') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:56:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:56:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:56:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:56:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:56:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce91bcdb-b0, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:56:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapce91bcdb-b0, col_values=(('external_ids', {'iface-id': 'ce91bcdb-b008-45a9-9c68-5c596111091f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:3a:1b', 'vm-uuid': 'dd3c8516-66cf-4a07-bb05-3608fd2cb5c4'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:56:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:56:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:56:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:56:38 user nova-compute[72362]: INFO os_vif [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:3a:1b,bridge_name='br-int',has_traffic_filtering=True,id=ce91bcdb-b008-45a9-9c68-5c596111091f,network=Network(f812ec4b-c0a0-4d6c-84e9-5b50199ad17a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce91bcdb-b0')
Aug 09 10:56:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:56:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] No VIF found with MAC fa:16:3e:c4:3a:1b, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:56:38 user nova-compute[72362]: DEBUG nova.network.neutron [req-31fe8264-9673-4ac7-9000-dda992075fae req-2627f358-ad8e-47dd-95b3-fd96947829f0 service nova] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Updated VIF entry in instance network info cache for port ce91bcdb-b008-45a9-9c68-5c596111091f. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:56:38 user nova-compute[72362]: DEBUG nova.network.neutron [req-31fe8264-9673-4ac7-9000-dda992075fae req-2627f358-ad8e-47dd-95b3-fd96947829f0 service nova] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Updating instance_info_cache with network_info: [{"id": "ce91bcdb-b008-45a9-9c68-5c596111091f", "address": "fa:16:3e:c4:3a:1b", "network": {"id": "f812ec4b-c0a0-4d6c-84e9-5b50199ad17a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2039781156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09af0e64509144b28ebccba3d90aee65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce91bcdb-b0", "ovs_interfaceid": "ce91bcdb-b008-45a9-9c68-5c596111091f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:56:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-31fe8264-9673-4ac7-9000-dda992075fae req-2627f358-ad8e-47dd-95b3-fd96947829f0 service nova] Releasing lock "refresh_cache-dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:56:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:56:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:56:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:56:40 user nova-compute[72362]: DEBUG nova.compute.manager [req-3c1b6ab6-0a72-45cf-a1bf-e8b29dec8932 req-bbd43df9-315a-4d73-80ea-95a53843e3b6 service nova] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Received event network-vif-plugged-ce91bcdb-b008-45a9-9c68-5c596111091f {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:56:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3c1b6ab6-0a72-45cf-a1bf-e8b29dec8932 req-bbd43df9-315a-4d73-80ea-95a53843e3b6 service nova] Acquiring lock "dd3c8516-66cf-4a07-bb05-3608fd2cb5c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:56:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3c1b6ab6-0a72-45cf-a1bf-e8b29dec8932 req-bbd43df9-315a-4d73-80ea-95a53843e3b6 service nova] Lock "dd3c8516-66cf-4a07-bb05-3608fd2cb5c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:56:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-3c1b6ab6-0a72-45cf-a1bf-e8b29dec8932 req-bbd43df9-315a-4d73-80ea-95a53843e3b6 service nova] Lock "dd3c8516-66cf-4a07-bb05-3608fd2cb5c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:56:40 user nova-compute[72362]: DEBUG nova.compute.manager [req-3c1b6ab6-0a72-45cf-a1bf-e8b29dec8932 req-bbd43df9-315a-4d73-80ea-95a53843e3b6 service nova] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] No waiting events found dispatching network-vif-plugged-ce91bcdb-b008-45a9-9c68-5c596111091f {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:56:40 user nova-compute[72362]: WARNING nova.compute.manager [req-3c1b6ab6-0a72-45cf-a1bf-e8b29dec8932 req-bbd43df9-315a-4d73-80ea-95a53843e3b6 service nova] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Received unexpected event network-vif-plugged-ce91bcdb-b008-45a9-9c68-5c596111091f for instance with vm_state building and task_state spawning.
Aug 09 10:56:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:56:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:56:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:56:42 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691578602.0362058, dd3c8516-66cf-4a07-bb05-3608fd2cb5c4 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:56:42 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] VM Resumed (Lifecycle Event)
Aug 09 10:56:42 user nova-compute[72362]: DEBUG nova.compute.manager [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:56:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 10:56:42 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Instance spawned successfully.
Aug 09 10:56:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 10:56:42 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:56:42 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:56:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Found default for hw_cdrom_bus of ide {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:56:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Found default for hw_disk_bus of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:56:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:56:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:56:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Found default for hw_video_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:56:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Found default for hw_vif_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 10:56:42 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:56:42 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691578602.037938, dd3c8516-66cf-4a07-bb05-3608fd2cb5c4 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:56:42 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] VM Started (Lifecycle Event)
Aug 09 10:56:42 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:56:42 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:56:42 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 10:56:42 user nova-compute[72362]: INFO nova.compute.manager [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Took 6.38 seconds to spawn the instance on the hypervisor.
Aug 09 10:56:42 user nova-compute[72362]: DEBUG nova.compute.manager [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:56:42 user nova-compute[72362]: DEBUG nova.compute.manager [req-e5de8ebe-abbc-43aa-b311-659897885df0 req-b2fcdbab-868d-482b-a508-1d819bf995d6 service nova] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Received event network-vif-plugged-ce91bcdb-b008-45a9-9c68-5c596111091f {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:56:42 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e5de8ebe-abbc-43aa-b311-659897885df0 req-b2fcdbab-868d-482b-a508-1d819bf995d6 service nova] Acquiring lock "dd3c8516-66cf-4a07-bb05-3608fd2cb5c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:56:42 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e5de8ebe-abbc-43aa-b311-659897885df0 req-b2fcdbab-868d-482b-a508-1d819bf995d6 service nova] Lock "dd3c8516-66cf-4a07-bb05-3608fd2cb5c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:56:42 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e5de8ebe-abbc-43aa-b311-659897885df0 req-b2fcdbab-868d-482b-a508-1d819bf995d6 service nova] Lock "dd3c8516-66cf-4a07-bb05-3608fd2cb5c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:56:42 user nova-compute[72362]: DEBUG nova.compute.manager [req-e5de8ebe-abbc-43aa-b311-659897885df0 req-b2fcdbab-868d-482b-a508-1d819bf995d6 service nova] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] No waiting events found dispatching network-vif-plugged-ce91bcdb-b008-45a9-9c68-5c596111091f {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:56:42 user nova-compute[72362]: WARNING nova.compute.manager [req-e5de8ebe-abbc-43aa-b311-659897885df0 req-b2fcdbab-868d-482b-a508-1d819bf995d6 service nova] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Received unexpected event network-vif-plugged-ce91bcdb-b008-45a9-9c68-5c596111091f for instance with vm_state building and task_state spawning.
Aug 09 10:56:42 user nova-compute[72362]: INFO nova.compute.manager [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Took 7.11 seconds to build instance.
Aug 09 10:56:42 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-aabda56c-541b-4476-ab7c-87f3491fcfb6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.212s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:56:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:56:43 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:56:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:56:48 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:56:53 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:56:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:56:58 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:57:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:57:03 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:57:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:57:08 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:57:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:57:13 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:57:18 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:57:21 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:57:23 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:57:25 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:57:25 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 10:57:25 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Rebuilding the list of instances to heal {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 10:57:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "refresh_cache-dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:57:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquired lock "refresh_cache-dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:57:26 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Forcefully refreshing network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 10:57:26 user nova-compute[72362]: DEBUG nova.objects.instance [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lazy-loading 'info_cache' on Instance uuid dd3c8516-66cf-4a07-bb05-3608fd2cb5c4 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:57:26 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Updating instance_info_cache with network_info: [{"id": "ce91bcdb-b008-45a9-9c68-5c596111091f", "address": "fa:16:3e:c4:3a:1b", "network": {"id": "f812ec4b-c0a0-4d6c-84e9-5b50199ad17a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2039781156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09af0e64509144b28ebccba3d90aee65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce91bcdb-b0", "ovs_interfaceid": "ce91bcdb-b008-45a9-9c68-5c596111091f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:57:26 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Releasing lock "refresh_cache-dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:57:26 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Updated the network info_cache for instance {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 10:57:26 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:57:27 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:57:27 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 10:57:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:57:28 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:57:29 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:57:30 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:57:30 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:57:31 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:57:33 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:57:33 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:57:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:57:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:57:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:57:34 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 10:57:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd3c8516-66cf-4a07-bb05-3608fd2cb5c4/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:57:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd3c8516-66cf-4a07-bb05-3608fd2cb5c4/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:57:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd3c8516-66cf-4a07-bb05-3608fd2cb5c4/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:57:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd3c8516-66cf-4a07-bb05-3608fd2cb5c4/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:57:34 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:57:34 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:57:34 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=8856MB free_disk=24.98052978515625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 10:57:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:57:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:57:34 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance dd3c8516-66cf-4a07-bb05-3608fd2cb5c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:57:34 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 10:57:34 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 10:57:34 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Refreshing inventories for resource provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 10:57:35 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Updating ProviderTree inventory for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 10:57:35 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Updating inventory in ProviderTree for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 10:57:35 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Refreshing aggregate associations for resource provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d, aggregates: None {{(pid=72362) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 10:57:35 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Refreshing trait associations for resource provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE41,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=72362) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 10:57:35 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:57:35 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:57:35 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 10:57:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.417s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:57:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:57:43 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:57:47 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:57:47 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Cleaning up deleted instances {{(pid=72362) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 10:57:47 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] There are 0 instances to clean {{(pid=72362) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 10:57:48 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:57:48 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:57:48 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 10:57:48 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 10:57:48 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 10:57:48 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:57:53 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:57:54 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:57:54 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72362) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 10:57:58 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:58:03 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:58:08 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:58:13 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:58:18 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:58:22 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:58:23 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:58:26 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:58:26 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 10:58:26 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Rebuilding the list of instances to heal {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 10:58:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "refresh_cache-dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:58:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquired lock "refresh_cache-dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:58:27 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Forcefully refreshing network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 10:58:27 user nova-compute[72362]: DEBUG nova.objects.instance [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lazy-loading 'info_cache' on Instance uuid dd3c8516-66cf-4a07-bb05-3608fd2cb5c4 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:58:27 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Updating instance_info_cache with network_info: [{"id": "ce91bcdb-b008-45a9-9c68-5c596111091f", "address": "fa:16:3e:c4:3a:1b", "network": {"id": "f812ec4b-c0a0-4d6c-84e9-5b50199ad17a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2039781156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09af0e64509144b28ebccba3d90aee65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce91bcdb-b0", "ovs_interfaceid": "ce91bcdb-b008-45a9-9c68-5c596111091f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:58:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Releasing lock "refresh_cache-dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:58:27 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Updated the network info_cache for instance {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 10:58:27 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:58:27 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:58:27 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 10:58:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:58:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-58544ec3-9274-4cdc-b8a1-ff5da2d4192a tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Acquiring lock "dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:58:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-58544ec3-9274-4cdc-b8a1-ff5da2d4192a tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:58:29 user nova-compute[72362]: DEBUG nova.objects.instance [None req-58544ec3-9274-4cdc-b8a1-ff5da2d4192a tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lazy-loading 'flavor' on Instance uuid dd3c8516-66cf-4a07-bb05-3608fd2cb5c4 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:58:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-58544ec3-9274-4cdc-b8a1-ff5da2d4192a tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:58:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-58544ec3-9274-4cdc-b8a1-ff5da2d4192a tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Acquiring lock "dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:58:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-58544ec3-9274-4cdc-b8a1-ff5da2d4192a tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:58:29 user nova-compute[72362]: INFO nova.compute.manager [None req-58544ec3-9274-4cdc-b8a1-ff5da2d4192a tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Attaching volume 8c898a97-4cd3-4760-b3fe-a1444d78003e to /dev/vdb
Aug 09 10:58:29 user nova-compute[72362]: DEBUG os_brick.utils [None req-58544ec3-9274-4cdc-b8a1-ff5da2d4192a tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:58:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:58:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:58:29 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab83a6d-1966-489b-bf26-223027a462f0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:58:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:58:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:58:29 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95f82ca-0767-4b22-aab1-4a0cc3e11c91]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:58:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:58:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:58:29 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[102d0f89-5e7c-42cd-833c-368413911bca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:58:29 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb5fe80-3587-49a4-a892-a07d5f5cf3f3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:58:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-58544ec3-9274-4cdc-b8a1-ff5da2d4192a tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:58:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-58544ec3-9274-4cdc-b8a1-ff5da2d4192a tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:58:29 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-58544ec3-9274-4cdc-b8a1-ff5da2d4192a tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 10:58:29 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:58:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 10:58:30 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 10:58:30 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc11b00-f7c3-4181-9804-b9a42194d7ed]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:58:30 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-58544ec3-9274-4cdc-b8a1-ff5da2d4192a tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 10:58:30 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-58544ec3-9274-4cdc-b8a1-ff5da2d4192a tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 10:58:30 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-58544ec3-9274-4cdc-b8a1-ff5da2d4192a tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 10:58:30 user nova-compute[72362]: DEBUG os_brick.utils [None req-58544ec3-9274-4cdc-b8a1-ff5da2d4192a tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:58:30 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-58544ec3-9274-4cdc-b8a1-ff5da2d4192a tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Updating existing volume attachment record: cbd84968-b68e-40b0-9250-63f8d43baf32 {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 10:58:30 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:58:30 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:58:31 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:58:32 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:58:33 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:58:33 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:58:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:58:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:58:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:58:34 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 10:58:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd3c8516-66cf-4a07-bb05-3608fd2cb5c4/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:58:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd3c8516-66cf-4a07-bb05-3608fd2cb5c4/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:58:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd3c8516-66cf-4a07-bb05-3608fd2cb5c4/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:58:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd3c8516-66cf-4a07-bb05-3608fd2cb5c4/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:58:34 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:58:34 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:58:34 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=8846MB free_disk=24.979785919189453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 10:58:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:58:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:58:34 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance dd3c8516-66cf-4a07-bb05-3608fd2cb5c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:58:34 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 10:58:34 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 10:58:34 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:58:34 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:58:34 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 10:58:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:58:37 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58544ec3-9274-4cdc-b8a1-ff5da2d4192a tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:58:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-58544ec3-9274-4cdc-b8a1-ff5da2d4192a tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AkHfpyJd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:58:37 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-58544ec3-9274-4cdc-b8a1-ff5da2d4192a tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:58:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-58544ec3-9274-4cdc-b8a1-ff5da2d4192a tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:58:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-58544ec3-9274-4cdc-b8a1-ff5da2d4192a tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:58:37 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-58544ec3-9274-4cdc-b8a1-ff5da2d4192a tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:58:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-58544ec3-9274-4cdc-b8a1-ff5da2d4192a tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:58:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-58544ec3-9274-4cdc-b8a1-ff5da2d4192a tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:58:37 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-58544ec3-9274-4cdc-b8a1-ff5da2d4192a tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:58:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:58:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:58:37 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[997ecae5-17b9-410a-ae77-4b026fd6faf0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:58:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-58544ec3-9274-4cdc-b8a1-ff5da2d4192a tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:58:37 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:58:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:58:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:58:37 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[416c4438-13fd-4bec-8656-ab16a0ab3ebe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:58:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-58544ec3-9274-4cdc-b8a1-ff5da2d4192a tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e] added
Aug 09 10:58:37 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:58:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:58:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:58:37 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[26dc2c0b-c50e-4b6e-996c-f4e07f334390]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:58:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-58544ec3-9274-4cdc-b8a1-ff5da2d4192a tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:58:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:58:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:58:37 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6eb7c3-06d0-4a69-94c7-c7085b55177c]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:58:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-58544ec3-9274-4cdc-b8a1-ff5da2d4192a tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:58:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AkHfpyJd {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:58:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AkHfpyJd" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:58:37 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c46a3cd-4281-40ca-abc4-51226b01d1b1]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:58:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-58544ec3-9274-4cdc-b8a1-ff5da2d4192a tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AkHfpyJd'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:58:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:58:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:58:37 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb852a8b-9880-4116-94b1-b35488a5d4dd]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:58:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-58544ec3-9274-4cdc-b8a1-ff5da2d4192a tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:58:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:58:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:58:37 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[92272400-5097-4651-8127-cbe0d7af8f8b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:58:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-58544ec3-9274-4cdc-b8a1-ff5da2d4192a tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 10:58:37 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:58:37 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-58544ec3-9274-4cdc-b8a1-ff5da2d4192a tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 10:58:37 user nova-compute[72362]:  {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:58:37 user nova-compute[72362]: WARNING os_brick.initiator.connectors.iscsi [None req-58544ec3-9274-4cdc-b8a1-ff5da2d4192a tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 10:58:37 user nova-compute[72362]: 
Aug 09 10:58:37 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:58:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:58:38 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad275cc9-a985-45da-8f75-5aef3faf3594]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:58:38 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-58544ec3-9274-4cdc-b8a1-ff5da2d4192a tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e, portal: 172.16.0.220,3260]
Aug 09 10:58:38 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e, portal: 172.16.0.220,3260] successful.
Aug 09 10:58:38 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:58:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:58:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:58:38 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1ccc2b-9a9b-417e-a9c4-7cb3f4ec54ef]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:58:38 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-58544ec3-9274-4cdc-b8a1-ff5da2d4192a tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:58:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:58:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:58:38 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[236bafaf-1af0-44ca-a16f-6abba91aedd3]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:58:38 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-58544ec3-9274-4cdc-b8a1-ff5da2d4192a tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e (non-flash)
Aug 09 10:58:38 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:58:38 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-58544ec3-9274-4cdc-b8a1-ff5da2d4192a tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e (non-flash)
Aug 09 10:58:38 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:58:38 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-58544ec3-9274-4cdc-b8a1-ff5da2d4192a tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:58:38 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-58544ec3-9274-4cdc-b8a1-ff5da2d4192a tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:58:38 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-58544ec3-9274-4cdc-b8a1-ff5da2d4192a tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:58:38 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-58544ec3-9274-4cdc-b8a1-ff5da2d4192a tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:58:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:58:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:58:38 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38b86c4-e684-4d0a-8104-25a89394f1a4]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:58:38 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-58544ec3-9274-4cdc-b8a1-ff5da2d4192a tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:58:38 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-58544ec3-9274-4cdc-b8a1-ff5da2d4192a tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AkHfpyJd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:58:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:58:39 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-58544ec3-9274-4cdc-b8a1-ff5da2d4192a tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:58:39 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-58544ec3-9274-4cdc-b8a1-ff5da2d4192a tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '23161653462343036', 'path': '/dev/sdb'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:58:39 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58544ec3-9274-4cdc-b8a1-ff5da2d4192a tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161653462343036', 'path': '/dev/sdb'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:58:39 user nova-compute[72362]: DEBUG nova.objects.instance [None req-58544ec3-9274-4cdc-b8a1-ff5da2d4192a tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lazy-loading 'flavor' on Instance uuid dd3c8516-66cf-4a07-bb05-3608fd2cb5c4 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:58:39 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-58544ec3-9274-4cdc-b8a1-ff5da2d4192a tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 10:58:39 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:58:39 user nova-compute[72362]:   <source dev="/dev/sdb"/>
Aug 09 10:58:39 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 10:58:39 user nova-compute[72362]:   <serial>8c898a97-4cd3-4760-b3fe-a1444d78003e</serial>
Aug 09 10:58:39 user nova-compute[72362]: </disk>
Aug 09 10:58:39 user nova-compute[72362]:  {{(pid=72362) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 10:58:39 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-58544ec3-9274-4cdc-b8a1-ff5da2d4192a tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:58:39 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-58544ec3-9274-4cdc-b8a1-ff5da2d4192a tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 10:58:39 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-58544ec3-9274-4cdc-b8a1-ff5da2d4192a tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] No VIF found with MAC fa:16:3e:c4:3a:1b, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 10:58:39 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-58544ec3-9274-4cdc-b8a1-ff5da2d4192a tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.933s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:58:40 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:58:43 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:58:48 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:58:48 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:58:49 user nova-compute[72362]: DEBUG nova.compute.manager [req-8b84b057-319e-454e-ae0f-15943289a045 req-f9f3e78d-8eec-40ed-8b41-800d89567ae2 service nova] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Received event network-changed-ce91bcdb-b008-45a9-9c68-5c596111091f {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:58:49 user nova-compute[72362]: DEBUG nova.compute.manager [req-8b84b057-319e-454e-ae0f-15943289a045 req-f9f3e78d-8eec-40ed-8b41-800d89567ae2 service nova] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Refreshing instance network info cache due to event network-changed-ce91bcdb-b008-45a9-9c68-5c596111091f. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:58:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8b84b057-319e-454e-ae0f-15943289a045 req-f9f3e78d-8eec-40ed-8b41-800d89567ae2 service nova] Acquiring lock "refresh_cache-dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:58:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8b84b057-319e-454e-ae0f-15943289a045 req-f9f3e78d-8eec-40ed-8b41-800d89567ae2 service nova] Acquired lock "refresh_cache-dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:58:49 user nova-compute[72362]: DEBUG nova.network.neutron [req-8b84b057-319e-454e-ae0f-15943289a045 req-f9f3e78d-8eec-40ed-8b41-800d89567ae2 service nova] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Refreshing network info cache for port ce91bcdb-b008-45a9-9c68-5c596111091f {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:58:50 user nova-compute[72362]: DEBUG nova.network.neutron [req-8b84b057-319e-454e-ae0f-15943289a045 req-f9f3e78d-8eec-40ed-8b41-800d89567ae2 service nova] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Updated VIF entry in instance network info cache for port ce91bcdb-b008-45a9-9c68-5c596111091f. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:58:50 user nova-compute[72362]: DEBUG nova.network.neutron [req-8b84b057-319e-454e-ae0f-15943289a045 req-f9f3e78d-8eec-40ed-8b41-800d89567ae2 service nova] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Updating instance_info_cache with network_info: [{"id": "ce91bcdb-b008-45a9-9c68-5c596111091f", "address": "fa:16:3e:c4:3a:1b", "network": {"id": "f812ec4b-c0a0-4d6c-84e9-5b50199ad17a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2039781156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09af0e64509144b28ebccba3d90aee65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce91bcdb-b0", "ovs_interfaceid": "ce91bcdb-b008-45a9-9c68-5c596111091f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:58:50 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8b84b057-319e-454e-ae0f-15943289a045 req-f9f3e78d-8eec-40ed-8b41-800d89567ae2 service nova] Releasing lock "refresh_cache-dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:58:51 user nova-compute[72362]: DEBUG nova.compute.manager [req-09a432a1-625e-4ad8-b32c-b4ad4e8c4522 req-30e366a6-8991-4c16-93d8-3c5b278cc2b2 service nova] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Received event network-changed-ce91bcdb-b008-45a9-9c68-5c596111091f {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:58:51 user nova-compute[72362]: DEBUG nova.compute.manager [req-09a432a1-625e-4ad8-b32c-b4ad4e8c4522 req-30e366a6-8991-4c16-93d8-3c5b278cc2b2 service nova] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Refreshing instance network info cache due to event network-changed-ce91bcdb-b008-45a9-9c68-5c596111091f. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 10:58:51 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-09a432a1-625e-4ad8-b32c-b4ad4e8c4522 req-30e366a6-8991-4c16-93d8-3c5b278cc2b2 service nova] Acquiring lock "refresh_cache-dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:58:51 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-09a432a1-625e-4ad8-b32c-b4ad4e8c4522 req-30e366a6-8991-4c16-93d8-3c5b278cc2b2 service nova] Acquired lock "refresh_cache-dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:58:51 user nova-compute[72362]: DEBUG nova.network.neutron [req-09a432a1-625e-4ad8-b32c-b4ad4e8c4522 req-30e366a6-8991-4c16-93d8-3c5b278cc2b2 service nova] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Refreshing network info cache for port ce91bcdb-b008-45a9-9c68-5c596111091f {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 10:58:52 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:58:52 user nova-compute[72362]: DEBUG nova.network.neutron [req-09a432a1-625e-4ad8-b32c-b4ad4e8c4522 req-30e366a6-8991-4c16-93d8-3c5b278cc2b2 service nova] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Updated VIF entry in instance network info cache for port ce91bcdb-b008-45a9-9c68-5c596111091f. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 10:58:52 user nova-compute[72362]: DEBUG nova.network.neutron [req-09a432a1-625e-4ad8-b32c-b4ad4e8c4522 req-30e366a6-8991-4c16-93d8-3c5b278cc2b2 service nova] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Updating instance_info_cache with network_info: [{"id": "ce91bcdb-b008-45a9-9c68-5c596111091f", "address": "fa:16:3e:c4:3a:1b", "network": {"id": "f812ec4b-c0a0-4d6c-84e9-5b50199ad17a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2039781156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09af0e64509144b28ebccba3d90aee65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce91bcdb-b0", "ovs_interfaceid": "ce91bcdb-b008-45a9-9c68-5c596111091f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:58:52 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-09a432a1-625e-4ad8-b32c-b4ad4e8c4522 req-30e366a6-8991-4c16-93d8-3c5b278cc2b2 service nova] Releasing lock "refresh_cache-dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:58:53 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:58:56 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Acquiring lock "dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:58:56 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:58:56 user nova-compute[72362]: INFO nova.compute.manager [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Rebooting instance
Aug 09 10:58:56 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Acquiring lock "refresh_cache-dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:58:56 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Acquired lock "refresh_cache-dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:58:56 user nova-compute[72362]: DEBUG nova.network.neutron [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 10:58:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:58:58 user nova-compute[72362]: DEBUG nova.network.neutron [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Updating instance_info_cache with network_info: [{"id": "ce91bcdb-b008-45a9-9c68-5c596111091f", "address": "fa:16:3e:c4:3a:1b", "network": {"id": "f812ec4b-c0a0-4d6c-84e9-5b50199ad17a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2039781156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09af0e64509144b28ebccba3d90aee65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce91bcdb-b0", "ovs_interfaceid": "ce91bcdb-b008-45a9-9c68-5c596111091f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:58:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Releasing lock "refresh_cache-dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:58:58 user nova-compute[72362]: DEBUG nova.compute.manager [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:58:58 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:58:58 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:58:58 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:58:58 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:58:58 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:58:58 user nova-compute[72362]: DEBUG nova.compute.manager [req-11b1cd81-a6cd-442d-be6d-dc31a6a4b7f6 req-1ea8023f-79c1-4c6a-8d9a-4cc8daf26e95 service nova] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Received event network-vif-unplugged-ce91bcdb-b008-45a9-9c68-5c596111091f {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:58:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-11b1cd81-a6cd-442d-be6d-dc31a6a4b7f6 req-1ea8023f-79c1-4c6a-8d9a-4cc8daf26e95 service nova] Acquiring lock "dd3c8516-66cf-4a07-bb05-3608fd2cb5c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:58:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-11b1cd81-a6cd-442d-be6d-dc31a6a4b7f6 req-1ea8023f-79c1-4c6a-8d9a-4cc8daf26e95 service nova] Lock "dd3c8516-66cf-4a07-bb05-3608fd2cb5c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:58:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-11b1cd81-a6cd-442d-be6d-dc31a6a4b7f6 req-1ea8023f-79c1-4c6a-8d9a-4cc8daf26e95 service nova] Lock "dd3c8516-66cf-4a07-bb05-3608fd2cb5c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:58:58 user nova-compute[72362]: DEBUG nova.compute.manager [req-11b1cd81-a6cd-442d-be6d-dc31a6a4b7f6 req-1ea8023f-79c1-4c6a-8d9a-4cc8daf26e95 service nova] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] No waiting events found dispatching network-vif-unplugged-ce91bcdb-b008-45a9-9c68-5c596111091f {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:58:58 user nova-compute[72362]: WARNING nova.compute.manager [req-11b1cd81-a6cd-442d-be6d-dc31a6a4b7f6 req-1ea8023f-79c1-4c6a-8d9a-4cc8daf26e95 service nova] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Received unexpected event network-vif-unplugged-ce91bcdb-b008-45a9-9c68-5c596111091f for instance with vm_state active and task_state reboot_started_hard.
Aug 09 10:58:58 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:58:58 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Instance destroyed successfully.
Aug 09 10:58:58 user nova-compute[72362]: DEBUG nova.objects.instance [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lazy-loading 'resources' on Instance uuid dd3c8516-66cf-4a07-bb05-3608fd2cb5c4 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:58:58 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:56:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1983830734',display_name='tempest-TestMinimumBasicScenario-server-1983830734',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1983830734',id=50,image_ref='87c9723c-ac63-4cff-bea1-0727e518ee00',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjd7zo6+sqTrdhNBsHe4adte2ZBACSCbCQi6XDW4qOuoD6kQFT9u3zFYOeUMnHPxXBjhN6VslITy0d03mQLz3n5vC0674qFICJqzPR2oI6z11ZT1yVIQW5wYnWMD5SE4Q==',key_name='tempest-TestMinimumBasicScenario-230225336',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:56:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='09af0e64509144b28ebccba3d90aee65',ramdisk_id='',reservation_id='r-0hkkepkh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='87c9723c-ac63-4cff-bea1-0727e518ee00',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-673917805',owner_user_name='tempest-TestMinimumBasicScenario-673917805-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:58:58Z,user_data=None,user_id='191f1c4d430949899c90b08f00aefd7e',uuid=dd3c8516-66cf-4a07-bb05-3608fd2cb5c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce91bcdb-b008-45a9-9c68-5c596111091f", "address": "fa:16:3e:c4:3a:1b", "network": {"id": "f812ec4b-c0a0-4d6c-84e9-5b50199ad17a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2039781156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09af0e64509144b28ebccba3d90aee65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce91bcdb-b0", "ovs_interfaceid": "ce91bcdb-b008-45a9-9c68-5c596111091f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 10:58:58 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Converting VIF {"id": "ce91bcdb-b008-45a9-9c68-5c596111091f", "address": "fa:16:3e:c4:3a:1b", "network": {"id": "f812ec4b-c0a0-4d6c-84e9-5b50199ad17a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2039781156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09af0e64509144b28ebccba3d90aee65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce91bcdb-b0", "ovs_interfaceid": "ce91bcdb-b008-45a9-9c68-5c596111091f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:58:58 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:3a:1b,bridge_name='br-int',has_traffic_filtering=True,id=ce91bcdb-b008-45a9-9c68-5c596111091f,network=Network(f812ec4b-c0a0-4d6c-84e9-5b50199ad17a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce91bcdb-b0') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:58:58 user nova-compute[72362]: DEBUG os_vif [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:3a:1b,bridge_name='br-int',has_traffic_filtering=True,id=ce91bcdb-b008-45a9-9c68-5c596111091f,network=Network(f812ec4b-c0a0-4d6c-84e9-5b50199ad17a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce91bcdb-b0') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 10:58:58 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:58:58 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce91bcdb-b0, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:58:58 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:58:58 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:58:58 user nova-compute[72362]: INFO os_vif [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:3a:1b,bridge_name='br-int',has_traffic_filtering=True,id=ce91bcdb-b008-45a9-9c68-5c596111091f,network=Network(f812ec4b-c0a0-4d6c-84e9-5b50199ad17a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce91bcdb-b0')
Aug 09 10:58:58 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 10:58:58 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AkHfpyJd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:58:58 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:58:58 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:58:58 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:58:58 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 10:58:58 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef45403b-cb10-4395-97a2-a67fce53c784]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23952d5-d5e6-4eb6-be21-a5bc6c60b016]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e (non-flash)
Aug 09 10:58:59 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e (non-flash)
Aug 09 10:58:59 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34dc2b32e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e'): ({'sdb'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Removing single pathed devices sdb {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87e1d94-c0b0-463c-8897-0be70e6607e7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e7e67e-861d-4b48-9a53-2f168681810e]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Flushing IO for device /dev/sdb {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[66713be0-dde4-4072-baca-e13d24a5c02e]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[668f798a-b78c-41af-87e7-a82521cb326a]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] SCSI volumes sdb have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3565493-7c75-4c01-ba58-4795ef9e4df9]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1fbd63-cf3a-4061-a5eb-fbd691cecaf1]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e, portal: 172.16.0.220,3260]
Aug 09 10:58:59 user nova-compute[72362]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e, portal: 172.16.0.220,3260] successful.
Aug 09 10:58:59 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0fbd3a4-5dc9-4291-8d18-c380416a7d5f]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] <== disconnect_volume: return (289ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Start _get_guest_xml network_info=[{"id": "ce91bcdb-b008-45a9-9c68-5c596111091f", "address": "fa:16:3e:c4:3a:1b", "network": {"id": "f812ec4b-c0a0-4d6c-84e9-5b50199ad17a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2039781156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09af0e64509144b28ebccba3d90aee65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce91bcdb-b0", "ovs_interfaceid": "ce91bcdb-b008-45a9-9c68-5c596111091f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=87c9723c-ac63-4cff-bea1-0727e518ee00,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': '87c9723c-ac63-4cff-bea1-0727e518ee00'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'cbd84968-b68e-40b0-9250-63f8d43baf32', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AkHfpyJd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'dd3c8516-66cf-4a07-bb05-3608fd2cb5c4', 'attached_at': '', 'detached_at': '', 'volume_id': '8c898a97-4cd3-4760-b3fe-a1444d78003e', 'serial': '8c898a97-4cd3-4760-b3fe-a1444d78003e'}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 10:58:59 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:58:59 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:58:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=87c9723c-ac63-4cff-bea1-0727e518ee00,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG nova.objects.instance [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lazy-loading 'vcpu_model' on Instance uuid dd3c8516-66cf-4a07-bb05-3608fd2cb5c4 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AkHfpyJd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 10:58:59 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:58:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:58:59 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 10:58:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 10:58:59 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f642eb6a-1283-49fc-9656-7416a644cbf7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 10:58:59 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc68eca-7a74-45c9-8f83-482f407de306]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e] added
Aug 09 10:58:59 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca45e79f-1c9f-4b1e-9ac4-4a306071d248]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[833fc6bc-cf86-4c3c-ac69-c8e7e2ad95bf]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AkHfpyJd {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AkHfpyJd" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f060605d-c438-46ac-949c-325bd69ba11f]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AkHfpyJd'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31765d2-4b7d-48b4-90df-05695893fb5c]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98b8153-59b1-4a96-90c3-a3dae70e1b70]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 10:58:59 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 10:58:59 user nova-compute[72362]:  {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:58:59 user nova-compute[72362]: WARNING os_brick.initiator.connectors.iscsi [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 10:58:59 user nova-compute[72362]: 
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d43d71-656a-4a7f-981d-dbcca4ed21b4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e, portal: 172.16.0.220,3260]
Aug 09 10:58:59 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e, portal: 172.16.0.220,3260] successful.
Aug 09 10:58:59 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed1ca8b-7d39-41c1-9c40-d78644801bf3]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[108a02d9-105d-4645-8977-6990ba7a30db]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e (non-flash)
Aug 09 10:58:59 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e (non-flash)
Aug 09 10:58:59 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[7344a1be-5715-4b30-8cf8-29092ed8cc6e]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 10:58:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AkHfpyJd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 10:59:00 user nova-compute[72362]: DEBUG nova.compute.manager [req-e4ff220f-eedd-4830-b103-36a3642172c2 req-e7aa813c-dee8-4424-a6de-86c809e14add service nova] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Received event network-vif-plugged-ce91bcdb-b008-45a9-9c68-5c596111091f {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:59:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e4ff220f-eedd-4830-b103-36a3642172c2 req-e7aa813c-dee8-4424-a6de-86c809e14add service nova] Acquiring lock "dd3c8516-66cf-4a07-bb05-3608fd2cb5c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:59:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e4ff220f-eedd-4830-b103-36a3642172c2 req-e7aa813c-dee8-4424-a6de-86c809e14add service nova] Lock "dd3c8516-66cf-4a07-bb05-3608fd2cb5c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:59:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e4ff220f-eedd-4830-b103-36a3642172c2 req-e7aa813c-dee8-4424-a6de-86c809e14add service nova] Lock "dd3c8516-66cf-4a07-bb05-3608fd2cb5c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:59:00 user nova-compute[72362]: DEBUG nova.compute.manager [req-e4ff220f-eedd-4830-b103-36a3642172c2 req-e7aa813c-dee8-4424-a6de-86c809e14add service nova] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] No waiting events found dispatching network-vif-plugged-ce91bcdb-b008-45a9-9c68-5c596111091f {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:59:00 user nova-compute[72362]: WARNING nova.compute.manager [req-e4ff220f-eedd-4830-b103-36a3642172c2 req-e7aa813c-dee8-4424-a6de-86c809e14add service nova] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Received unexpected event network-vif-plugged-ce91bcdb-b008-45a9-9c68-5c596111091f for instance with vm_state active and task_state reboot_started_hard.
Aug 09 10:59:00 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 10:59:00 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23161653462343036', 'path': '/dev/sdb'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 10:59:00 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161653462343036', 'path': '/dev/sdb'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 10:59:00 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:56:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1983830734',display_name='tempest-TestMinimumBasicScenario-server-1983830734',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1983830734',id=50,image_ref='87c9723c-ac63-4cff-bea1-0727e518ee00',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjd7zo6+sqTrdhNBsHe4adte2ZBACSCbCQi6XDW4qOuoD6kQFT9u3zFYOeUMnHPxXBjhN6VslITy0d03mQLz3n5vC0674qFICJqzPR2oI6z11ZT1yVIQW5wYnWMD5SE4Q==',key_name='tempest-TestMinimumBasicScenario-230225336',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:56:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='09af0e64509144b28ebccba3d90aee65',ramdisk_id='',reservation_id='r-0hkkepkh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='87c9723c-ac63-4cff-bea1-0727e518ee00',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-673917805',owner_user_name='tempest-TestMinimumBasicScenario-673917805-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:58:58Z,user_data=None,user_id='191f1c4d430949899c90b08f00aefd7e',uuid=dd3c8516-66cf-4a07-bb05-3608fd2cb5c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce91bcdb-b008-45a9-9c68-5c596111091f", "address": "fa:16:3e:c4:3a:1b", "network": {"id": "f812ec4b-c0a0-4d6c-84e9-5b50199ad17a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2039781156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09af0e64509144b28ebccba3d90aee65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce91bcdb-b0", "ovs_interfaceid": "ce91bcdb-b008-45a9-9c68-5c596111091f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 10:59:00 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Converting VIF {"id": "ce91bcdb-b008-45a9-9c68-5c596111091f", "address": "fa:16:3e:c4:3a:1b", "network": {"id": "f812ec4b-c0a0-4d6c-84e9-5b50199ad17a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2039781156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09af0e64509144b28ebccba3d90aee65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce91bcdb-b0", "ovs_interfaceid": "ce91bcdb-b008-45a9-9c68-5c596111091f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:59:00 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:3a:1b,bridge_name='br-int',has_traffic_filtering=True,id=ce91bcdb-b008-45a9-9c68-5c596111091f,network=Network(f812ec4b-c0a0-4d6c-84e9-5b50199ad17a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce91bcdb-b0') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:59:00 user nova-compute[72362]: DEBUG nova.objects.instance [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lazy-loading 'pci_devices' on Instance uuid dd3c8516-66cf-4a07-bb05-3608fd2cb5c4 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:59:00 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] End _get_guest_xml xml=<domain type="kvm">
Aug 09 10:59:00 user nova-compute[72362]:   <uuid>dd3c8516-66cf-4a07-bb05-3608fd2cb5c4</uuid>
Aug 09 10:59:00 user nova-compute[72362]:   <name>instance-00000032</name>
Aug 09 10:59:00 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 10:59:00 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 10:59:00 user nova-compute[72362]:   <metadata>
Aug 09 10:59:00 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 10:59:00 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 10:59:00 user nova-compute[72362]:       <nova:name>tempest-TestMinimumBasicScenario-server-1983830734</nova:name>
Aug 09 10:59:00 user nova-compute[72362]:       <nova:creationTime>2023-08-09 10:58:59</nova:creationTime>
Aug 09 10:59:00 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 10:59:00 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 10:59:00 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 10:59:00 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 10:59:00 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 10:59:00 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 10:59:00 user nova-compute[72362]:       </nova:flavor>
Aug 09 10:59:00 user nova-compute[72362]:       <nova:owner>
Aug 09 10:59:00 user nova-compute[72362]:         <nova:user uuid="191f1c4d430949899c90b08f00aefd7e">tempest-TestMinimumBasicScenario-673917805-project-member</nova:user>
Aug 09 10:59:00 user nova-compute[72362]:         <nova:project uuid="09af0e64509144b28ebccba3d90aee65">tempest-TestMinimumBasicScenario-673917805</nova:project>
Aug 09 10:59:00 user nova-compute[72362]:       </nova:owner>
Aug 09 10:59:00 user nova-compute[72362]:       <nova:root type="image" uuid="87c9723c-ac63-4cff-bea1-0727e518ee00"/>
Aug 09 10:59:00 user nova-compute[72362]:       <nova:ports>
Aug 09 10:59:00 user nova-compute[72362]:         <nova:port uuid="ce91bcdb-b008-45a9-9c68-5c596111091f">
Aug 09 10:59:00 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 10:59:00 user nova-compute[72362]:         </nova:port>
Aug 09 10:59:00 user nova-compute[72362]:       </nova:ports>
Aug 09 10:59:00 user nova-compute[72362]:     </nova:instance>
Aug 09 10:59:00 user nova-compute[72362]:   </metadata>
Aug 09 10:59:00 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 10:59:00 user nova-compute[72362]:     <system>
Aug 09 10:59:00 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 10:59:00 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 10:59:00 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 10:59:00 user nova-compute[72362]:       <entry name="serial">dd3c8516-66cf-4a07-bb05-3608fd2cb5c4</entry>
Aug 09 10:59:00 user nova-compute[72362]:       <entry name="uuid">dd3c8516-66cf-4a07-bb05-3608fd2cb5c4</entry>
Aug 09 10:59:00 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 10:59:00 user nova-compute[72362]:     </system>
Aug 09 10:59:00 user nova-compute[72362]:   </sysinfo>
Aug 09 10:59:00 user nova-compute[72362]:   <os>
Aug 09 10:59:00 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 10:59:00 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 10:59:00 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 10:59:00 user nova-compute[72362]:   </os>
Aug 09 10:59:00 user nova-compute[72362]:   <features>
Aug 09 10:59:00 user nova-compute[72362]:     <acpi/>
Aug 09 10:59:00 user nova-compute[72362]:     <apic/>
Aug 09 10:59:00 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 10:59:00 user nova-compute[72362]:   </features>
Aug 09 10:59:00 user nova-compute[72362]:   <clock offset="utc">
Aug 09 10:59:00 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 10:59:00 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 10:59:00 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 10:59:00 user nova-compute[72362]:   </clock>
Aug 09 10:59:00 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 10:59:00 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 10:59:00 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 10:59:00 user nova-compute[72362]:   </cpu>
Aug 09 10:59:00 user nova-compute[72362]:   <devices>
Aug 09 10:59:00 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 10:59:00 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 10:59:00 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/dd3c8516-66cf-4a07-bb05-3608fd2cb5c4/disk"/>
Aug 09 10:59:00 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 10:59:00 user nova-compute[72362]:     </disk>
Aug 09 10:59:00 user nova-compute[72362]:     <disk type="block" device="disk">
Aug 09 10:59:00 user nova-compute[72362]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 10:59:00 user nova-compute[72362]:       <source dev="/dev/sdb"/>
Aug 09 10:59:00 user nova-compute[72362]:       <target dev="vdb" bus="virtio"/>
Aug 09 10:59:00 user nova-compute[72362]:       <serial>8c898a97-4cd3-4760-b3fe-a1444d78003e</serial>
Aug 09 10:59:00 user nova-compute[72362]:     </disk>
Aug 09 10:59:00 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 10:59:00 user nova-compute[72362]:       <mac address="fa:16:3e:c4:3a:1b"/>
Aug 09 10:59:00 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:59:00 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 10:59:00 user nova-compute[72362]:       <target dev="tapce91bcdb-b0"/>
Aug 09 10:59:00 user nova-compute[72362]:     </interface>
Aug 09 10:59:00 user nova-compute[72362]:     <serial type="pty">
Aug 09 10:59:00 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/dd3c8516-66cf-4a07-bb05-3608fd2cb5c4/console.log" append="off"/>
Aug 09 10:59:00 user nova-compute[72362]:     </serial>
Aug 09 10:59:00 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 10:59:00 user nova-compute[72362]:     <video>
Aug 09 10:59:00 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 10:59:00 user nova-compute[72362]:     </video>
Aug 09 10:59:00 user nova-compute[72362]:     <rng model="virtio">
Aug 09 10:59:00 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 10:59:00 user nova-compute[72362]:     </rng>
Aug 09 10:59:00 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 10:59:00 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 10:59:00 user nova-compute[72362]:       <stats period="10"/>
Aug 09 10:59:00 user nova-compute[72362]:     </memballoon>
Aug 09 10:59:00 user nova-compute[72362]:   </devices>
Aug 09 10:59:00 user nova-compute[72362]: </domain>
Aug 09 10:59:00 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 10:59:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd3c8516-66cf-4a07-bb05-3608fd2cb5c4/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:59:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd3c8516-66cf-4a07-bb05-3608fd2cb5c4/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:59:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd3c8516-66cf-4a07-bb05-3608fd2cb5c4/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:59:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd3c8516-66cf-4a07-bb05-3608fd2cb5c4/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:59:00 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:59:00 user nova-compute[72362]: DEBUG nova.objects.instance [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lazy-loading 'trusted_certs' on Instance uuid dd3c8516-66cf-4a07-bb05-3608fd2cb5c4 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:59:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a41d4673be03dba18331fae3785d818ca8105baf --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:59:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a41d4673be03dba18331fae3785d818ca8105baf --force-share --output=json" returned: 0 in 0.139s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:59:01 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dd3c8516-66cf-4a07-bb05-3608fd2cb5c4/disk. size=1073741824 {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 10:59:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd3c8516-66cf-4a07-bb05-3608fd2cb5c4/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:59:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd3c8516-66cf-4a07-bb05-3608fd2cb5c4/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:59:01 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Cannot resize image /opt/stack/data/nova/instances/dd3c8516-66cf-4a07-bb05-3608fd2cb5c4/disk to a smaller size. {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 10:59:01 user nova-compute[72362]: DEBUG nova.objects.instance [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lazy-loading 'migration_context' on Instance uuid dd3c8516-66cf-4a07-bb05-3608fd2cb5c4 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:59:01 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:56:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1983830734',display_name='tempest-TestMinimumBasicScenario-server-1983830734',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1983830734',id=50,image_ref='87c9723c-ac63-4cff-bea1-0727e518ee00',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjd7zo6+sqTrdhNBsHe4adte2ZBACSCbCQi6XDW4qOuoD6kQFT9u3zFYOeUMnHPxXBjhN6VslITy0d03mQLz3n5vC0674qFICJqzPR2oI6z11ZT1yVIQW5wYnWMD5SE4Q==',key_name='tempest-TestMinimumBasicScenario-230225336',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:56:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='09af0e64509144b28ebccba3d90aee65',ramdisk_id='',reservation_id='r-0hkkepkh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='87c9723c-ac63-4cff-bea1-0727e518ee00',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-673917805',owner_user_name='tempest-TestMinimumBasicScenario-673917805-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T10:58:58Z,user_data=None,user_id='191f1c4d430949899c90b08f00aefd7e',uuid=dd3c8516-66cf-4a07-bb05-3608fd2cb5c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce91bcdb-b008-45a9-9c68-5c596111091f", "address": "fa:16:3e:c4:3a:1b", "network": {"id": "f812ec4b-c0a0-4d6c-84e9-5b50199ad17a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2039781156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09af0e64509144b28ebccba3d90aee65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce91bcdb-b0", "ovs_interfaceid": "ce91bcdb-b008-45a9-9c68-5c596111091f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 10:59:01 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Converting VIF {"id": "ce91bcdb-b008-45a9-9c68-5c596111091f", "address": "fa:16:3e:c4:3a:1b", "network": {"id": "f812ec4b-c0a0-4d6c-84e9-5b50199ad17a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2039781156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09af0e64509144b28ebccba3d90aee65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce91bcdb-b0", "ovs_interfaceid": "ce91bcdb-b008-45a9-9c68-5c596111091f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 10:59:01 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:3a:1b,bridge_name='br-int',has_traffic_filtering=True,id=ce91bcdb-b008-45a9-9c68-5c596111091f,network=Network(f812ec4b-c0a0-4d6c-84e9-5b50199ad17a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce91bcdb-b0') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 10:59:01 user nova-compute[72362]: DEBUG os_vif [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:3a:1b,bridge_name='br-int',has_traffic_filtering=True,id=ce91bcdb-b008-45a9-9c68-5c596111091f,network=Network(f812ec4b-c0a0-4d6c-84e9-5b50199ad17a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce91bcdb-b0') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 10:59:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:59:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:59:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 10:59:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:59:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce91bcdb-b0, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:59:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapce91bcdb-b0, col_values=(('external_ids', {'iface-id': 'ce91bcdb-b008-45a9-9c68-5c596111091f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:3a:1b', 'vm-uuid': 'dd3c8516-66cf-4a07-bb05-3608fd2cb5c4'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 10:59:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:59:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:59:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:59:01 user nova-compute[72362]: INFO os_vif [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:3a:1b,bridge_name='br-int',has_traffic_filtering=True,id=ce91bcdb-b008-45a9-9c68-5c596111091f,network=Network(f812ec4b-c0a0-4d6c-84e9-5b50199ad17a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce91bcdb-b0')
Aug 09 10:59:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:59:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:59:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:59:02 user nova-compute[72362]: DEBUG nova.compute.manager [req-51297c50-de30-4796-95f1-b36965181fa7 req-19e7e3b3-ec2b-491e-903b-a66babb05abc service nova] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Received event network-vif-plugged-ce91bcdb-b008-45a9-9c68-5c596111091f {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:59:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-51297c50-de30-4796-95f1-b36965181fa7 req-19e7e3b3-ec2b-491e-903b-a66babb05abc service nova] Acquiring lock "dd3c8516-66cf-4a07-bb05-3608fd2cb5c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:59:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-51297c50-de30-4796-95f1-b36965181fa7 req-19e7e3b3-ec2b-491e-903b-a66babb05abc service nova] Lock "dd3c8516-66cf-4a07-bb05-3608fd2cb5c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:59:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-51297c50-de30-4796-95f1-b36965181fa7 req-19e7e3b3-ec2b-491e-903b-a66babb05abc service nova] Lock "dd3c8516-66cf-4a07-bb05-3608fd2cb5c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:59:02 user nova-compute[72362]: DEBUG nova.compute.manager [req-51297c50-de30-4796-95f1-b36965181fa7 req-19e7e3b3-ec2b-491e-903b-a66babb05abc service nova] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] No waiting events found dispatching network-vif-plugged-ce91bcdb-b008-45a9-9c68-5c596111091f {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:59:02 user nova-compute[72362]: WARNING nova.compute.manager [req-51297c50-de30-4796-95f1-b36965181fa7 req-19e7e3b3-ec2b-491e-903b-a66babb05abc service nova] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Received unexpected event network-vif-plugged-ce91bcdb-b008-45a9-9c68-5c596111091f for instance with vm_state active and task_state reboot_started_hard.
Aug 09 10:59:03 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:59:03 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:59:03 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:59:04 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Removed pending event for dd3c8516-66cf-4a07-bb05-3608fd2cb5c4 due to event {{(pid=72362) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 10:59:04 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691578744.8776252, dd3c8516-66cf-4a07-bb05-3608fd2cb5c4 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:59:04 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] VM Resumed (Lifecycle Event)
Aug 09 10:59:04 user nova-compute[72362]: DEBUG nova.compute.manager [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 10:59:04 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Instance rebooted successfully.
Aug 09 10:59:04 user nova-compute[72362]: DEBUG nova.compute.manager [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:59:04 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:59:04 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:59:04 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 09 10:59:04 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691578744.8821638, dd3c8516-66cf-4a07-bb05-3608fd2cb5c4 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 10:59:04 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] VM Started (Lifecycle Event)
Aug 09 10:59:04 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 10:59:04 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-eb6c2419-cdcd-4676-b5c0-366eddc652b2 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.013s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:59:04 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 10:59:05 user nova-compute[72362]: DEBUG nova.compute.manager [req-596ead72-d884-4b78-ae9b-357ed8804329 req-c17dbb90-ad36-4cf4-a1c7-3359e44f072a service nova] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Received event network-vif-plugged-ce91bcdb-b008-45a9-9c68-5c596111091f {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 10:59:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-596ead72-d884-4b78-ae9b-357ed8804329 req-c17dbb90-ad36-4cf4-a1c7-3359e44f072a service nova] Acquiring lock "dd3c8516-66cf-4a07-bb05-3608fd2cb5c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:59:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-596ead72-d884-4b78-ae9b-357ed8804329 req-c17dbb90-ad36-4cf4-a1c7-3359e44f072a service nova] Lock "dd3c8516-66cf-4a07-bb05-3608fd2cb5c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:59:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-596ead72-d884-4b78-ae9b-357ed8804329 req-c17dbb90-ad36-4cf4-a1c7-3359e44f072a service nova] Lock "dd3c8516-66cf-4a07-bb05-3608fd2cb5c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:59:05 user nova-compute[72362]: DEBUG nova.compute.manager [req-596ead72-d884-4b78-ae9b-357ed8804329 req-c17dbb90-ad36-4cf4-a1c7-3359e44f072a service nova] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] No waiting events found dispatching network-vif-plugged-ce91bcdb-b008-45a9-9c68-5c596111091f {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 10:59:05 user nova-compute[72362]: WARNING nova.compute.manager [req-596ead72-d884-4b78-ae9b-357ed8804329 req-c17dbb90-ad36-4cf4-a1c7-3359e44f072a service nova] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Received unexpected event network-vif-plugged-ce91bcdb-b008-45a9-9c68-5c596111091f for instance with vm_state active and task_state None.
Aug 09 10:59:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:59:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:59:11 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:59:16 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:59:21 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:59:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:59:23 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:59:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:59:26 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:59:26 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 10:59:26 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Rebuilding the list of instances to heal {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 10:59:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "refresh_cache-dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 10:59:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquired lock "refresh_cache-dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 10:59:27 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Forcefully refreshing network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 10:59:27 user nova-compute[72362]: DEBUG nova.objects.instance [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lazy-loading 'info_cache' on Instance uuid dd3c8516-66cf-4a07-bb05-3608fd2cb5c4 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 10:59:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:59:27 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Updating instance_info_cache with network_info: [{"id": "ce91bcdb-b008-45a9-9c68-5c596111091f", "address": "fa:16:3e:c4:3a:1b", "network": {"id": "f812ec4b-c0a0-4d6c-84e9-5b50199ad17a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2039781156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09af0e64509144b28ebccba3d90aee65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce91bcdb-b0", "ovs_interfaceid": "ce91bcdb-b008-45a9-9c68-5c596111091f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 10:59:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Releasing lock "refresh_cache-dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 10:59:27 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Updated the network info_cache for instance {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 10:59:27 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:59:27 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 10:59:28 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:59:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:59:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:59:32 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:59:32 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:59:33 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:59:33 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:59:35 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 10:59:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:59:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:59:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:59:35 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 10:59:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd3c8516-66cf-4a07-bb05-3608fd2cb5c4/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:59:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd3c8516-66cf-4a07-bb05-3608fd2cb5c4/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:59:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd3c8516-66cf-4a07-bb05-3608fd2cb5c4/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 10:59:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:59:36 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd3c8516-66cf-4a07-bb05-3608fd2cb5c4/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 10:59:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 10:59:36 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:59:36 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 10:59:36 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=8838MB free_disk=24.977596282958984GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 10:59:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 10:59:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 10:59:36 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance dd3c8516-66cf-4a07-bb05-3608fd2cb5c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 10:59:36 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 10:59:36 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 10:59:36 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 10:59:36 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 10:59:36 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 10:59:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.210s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 10:59:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 10:59:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:59:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 10:59:56 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:00:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:00:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:00:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 11:00:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:00:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:00:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:00:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:00:11 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:00:16 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:00:21 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:00:25 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:00:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:00:26 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:00:26 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 11:00:26 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Rebuilding the list of instances to heal {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 11:00:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "refresh_cache-dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 11:00:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquired lock "refresh_cache-dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 11:00:27 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Forcefully refreshing network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 11:00:27 user nova-compute[72362]: DEBUG nova.objects.instance [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lazy-loading 'info_cache' on Instance uuid dd3c8516-66cf-4a07-bb05-3608fd2cb5c4 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 11:00:27 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Updating instance_info_cache with network_info: [{"id": "ce91bcdb-b008-45a9-9c68-5c596111091f", "address": "fa:16:3e:c4:3a:1b", "network": {"id": "f812ec4b-c0a0-4d6c-84e9-5b50199ad17a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2039781156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09af0e64509144b28ebccba3d90aee65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce91bcdb-b0", "ovs_interfaceid": "ce91bcdb-b008-45a9-9c68-5c596111091f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 11:00:27 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Releasing lock "refresh_cache-dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 11:00:27 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Updated the network info_cache for instance {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 11:00:28 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:00:28 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 11:00:29 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:00:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:00:33 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:00:33 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:00:34 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:00:35 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:00:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:00:37 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:00:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:00:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:00:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:00:38 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 11:00:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd3c8516-66cf-4a07-bb05-3608fd2cb5c4/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:00:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd3c8516-66cf-4a07-bb05-3608fd2cb5c4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:00:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd3c8516-66cf-4a07-bb05-3608fd2cb5c4/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:00:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd3c8516-66cf-4a07-bb05-3608fd2cb5c4/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:00:38 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 11:00:38 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 11:00:38 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 11:00:38 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=8854MB free_disk=24.97698974609375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 11:00:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:00:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:00:39 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance dd3c8516-66cf-4a07-bb05-3608fd2cb5c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 11:00:39 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 11:00:39 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 11:00:39 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 11:00:39 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 11:00:39 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 11:00:39 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.211s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:00:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:00:45 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:00:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:00:48 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:00:49 user nova-compute[72362]: DEBUG nova.compute.manager [req-4d67aed7-f47f-419a-b5d2-f623e92b5f00 req-bce8e8a9-dc87-4e5d-ba8e-a231289ea57b service nova] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Received event network-changed-ce91bcdb-b008-45a9-9c68-5c596111091f {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 11:00:49 user nova-compute[72362]: DEBUG nova.compute.manager [req-4d67aed7-f47f-419a-b5d2-f623e92b5f00 req-bce8e8a9-dc87-4e5d-ba8e-a231289ea57b service nova] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Refreshing instance network info cache due to event network-changed-ce91bcdb-b008-45a9-9c68-5c596111091f. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 11:00:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-4d67aed7-f47f-419a-b5d2-f623e92b5f00 req-bce8e8a9-dc87-4e5d-ba8e-a231289ea57b service nova] Acquiring lock "refresh_cache-dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 11:00:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-4d67aed7-f47f-419a-b5d2-f623e92b5f00 req-bce8e8a9-dc87-4e5d-ba8e-a231289ea57b service nova] Acquired lock "refresh_cache-dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 11:00:49 user nova-compute[72362]: DEBUG nova.network.neutron [req-4d67aed7-f47f-419a-b5d2-f623e92b5f00 req-bce8e8a9-dc87-4e5d-ba8e-a231289ea57b service nova] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Refreshing network info cache for port ce91bcdb-b008-45a9-9c68-5c596111091f {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 11:00:49 user nova-compute[72362]: DEBUG nova.network.neutron [req-4d67aed7-f47f-419a-b5d2-f623e92b5f00 req-bce8e8a9-dc87-4e5d-ba8e-a231289ea57b service nova] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Updated VIF entry in instance network info cache for port ce91bcdb-b008-45a9-9c68-5c596111091f. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 11:00:49 user nova-compute[72362]: DEBUG nova.network.neutron [req-4d67aed7-f47f-419a-b5d2-f623e92b5f00 req-bce8e8a9-dc87-4e5d-ba8e-a231289ea57b service nova] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Updating instance_info_cache with network_info: [{"id": "ce91bcdb-b008-45a9-9c68-5c596111091f", "address": "fa:16:3e:c4:3a:1b", "network": {"id": "f812ec4b-c0a0-4d6c-84e9-5b50199ad17a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2039781156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09af0e64509144b28ebccba3d90aee65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce91bcdb-b0", "ovs_interfaceid": "ce91bcdb-b008-45a9-9c68-5c596111091f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 11:00:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-4d67aed7-f47f-419a-b5d2-f623e92b5f00 req-bce8e8a9-dc87-4e5d-ba8e-a231289ea57b service nova] Releasing lock "refresh_cache-dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 11:00:49 user nova-compute[72362]: DEBUG nova.compute.manager [req-904346f6-ae4b-43a5-98eb-942b6d80bc17 req-9ec95000-e592-4fd4-99d4-c29792c75041 service nova] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Received event network-changed-ce91bcdb-b008-45a9-9c68-5c596111091f {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 11:00:49 user nova-compute[72362]: DEBUG nova.compute.manager [req-904346f6-ae4b-43a5-98eb-942b6d80bc17 req-9ec95000-e592-4fd4-99d4-c29792c75041 service nova] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Refreshing instance network info cache due to event network-changed-ce91bcdb-b008-45a9-9c68-5c596111091f. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 11:00:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-904346f6-ae4b-43a5-98eb-942b6d80bc17 req-9ec95000-e592-4fd4-99d4-c29792c75041 service nova] Acquiring lock "refresh_cache-dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 11:00:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-904346f6-ae4b-43a5-98eb-942b6d80bc17 req-9ec95000-e592-4fd4-99d4-c29792c75041 service nova] Acquired lock "refresh_cache-dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 11:00:49 user nova-compute[72362]: DEBUG nova.network.neutron [req-904346f6-ae4b-43a5-98eb-942b6d80bc17 req-9ec95000-e592-4fd4-99d4-c29792c75041 service nova] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Refreshing network info cache for port ce91bcdb-b008-45a9-9c68-5c596111091f {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2f9f65a2-0a3a-43c5-a96d-58e1b8b73414 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Acquiring lock "dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2f9f65a2-0a3a-43c5-a96d-58e1b8b73414 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:00:50 user nova-compute[72362]: INFO nova.compute.manager [None req-2f9f65a2-0a3a-43c5-a96d-58e1b8b73414 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Detaching volume 8c898a97-4cd3-4760-b3fe-a1444d78003e
Aug 09 11:00:50 user nova-compute[72362]: INFO nova.virt.block_device [None req-2f9f65a2-0a3a-43c5-a96d-58e1b8b73414 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Attempting to driver detach volume 8c898a97-4cd3-4760-b3fe-a1444d78003e from mountpoint /dev/vdb
Aug 09 11:00:50 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-2f9f65a2-0a3a-43c5-a96d-58e1b8b73414 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Attempting to detach device vdb from instance dd3c8516-66cf-4a07-bb05-3608fd2cb5c4 from the persistent domain config. {{(pid=72362) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-2f9f65a2-0a3a-43c5-a96d-58e1b8b73414 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 11:00:50 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 11:00:50 user nova-compute[72362]:   <source dev="/dev/sdb"/>
Aug 09 11:00:50 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 11:00:50 user nova-compute[72362]:   <serial>8c898a97-4cd3-4760-b3fe-a1444d78003e</serial>
Aug 09 11:00:50 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 11:00:50 user nova-compute[72362]: </disk>
Aug 09 11:00:50 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 11:00:50 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-2f9f65a2-0a3a-43c5-a96d-58e1b8b73414 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Successfully detached device vdb from instance dd3c8516-66cf-4a07-bb05-3608fd2cb5c4 from the persistent domain config.
Aug 09 11:00:50 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-2f9f65a2-0a3a-43c5-a96d-58e1b8b73414 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dd3c8516-66cf-4a07-bb05-3608fd2cb5c4 from the live domain config. {{(pid=72362) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-2f9f65a2-0a3a-43c5-a96d-58e1b8b73414 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 11:00:50 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 11:00:50 user nova-compute[72362]:   <source dev="/dev/sdb"/>
Aug 09 11:00:50 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 11:00:50 user nova-compute[72362]:   <serial>8c898a97-4cd3-4760-b3fe-a1444d78003e</serial>
Aug 09 11:00:50 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 11:00:50 user nova-compute[72362]: </disk>
Aug 09 11:00:50 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG nova.network.neutron [req-904346f6-ae4b-43a5-98eb-942b6d80bc17 req-9ec95000-e592-4fd4-99d4-c29792c75041 service nova] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Updated VIF entry in instance network info cache for port ce91bcdb-b008-45a9-9c68-5c596111091f. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG nova.network.neutron [req-904346f6-ae4b-43a5-98eb-942b6d80bc17 req-9ec95000-e592-4fd4-99d4-c29792c75041 service nova] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Updating instance_info_cache with network_info: [{"id": "ce91bcdb-b008-45a9-9c68-5c596111091f", "address": "fa:16:3e:c4:3a:1b", "network": {"id": "f812ec4b-c0a0-4d6c-84e9-5b50199ad17a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2039781156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09af0e64509144b28ebccba3d90aee65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce91bcdb-b0", "ovs_interfaceid": "ce91bcdb-b008-45a9-9c68-5c596111091f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-904346f6-ae4b-43a5-98eb-942b6d80bc17 req-9ec95000-e592-4fd4-99d4-c29792c75041 service nova] Releasing lock "refresh_cache-dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Received event <DeviceRemovedEvent: 1691578850.542135, dd3c8516-66cf-4a07-bb05-3608fd2cb5c4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72362) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-2f9f65a2-0a3a-43c5-a96d-58e1b8b73414 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dd3c8516-66cf-4a07-bb05-3608fd2cb5c4 {{(pid=72362) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 11:00:50 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-2f9f65a2-0a3a-43c5-a96d-58e1b8b73414 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Successfully detached device vdb from instance dd3c8516-66cf-4a07-bb05-3608fd2cb5c4 from the live domain config.
Aug 09 11:00:50 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f9f65a2-0a3a-43c5-a96d-58e1b8b73414 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9f65a2-0a3a-43c5-a96d-58e1b8b73414 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AkHfpyJd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 11:00:50 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-2f9f65a2-0a3a-43c5-a96d-58e1b8b73414 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 11:00:50 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-2f9f65a2-0a3a-43c5-a96d-58e1b8b73414 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-2f9f65a2-0a3a-43c5-a96d-58e1b8b73414 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9f65a2-0a3a-43c5-a96d-58e1b8b73414 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e136c30-7012-4c9a-9600-b5b6bd0f5322]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99d0965-68fc-415d-8918-8e359d6071fc]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9f65a2-0a3a-43c5-a96d-58e1b8b73414 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e (non-flash)
Aug 09 11:00:50 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9f65a2-0a3a-43c5-a96d-58e1b8b73414 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e (non-flash)
Aug 09 11:00:50 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9f65a2-0a3a-43c5-a96d-58e1b8b73414 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34dc2b00d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e'): ({'sdb'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-2f9f65a2-0a3a-43c5-a96d-58e1b8b73414 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Removing single pathed devices sdb {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77a0860-c02c-4dc8-a3f8-f697198b3181]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e11a4c-d548-4073-a053-d58ffacf16e1]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-2f9f65a2-0a3a-43c5-a96d-58e1b8b73414 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Flushing IO for device /dev/sdb {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca59a08-64a5-4eaa-abae-57b8d5d370ce]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-2f9f65a2-0a3a-43c5-a96d-58e1b8b73414 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4701585-089b-45fe-8738-59b1e6fdbadb]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-2f9f65a2-0a3a-43c5-a96d-58e1b8b73414 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-2f9f65a2-0a3a-43c5-a96d-58e1b8b73414 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] SCSI volumes sdb have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9f65a2-0a3a-43c5-a96d-58e1b8b73414 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a34ee37-53ad-4de9-aea6-4ca8215394c6]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9f65a2-0a3a-43c5-a96d-58e1b8b73414 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[9144ee2d-f8b2-407a-9269-a71e6bd4194c]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9f65a2-0a3a-43c5-a96d-58e1b8b73414 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e, portal: 172.16.0.220,3260]
Aug 09 11:00:50 user nova-compute[72362]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e, portal: 172.16.0.220,3260] successful.
Aug 09 11:00:50 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c898a97-4cd3-4760-b3fe-a1444d78003e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[66514ff2-e1a6-4db4-8714-4e2e74a5c173]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9f65a2-0a3a-43c5-a96d-58e1b8b73414 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-2f9f65a2-0a3a-43c5-a96d-58e1b8b73414 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.239s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9f65a2-0a3a-43c5-a96d-58e1b8b73414 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] <== disconnect_volume: return (241ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 11:00:50 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f9f65a2-0a3a-43c5-a96d-58e1b8b73414 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 11:00:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:00:51 user nova-compute[72362]: DEBUG nova.objects.instance [None req-2f9f65a2-0a3a-43c5-a96d-58e1b8b73414 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lazy-loading 'flavor' on Instance uuid dd3c8516-66cf-4a07-bb05-3608fd2cb5c4 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 11:00:51 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-2f9f65a2-0a3a-43c5-a96d-58e1b8b73414 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.742s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:00:52 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:00:56 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:01:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:01:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:01:11 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:01:16 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:01:21 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:01:24 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:01:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:01:28 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:01:28 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 11:01:28 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Rebuilding the list of instances to heal {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 11:01:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "refresh_cache-dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 11:01:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquired lock "refresh_cache-dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 11:01:29 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Forcefully refreshing network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 11:01:29 user nova-compute[72362]: DEBUG nova.objects.instance [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lazy-loading 'info_cache' on Instance uuid dd3c8516-66cf-4a07-bb05-3608fd2cb5c4 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 11:01:29 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Updating instance_info_cache with network_info: [{"id": "ce91bcdb-b008-45a9-9c68-5c596111091f", "address": "fa:16:3e:c4:3a:1b", "network": {"id": "f812ec4b-c0a0-4d6c-84e9-5b50199ad17a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2039781156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09af0e64509144b28ebccba3d90aee65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce91bcdb-b0", "ovs_interfaceid": "ce91bcdb-b008-45a9-9c68-5c596111091f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 11:01:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Releasing lock "refresh_cache-dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 11:01:29 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Updated the network info_cache for instance {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 11:01:29 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:01:29 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:01:29 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 11:01:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:01:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:01:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 11:01:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:01:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:01:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:01:33 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:01:34 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:01:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:01:36 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:01:36 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:01:37 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:01:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:01:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:01:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:01:38 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 11:01:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd3c8516-66cf-4a07-bb05-3608fd2cb5c4/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:01:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd3c8516-66cf-4a07-bb05-3608fd2cb5c4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:01:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd3c8516-66cf-4a07-bb05-3608fd2cb5c4/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:01:38 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd3c8516-66cf-4a07-bb05-3608fd2cb5c4/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:01:38 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 11:01:38 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 11:01:38 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=8879MB free_disk=24.968387603759766GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 11:01:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:01:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:01:38 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance dd3c8516-66cf-4a07-bb05-3608fd2cb5c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 11:01:38 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 11:01:38 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 11:01:39 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 11:01:39 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 11:01:39 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 11:01:39 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.183s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:01:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:01:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-acae6533-73bb-4b9c-9910-47c68dddc008 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Acquiring lock "dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:01:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-acae6533-73bb-4b9c-9910-47c68dddc008 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:01:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-acae6533-73bb-4b9c-9910-47c68dddc008 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Acquiring lock "dd3c8516-66cf-4a07-bb05-3608fd2cb5c4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:01:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-acae6533-73bb-4b9c-9910-47c68dddc008 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "dd3c8516-66cf-4a07-bb05-3608fd2cb5c4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:01:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-acae6533-73bb-4b9c-9910-47c68dddc008 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "dd3c8516-66cf-4a07-bb05-3608fd2cb5c4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:01:46 user nova-compute[72362]: INFO nova.compute.manager [None req-acae6533-73bb-4b9c-9910-47c68dddc008 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Terminating instance
Aug 09 11:01:46 user nova-compute[72362]: DEBUG nova.compute.manager [None req-acae6533-73bb-4b9c-9910-47c68dddc008 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Start destroying the instance on the hypervisor. {{(pid=72362) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 11:01:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:01:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:01:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:01:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:01:46 user nova-compute[72362]: DEBUG nova.compute.manager [req-b1811035-d3c9-41a4-b2a7-324b596cf4f0 req-7ec8c4b3-f640-4c99-b683-2c7f1c51b7e8 service nova] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Received event network-vif-unplugged-ce91bcdb-b008-45a9-9c68-5c596111091f {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 11:01:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b1811035-d3c9-41a4-b2a7-324b596cf4f0 req-7ec8c4b3-f640-4c99-b683-2c7f1c51b7e8 service nova] Acquiring lock "dd3c8516-66cf-4a07-bb05-3608fd2cb5c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:01:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b1811035-d3c9-41a4-b2a7-324b596cf4f0 req-7ec8c4b3-f640-4c99-b683-2c7f1c51b7e8 service nova] Lock "dd3c8516-66cf-4a07-bb05-3608fd2cb5c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:01:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b1811035-d3c9-41a4-b2a7-324b596cf4f0 req-7ec8c4b3-f640-4c99-b683-2c7f1c51b7e8 service nova] Lock "dd3c8516-66cf-4a07-bb05-3608fd2cb5c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:01:46 user nova-compute[72362]: DEBUG nova.compute.manager [req-b1811035-d3c9-41a4-b2a7-324b596cf4f0 req-7ec8c4b3-f640-4c99-b683-2c7f1c51b7e8 service nova] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] No waiting events found dispatching network-vif-unplugged-ce91bcdb-b008-45a9-9c68-5c596111091f {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 11:01:46 user nova-compute[72362]: DEBUG nova.compute.manager [req-b1811035-d3c9-41a4-b2a7-324b596cf4f0 req-7ec8c4b3-f640-4c99-b683-2c7f1c51b7e8 service nova] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Received event network-vif-unplugged-ce91bcdb-b008-45a9-9c68-5c596111091f for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 11:01:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:01:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:01:46 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Instance destroyed successfully.
Aug 09 11:01:46 user nova-compute[72362]: DEBUG nova.objects.instance [None req-acae6533-73bb-4b9c-9910-47c68dddc008 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lazy-loading 'resources' on Instance uuid dd3c8516-66cf-4a07-bb05-3608fd2cb5c4 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 11:01:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-acae6533-73bb-4b9c-9910-47c68dddc008 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T10:56:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1983830734',display_name='tempest-TestMinimumBasicScenario-server-1983830734',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1983830734',id=50,image_ref='87c9723c-ac63-4cff-bea1-0727e518ee00',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjd7zo6+sqTrdhNBsHe4adte2ZBACSCbCQi6XDW4qOuoD6kQFT9u3zFYOeUMnHPxXBjhN6VslITy0d03mQLz3n5vC0674qFICJqzPR2oI6z11ZT1yVIQW5wYnWMD5SE4Q==',key_name='tempest-TestMinimumBasicScenario-230225336',keypairs=<?>,launch_index=0,launched_at=2023-08-09T10:56:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='09af0e64509144b28ebccba3d90aee65',ramdisk_id='',reservation_id='r-0hkkepkh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='87c9723c-ac63-4cff-bea1-0727e518ee00',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-673917805',owner_user_name='tempest-TestMinimumBasicScenario-673917805-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T10:59:05Z,user_data=None,user_id='191f1c4d430949899c90b08f00aefd7e',uuid=dd3c8516-66cf-4a07-bb05-3608fd2cb5c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce91bcdb-b008-45a9-9c68-5c596111091f", "address": "fa:16:3e:c4:3a:1b", "network": {"id": "f812ec4b-c0a0-4d6c-84e9-5b50199ad17a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2039781156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09af0e64509144b28ebccba3d90aee65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce91bcdb-b0", "ovs_interfaceid": "ce91bcdb-b008-45a9-9c68-5c596111091f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 11:01:46 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-acae6533-73bb-4b9c-9910-47c68dddc008 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Converting VIF {"id": "ce91bcdb-b008-45a9-9c68-5c596111091f", "address": "fa:16:3e:c4:3a:1b", "network": {"id": "f812ec4b-c0a0-4d6c-84e9-5b50199ad17a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2039781156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09af0e64509144b28ebccba3d90aee65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce91bcdb-b0", "ovs_interfaceid": "ce91bcdb-b008-45a9-9c68-5c596111091f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 11:01:46 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-acae6533-73bb-4b9c-9910-47c68dddc008 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:3a:1b,bridge_name='br-int',has_traffic_filtering=True,id=ce91bcdb-b008-45a9-9c68-5c596111091f,network=Network(f812ec4b-c0a0-4d6c-84e9-5b50199ad17a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce91bcdb-b0') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 11:01:46 user nova-compute[72362]: DEBUG os_vif [None req-acae6533-73bb-4b9c-9910-47c68dddc008 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:3a:1b,bridge_name='br-int',has_traffic_filtering=True,id=ce91bcdb-b008-45a9-9c68-5c596111091f,network=Network(f812ec4b-c0a0-4d6c-84e9-5b50199ad17a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce91bcdb-b0') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 11:01:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:01:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce91bcdb-b0, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 11:01:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:01:46 user nova-compute[72362]: INFO os_vif [None req-acae6533-73bb-4b9c-9910-47c68dddc008 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:3a:1b,bridge_name='br-int',has_traffic_filtering=True,id=ce91bcdb-b008-45a9-9c68-5c596111091f,network=Network(f812ec4b-c0a0-4d6c-84e9-5b50199ad17a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce91bcdb-b0')
Aug 09 11:01:46 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-acae6533-73bb-4b9c-9910-47c68dddc008 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Deleting instance files /opt/stack/data/nova/instances/dd3c8516-66cf-4a07-bb05-3608fd2cb5c4_del
Aug 09 11:01:46 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-acae6533-73bb-4b9c-9910-47c68dddc008 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Deletion of /opt/stack/data/nova/instances/dd3c8516-66cf-4a07-bb05-3608fd2cb5c4_del complete
Aug 09 11:01:46 user nova-compute[72362]: INFO nova.compute.manager [None req-acae6533-73bb-4b9c-9910-47c68dddc008 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 09 11:01:46 user nova-compute[72362]: DEBUG oslo.service.loopingcall [None req-acae6533-73bb-4b9c-9910-47c68dddc008 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72362) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 11:01:46 user nova-compute[72362]: DEBUG nova.compute.manager [-] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Deallocating network for instance {{(pid=72362) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 11:01:46 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] deallocate_for_instance() {{(pid=72362) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 11:01:47 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 11:01:47 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Took 0.74 seconds to deallocate network for instance.
Aug 09 11:01:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-acae6533-73bb-4b9c-9910-47c68dddc008 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:01:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-acae6533-73bb-4b9c-9910-47c68dddc008 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:01:47 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-acae6533-73bb-4b9c-9910-47c68dddc008 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 11:01:47 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-acae6533-73bb-4b9c-9910-47c68dddc008 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 11:01:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-acae6533-73bb-4b9c-9910-47c68dddc008 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.117s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:01:47 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-acae6533-73bb-4b9c-9910-47c68dddc008 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Deleted allocations for instance dd3c8516-66cf-4a07-bb05-3608fd2cb5c4
Aug 09 11:01:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-acae6533-73bb-4b9c-9910-47c68dddc008 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "dd3c8516-66cf-4a07-bb05-3608fd2cb5c4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.978s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:01:48 user nova-compute[72362]: DEBUG nova.compute.manager [req-d836a58c-5a0a-4d31-96c4-3cd318d54e49 req-51688e19-1fb4-4eea-9c28-317c4abd37f1 service nova] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Received event network-vif-plugged-ce91bcdb-b008-45a9-9c68-5c596111091f {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 11:01:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-d836a58c-5a0a-4d31-96c4-3cd318d54e49 req-51688e19-1fb4-4eea-9c28-317c4abd37f1 service nova] Acquiring lock "dd3c8516-66cf-4a07-bb05-3608fd2cb5c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:01:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-d836a58c-5a0a-4d31-96c4-3cd318d54e49 req-51688e19-1fb4-4eea-9c28-317c4abd37f1 service nova] Lock "dd3c8516-66cf-4a07-bb05-3608fd2cb5c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:01:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-d836a58c-5a0a-4d31-96c4-3cd318d54e49 req-51688e19-1fb4-4eea-9c28-317c4abd37f1 service nova] Lock "dd3c8516-66cf-4a07-bb05-3608fd2cb5c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:01:48 user nova-compute[72362]: DEBUG nova.compute.manager [req-d836a58c-5a0a-4d31-96c4-3cd318d54e49 req-51688e19-1fb4-4eea-9c28-317c4abd37f1 service nova] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] No waiting events found dispatching network-vif-plugged-ce91bcdb-b008-45a9-9c68-5c596111091f {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 11:01:48 user nova-compute[72362]: WARNING nova.compute.manager [req-d836a58c-5a0a-4d31-96c4-3cd318d54e49 req-51688e19-1fb4-4eea-9c28-317c4abd37f1 service nova] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Received unexpected event network-vif-plugged-ce91bcdb-b008-45a9-9c68-5c596111091f for instance with vm_state deleted and task_state None.
Aug 09 11:01:48 user nova-compute[72362]: DEBUG nova.compute.manager [req-d836a58c-5a0a-4d31-96c4-3cd318d54e49 req-51688e19-1fb4-4eea-9c28-317c4abd37f1 service nova] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Received event network-vif-deleted-ce91bcdb-b008-45a9-9c68-5c596111091f {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 11:01:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:01:56 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:02:01 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691578906.7838795, dd3c8516-66cf-4a07-bb05-3608fd2cb5c4 => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 11:02:01 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] VM Stopped (Lifecycle Event)
Aug 09 11:02:01 user nova-compute[72362]: DEBUG nova.compute.manager [None req-25a6a34d-6715-4277-8702-a5d13167a328 None None] [instance: dd3c8516-66cf-4a07-bb05-3608fd2cb5c4] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 11:02:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:02:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:02:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 11:02:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:02:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:02:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:02:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:02:11 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:02:16 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:02:21 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:02:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:02:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:02:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 11:02:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:02:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:02:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:02:27 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:02:28 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:02:28 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 11:02:28 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Rebuilding the list of instances to heal {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 11:02:28 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Didn't find any instances for network info cache update. {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 11:02:30 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:02:30 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:02:30 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 11:02:30 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:02:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:02:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:02:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 11:02:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:02:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:02:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:02:34 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:02:34 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:02:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:02:36 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:02:37 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:02:39 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:02:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:02:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:02:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:02:40 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 11:02:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Acquiring lock "83001be0-c830-41cc-ae51-c6cefa9427d5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:02:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "83001be0-c830-41cc-ae51-c6cefa9427d5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:02:40 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 11:02:40 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 11:02:40 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=9001MB free_disk=25.015422821044922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 11:02:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:02:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:02:40 user nova-compute[72362]: DEBUG nova.compute.manager [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Starting instance... {{(pid=72362) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 11:02:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:02:40 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 83001be0-c830-41cc-ae51-c6cefa9427d5 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 09 11:02:40 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 11:02:40 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 11:02:40 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Refreshing inventories for resource provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 11:02:40 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Updating ProviderTree inventory for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 11:02:40 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Updating inventory in ProviderTree for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 11:02:40 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Refreshing aggregate associations for resource provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d, aggregates: None {{(pid=72362) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 11:02:40 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Refreshing trait associations for resource provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE41,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=72362) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 11:02:40 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 11:02:40 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 11:02:40 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 11:02:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.417s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:02:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.255s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:02:40 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 11:02:40 user nova-compute[72362]: INFO nova.compute.claims [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Claim successful on node user
Aug 09 11:02:41 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 11:02:41 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 11:02:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.206s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:02:41 user nova-compute[72362]: DEBUG nova.compute.manager [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Start building networks asynchronously for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 11:02:41 user nova-compute[72362]: DEBUG nova.compute.manager [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Allocating IP information in the background. {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 11:02:41 user nova-compute[72362]: DEBUG nova.network.neutron [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] allocate_for_instance() {{(pid=72362) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 11:02:41 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 11:02:41 user nova-compute[72362]: DEBUG nova.compute.manager [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Start building block device mappings for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 11:02:41 user nova-compute[72362]: DEBUG nova.policy [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '191f1c4d430949899c90b08f00aefd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09af0e64509144b28ebccba3d90aee65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72362) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 11:02:41 user nova-compute[72362]: DEBUG nova.compute.manager [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Start spawning the instance on the hypervisor. {{(pid=72362) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 11:02:41 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 11:02:41 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Creating image(s)
Aug 09 11:02:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Acquiring lock "/opt/stack/data/nova/instances/83001be0-c830-41cc-ae51-c6cefa9427d5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:02:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "/opt/stack/data/nova/instances/83001be0-c830-41cc-ae51-c6cefa9427d5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:02:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "/opt/stack/data/nova/instances/83001be0-c830-41cc-ae51-c6cefa9427d5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:02:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Acquiring lock "09f7cdc922adceb8daa8444687a8542e843a3723" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:02:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "09f7cdc922adceb8daa8444687a8542e843a3723" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:02:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09f7cdc922adceb8daa8444687a8542e843a3723.part --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:02:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:02:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09f7cdc922adceb8daa8444687a8542e843a3723.part --force-share --output=json" returned: 0 in 0.140s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:02:42 user nova-compute[72362]: DEBUG nova.virt.images [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] 8f49369d-23b9-4a17-810a-99a87d4784e5 was qcow2, converting to raw {{(pid=72362) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 11:02:42 user nova-compute[72362]: DEBUG nova.privsep.utils [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72362) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 11:02:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/09f7cdc922adceb8daa8444687a8542e843a3723.part /opt/stack/data/nova/instances/_base/09f7cdc922adceb8daa8444687a8542e843a3723.converted {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:02:42 user nova-compute[72362]: DEBUG nova.network.neutron [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Successfully created port: 29efac0a-52ab-471c-9f79-0d94142311f2 {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 11:02:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/09f7cdc922adceb8daa8444687a8542e843a3723.part /opt/stack/data/nova/instances/_base/09f7cdc922adceb8daa8444687a8542e843a3723.converted" returned: 0 in 0.470s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:02:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09f7cdc922adceb8daa8444687a8542e843a3723.converted --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:02:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09f7cdc922adceb8daa8444687a8542e843a3723.converted --force-share --output=json" returned: 0 in 0.145s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:02:42 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "09f7cdc922adceb8daa8444687a8542e843a3723" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.518s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:02:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09f7cdc922adceb8daa8444687a8542e843a3723 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:02:43 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09f7cdc922adceb8daa8444687a8542e843a3723 --force-share --output=json" returned: 0 in 0.130s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:02:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Acquiring lock "09f7cdc922adceb8daa8444687a8542e843a3723" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:02:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "09f7cdc922adceb8daa8444687a8542e843a3723" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:02:43 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09f7cdc922adceb8daa8444687a8542e843a3723 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:02:43 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09f7cdc922adceb8daa8444687a8542e843a3723 --force-share --output=json" returned: 0 in 0.140s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:02:43 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09f7cdc922adceb8daa8444687a8542e843a3723,backing_fmt=raw /opt/stack/data/nova/instances/83001be0-c830-41cc-ae51-c6cefa9427d5/disk 1073741824 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:02:43 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09f7cdc922adceb8daa8444687a8542e843a3723,backing_fmt=raw /opt/stack/data/nova/instances/83001be0-c830-41cc-ae51-c6cefa9427d5/disk 1073741824" returned: 0 in 0.050s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:02:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "09f7cdc922adceb8daa8444687a8542e843a3723" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:02:43 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09f7cdc922adceb8daa8444687a8542e843a3723 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:02:43 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09f7cdc922adceb8daa8444687a8542e843a3723 --force-share --output=json" returned: 0 in 0.145s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:02:43 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Checking if we can resize image /opt/stack/data/nova/instances/83001be0-c830-41cc-ae51-c6cefa9427d5/disk. size=1073741824 {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 11:02:43 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83001be0-c830-41cc-ae51-c6cefa9427d5/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:02:43 user nova-compute[72362]: DEBUG nova.network.neutron [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Successfully updated port: 29efac0a-52ab-471c-9f79-0d94142311f2 {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 11:02:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Acquiring lock "refresh_cache-83001be0-c830-41cc-ae51-c6cefa9427d5" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 11:02:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Acquired lock "refresh_cache-83001be0-c830-41cc-ae51-c6cefa9427d5" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 11:02:43 user nova-compute[72362]: DEBUG nova.network.neutron [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 11:02:43 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83001be0-c830-41cc-ae51-c6cefa9427d5/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:02:43 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Cannot resize image /opt/stack/data/nova/instances/83001be0-c830-41cc-ae51-c6cefa9427d5/disk to a smaller size. {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 11:02:43 user nova-compute[72362]: DEBUG nova.objects.instance [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lazy-loading 'migration_context' on Instance uuid 83001be0-c830-41cc-ae51-c6cefa9427d5 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 11:02:43 user nova-compute[72362]: DEBUG nova.compute.manager [req-1c479135-ec7c-4be5-87cd-fcd743e00721 req-6c5b7692-9a01-403a-b951-8dd54fe1bfca service nova] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Received event network-changed-29efac0a-52ab-471c-9f79-0d94142311f2 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 11:02:43 user nova-compute[72362]: DEBUG nova.compute.manager [req-1c479135-ec7c-4be5-87cd-fcd743e00721 req-6c5b7692-9a01-403a-b951-8dd54fe1bfca service nova] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Refreshing instance network info cache due to event network-changed-29efac0a-52ab-471c-9f79-0d94142311f2. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 11:02:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-1c479135-ec7c-4be5-87cd-fcd743e00721 req-6c5b7692-9a01-403a-b951-8dd54fe1bfca service nova] Acquiring lock "refresh_cache-83001be0-c830-41cc-ae51-c6cefa9427d5" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 11:02:43 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Created local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 11:02:43 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Ensure instance console log exists: /opt/stack/data/nova/instances/83001be0-c830-41cc-ae51-c6cefa9427d5/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 11:02:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:02:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:02:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:02:43 user nova-compute[72362]: DEBUG nova.network.neutron [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 11:02:43 user nova-compute[72362]: DEBUG nova.network.neutron [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Updating instance_info_cache with network_info: [{"id": "29efac0a-52ab-471c-9f79-0d94142311f2", "address": "fa:16:3e:37:b4:94", "network": {"id": "f812ec4b-c0a0-4d6c-84e9-5b50199ad17a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2039781156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09af0e64509144b28ebccba3d90aee65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29efac0a-52", "ovs_interfaceid": "29efac0a-52ab-471c-9f79-0d94142311f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 11:02:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Releasing lock "refresh_cache-83001be0-c830-41cc-ae51-c6cefa9427d5" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 11:02:43 user nova-compute[72362]: DEBUG nova.compute.manager [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Instance network_info: |[{"id": "29efac0a-52ab-471c-9f79-0d94142311f2", "address": "fa:16:3e:37:b4:94", "network": {"id": "f812ec4b-c0a0-4d6c-84e9-5b50199ad17a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2039781156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09af0e64509144b28ebccba3d90aee65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29efac0a-52", "ovs_interfaceid": "29efac0a-52ab-471c-9f79-0d94142311f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 11:02:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-1c479135-ec7c-4be5-87cd-fcd743e00721 req-6c5b7692-9a01-403a-b951-8dd54fe1bfca service nova] Acquired lock "refresh_cache-83001be0-c830-41cc-ae51-c6cefa9427d5" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 11:02:43 user nova-compute[72362]: DEBUG nova.network.neutron [req-1c479135-ec7c-4be5-87cd-fcd743e00721 req-6c5b7692-9a01-403a-b951-8dd54fe1bfca service nova] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Refreshing network info cache for port 29efac0a-52ab-471c-9f79-0d94142311f2 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 11:02:43 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Start _get_guest_xml network_info=[{"id": "29efac0a-52ab-471c-9f79-0d94142311f2", "address": "fa:16:3e:37:b4:94", "network": {"id": "f812ec4b-c0a0-4d6c-84e9-5b50199ad17a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2039781156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09af0e64509144b28ebccba3d90aee65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29efac0a-52", "ovs_interfaceid": "29efac0a-52ab-471c-9f79-0d94142311f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T11:02:37Z,direct_url=<?>,disk_format='qcow2',id=8f49369d-23b9-4a17-810a-99a87d4784e5,min_disk=0,min_ram=0,name='tempest-scenario-img--124787234',owner='09af0e64509144b28ebccba3d90aee65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T11:02:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': '8f49369d-23b9-4a17-810a-99a87d4784e5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 11:02:43 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 11:02:43 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 11:02:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 11:02:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 11:02:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 11:02:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 11:02:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 11:02:44 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T11:02:37Z,direct_url=<?>,disk_format='qcow2',id=8f49369d-23b9-4a17-810a-99a87d4784e5,min_disk=0,min_ram=0,name='tempest-scenario-img--124787234',owner='09af0e64509144b28ebccba3d90aee65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T11:02:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 11:02:44 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 11:02:44 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 11:02:44 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 11:02:44 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 11:02:44 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 11:02:44 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 11:02:44 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 11:02:44 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 11:02:44 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 11:02:44 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 11:02:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T11:02:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1056692255',display_name='tempest-TestMinimumBasicScenario-server-1056692255',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1056692255',id=51,image_ref='8f49369d-23b9-4a17-810a-99a87d4784e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTfDfC1bfcQz5oD9uMtn5En5W80TRuo9YZ9/YtqrSJ7Bvve2Vp7XXOY9F6NM+AKs65NFrCVKzKFZZYrW0uSn14mqL01OzLRTD2hWvwIG/2rPaHbjtnqk38+QFsWL/eVWw==',key_name='tempest-TestMinimumBasicScenario-2029956847',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09af0e64509144b28ebccba3d90aee65',ramdisk_id='',reservation_id='r-0rvbp9l0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8f49369d-23b9-4a17-810a-99a87d4784e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-673917805',owner_user_name='tempest-TestMinimumBasicScenario-673917805-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T11:02:41Z,user_data=None,user_id='191f1c4d430949899c90b08f00aefd7e',uuid=83001be0-c830-41cc-ae51-c6cefa9427d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29efac0a-52ab-471c-9f79-0d94142311f2", "address": "fa:16:3e:37:b4:94", "network": {"id": "f812ec4b-c0a0-4d6c-84e9-5b50199ad17a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2039781156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09af0e64509144b28ebccba3d90aee65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29efac0a-52", "ovs_interfaceid": "29efac0a-52ab-471c-9f79-0d94142311f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 11:02:44 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Converting VIF {"id": "29efac0a-52ab-471c-9f79-0d94142311f2", "address": "fa:16:3e:37:b4:94", "network": {"id": "f812ec4b-c0a0-4d6c-84e9-5b50199ad17a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2039781156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09af0e64509144b28ebccba3d90aee65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29efac0a-52", "ovs_interfaceid": "29efac0a-52ab-471c-9f79-0d94142311f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 11:02:44 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:b4:94,bridge_name='br-int',has_traffic_filtering=True,id=29efac0a-52ab-471c-9f79-0d94142311f2,network=Network(f812ec4b-c0a0-4d6c-84e9-5b50199ad17a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29efac0a-52') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 11:02:44 user nova-compute[72362]: DEBUG nova.objects.instance [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lazy-loading 'pci_devices' on Instance uuid 83001be0-c830-41cc-ae51-c6cefa9427d5 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 11:02:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] End _get_guest_xml xml=<domain type="kvm">
Aug 09 11:02:44 user nova-compute[72362]:   <uuid>83001be0-c830-41cc-ae51-c6cefa9427d5</uuid>
Aug 09 11:02:44 user nova-compute[72362]:   <name>instance-00000033</name>
Aug 09 11:02:44 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 11:02:44 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 11:02:44 user nova-compute[72362]:   <metadata>
Aug 09 11:02:44 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 11:02:44 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 11:02:44 user nova-compute[72362]:       <nova:name>tempest-TestMinimumBasicScenario-server-1056692255</nova:name>
Aug 09 11:02:44 user nova-compute[72362]:       <nova:creationTime>2023-08-09 11:02:43</nova:creationTime>
Aug 09 11:02:44 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 11:02:44 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 11:02:44 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 11:02:44 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 11:02:44 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 11:02:44 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 11:02:44 user nova-compute[72362]:       </nova:flavor>
Aug 09 11:02:44 user nova-compute[72362]:       <nova:owner>
Aug 09 11:02:44 user nova-compute[72362]:         <nova:user uuid="191f1c4d430949899c90b08f00aefd7e">tempest-TestMinimumBasicScenario-673917805-project-member</nova:user>
Aug 09 11:02:44 user nova-compute[72362]:         <nova:project uuid="09af0e64509144b28ebccba3d90aee65">tempest-TestMinimumBasicScenario-673917805</nova:project>
Aug 09 11:02:44 user nova-compute[72362]:       </nova:owner>
Aug 09 11:02:44 user nova-compute[72362]:       <nova:root type="image" uuid="8f49369d-23b9-4a17-810a-99a87d4784e5"/>
Aug 09 11:02:44 user nova-compute[72362]:       <nova:ports>
Aug 09 11:02:44 user nova-compute[72362]:         <nova:port uuid="29efac0a-52ab-471c-9f79-0d94142311f2">
Aug 09 11:02:44 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 11:02:44 user nova-compute[72362]:         </nova:port>
Aug 09 11:02:44 user nova-compute[72362]:       </nova:ports>
Aug 09 11:02:44 user nova-compute[72362]:     </nova:instance>
Aug 09 11:02:44 user nova-compute[72362]:   </metadata>
Aug 09 11:02:44 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 11:02:44 user nova-compute[72362]:     <system>
Aug 09 11:02:44 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 11:02:44 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 11:02:44 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 11:02:44 user nova-compute[72362]:       <entry name="serial">83001be0-c830-41cc-ae51-c6cefa9427d5</entry>
Aug 09 11:02:44 user nova-compute[72362]:       <entry name="uuid">83001be0-c830-41cc-ae51-c6cefa9427d5</entry>
Aug 09 11:02:44 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 11:02:44 user nova-compute[72362]:     </system>
Aug 09 11:02:44 user nova-compute[72362]:   </sysinfo>
Aug 09 11:02:44 user nova-compute[72362]:   <os>
Aug 09 11:02:44 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 11:02:44 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 11:02:44 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 11:02:44 user nova-compute[72362]:   </os>
Aug 09 11:02:44 user nova-compute[72362]:   <features>
Aug 09 11:02:44 user nova-compute[72362]:     <acpi/>
Aug 09 11:02:44 user nova-compute[72362]:     <apic/>
Aug 09 11:02:44 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 11:02:44 user nova-compute[72362]:   </features>
Aug 09 11:02:44 user nova-compute[72362]:   <clock offset="utc">
Aug 09 11:02:44 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 11:02:44 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 11:02:44 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 11:02:44 user nova-compute[72362]:   </clock>
Aug 09 11:02:44 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 11:02:44 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 11:02:44 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 11:02:44 user nova-compute[72362]:   </cpu>
Aug 09 11:02:44 user nova-compute[72362]:   <devices>
Aug 09 11:02:44 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 11:02:44 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 11:02:44 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/83001be0-c830-41cc-ae51-c6cefa9427d5/disk"/>
Aug 09 11:02:44 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 11:02:44 user nova-compute[72362]:     </disk>
Aug 09 11:02:44 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 11:02:44 user nova-compute[72362]:       <mac address="fa:16:3e:37:b4:94"/>
Aug 09 11:02:44 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 11:02:44 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 11:02:44 user nova-compute[72362]:       <target dev="tap29efac0a-52"/>
Aug 09 11:02:44 user nova-compute[72362]:     </interface>
Aug 09 11:02:44 user nova-compute[72362]:     <serial type="pty">
Aug 09 11:02:44 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/83001be0-c830-41cc-ae51-c6cefa9427d5/console.log" append="off"/>
Aug 09 11:02:44 user nova-compute[72362]:     </serial>
Aug 09 11:02:44 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 11:02:44 user nova-compute[72362]:     <video>
Aug 09 11:02:44 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 11:02:44 user nova-compute[72362]:     </video>
Aug 09 11:02:44 user nova-compute[72362]:     <rng model="virtio">
Aug 09 11:02:44 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 11:02:44 user nova-compute[72362]:     </rng>
Aug 09 11:02:44 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 11:02:44 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 11:02:44 user nova-compute[72362]:       <stats period="10"/>
Aug 09 11:02:44 user nova-compute[72362]:     </memballoon>
Aug 09 11:02:44 user nova-compute[72362]:   </devices>
Aug 09 11:02:44 user nova-compute[72362]: </domain>
Aug 09 11:02:44 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 11:02:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T11:02:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1056692255',display_name='tempest-TestMinimumBasicScenario-server-1056692255',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1056692255',id=51,image_ref='8f49369d-23b9-4a17-810a-99a87d4784e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTfDfC1bfcQz5oD9uMtn5En5W80TRuo9YZ9/YtqrSJ7Bvve2Vp7XXOY9F6NM+AKs65NFrCVKzKFZZYrW0uSn14mqL01OzLRTD2hWvwIG/2rPaHbjtnqk38+QFsWL/eVWw==',key_name='tempest-TestMinimumBasicScenario-2029956847',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09af0e64509144b28ebccba3d90aee65',ramdisk_id='',reservation_id='r-0rvbp9l0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8f49369d-23b9-4a17-810a-99a87d4784e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-673917805',owner_user_name='tempest-TestMinimumBasicScenario-673917805-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T11:02:41Z,user_data=None,user_id='191f1c4d430949899c90b08f00aefd7e',uuid=83001be0-c830-41cc-ae51-c6cefa9427d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29efac0a-52ab-471c-9f79-0d94142311f2", "address": "fa:16:3e:37:b4:94", "network": {"id": "f812ec4b-c0a0-4d6c-84e9-5b50199ad17a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2039781156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09af0e64509144b28ebccba3d90aee65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29efac0a-52", "ovs_interfaceid": "29efac0a-52ab-471c-9f79-0d94142311f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 11:02:44 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Converting VIF {"id": "29efac0a-52ab-471c-9f79-0d94142311f2", "address": "fa:16:3e:37:b4:94", "network": {"id": "f812ec4b-c0a0-4d6c-84e9-5b50199ad17a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2039781156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09af0e64509144b28ebccba3d90aee65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29efac0a-52", "ovs_interfaceid": "29efac0a-52ab-471c-9f79-0d94142311f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 11:02:44 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:b4:94,bridge_name='br-int',has_traffic_filtering=True,id=29efac0a-52ab-471c-9f79-0d94142311f2,network=Network(f812ec4b-c0a0-4d6c-84e9-5b50199ad17a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29efac0a-52') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 11:02:44 user nova-compute[72362]: DEBUG os_vif [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:b4:94,bridge_name='br-int',has_traffic_filtering=True,id=29efac0a-52ab-471c-9f79-0d94142311f2,network=Network(f812ec4b-c0a0-4d6c-84e9-5b50199ad17a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29efac0a-52') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 11:02:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:02:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 11:02:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 11:02:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:02:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap29efac0a-52, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 11:02:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap29efac0a-52, col_values=(('external_ids', {'iface-id': '29efac0a-52ab-471c-9f79-0d94142311f2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:b4:94', 'vm-uuid': '83001be0-c830-41cc-ae51-c6cefa9427d5'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 11:02:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:02:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:02:44 user nova-compute[72362]: INFO os_vif [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:b4:94,bridge_name='br-int',has_traffic_filtering=True,id=29efac0a-52ab-471c-9f79-0d94142311f2,network=Network(f812ec4b-c0a0-4d6c-84e9-5b50199ad17a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29efac0a-52')
Aug 09 11:02:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 11:02:44 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] No VIF found with MAC fa:16:3e:37:b4:94, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 11:02:44 user nova-compute[72362]: DEBUG nova.network.neutron [req-1c479135-ec7c-4be5-87cd-fcd743e00721 req-6c5b7692-9a01-403a-b951-8dd54fe1bfca service nova] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Updated VIF entry in instance network info cache for port 29efac0a-52ab-471c-9f79-0d94142311f2. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 11:02:44 user nova-compute[72362]: DEBUG nova.network.neutron [req-1c479135-ec7c-4be5-87cd-fcd743e00721 req-6c5b7692-9a01-403a-b951-8dd54fe1bfca service nova] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Updating instance_info_cache with network_info: [{"id": "29efac0a-52ab-471c-9f79-0d94142311f2", "address": "fa:16:3e:37:b4:94", "network": {"id": "f812ec4b-c0a0-4d6c-84e9-5b50199ad17a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2039781156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09af0e64509144b28ebccba3d90aee65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29efac0a-52", "ovs_interfaceid": "29efac0a-52ab-471c-9f79-0d94142311f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 11:02:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-1c479135-ec7c-4be5-87cd-fcd743e00721 req-6c5b7692-9a01-403a-b951-8dd54fe1bfca service nova] Releasing lock "refresh_cache-83001be0-c830-41cc-ae51-c6cefa9427d5" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 11:02:45 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:02:45 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:02:45 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:02:45 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:02:45 user nova-compute[72362]: DEBUG nova.compute.manager [req-6d8a29b7-fa64-4f8a-921a-66371f8c9677 req-78524c2a-ebae-429e-abcf-310eef5845db service nova] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Received event network-vif-plugged-29efac0a-52ab-471c-9f79-0d94142311f2 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 11:02:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-6d8a29b7-fa64-4f8a-921a-66371f8c9677 req-78524c2a-ebae-429e-abcf-310eef5845db service nova] Acquiring lock "83001be0-c830-41cc-ae51-c6cefa9427d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:02:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-6d8a29b7-fa64-4f8a-921a-66371f8c9677 req-78524c2a-ebae-429e-abcf-310eef5845db service nova] Lock "83001be0-c830-41cc-ae51-c6cefa9427d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:02:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-6d8a29b7-fa64-4f8a-921a-66371f8c9677 req-78524c2a-ebae-429e-abcf-310eef5845db service nova] Lock "83001be0-c830-41cc-ae51-c6cefa9427d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:02:45 user nova-compute[72362]: DEBUG nova.compute.manager [req-6d8a29b7-fa64-4f8a-921a-66371f8c9677 req-78524c2a-ebae-429e-abcf-310eef5845db service nova] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] No waiting events found dispatching network-vif-plugged-29efac0a-52ab-471c-9f79-0d94142311f2 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 11:02:45 user nova-compute[72362]: WARNING nova.compute.manager [req-6d8a29b7-fa64-4f8a-921a-66371f8c9677 req-78524c2a-ebae-429e-abcf-310eef5845db service nova] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Received unexpected event network-vif-plugged-29efac0a-52ab-471c-9f79-0d94142311f2 for instance with vm_state building and task_state spawning.
Aug 09 11:02:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:02:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:02:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:02:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:02:47 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691578967.7839003, 83001be0-c830-41cc-ae51-c6cefa9427d5 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 11:02:47 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] VM Resumed (Lifecycle Event)
Aug 09 11:02:47 user nova-compute[72362]: DEBUG nova.compute.manager [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 11:02:47 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 11:02:47 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Instance spawned successfully.
Aug 09 11:02:47 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 11:02:47 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 11:02:47 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Found default for hw_cdrom_bus of ide {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 11:02:47 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Found default for hw_disk_bus of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 11:02:47 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 11:02:47 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 11:02:47 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Found default for hw_video_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 11:02:47 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Found default for hw_vif_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 11:02:47 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 11:02:47 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 11:02:47 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691578967.7873602, 83001be0-c830-41cc-ae51-c6cefa9427d5 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 11:02:47 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] VM Started (Lifecycle Event)
Aug 09 11:02:47 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 11:02:47 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 11:02:47 user nova-compute[72362]: DEBUG nova.compute.manager [req-baaacd21-d670-40aa-b98a-a691fe2e2613 req-0f58e3b9-3ca9-49f3-8d01-bf449d65829f service nova] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Received event network-vif-plugged-29efac0a-52ab-471c-9f79-0d94142311f2 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 11:02:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-baaacd21-d670-40aa-b98a-a691fe2e2613 req-0f58e3b9-3ca9-49f3-8d01-bf449d65829f service nova] Acquiring lock "83001be0-c830-41cc-ae51-c6cefa9427d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:02:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-baaacd21-d670-40aa-b98a-a691fe2e2613 req-0f58e3b9-3ca9-49f3-8d01-bf449d65829f service nova] Lock "83001be0-c830-41cc-ae51-c6cefa9427d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:02:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-baaacd21-d670-40aa-b98a-a691fe2e2613 req-0f58e3b9-3ca9-49f3-8d01-bf449d65829f service nova] Lock "83001be0-c830-41cc-ae51-c6cefa9427d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:02:47 user nova-compute[72362]: DEBUG nova.compute.manager [req-baaacd21-d670-40aa-b98a-a691fe2e2613 req-0f58e3b9-3ca9-49f3-8d01-bf449d65829f service nova] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] No waiting events found dispatching network-vif-plugged-29efac0a-52ab-471c-9f79-0d94142311f2 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 11:02:47 user nova-compute[72362]: WARNING nova.compute.manager [req-baaacd21-d670-40aa-b98a-a691fe2e2613 req-0f58e3b9-3ca9-49f3-8d01-bf449d65829f service nova] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Received unexpected event network-vif-plugged-29efac0a-52ab-471c-9f79-0d94142311f2 for instance with vm_state building and task_state spawning.
Aug 09 11:02:47 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 11:02:47 user nova-compute[72362]: INFO nova.compute.manager [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Took 6.53 seconds to spawn the instance on the hypervisor.
Aug 09 11:02:47 user nova-compute[72362]: DEBUG nova.compute.manager [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 11:02:48 user nova-compute[72362]: INFO nova.compute.manager [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Took 7.39 seconds to build instance.
Aug 09 11:02:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-81d8e89a-0e84-40c7-b010-87883e647c3c tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "83001be0-c830-41cc-ae51-c6cefa9427d5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.551s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:02:48 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:02:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:02:52 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:02:52 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:02:52 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Cleaning up deleted instances {{(pid=72362) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 11:02:52 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] There are 0 instances to clean {{(pid=72362) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 11:02:54 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:02:59 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:03:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:03:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:03:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:03:07 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:03:07 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72362) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 11:03:09 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:03:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:03:14 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:03:17 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:03:19 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:03:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:03:27 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:03:28 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:03:28 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 11:03:28 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Rebuilding the list of instances to heal {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 11:03:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "refresh_cache-83001be0-c830-41cc-ae51-c6cefa9427d5" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 11:03:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquired lock "refresh_cache-83001be0-c830-41cc-ae51-c6cefa9427d5" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 11:03:29 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Forcefully refreshing network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 11:03:29 user nova-compute[72362]: DEBUG nova.objects.instance [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lazy-loading 'info_cache' on Instance uuid 83001be0-c830-41cc-ae51-c6cefa9427d5 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 11:03:29 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:03:29 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Updating instance_info_cache with network_info: [{"id": "29efac0a-52ab-471c-9f79-0d94142311f2", "address": "fa:16:3e:37:b4:94", "network": {"id": "f812ec4b-c0a0-4d6c-84e9-5b50199ad17a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2039781156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09af0e64509144b28ebccba3d90aee65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29efac0a-52", "ovs_interfaceid": "29efac0a-52ab-471c-9f79-0d94142311f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 11:03:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Releasing lock "refresh_cache-83001be0-c830-41cc-ae51-c6cefa9427d5" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 11:03:29 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Updated the network info_cache for instance {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 11:03:29 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:03:29 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Triggering sync for uuid 83001be0-c830-41cc-ae51-c6cefa9427d5 {{(pid=72362) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 11:03:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "83001be0-c830-41cc-ae51-c6cefa9427d5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:03:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "83001be0-c830-41cc-ae51-c6cefa9427d5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:03:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "83001be0-c830-41cc-ae51-c6cefa9427d5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:03:31 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:03:31 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 11:03:32 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:03:34 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:03:34 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:03:34 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:03:38 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:03:38 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:03:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:03:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:03:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 11:03:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:03:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:03:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:03:39 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:03:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:03:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:03:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:03:40 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 11:03:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83001be0-c830-41cc-ae51-c6cefa9427d5/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:03:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83001be0-c830-41cc-ae51-c6cefa9427d5/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:03:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83001be0-c830-41cc-ae51-c6cefa9427d5/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:03:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83001be0-c830-41cc-ae51-c6cefa9427d5/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:03:40 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 11:03:40 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 11:03:40 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=8865MB free_disk=24.945270538330078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 11:03:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:03:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:03:40 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 83001be0-c830-41cc-ae51-c6cefa9427d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 11:03:40 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 11:03:40 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 11:03:40 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 11:03:40 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 11:03:41 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 11:03:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.216s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:03:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:03:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:03:54 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:03:54 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:03:54 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 11:03:54 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:03:54 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:03:54 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:03:59 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:04:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:04:09 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:04:14 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:04:19 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:04:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:04:29 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:04:30 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:04:30 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:04:30 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 11:04:30 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Rebuilding the list of instances to heal {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 11:04:31 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "refresh_cache-83001be0-c830-41cc-ae51-c6cefa9427d5" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 11:04:31 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquired lock "refresh_cache-83001be0-c830-41cc-ae51-c6cefa9427d5" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 11:04:31 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Forcefully refreshing network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 11:04:31 user nova-compute[72362]: DEBUG nova.objects.instance [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lazy-loading 'info_cache' on Instance uuid 83001be0-c830-41cc-ae51-c6cefa9427d5 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 11:04:31 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Updating instance_info_cache with network_info: [{"id": "29efac0a-52ab-471c-9f79-0d94142311f2", "address": "fa:16:3e:37:b4:94", "network": {"id": "f812ec4b-c0a0-4d6c-84e9-5b50199ad17a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2039781156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09af0e64509144b28ebccba3d90aee65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29efac0a-52", "ovs_interfaceid": "29efac0a-52ab-471c-9f79-0d94142311f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 11:04:31 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Releasing lock "refresh_cache-83001be0-c830-41cc-ae51-c6cefa9427d5" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 11:04:31 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Updated the network info_cache for instance {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 11:04:33 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:04:33 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:04:33 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 11:04:34 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:04:34 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:04:34 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 11:04:34 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:04:34 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:04:34 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:04:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0269f3f3-67f0-447b-914e-94a5c63bec48 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Acquiring lock "83001be0-c830-41cc-ae51-c6cefa9427d5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:04:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0269f3f3-67f0-447b-914e-94a5c63bec48 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "83001be0-c830-41cc-ae51-c6cefa9427d5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:04:34 user nova-compute[72362]: DEBUG nova.objects.instance [None req-0269f3f3-67f0-447b-914e-94a5c63bec48 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lazy-loading 'flavor' on Instance uuid 83001be0-c830-41cc-ae51-c6cefa9427d5 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 11:04:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0269f3f3-67f0-447b-914e-94a5c63bec48 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "83001be0-c830-41cc-ae51-c6cefa9427d5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:04:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0269f3f3-67f0-447b-914e-94a5c63bec48 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Acquiring lock "83001be0-c830-41cc-ae51-c6cefa9427d5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:04:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0269f3f3-67f0-447b-914e-94a5c63bec48 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "83001be0-c830-41cc-ae51-c6cefa9427d5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:04:34 user nova-compute[72362]: INFO nova.compute.manager [None req-0269f3f3-67f0-447b-914e-94a5c63bec48 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Attaching volume 4a544ac1-7f56-4afb-a116-b54851539c6f to /dev/vdb
Aug 09 11:04:34 user nova-compute[72362]: DEBUG os_brick.utils [None req-0269f3f3-67f0-447b-914e-94a5c63bec48 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 11:04:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:04:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:04:34 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[91203db6-4ee8-4deb-be13-b150951db36e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:04:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:04:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:04:34 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a7048f-263a-4eb4-8549-53cd52aa7608]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:04:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:04:34 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:04:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:04:34 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91c5860-b2ac-4093-b34b-43b2bf1e95c9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:04:34 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5ffab6-94a9-45f4-8c5a-28eeba761bab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:04:34 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-0269f3f3-67f0-447b-914e-94a5c63bec48 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:04:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-0269f3f3-67f0-447b-914e-94a5c63bec48 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 11:04:35 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0269f3f3-67f0-447b-914e-94a5c63bec48 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 11:04:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:04:35 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 11:04:35 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 11:04:35 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d1f263-447c-4510-9784-8d94e341e0ea]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:04:35 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-0269f3f3-67f0-447b-914e-94a5c63bec48 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 11:04:35 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-0269f3f3-67f0-447b-914e-94a5c63bec48 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 11:04:35 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-0269f3f3-67f0-447b-914e-94a5c63bec48 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 11:04:35 user nova-compute[72362]: DEBUG os_brick.utils [None req-0269f3f3-67f0-447b-914e-94a5c63bec48 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 11:04:35 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-0269f3f3-67f0-447b-914e-94a5c63bec48 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Updating existing volume attachment record: a7ce2f2d-a8f1-4fc2-8023-eea77e10e702 {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 11:04:35 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:04:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:04:39 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:04:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:04:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.003s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:04:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:04:40 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 11:04:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83001be0-c830-41cc-ae51-c6cefa9427d5/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:04:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83001be0-c830-41cc-ae51-c6cefa9427d5/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:04:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83001be0-c830-41cc-ae51-c6cefa9427d5/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:04:40 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83001be0-c830-41cc-ae51-c6cefa9427d5/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:04:40 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 11:04:40 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 11:04:40 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=8849MB free_disk=24.944530487060547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 11:04:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:04:40 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:04:40 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 83001be0-c830-41cc-ae51-c6cefa9427d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 11:04:40 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 11:04:40 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 11:04:41 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 11:04:41 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 11:04:41 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 11:04:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.184s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:04:42 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:04:42 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:04:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:04:48 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0269f3f3-67f0-447b-914e-94a5c63bec48 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 11:04:48 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-0269f3f3-67f0-447b-914e-94a5c63bec48 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4a544ac1-7f56-4afb-a116-b54851539c6f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cVBfzvWT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 11:04:48 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-0269f3f3-67f0-447b-914e-94a5c63bec48 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 11:04:48 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-0269f3f3-67f0-447b-914e-94a5c63bec48 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 11:04:48 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-0269f3f3-67f0-447b-914e-94a5c63bec48 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 11:04:48 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-0269f3f3-67f0-447b-914e-94a5c63bec48 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 11:04:48 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-0269f3f3-67f0-447b-914e-94a5c63bec48 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a544ac1-7f56-4afb-a116-b54851539c6f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 11:04:48 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-0269f3f3-67f0-447b-914e-94a5c63bec48 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a544ac1-7f56-4afb-a116-b54851539c6f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 11:04:48 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-0269f3f3-67f0-447b-914e-94a5c63bec48 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 11:04:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a544ac1-7f56-4afb-a116-b54851539c6f -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:04:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a544ac1-7f56-4afb-a116-b54851539c6f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:04:48 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[778c6bd2-3c2f-4461-af9e-9a58a612b8df]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:04:48 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-0269f3f3-67f0-447b-914e-94a5c63bec48 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 11:04:48 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:04:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a544ac1-7f56-4afb-a116-b54851539c6f -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:04:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a544ac1-7f56-4afb-a116-b54851539c6f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:04:48 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b120f55-51e4-4050-9fc6-b117343c72b2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a544ac1-7f56-4afb-a116-b54851539c6f] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:04:48 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-0269f3f3-67f0-447b-914e-94a5c63bec48 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a544ac1-7f56-4afb-a116-b54851539c6f] added
Aug 09 11:04:48 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:04:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a544ac1-7f56-4afb-a116-b54851539c6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:04:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a544ac1-7f56-4afb-a116-b54851539c6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:04:48 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6117cbc-e329-4a1c-8e74-8c84fe93bf04]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:04:48 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-0269f3f3-67f0-447b-914e-94a5c63bec48 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:04:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a544ac1-7f56-4afb-a116-b54851539c6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:04:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a544ac1-7f56-4afb-a116-b54851539c6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:04:48 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a98a4fe-6d51-4102-812a-e91132dfd99f]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:04:48 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-0269f3f3-67f0-447b-914e-94a5c63bec48 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:04:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a544ac1-7f56-4afb-a116-b54851539c6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cVBfzvWT {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:04:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a544ac1-7f56-4afb-a116-b54851539c6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cVBfzvWT" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:04:48 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9239e8-5b77-4083-b106-3df6d9737b54]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:04:48 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-0269f3f3-67f0-447b-914e-94a5c63bec48 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cVBfzvWT'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:04:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a544ac1-7f56-4afb-a116-b54851539c6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:04:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a544ac1-7f56-4afb-a116-b54851539c6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:04:48 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb4e7b9-1c89-4923-a16e-80fbe9e76d43]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:04:48 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-0269f3f3-67f0-447b-914e-94a5c63bec48 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:04:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:04:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:04:48 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fed3d21-dbb0-4883-88ec-c297225d5a90]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:04:48 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-0269f3f3-67f0-447b-914e-94a5c63bec48 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 11:04:48 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 11:04:48 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-0269f3f3-67f0-447b-914e-94a5c63bec48 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 11:04:48 user nova-compute[72362]:  {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 11:04:48 user nova-compute[72362]: WARNING os_brick.initiator.connectors.iscsi [None req-0269f3f3-67f0-447b-914e-94a5c63bec48 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 11:04:48 user nova-compute[72362]: 
Aug 09 11:04:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a544ac1-7f56-4afb-a116-b54851539c6f -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:04:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a544ac1-7f56-4afb-a116-b54851539c6f -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:04:48 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b780ff-f83d-4437-b786-74e76b3852e9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a544ac1-7f56-4afb-a116-b54851539c6f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4a544ac1-7f56-4afb-a116-b54851539c6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:04:48 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-0269f3f3-67f0-447b-914e-94a5c63bec48 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a544ac1-7f56-4afb-a116-b54851539c6f, portal: 172.16.0.220,3260]
Aug 09 11:04:48 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:4a544ac1-7f56-4afb-a116-b54851539c6f, portal: 172.16.0.220,3260] successful.
Aug 09 11:04:48 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:04:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a544ac1-7f56-4afb-a116-b54851539c6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:04:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a544ac1-7f56-4afb-a116-b54851539c6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:04:48 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ec4cf4-2110-4600-9968-331884d656b2]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:04:48 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-0269f3f3-67f0-447b-914e-94a5c63bec48 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:04:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:04:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:04:48 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7b35f6-4682-49e3-ac9f-95c7b62bf937]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a544ac1-7f56-4afb-a116-b54851539c6f (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:04:48 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-0269f3f3-67f0-447b-914e-94a5c63bec48 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a544ac1-7f56-4afb-a116-b54851539c6f (non-flash)
Aug 09 11:04:48 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 11:04:48 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-0269f3f3-67f0-447b-914e-94a5c63bec48 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a544ac1-7f56-4afb-a116-b54851539c6f (non-flash)
Aug 09 11:04:48 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 11:04:48 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-0269f3f3-67f0-447b-914e-94a5c63bec48 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a544ac1-7f56-4afb-a116-b54851539c6f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 11:04:48 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-0269f3f3-67f0-447b-914e-94a5c63bec48 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 11:04:48 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-0269f3f3-67f0-447b-914e-94a5c63bec48 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] HCTL ('33', '-', '-', 0) found on session 63 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 11:04:48 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-0269f3f3-67f0-447b-914e-94a5c63bec48 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 11:04:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:04:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:04:48 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[2087b301-ec42-46af-93e6-ff15b52e25b7]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:04:48 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-0269f3f3-67f0-447b-914e-94a5c63bec48 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 11:04:48 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-0269f3f3-67f0-447b-914e-94a5c63bec48 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cVBfzvWT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 11:04:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:04:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:04:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 11:04:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:04:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:04:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:04:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-0269f3f3-67f0-447b-914e-94a5c63bec48 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 11:04:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-0269f3f3-67f0-447b-914e-94a5c63bec48 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23832376462336132', 'path': '/dev/sdb'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 11:04:49 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0269f3f3-67f0-447b-914e-94a5c63bec48 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832376462336132', 'path': '/dev/sdb'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 11:04:49 user nova-compute[72362]: DEBUG nova.objects.instance [None req-0269f3f3-67f0-447b-914e-94a5c63bec48 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lazy-loading 'flavor' on Instance uuid 83001be0-c830-41cc-ae51-c6cefa9427d5 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 11:04:49 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-0269f3f3-67f0-447b-914e-94a5c63bec48 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 11:04:49 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 11:04:49 user nova-compute[72362]:   <source dev="/dev/sdb"/>
Aug 09 11:04:49 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 11:04:49 user nova-compute[72362]:   <serial>4a544ac1-7f56-4afb-a116-b54851539c6f</serial>
Aug 09 11:04:49 user nova-compute[72362]: </disk>
Aug 09 11:04:49 user nova-compute[72362]:  {{(pid=72362) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 11:04:50 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-0269f3f3-67f0-447b-914e-94a5c63bec48 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 11:04:50 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-0269f3f3-67f0-447b-914e-94a5c63bec48 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 11:04:50 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-0269f3f3-67f0-447b-914e-94a5c63bec48 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] No VIF found with MAC fa:16:3e:37:b4:94, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 11:04:50 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-0269f3f3-67f0-447b-914e-94a5c63bec48 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "83001be0-c830-41cc-ae51-c6cefa9427d5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.298s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:04:50 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:04:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:04:52 user nova-compute[72362]: DEBUG nova.compute.manager [req-0eb42ee5-ebf9-4b25-a66c-89a9c0401352 req-8477001c-64e7-42da-b748-16516e397449 service nova] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Received event network-changed-29efac0a-52ab-471c-9f79-0d94142311f2 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 11:04:52 user nova-compute[72362]: DEBUG nova.compute.manager [req-0eb42ee5-ebf9-4b25-a66c-89a9c0401352 req-8477001c-64e7-42da-b748-16516e397449 service nova] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Refreshing instance network info cache due to event network-changed-29efac0a-52ab-471c-9f79-0d94142311f2. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 11:04:52 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-0eb42ee5-ebf9-4b25-a66c-89a9c0401352 req-8477001c-64e7-42da-b748-16516e397449 service nova] Acquiring lock "refresh_cache-83001be0-c830-41cc-ae51-c6cefa9427d5" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 11:04:52 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-0eb42ee5-ebf9-4b25-a66c-89a9c0401352 req-8477001c-64e7-42da-b748-16516e397449 service nova] Acquired lock "refresh_cache-83001be0-c830-41cc-ae51-c6cefa9427d5" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 11:04:52 user nova-compute[72362]: DEBUG nova.network.neutron [req-0eb42ee5-ebf9-4b25-a66c-89a9c0401352 req-8477001c-64e7-42da-b748-16516e397449 service nova] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Refreshing network info cache for port 29efac0a-52ab-471c-9f79-0d94142311f2 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 11:04:53 user nova-compute[72362]: DEBUG nova.network.neutron [req-0eb42ee5-ebf9-4b25-a66c-89a9c0401352 req-8477001c-64e7-42da-b748-16516e397449 service nova] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Updated VIF entry in instance network info cache for port 29efac0a-52ab-471c-9f79-0d94142311f2. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 11:04:53 user nova-compute[72362]: DEBUG nova.network.neutron [req-0eb42ee5-ebf9-4b25-a66c-89a9c0401352 req-8477001c-64e7-42da-b748-16516e397449 service nova] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Updating instance_info_cache with network_info: [{"id": "29efac0a-52ab-471c-9f79-0d94142311f2", "address": "fa:16:3e:37:b4:94", "network": {"id": "f812ec4b-c0a0-4d6c-84e9-5b50199ad17a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2039781156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09af0e64509144b28ebccba3d90aee65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29efac0a-52", "ovs_interfaceid": "29efac0a-52ab-471c-9f79-0d94142311f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 11:04:53 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-0eb42ee5-ebf9-4b25-a66c-89a9c0401352 req-8477001c-64e7-42da-b748-16516e397449 service nova] Releasing lock "refresh_cache-83001be0-c830-41cc-ae51-c6cefa9427d5" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 11:04:54 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:04:54 user nova-compute[72362]: DEBUG nova.compute.manager [req-829c4cc6-4a32-4dbf-b6ec-7d8f27961b9c req-650aedfb-f5ac-41df-8016-b230f2f076b4 service nova] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Received event network-changed-29efac0a-52ab-471c-9f79-0d94142311f2 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 11:04:54 user nova-compute[72362]: DEBUG nova.compute.manager [req-829c4cc6-4a32-4dbf-b6ec-7d8f27961b9c req-650aedfb-f5ac-41df-8016-b230f2f076b4 service nova] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Refreshing instance network info cache due to event network-changed-29efac0a-52ab-471c-9f79-0d94142311f2. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 11:04:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-829c4cc6-4a32-4dbf-b6ec-7d8f27961b9c req-650aedfb-f5ac-41df-8016-b230f2f076b4 service nova] Acquiring lock "refresh_cache-83001be0-c830-41cc-ae51-c6cefa9427d5" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 11:04:54 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-829c4cc6-4a32-4dbf-b6ec-7d8f27961b9c req-650aedfb-f5ac-41df-8016-b230f2f076b4 service nova] Acquired lock "refresh_cache-83001be0-c830-41cc-ae51-c6cefa9427d5" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 11:04:54 user nova-compute[72362]: DEBUG nova.network.neutron [req-829c4cc6-4a32-4dbf-b6ec-7d8f27961b9c req-650aedfb-f5ac-41df-8016-b230f2f076b4 service nova] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Refreshing network info cache for port 29efac0a-52ab-471c-9f79-0d94142311f2 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 11:04:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-159fb974-9c30-4e15-b408-f990241e092f tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Acquiring lock "83001be0-c830-41cc-ae51-c6cefa9427d5" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:04:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-159fb974-9c30-4e15-b408-f990241e092f tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "83001be0-c830-41cc-ae51-c6cefa9427d5" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:04:55 user nova-compute[72362]: INFO nova.compute.manager [None req-159fb974-9c30-4e15-b408-f990241e092f tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Rebooting instance
Aug 09 11:04:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-159fb974-9c30-4e15-b408-f990241e092f tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Acquiring lock "refresh_cache-83001be0-c830-41cc-ae51-c6cefa9427d5" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 11:04:55 user nova-compute[72362]: DEBUG nova.network.neutron [req-829c4cc6-4a32-4dbf-b6ec-7d8f27961b9c req-650aedfb-f5ac-41df-8016-b230f2f076b4 service nova] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Updated VIF entry in instance network info cache for port 29efac0a-52ab-471c-9f79-0d94142311f2. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 11:04:55 user nova-compute[72362]: DEBUG nova.network.neutron [req-829c4cc6-4a32-4dbf-b6ec-7d8f27961b9c req-650aedfb-f5ac-41df-8016-b230f2f076b4 service nova] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Updating instance_info_cache with network_info: [{"id": "29efac0a-52ab-471c-9f79-0d94142311f2", "address": "fa:16:3e:37:b4:94", "network": {"id": "f812ec4b-c0a0-4d6c-84e9-5b50199ad17a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2039781156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09af0e64509144b28ebccba3d90aee65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29efac0a-52", "ovs_interfaceid": "29efac0a-52ab-471c-9f79-0d94142311f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 11:04:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-829c4cc6-4a32-4dbf-b6ec-7d8f27961b9c req-650aedfb-f5ac-41df-8016-b230f2f076b4 service nova] Releasing lock "refresh_cache-83001be0-c830-41cc-ae51-c6cefa9427d5" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 11:04:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-159fb974-9c30-4e15-b408-f990241e092f tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Acquired lock "refresh_cache-83001be0-c830-41cc-ae51-c6cefa9427d5" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 11:04:55 user nova-compute[72362]: DEBUG nova.network.neutron [None req-159fb974-9c30-4e15-b408-f990241e092f tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 11:04:55 user nova-compute[72362]: DEBUG nova.network.neutron [None req-159fb974-9c30-4e15-b408-f990241e092f tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Updating instance_info_cache with network_info: [{"id": "29efac0a-52ab-471c-9f79-0d94142311f2", "address": "fa:16:3e:37:b4:94", "network": {"id": "f812ec4b-c0a0-4d6c-84e9-5b50199ad17a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2039781156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09af0e64509144b28ebccba3d90aee65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29efac0a-52", "ovs_interfaceid": "29efac0a-52ab-471c-9f79-0d94142311f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 11:04:55 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-159fb974-9c30-4e15-b408-f990241e092f tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Releasing lock "refresh_cache-83001be0-c830-41cc-ae51-c6cefa9427d5" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 11:04:55 user nova-compute[72362]: DEBUG nova.compute.manager [None req-159fb974-9c30-4e15-b408-f990241e092f tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 11:04:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:04:58 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:04:58 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:04:58 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:04:58 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:04:58 user nova-compute[72362]: DEBUG nova.compute.manager [req-22af623d-976c-4675-974e-2680ce9b48e2 req-9df91252-6b22-4dbf-bc77-643c41372880 service nova] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Received event network-vif-unplugged-29efac0a-52ab-471c-9f79-0d94142311f2 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 11:04:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-22af623d-976c-4675-974e-2680ce9b48e2 req-9df91252-6b22-4dbf-bc77-643c41372880 service nova] Acquiring lock "83001be0-c830-41cc-ae51-c6cefa9427d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:04:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-22af623d-976c-4675-974e-2680ce9b48e2 req-9df91252-6b22-4dbf-bc77-643c41372880 service nova] Lock "83001be0-c830-41cc-ae51-c6cefa9427d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:04:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-22af623d-976c-4675-974e-2680ce9b48e2 req-9df91252-6b22-4dbf-bc77-643c41372880 service nova] Lock "83001be0-c830-41cc-ae51-c6cefa9427d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:04:58 user nova-compute[72362]: DEBUG nova.compute.manager [req-22af623d-976c-4675-974e-2680ce9b48e2 req-9df91252-6b22-4dbf-bc77-643c41372880 service nova] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] No waiting events found dispatching network-vif-unplugged-29efac0a-52ab-471c-9f79-0d94142311f2 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 11:04:58 user nova-compute[72362]: WARNING nova.compute.manager [req-22af623d-976c-4675-974e-2680ce9b48e2 req-9df91252-6b22-4dbf-bc77-643c41372880 service nova] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Received unexpected event network-vif-unplugged-29efac0a-52ab-471c-9f79-0d94142311f2 for instance with vm_state active and task_state reboot_started.
Aug 09 11:04:59 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-159fb974-9c30-4e15-b408-f990241e092f tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Instance shutdown successfully.
Aug 09 11:04:59 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:05:00 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:05:00 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:05:00 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:05:00 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:05:00 user nova-compute[72362]: DEBUG nova.compute.manager [req-b1bb83ff-8745-455a-b3b9-785cb093198e req-e492212c-c79d-4f3e-8188-4f1f9c0ea0aa service nova] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Received event network-vif-plugged-29efac0a-52ab-471c-9f79-0d94142311f2 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 11:05:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b1bb83ff-8745-455a-b3b9-785cb093198e req-e492212c-c79d-4f3e-8188-4f1f9c0ea0aa service nova] Acquiring lock "83001be0-c830-41cc-ae51-c6cefa9427d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:05:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b1bb83ff-8745-455a-b3b9-785cb093198e req-e492212c-c79d-4f3e-8188-4f1f9c0ea0aa service nova] Lock "83001be0-c830-41cc-ae51-c6cefa9427d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:05:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b1bb83ff-8745-455a-b3b9-785cb093198e req-e492212c-c79d-4f3e-8188-4f1f9c0ea0aa service nova] Lock "83001be0-c830-41cc-ae51-c6cefa9427d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:05:00 user nova-compute[72362]: DEBUG nova.compute.manager [req-b1bb83ff-8745-455a-b3b9-785cb093198e req-e492212c-c79d-4f3e-8188-4f1f9c0ea0aa service nova] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] No waiting events found dispatching network-vif-plugged-29efac0a-52ab-471c-9f79-0d94142311f2 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 11:05:00 user nova-compute[72362]: WARNING nova.compute.manager [req-b1bb83ff-8745-455a-b3b9-785cb093198e req-e492212c-c79d-4f3e-8188-4f1f9c0ea0aa service nova] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Received unexpected event network-vif-plugged-29efac0a-52ab-471c-9f79-0d94142311f2 for instance with vm_state active and task_state reboot_started.
Aug 09 11:05:00 user nova-compute[72362]: DEBUG nova.compute.manager [req-b1bb83ff-8745-455a-b3b9-785cb093198e req-e492212c-c79d-4f3e-8188-4f1f9c0ea0aa service nova] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Received event network-vif-plugged-29efac0a-52ab-471c-9f79-0d94142311f2 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 11:05:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b1bb83ff-8745-455a-b3b9-785cb093198e req-e492212c-c79d-4f3e-8188-4f1f9c0ea0aa service nova] Acquiring lock "83001be0-c830-41cc-ae51-c6cefa9427d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:05:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b1bb83ff-8745-455a-b3b9-785cb093198e req-e492212c-c79d-4f3e-8188-4f1f9c0ea0aa service nova] Lock "83001be0-c830-41cc-ae51-c6cefa9427d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:05:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b1bb83ff-8745-455a-b3b9-785cb093198e req-e492212c-c79d-4f3e-8188-4f1f9c0ea0aa service nova] Lock "83001be0-c830-41cc-ae51-c6cefa9427d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:05:00 user nova-compute[72362]: DEBUG nova.compute.manager [req-b1bb83ff-8745-455a-b3b9-785cb093198e req-e492212c-c79d-4f3e-8188-4f1f9c0ea0aa service nova] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] No waiting events found dispatching network-vif-plugged-29efac0a-52ab-471c-9f79-0d94142311f2 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 11:05:00 user nova-compute[72362]: WARNING nova.compute.manager [req-b1bb83ff-8745-455a-b3b9-785cb093198e req-e492212c-c79d-4f3e-8188-4f1f9c0ea0aa service nova] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Received unexpected event network-vif-plugged-29efac0a-52ab-471c-9f79-0d94142311f2 for instance with vm_state active and task_state reboot_started.
Aug 09 11:05:00 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:05:00 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:05:02 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Removed pending event for 83001be0-c830-41cc-ae51-c6cefa9427d5 due to event {{(pid=72362) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 11:05:02 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691579102.406658, 83001be0-c830-41cc-ae51-c6cefa9427d5 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 11:05:02 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] VM Resumed (Lifecycle Event)
Aug 09 11:05:02 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Instance running successfully.
Aug 09 11:05:02 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-159fb974-9c30-4e15-b408-f990241e092f tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Instance soft rebooted successfully.
Aug 09 11:05:02 user nova-compute[72362]: DEBUG nova.compute.manager [None req-159fb974-9c30-4e15-b408-f990241e092f tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 11:05:02 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 11:05:02 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 11:05:02 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 09 11:05:02 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691579102.408635, 83001be0-c830-41cc-ae51-c6cefa9427d5 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 11:05:02 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] VM Started (Lifecycle Event)
Aug 09 11:05:02 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 11:05:02 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 11:05:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-159fb974-9c30-4e15-b408-f990241e092f tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "83001be0-c830-41cc-ae51-c6cefa9427d5" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.305s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:05:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:05:02 user nova-compute[72362]: DEBUG nova.compute.manager [req-2bc4ab56-6a61-4516-920b-3a273ef73541 req-049198ec-60f8-499c-9129-4d6d86d87ff6 service nova] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Received event network-vif-plugged-29efac0a-52ab-471c-9f79-0d94142311f2 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 11:05:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-2bc4ab56-6a61-4516-920b-3a273ef73541 req-049198ec-60f8-499c-9129-4d6d86d87ff6 service nova] Acquiring lock "83001be0-c830-41cc-ae51-c6cefa9427d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:05:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-2bc4ab56-6a61-4516-920b-3a273ef73541 req-049198ec-60f8-499c-9129-4d6d86d87ff6 service nova] Lock "83001be0-c830-41cc-ae51-c6cefa9427d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:05:02 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-2bc4ab56-6a61-4516-920b-3a273ef73541 req-049198ec-60f8-499c-9129-4d6d86d87ff6 service nova] Lock "83001be0-c830-41cc-ae51-c6cefa9427d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:05:02 user nova-compute[72362]: DEBUG nova.compute.manager [req-2bc4ab56-6a61-4516-920b-3a273ef73541 req-049198ec-60f8-499c-9129-4d6d86d87ff6 service nova] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] No waiting events found dispatching network-vif-plugged-29efac0a-52ab-471c-9f79-0d94142311f2 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 11:05:02 user nova-compute[72362]: WARNING nova.compute.manager [req-2bc4ab56-6a61-4516-920b-3a273ef73541 req-049198ec-60f8-499c-9129-4d6d86d87ff6 service nova] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Received unexpected event network-vif-plugged-29efac0a-52ab-471c-9f79-0d94142311f2 for instance with vm_state active and task_state None.
Aug 09 11:05:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:05:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:05:09 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:05:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:05:14 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:05:17 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:05:19 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:05:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:05:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:05:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:05:29 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:05:29 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:05:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:05:32 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:05:32 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 11:05:32 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Rebuilding the list of instances to heal {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 11:05:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "refresh_cache-83001be0-c830-41cc-ae51-c6cefa9427d5" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 11:05:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquired lock "refresh_cache-83001be0-c830-41cc-ae51-c6cefa9427d5" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 11:05:33 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Forcefully refreshing network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 11:05:33 user nova-compute[72362]: DEBUG nova.objects.instance [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lazy-loading 'info_cache' on Instance uuid 83001be0-c830-41cc-ae51-c6cefa9427d5 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 11:05:33 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Updating instance_info_cache with network_info: [{"id": "29efac0a-52ab-471c-9f79-0d94142311f2", "address": "fa:16:3e:37:b4:94", "network": {"id": "f812ec4b-c0a0-4d6c-84e9-5b50199ad17a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2039781156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09af0e64509144b28ebccba3d90aee65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29efac0a-52", "ovs_interfaceid": "29efac0a-52ab-471c-9f79-0d94142311f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 11:05:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Releasing lock "refresh_cache-83001be0-c830-41cc-ae51-c6cefa9427d5" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 11:05:33 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Updated the network info_cache for instance {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 11:05:34 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:05:34 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:05:34 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:05:34 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 11:05:35 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:05:36 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:05:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:05:41 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:05:41 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:05:41 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:05:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:05:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:05:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:05:41 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 11:05:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83001be0-c830-41cc-ae51-c6cefa9427d5/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:05:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83001be0-c830-41cc-ae51-c6cefa9427d5/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:05:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83001be0-c830-41cc-ae51-c6cefa9427d5/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:05:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83001be0-c830-41cc-ae51-c6cefa9427d5/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:05:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 11:05:42 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 11:05:42 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 11:05:42 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=8818MB free_disk=24.942676544189453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 11:05:42 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:05:42 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:05:42 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 83001be0-c830-41cc-ae51-c6cefa9427d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 11:05:42 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 11:05:42 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 11:05:42 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 11:05:42 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 11:05:42 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 11:05:42 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.153s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:05:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:05:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:05:54 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:05:59 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:06:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:06:09 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:06:14 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:06:19 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:06:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:06:29 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:06:30 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:06:32 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:06:32 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 11:06:32 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Rebuilding the list of instances to heal {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 11:06:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "refresh_cache-83001be0-c830-41cc-ae51-c6cefa9427d5" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 11:06:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquired lock "refresh_cache-83001be0-c830-41cc-ae51-c6cefa9427d5" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 11:06:33 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Forcefully refreshing network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 11:06:33 user nova-compute[72362]: DEBUG nova.objects.instance [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lazy-loading 'info_cache' on Instance uuid 83001be0-c830-41cc-ae51-c6cefa9427d5 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 11:06:33 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Updating instance_info_cache with network_info: [{"id": "29efac0a-52ab-471c-9f79-0d94142311f2", "address": "fa:16:3e:37:b4:94", "network": {"id": "f812ec4b-c0a0-4d6c-84e9-5b50199ad17a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2039781156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09af0e64509144b28ebccba3d90aee65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29efac0a-52", "ovs_interfaceid": "29efac0a-52ab-471c-9f79-0d94142311f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 11:06:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Releasing lock "refresh_cache-83001be0-c830-41cc-ae51-c6cefa9427d5" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 11:06:33 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Updated the network info_cache for instance {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 11:06:34 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:06:35 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:06:36 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:06:36 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 11:06:37 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:06:37 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:06:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:06:41 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:06:42 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:06:42 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:06:42 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:06:42 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 11:06:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83001be0-c830-41cc-ae51-c6cefa9427d5/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:06:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83001be0-c830-41cc-ae51-c6cefa9427d5/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:06:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83001be0-c830-41cc-ae51-c6cefa9427d5/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:06:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83001be0-c830-41cc-ae51-c6cefa9427d5/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:06:42 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 11:06:42 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 11:06:42 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 11:06:42 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=8851MB free_disk=24.942123413085938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 11:06:42 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:06:42 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:06:42 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 83001be0-c830-41cc-ae51-c6cefa9427d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 11:06:42 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 11:06:42 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 11:06:42 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 11:06:42 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 11:06:42 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 11:06:42 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.205s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:06:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:06:44 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:06:44 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:06:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:06:47 user nova-compute[72362]: DEBUG nova.compute.manager [req-76297d16-fac8-4731-8d07-90b78baa74a2 req-79578ec2-c989-463b-88fa-d36740cdcff0 service nova] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Received event network-changed-29efac0a-52ab-471c-9f79-0d94142311f2 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 11:06:47 user nova-compute[72362]: DEBUG nova.compute.manager [req-76297d16-fac8-4731-8d07-90b78baa74a2 req-79578ec2-c989-463b-88fa-d36740cdcff0 service nova] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Refreshing instance network info cache due to event network-changed-29efac0a-52ab-471c-9f79-0d94142311f2. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 11:06:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-76297d16-fac8-4731-8d07-90b78baa74a2 req-79578ec2-c989-463b-88fa-d36740cdcff0 service nova] Acquiring lock "refresh_cache-83001be0-c830-41cc-ae51-c6cefa9427d5" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 11:06:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-76297d16-fac8-4731-8d07-90b78baa74a2 req-79578ec2-c989-463b-88fa-d36740cdcff0 service nova] Acquired lock "refresh_cache-83001be0-c830-41cc-ae51-c6cefa9427d5" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 11:06:47 user nova-compute[72362]: DEBUG nova.network.neutron [req-76297d16-fac8-4731-8d07-90b78baa74a2 req-79578ec2-c989-463b-88fa-d36740cdcff0 service nova] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Refreshing network info cache for port 29efac0a-52ab-471c-9f79-0d94142311f2 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 11:06:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:06:47 user nova-compute[72362]: DEBUG nova.network.neutron [req-76297d16-fac8-4731-8d07-90b78baa74a2 req-79578ec2-c989-463b-88fa-d36740cdcff0 service nova] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Updated VIF entry in instance network info cache for port 29efac0a-52ab-471c-9f79-0d94142311f2. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 11:06:47 user nova-compute[72362]: DEBUG nova.network.neutron [req-76297d16-fac8-4731-8d07-90b78baa74a2 req-79578ec2-c989-463b-88fa-d36740cdcff0 service nova] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Updating instance_info_cache with network_info: [{"id": "29efac0a-52ab-471c-9f79-0d94142311f2", "address": "fa:16:3e:37:b4:94", "network": {"id": "f812ec4b-c0a0-4d6c-84e9-5b50199ad17a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2039781156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09af0e64509144b28ebccba3d90aee65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29efac0a-52", "ovs_interfaceid": "29efac0a-52ab-471c-9f79-0d94142311f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 11:06:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-76297d16-fac8-4731-8d07-90b78baa74a2 req-79578ec2-c989-463b-88fa-d36740cdcff0 service nova] Releasing lock "refresh_cache-83001be0-c830-41cc-ae51-c6cefa9427d5" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 11:06:48 user nova-compute[72362]: DEBUG nova.compute.manager [req-4084f1f2-2159-407d-9b17-e0ab1f2251d1 req-efe08217-c8b3-47df-b1fa-cc11b2beb10b service nova] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Received event network-changed-29efac0a-52ab-471c-9f79-0d94142311f2 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 11:06:48 user nova-compute[72362]: DEBUG nova.compute.manager [req-4084f1f2-2159-407d-9b17-e0ab1f2251d1 req-efe08217-c8b3-47df-b1fa-cc11b2beb10b service nova] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Refreshing instance network info cache due to event network-changed-29efac0a-52ab-471c-9f79-0d94142311f2. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 11:06:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-4084f1f2-2159-407d-9b17-e0ab1f2251d1 req-efe08217-c8b3-47df-b1fa-cc11b2beb10b service nova] Acquiring lock "refresh_cache-83001be0-c830-41cc-ae51-c6cefa9427d5" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 11:06:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-4084f1f2-2159-407d-9b17-e0ab1f2251d1 req-efe08217-c8b3-47df-b1fa-cc11b2beb10b service nova] Acquired lock "refresh_cache-83001be0-c830-41cc-ae51-c6cefa9427d5" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 11:06:48 user nova-compute[72362]: DEBUG nova.network.neutron [req-4084f1f2-2159-407d-9b17-e0ab1f2251d1 req-efe08217-c8b3-47df-b1fa-cc11b2beb10b service nova] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Refreshing network info cache for port 29efac0a-52ab-471c-9f79-0d94142311f2 {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 11:06:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-8484c01c-4dc8-4154-99fe-2289e5d687b6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Acquiring lock "83001be0-c830-41cc-ae51-c6cefa9427d5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:06:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-8484c01c-4dc8-4154-99fe-2289e5d687b6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "83001be0-c830-41cc-ae51-c6cefa9427d5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:06:48 user nova-compute[72362]: INFO nova.compute.manager [None req-8484c01c-4dc8-4154-99fe-2289e5d687b6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Detaching volume 4a544ac1-7f56-4afb-a116-b54851539c6f
Aug 09 11:06:48 user nova-compute[72362]: INFO nova.virt.block_device [None req-8484c01c-4dc8-4154-99fe-2289e5d687b6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Attempting to driver detach volume 4a544ac1-7f56-4afb-a116-b54851539c6f from mountpoint /dev/vdb
Aug 09 11:06:48 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-8484c01c-4dc8-4154-99fe-2289e5d687b6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Attempting to detach device vdb from instance 83001be0-c830-41cc-ae51-c6cefa9427d5 from the persistent domain config. {{(pid=72362) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 11:06:48 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-8484c01c-4dc8-4154-99fe-2289e5d687b6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 11:06:48 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 11:06:48 user nova-compute[72362]:   <source dev="/dev/sdb"/>
Aug 09 11:06:48 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 11:06:48 user nova-compute[72362]:   <serial>4a544ac1-7f56-4afb-a116-b54851539c6f</serial>
Aug 09 11:06:48 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 11:06:48 user nova-compute[72362]: </disk>
Aug 09 11:06:48 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 11:06:48 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-8484c01c-4dc8-4154-99fe-2289e5d687b6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Successfully detached device vdb from instance 83001be0-c830-41cc-ae51-c6cefa9427d5 from the persistent domain config.
Aug 09 11:06:48 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-8484c01c-4dc8-4154-99fe-2289e5d687b6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 83001be0-c830-41cc-ae51-c6cefa9427d5 from the live domain config. {{(pid=72362) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 11:06:48 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-8484c01c-4dc8-4154-99fe-2289e5d687b6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 11:06:48 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 11:06:48 user nova-compute[72362]:   <source dev="/dev/sdb"/>
Aug 09 11:06:48 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 11:06:48 user nova-compute[72362]:   <serial>4a544ac1-7f56-4afb-a116-b54851539c6f</serial>
Aug 09 11:06:48 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 11:06:48 user nova-compute[72362]: </disk>
Aug 09 11:06:48 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 11:06:49 user nova-compute[72362]: DEBUG nova.network.neutron [req-4084f1f2-2159-407d-9b17-e0ab1f2251d1 req-efe08217-c8b3-47df-b1fa-cc11b2beb10b service nova] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Updated VIF entry in instance network info cache for port 29efac0a-52ab-471c-9f79-0d94142311f2. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 11:06:49 user nova-compute[72362]: DEBUG nova.network.neutron [req-4084f1f2-2159-407d-9b17-e0ab1f2251d1 req-efe08217-c8b3-47df-b1fa-cc11b2beb10b service nova] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Updating instance_info_cache with network_info: [{"id": "29efac0a-52ab-471c-9f79-0d94142311f2", "address": "fa:16:3e:37:b4:94", "network": {"id": "f812ec4b-c0a0-4d6c-84e9-5b50199ad17a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2039781156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09af0e64509144b28ebccba3d90aee65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29efac0a-52", "ovs_interfaceid": "29efac0a-52ab-471c-9f79-0d94142311f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 11:06:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-4084f1f2-2159-407d-9b17-e0ab1f2251d1 req-efe08217-c8b3-47df-b1fa-cc11b2beb10b service nova] Releasing lock "refresh_cache-83001be0-c830-41cc-ae51-c6cefa9427d5" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 11:06:49 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Received event <DeviceRemovedEvent: 1691579209.2590187, 83001be0-c830-41cc-ae51-c6cefa9427d5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72362) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 11:06:49 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-8484c01c-4dc8-4154-99fe-2289e5d687b6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 83001be0-c830-41cc-ae51-c6cefa9427d5 {{(pid=72362) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 11:06:49 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-8484c01c-4dc8-4154-99fe-2289e5d687b6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Successfully detached device vdb from instance 83001be0-c830-41cc-ae51-c6cefa9427d5 from the live domain config.
Aug 09 11:06:49 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8484c01c-4dc8-4154-99fe-2289e5d687b6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 11:06:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-8484c01c-4dc8-4154-99fe-2289e5d687b6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:4a544ac1-7f56-4afb-a116-b54851539c6f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cVBfzvWT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 11:06:49 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-8484c01c-4dc8-4154-99fe-2289e5d687b6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 11:06:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-8484c01c-4dc8-4154-99fe-2289e5d687b6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 11:06:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-8484c01c-4dc8-4154-99fe-2289e5d687b6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 11:06:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-8484c01c-4dc8-4154-99fe-2289e5d687b6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a544ac1-7f56-4afb-a116-b54851539c6f', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 11:06:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:06:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:06:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1cfb35-efbf-498e-8530-8310d4a37091]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a544ac1-7f56-4afb-a116-b54851539c6f\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:06:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:06:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:06:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[919938d1-0e48-493b-b152-e3c63e8fa8c3]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a544ac1-7f56-4afb-a116-b54851539c6f (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:06:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-8484c01c-4dc8-4154-99fe-2289e5d687b6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a544ac1-7f56-4afb-a116-b54851539c6f (non-flash)
Aug 09 11:06:49 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 11:06:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-8484c01c-4dc8-4154-99fe-2289e5d687b6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a544ac1-7f56-4afb-a116-b54851539c6f (non-flash)
Aug 09 11:06:49 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 11:06:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-8484c01c-4dc8-4154-99fe-2289e5d687b6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e424ed40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a544ac1-7f56-4afb-a116-b54851539c6f'): ({'sdb'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 11:06:49 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-8484c01c-4dc8-4154-99fe-2289e5d687b6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Removing single pathed devices sdb {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 11:06:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:06:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:06:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f397b03-e4af-4015-b356-c0c9e7016f7e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:06:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:06:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:06:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[85fd6f63-29ae-4195-874d-e77e9059b102]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:06:49 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-8484c01c-4dc8-4154-99fe-2289e5d687b6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Flushing IO for device /dev/sdb {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 11:06:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:06:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:06:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e56fc44-2e85-4bc7-8bef-95ef67822543]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:06:49 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-8484c01c-4dc8-4154-99fe-2289e5d687b6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 11:06:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:06:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:06:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:06:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[270f6dd0-d0b9-4b9e-9007-d31b3a409cf1]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:06:49 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-8484c01c-4dc8-4154-99fe-2289e5d687b6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 11:06:49 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-8484c01c-4dc8-4154-99fe-2289e5d687b6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] SCSI volumes sdb have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 11:06:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-8484c01c-4dc8-4154-99fe-2289e5d687b6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a544ac1-7f56-4afb-a116-b54851539c6f')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 11:06:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a544ac1-7f56-4afb-a116-b54851539c6f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:06:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a544ac1-7f56-4afb-a116-b54851539c6f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:06:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[896eb1cc-e1e0-4f25-b053-952e888d9e45]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:06:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-8484c01c-4dc8-4154-99fe-2289e5d687b6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:06:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a544ac1-7f56-4afb-a116-b54851539c6f -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:06:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a544ac1-7f56-4afb-a116-b54851539c6f -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:06:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c8187a-f1af-4b7a-b4d6-35d74c1a3504]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:4a544ac1-7f56-4afb-a116-b54851539c6f, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:4a544ac1-7f56-4afb-a116-b54851539c6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:06:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-8484c01c-4dc8-4154-99fe-2289e5d687b6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:4a544ac1-7f56-4afb-a116-b54851539c6f, portal: 172.16.0.220,3260]
Aug 09 11:06:49 user nova-compute[72362]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:4a544ac1-7f56-4afb-a116-b54851539c6f, portal: 172.16.0.220,3260] successful.
Aug 09 11:06:49 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:06:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a544ac1-7f56-4afb-a116-b54851539c6f -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:06:49 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a544ac1-7f56-4afb-a116-b54851539c6f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:06:49 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba71c02-e290-42f8-84d4-4c6dd39ecf75]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:06:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-8484c01c-4dc8-4154-99fe-2289e5d687b6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:06:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-8484c01c-4dc8-4154-99fe-2289e5d687b6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 11:06:49 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-8484c01c-4dc8-4154-99fe-2289e5d687b6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] <== disconnect_volume: return (284ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 11:06:49 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8484c01c-4dc8-4154-99fe-2289e5d687b6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 11:06:50 user nova-compute[72362]: DEBUG nova.objects.instance [None req-8484c01c-4dc8-4154-99fe-2289e5d687b6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lazy-loading 'flavor' on Instance uuid 83001be0-c830-41cc-ae51-c6cefa9427d5 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 11:06:50 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-8484c01c-4dc8-4154-99fe-2289e5d687b6 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "83001be0-c830-41cc-ae51-c6cefa9427d5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.741s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:06:54 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:06:55 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:06:59 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:07:04 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:07:09 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:07:14 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:07:19 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:07:19 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:07:19 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 11:07:19 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:07:19 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:07:19 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:07:24 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:07:29 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:07:30 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:07:33 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:07:33 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 11:07:33 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Rebuilding the list of instances to heal {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 11:07:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "refresh_cache-83001be0-c830-41cc-ae51-c6cefa9427d5" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 11:07:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquired lock "refresh_cache-83001be0-c830-41cc-ae51-c6cefa9427d5" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 11:07:34 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Forcefully refreshing network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 11:07:34 user nova-compute[72362]: DEBUG nova.objects.instance [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lazy-loading 'info_cache' on Instance uuid 83001be0-c830-41cc-ae51-c6cefa9427d5 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 11:07:34 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:07:34 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:07:34 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 11:07:34 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:07:34 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:07:34 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:07:34 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Updating instance_info_cache with network_info: [{"id": "29efac0a-52ab-471c-9f79-0d94142311f2", "address": "fa:16:3e:37:b4:94", "network": {"id": "f812ec4b-c0a0-4d6c-84e9-5b50199ad17a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2039781156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09af0e64509144b28ebccba3d90aee65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29efac0a-52", "ovs_interfaceid": "29efac0a-52ab-471c-9f79-0d94142311f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 11:07:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Releasing lock "refresh_cache-83001be0-c830-41cc-ae51-c6cefa9427d5" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 11:07:34 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Updated the network info_cache for instance {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 11:07:35 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:07:37 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:07:38 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:07:38 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 11:07:38 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:07:39 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:07:39 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:07:41 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:07:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:07:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:07:41 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:07:41 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 11:07:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83001be0-c830-41cc-ae51-c6cefa9427d5/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:07:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83001be0-c830-41cc-ae51-c6cefa9427d5/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:07:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83001be0-c830-41cc-ae51-c6cefa9427d5/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:07:42 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83001be0-c830-41cc-ae51-c6cefa9427d5/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:07:42 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 11:07:42 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 11:07:42 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=8866MB free_disk=24.941299438476562GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 11:07:42 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:07:42 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:07:42 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 83001be0-c830-41cc-ae51-c6cefa9427d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 11:07:42 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 11:07:42 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 11:07:42 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Refreshing inventories for resource provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 11:07:43 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Updating ProviderTree inventory for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 11:07:43 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Updating inventory in ProviderTree for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 11:07:43 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Refreshing aggregate associations for resource provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d, aggregates: None {{(pid=72362) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 11:07:43 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Refreshing trait associations for resource provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE41,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=72362) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 11:07:43 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 11:07:43 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 11:07:43 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 11:07:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.416s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:07:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:07:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-bca88411-325f-4a23-adfa-5a20181bc4b5 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Acquiring lock "83001be0-c830-41cc-ae51-c6cefa9427d5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:07:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-bca88411-325f-4a23-adfa-5a20181bc4b5 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "83001be0-c830-41cc-ae51-c6cefa9427d5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:07:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-bca88411-325f-4a23-adfa-5a20181bc4b5 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Acquiring lock "83001be0-c830-41cc-ae51-c6cefa9427d5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:07:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-bca88411-325f-4a23-adfa-5a20181bc4b5 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "83001be0-c830-41cc-ae51-c6cefa9427d5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:07:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-bca88411-325f-4a23-adfa-5a20181bc4b5 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "83001be0-c830-41cc-ae51-c6cefa9427d5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:07:44 user nova-compute[72362]: INFO nova.compute.manager [None req-bca88411-325f-4a23-adfa-5a20181bc4b5 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Terminating instance
Aug 09 11:07:44 user nova-compute[72362]: DEBUG nova.compute.manager [None req-bca88411-325f-4a23-adfa-5a20181bc4b5 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Start destroying the instance on the hypervisor. {{(pid=72362) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 11:07:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:07:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:07:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:07:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:07:44 user nova-compute[72362]: DEBUG nova.compute.manager [req-601fe325-833a-4885-a4d8-c5c5b78227be req-c24759c9-192d-450d-aab1-f269d25e836c service nova] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Received event network-vif-unplugged-29efac0a-52ab-471c-9f79-0d94142311f2 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 11:07:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-601fe325-833a-4885-a4d8-c5c5b78227be req-c24759c9-192d-450d-aab1-f269d25e836c service nova] Acquiring lock "83001be0-c830-41cc-ae51-c6cefa9427d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:07:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-601fe325-833a-4885-a4d8-c5c5b78227be req-c24759c9-192d-450d-aab1-f269d25e836c service nova] Lock "83001be0-c830-41cc-ae51-c6cefa9427d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:07:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-601fe325-833a-4885-a4d8-c5c5b78227be req-c24759c9-192d-450d-aab1-f269d25e836c service nova] Lock "83001be0-c830-41cc-ae51-c6cefa9427d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:07:44 user nova-compute[72362]: DEBUG nova.compute.manager [req-601fe325-833a-4885-a4d8-c5c5b78227be req-c24759c9-192d-450d-aab1-f269d25e836c service nova] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] No waiting events found dispatching network-vif-unplugged-29efac0a-52ab-471c-9f79-0d94142311f2 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 11:07:44 user nova-compute[72362]: DEBUG nova.compute.manager [req-601fe325-833a-4885-a4d8-c5c5b78227be req-c24759c9-192d-450d-aab1-f269d25e836c service nova] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Received event network-vif-unplugged-29efac0a-52ab-471c-9f79-0d94142311f2 for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 11:07:45 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:07:45 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:07:45 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Instance destroyed successfully.
Aug 09 11:07:45 user nova-compute[72362]: DEBUG nova.objects.instance [None req-bca88411-325f-4a23-adfa-5a20181bc4b5 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lazy-loading 'resources' on Instance uuid 83001be0-c830-41cc-ae51-c6cefa9427d5 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 11:07:45 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-bca88411-325f-4a23-adfa-5a20181bc4b5 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T11:02:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1056692255',display_name='tempest-TestMinimumBasicScenario-server-1056692255',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1056692255',id=51,image_ref='8f49369d-23b9-4a17-810a-99a87d4784e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTfDfC1bfcQz5oD9uMtn5En5W80TRuo9YZ9/YtqrSJ7Bvve2Vp7XXOY9F6NM+AKs65NFrCVKzKFZZYrW0uSn14mqL01OzLRTD2hWvwIG/2rPaHbjtnqk38+QFsWL/eVWw==',key_name='tempest-TestMinimumBasicScenario-2029956847',keypairs=<?>,launch_index=0,launched_at=2023-08-09T11:02:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='09af0e64509144b28ebccba3d90aee65',ramdisk_id='',reservation_id='r-0rvbp9l0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8f49369d-23b9-4a17-810a-99a87d4784e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-673917805',owner_user_name='tempest-TestMinimumBasicScenario-673917805-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T11:05:02Z,user_data=None,user_id='191f1c4d430949899c90b08f00aefd7e',uuid=83001be0-c830-41cc-ae51-c6cefa9427d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29efac0a-52ab-471c-9f79-0d94142311f2", "address": "fa:16:3e:37:b4:94", "network": {"id": "f812ec4b-c0a0-4d6c-84e9-5b50199ad17a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2039781156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09af0e64509144b28ebccba3d90aee65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29efac0a-52", "ovs_interfaceid": "29efac0a-52ab-471c-9f79-0d94142311f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 11:07:45 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-bca88411-325f-4a23-adfa-5a20181bc4b5 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Converting VIF {"id": "29efac0a-52ab-471c-9f79-0d94142311f2", "address": "fa:16:3e:37:b4:94", "network": {"id": "f812ec4b-c0a0-4d6c-84e9-5b50199ad17a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2039781156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09af0e64509144b28ebccba3d90aee65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29efac0a-52", "ovs_interfaceid": "29efac0a-52ab-471c-9f79-0d94142311f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 11:07:45 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-bca88411-325f-4a23-adfa-5a20181bc4b5 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:b4:94,bridge_name='br-int',has_traffic_filtering=True,id=29efac0a-52ab-471c-9f79-0d94142311f2,network=Network(f812ec4b-c0a0-4d6c-84e9-5b50199ad17a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29efac0a-52') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 11:07:45 user nova-compute[72362]: DEBUG os_vif [None req-bca88411-325f-4a23-adfa-5a20181bc4b5 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:b4:94,bridge_name='br-int',has_traffic_filtering=True,id=29efac0a-52ab-471c-9f79-0d94142311f2,network=Network(f812ec4b-c0a0-4d6c-84e9-5b50199ad17a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29efac0a-52') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 11:07:45 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:07:45 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap29efac0a-52, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 11:07:45 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:07:45 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:07:45 user nova-compute[72362]: INFO os_vif [None req-bca88411-325f-4a23-adfa-5a20181bc4b5 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:b4:94,bridge_name='br-int',has_traffic_filtering=True,id=29efac0a-52ab-471c-9f79-0d94142311f2,network=Network(f812ec4b-c0a0-4d6c-84e9-5b50199ad17a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29efac0a-52')
Aug 09 11:07:45 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-bca88411-325f-4a23-adfa-5a20181bc4b5 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Deleting instance files /opt/stack/data/nova/instances/83001be0-c830-41cc-ae51-c6cefa9427d5_del
Aug 09 11:07:45 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-bca88411-325f-4a23-adfa-5a20181bc4b5 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Deletion of /opt/stack/data/nova/instances/83001be0-c830-41cc-ae51-c6cefa9427d5_del complete
Aug 09 11:07:45 user nova-compute[72362]: INFO nova.compute.manager [None req-bca88411-325f-4a23-adfa-5a20181bc4b5 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 09 11:07:45 user nova-compute[72362]: DEBUG oslo.service.loopingcall [None req-bca88411-325f-4a23-adfa-5a20181bc4b5 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72362) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 11:07:45 user nova-compute[72362]: DEBUG nova.compute.manager [-] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Deallocating network for instance {{(pid=72362) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 11:07:45 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] deallocate_for_instance() {{(pid=72362) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 11:07:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:07:46 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 11:07:46 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Took 0.67 seconds to deallocate network for instance.
Aug 09 11:07:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-bca88411-325f-4a23-adfa-5a20181bc4b5 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:07:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-bca88411-325f-4a23-adfa-5a20181bc4b5 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:07:46 user nova-compute[72362]: DEBUG nova.compute.manager [req-7541dc77-49cd-49a8-9afc-9147ecb8ec36 req-69e0bccd-f63d-45b9-a5a0-04bf6eb195ee service nova] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Received event network-vif-deleted-29efac0a-52ab-471c-9f79-0d94142311f2 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 11:07:46 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-bca88411-325f-4a23-adfa-5a20181bc4b5 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 11:07:46 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-bca88411-325f-4a23-adfa-5a20181bc4b5 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 11:07:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-bca88411-325f-4a23-adfa-5a20181bc4b5 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.111s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:07:46 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-bca88411-325f-4a23-adfa-5a20181bc4b5 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Deleted allocations for instance 83001be0-c830-41cc-ae51-c6cefa9427d5
Aug 09 11:07:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-bca88411-325f-4a23-adfa-5a20181bc4b5 tempest-TestMinimumBasicScenario-673917805 tempest-TestMinimumBasicScenario-673917805-project-member] Lock "83001be0-c830-41cc-ae51-c6cefa9427d5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.814s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:07:46 user nova-compute[72362]: DEBUG nova.compute.manager [req-f9262f96-baa3-4868-8d3c-b32b74886c7c req-c39975a5-efa7-4273-9718-db116e995f7b service nova] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Received event network-vif-plugged-29efac0a-52ab-471c-9f79-0d94142311f2 {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 11:07:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f9262f96-baa3-4868-8d3c-b32b74886c7c req-c39975a5-efa7-4273-9718-db116e995f7b service nova] Acquiring lock "83001be0-c830-41cc-ae51-c6cefa9427d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:07:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f9262f96-baa3-4868-8d3c-b32b74886c7c req-c39975a5-efa7-4273-9718-db116e995f7b service nova] Lock "83001be0-c830-41cc-ae51-c6cefa9427d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:07:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-f9262f96-baa3-4868-8d3c-b32b74886c7c req-c39975a5-efa7-4273-9718-db116e995f7b service nova] Lock "83001be0-c830-41cc-ae51-c6cefa9427d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:07:46 user nova-compute[72362]: DEBUG nova.compute.manager [req-f9262f96-baa3-4868-8d3c-b32b74886c7c req-c39975a5-efa7-4273-9718-db116e995f7b service nova] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] No waiting events found dispatching network-vif-plugged-29efac0a-52ab-471c-9f79-0d94142311f2 {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 11:07:46 user nova-compute[72362]: WARNING nova.compute.manager [req-f9262f96-baa3-4868-8d3c-b32b74886c7c req-c39975a5-efa7-4273-9718-db116e995f7b service nova] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Received unexpected event network-vif-plugged-29efac0a-52ab-471c-9f79-0d94142311f2 for instance with vm_state deleted and task_state None.
Aug 09 11:07:50 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:07:55 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:07:58 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:07:58 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Cleaning up deleted instances {{(pid=72362) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 11:07:58 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] There are 0 instances to clean {{(pid=72362) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 11:08:00 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691579265.3180673, 83001be0-c830-41cc-ae51-c6cefa9427d5 => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 11:08:00 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] VM Stopped (Lifecycle Event)
Aug 09 11:08:00 user nova-compute[72362]: DEBUG nova.compute.manager [None req-9f5951be-5bbe-409b-b306-624942b421e7 None None] [instance: 83001be0-c830-41cc-ae51-c6cefa9427d5] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 11:08:00 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:08:00 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:08:00 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 11:08:00 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:08:00 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:08:00 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:08:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:08:08 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:08:08 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72362) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 11:08:10 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:08:10 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:08:10 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 11:08:10 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:08:10 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:08:10 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:08:15 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:08:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:08:25 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:08:25 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:08:25 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 11:08:25 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:08:25 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:08:25 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:08:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:08:31 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:08:35 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:08:35 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:08:35 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 11:08:35 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:08:35 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:08:35 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:08:35 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:08:35 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 11:08:35 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Rebuilding the list of instances to heal {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 11:08:35 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Didn't find any instances for network info cache update. {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 11:08:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:08:37 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:08:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:08:38 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:08:39 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:08:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:08:40 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:08:40 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 11:08:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:08:42 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:08:42 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:08:42 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:08:42 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:08:42 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 11:08:43 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 11:08:43 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 11:08:43 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=8982MB free_disk=25.00818634033203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 11:08:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:08:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:08:43 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 11:08:43 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 11:08:43 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 11:08:43 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 11:08:43 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 11:08:43 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.187s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:08:45 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:08:45 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:08:45 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:08:50 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:08:55 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:08:55 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:08:55 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 11:08:55 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:08:55 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:08:55 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:08:58 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:09:00 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:09:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:09:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:09:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 11:09:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:09:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:09:05 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:09:09 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:09:10 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:09:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:09:13 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:09:15 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:09:17 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:09:19 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:09:20 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:09:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:09:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:09:25 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:09:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:09:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Acquiring lock "96100d9b-92e9-43d6-86bf-12d3fba7f036" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:09:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "96100d9b-92e9-43d6-86bf-12d3fba7f036" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:09:29 user nova-compute[72362]: DEBUG nova.compute.manager [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Starting instance... {{(pid=72362) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 11:09:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:09:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:09:29 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72362) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 11:09:29 user nova-compute[72362]: INFO nova.compute.claims [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Claim successful on node user
Aug 09 11:09:29 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 11:09:29 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 11:09:29 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.361s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:09:29 user nova-compute[72362]: DEBUG nova.compute.manager [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Start building networks asynchronously for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 11:09:29 user nova-compute[72362]: DEBUG nova.compute.manager [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Allocating IP information in the background. {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 11:09:29 user nova-compute[72362]: DEBUG nova.network.neutron [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] allocate_for_instance() {{(pid=72362) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 11:09:29 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 11:09:29 user nova-compute[72362]: DEBUG nova.compute.manager [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Start building block device mappings for instance. {{(pid=72362) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 11:09:30 user nova-compute[72362]: DEBUG nova.policy [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '45d255c663cc43ee91eba0dfa719ac38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a11cb43c879f459bb99373fc7f43c7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72362) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 11:09:30 user nova-compute[72362]: DEBUG nova.compute.manager [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Start spawning the instance on the hypervisor. {{(pid=72362) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 11:09:30 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Creating instance directory {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 11:09:30 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Creating image(s)
Aug 09 11:09:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Acquiring lock "/opt/stack/data/nova/instances/96100d9b-92e9-43d6-86bf-12d3fba7f036/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:09:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "/opt/stack/data/nova/instances/96100d9b-92e9-43d6-86bf-12d3fba7f036/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:09:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "/opt/stack/data/nova/instances/96100d9b-92e9-43d6-86bf-12d3fba7f036/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:09:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:09:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.168s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:09:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Acquiring lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:09:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:09:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:09:30 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:09:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.166s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:09:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/96100d9b-92e9-43d6-86bf-12d3fba7f036/disk 1073741824 {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:09:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4,backing_fmt=raw /opt/stack/data/nova/instances/96100d9b-92e9-43d6-86bf-12d3fba7f036/disk 1073741824" returned: 0 in 0.105s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:09:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "908b343131531a9dad1eb0a8dd5eaf3997822af4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:09:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:09:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/908b343131531a9dad1eb0a8dd5eaf3997822af4 --force-share --output=json" returned: 0 in 0.146s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:09:30 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Checking if we can resize image /opt/stack/data/nova/instances/96100d9b-92e9-43d6-86bf-12d3fba7f036/disk. size=1073741824 {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 11:09:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96100d9b-92e9-43d6-86bf-12d3fba7f036/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:09:30 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96100d9b-92e9-43d6-86bf-12d3fba7f036/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:09:30 user nova-compute[72362]: DEBUG nova.virt.disk.api [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Cannot resize image /opt/stack/data/nova/instances/96100d9b-92e9-43d6-86bf-12d3fba7f036/disk to a smaller size. {{(pid=72362) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 11:09:30 user nova-compute[72362]: DEBUG nova.objects.instance [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lazy-loading 'migration_context' on Instance uuid 96100d9b-92e9-43d6-86bf-12d3fba7f036 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 11:09:30 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Created local disks {{(pid=72362) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 11:09:30 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Ensure instance console log exists: /opt/stack/data/nova/instances/96100d9b-92e9-43d6-86bf-12d3fba7f036/console.log {{(pid=72362) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 11:09:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:09:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:09:30 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:09:31 user nova-compute[72362]: DEBUG nova.network.neutron [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Successfully created port: 35628821-d44d-4645-ab29-3fe27ab3589b {{(pid=72362) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 11:09:32 user nova-compute[72362]: DEBUG nova.network.neutron [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Successfully updated port: 35628821-d44d-4645-ab29-3fe27ab3589b {{(pid=72362) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 11:09:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Acquiring lock "refresh_cache-96100d9b-92e9-43d6-86bf-12d3fba7f036" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 11:09:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Acquired lock "refresh_cache-96100d9b-92e9-43d6-86bf-12d3fba7f036" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 11:09:32 user nova-compute[72362]: DEBUG nova.network.neutron [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Building network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 11:09:32 user nova-compute[72362]: DEBUG nova.compute.manager [req-b7a8cbbc-ff25-4e36-8439-1fb710ab4da0 req-68ecbc56-dbf0-4e15-8c7f-d8c4a53ee740 service nova] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Received event network-changed-35628821-d44d-4645-ab29-3fe27ab3589b {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 11:09:32 user nova-compute[72362]: DEBUG nova.compute.manager [req-b7a8cbbc-ff25-4e36-8439-1fb710ab4da0 req-68ecbc56-dbf0-4e15-8c7f-d8c4a53ee740 service nova] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Refreshing instance network info cache due to event network-changed-35628821-d44d-4645-ab29-3fe27ab3589b. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 11:09:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b7a8cbbc-ff25-4e36-8439-1fb710ab4da0 req-68ecbc56-dbf0-4e15-8c7f-d8c4a53ee740 service nova] Acquiring lock "refresh_cache-96100d9b-92e9-43d6-86bf-12d3fba7f036" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 11:09:32 user nova-compute[72362]: DEBUG nova.network.neutron [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Instance cache missing network info. {{(pid=72362) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 11:09:32 user nova-compute[72362]: DEBUG nova.network.neutron [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Updating instance_info_cache with network_info: [{"id": "35628821-d44d-4645-ab29-3fe27ab3589b", "address": "fa:16:3e:5c:55:25", "network": {"id": "52302a78-20d7-448f-93aa-b0d865b6d0d5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1565698948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a11cb43c879f459bb99373fc7f43c7f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35628821-d4", "ovs_interfaceid": "35628821-d44d-4645-ab29-3fe27ab3589b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 11:09:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Releasing lock "refresh_cache-96100d9b-92e9-43d6-86bf-12d3fba7f036" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 11:09:32 user nova-compute[72362]: DEBUG nova.compute.manager [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Instance network_info: |[{"id": "35628821-d44d-4645-ab29-3fe27ab3589b", "address": "fa:16:3e:5c:55:25", "network": {"id": "52302a78-20d7-448f-93aa-b0d865b6d0d5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1565698948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a11cb43c879f459bb99373fc7f43c7f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35628821-d4", "ovs_interfaceid": "35628821-d44d-4645-ab29-3fe27ab3589b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72362) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 11:09:32 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b7a8cbbc-ff25-4e36-8439-1fb710ab4da0 req-68ecbc56-dbf0-4e15-8c7f-d8c4a53ee740 service nova] Acquired lock "refresh_cache-96100d9b-92e9-43d6-86bf-12d3fba7f036" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 11:09:32 user nova-compute[72362]: DEBUG nova.network.neutron [req-b7a8cbbc-ff25-4e36-8439-1fb710ab4da0 req-68ecbc56-dbf0-4e15-8c7f-d8c4a53ee740 service nova] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Refreshing network info cache for port 35628821-d44d-4645-ab29-3fe27ab3589b {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 11:09:32 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Start _get_guest_xml network_info=[{"id": "35628821-d44d-4645-ab29-3fe27ab3589b", "address": "fa:16:3e:5c:55:25", "network": {"id": "52302a78-20d7-448f-93aa-b0d865b6d0d5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1565698948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a11cb43c879f459bb99373fc7f43c7f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35628821-d4", "ovs_interfaceid": "35628821-d44d-4645-ab29-3fe27ab3589b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': 'a08d1a11-49eb-4212-a351-e11ee9553b95'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 11:09:32 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 11:09:32 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 11:09:32 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 11:09:32 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] CPU controller missing on host. {{(pid=72362) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 11:09:32 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 11:09:32 user nova-compute[72362]: DEBUG nova.virt.libvirt.host [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] CPU controller found on host. {{(pid=72362) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 11:09:32 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72362) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 11:09:32 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T10:12:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T10:12:14Z,direct_url=<?>,disk_format='qcow2',id=a08d1a11-49eb-4212-a351-e11ee9553b95,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60b108dbc1e84afa9ca07b0a7793a358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T10:12:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 11:09:32 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Flavor limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 11:09:32 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Image limits 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 11:09:32 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Flavor pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 11:09:32 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Image pref 0:0:0 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 11:09:32 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 11:09:32 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 11:09:32 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 11:09:32 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Got 1 possible topologies {{(pid=72362) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 11:09:32 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 11:09:32 user nova-compute[72362]: DEBUG nova.virt.hardware [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72362) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 11:09:32 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T11:09:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-919658178',display_name='tempest-SnapshotDataIntegrityTests-server-919658178',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-919658178',id=52,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3yAje+FJ1sUO27PRKYR14kwoBPGPmAXF+a/IxrspoqXOAMvx3eMyb+3YSq4lTOyxBEsY+sNv662AoaOl+g2UsbN4Mkc/51Bv9GUHCjWYj2+Pjy0JdUyTa8mTrL2osfwg==',key_name='tempest-keypair-927946981',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a11cb43c879f459bb99373fc7f43c7f1',ramdisk_id='',reservation_id='r-12mpkw8f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1670400890',owner_user_name='tempest-SnapshotDataIntegrityTests-1670400890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T11:09:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45d255c663cc43ee91eba0dfa719ac38',uuid=96100d9b-92e9-43d6-86bf-12d3fba7f036,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35628821-d44d-4645-ab29-3fe27ab3589b", "address": "fa:16:3e:5c:55:25", "network": {"id": "52302a78-20d7-448f-93aa-b0d865b6d0d5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1565698948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a11cb43c879f459bb99373fc7f43c7f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35628821-d4", "ovs_interfaceid": "35628821-d44d-4645-ab29-3fe27ab3589b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72362) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 11:09:32 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Converting VIF {"id": "35628821-d44d-4645-ab29-3fe27ab3589b", "address": "fa:16:3e:5c:55:25", "network": {"id": "52302a78-20d7-448f-93aa-b0d865b6d0d5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1565698948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a11cb43c879f459bb99373fc7f43c7f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35628821-d4", "ovs_interfaceid": "35628821-d44d-4645-ab29-3fe27ab3589b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 11:09:32 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:55:25,bridge_name='br-int',has_traffic_filtering=True,id=35628821-d44d-4645-ab29-3fe27ab3589b,network=Network(52302a78-20d7-448f-93aa-b0d865b6d0d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35628821-d4') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 11:09:32 user nova-compute[72362]: DEBUG nova.objects.instance [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lazy-loading 'pci_devices' on Instance uuid 96100d9b-92e9-43d6-86bf-12d3fba7f036 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 11:09:32 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] End _get_guest_xml xml=<domain type="kvm">
Aug 09 11:09:32 user nova-compute[72362]:   <uuid>96100d9b-92e9-43d6-86bf-12d3fba7f036</uuid>
Aug 09 11:09:32 user nova-compute[72362]:   <name>instance-00000034</name>
Aug 09 11:09:32 user nova-compute[72362]:   <memory>524288</memory>
Aug 09 11:09:32 user nova-compute[72362]:   <vcpu>1</vcpu>
Aug 09 11:09:32 user nova-compute[72362]:   <metadata>
Aug 09 11:09:32 user nova-compute[72362]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 11:09:32 user nova-compute[72362]:       <nova:package version="0.0.0"/>
Aug 09 11:09:32 user nova-compute[72362]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-919658178</nova:name>
Aug 09 11:09:32 user nova-compute[72362]:       <nova:creationTime>2023-08-09 11:09:32</nova:creationTime>
Aug 09 11:09:32 user nova-compute[72362]:       <nova:flavor name="m1.tiny">
Aug 09 11:09:32 user nova-compute[72362]:         <nova:memory>512</nova:memory>
Aug 09 11:09:32 user nova-compute[72362]:         <nova:disk>1</nova:disk>
Aug 09 11:09:32 user nova-compute[72362]:         <nova:swap>0</nova:swap>
Aug 09 11:09:32 user nova-compute[72362]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 11:09:32 user nova-compute[72362]:         <nova:vcpus>1</nova:vcpus>
Aug 09 11:09:32 user nova-compute[72362]:       </nova:flavor>
Aug 09 11:09:32 user nova-compute[72362]:       <nova:owner>
Aug 09 11:09:32 user nova-compute[72362]:         <nova:user uuid="45d255c663cc43ee91eba0dfa719ac38">tempest-SnapshotDataIntegrityTests-1670400890-project-member</nova:user>
Aug 09 11:09:32 user nova-compute[72362]:         <nova:project uuid="a11cb43c879f459bb99373fc7f43c7f1">tempest-SnapshotDataIntegrityTests-1670400890</nova:project>
Aug 09 11:09:32 user nova-compute[72362]:       </nova:owner>
Aug 09 11:09:32 user nova-compute[72362]:       <nova:root type="image" uuid="a08d1a11-49eb-4212-a351-e11ee9553b95"/>
Aug 09 11:09:32 user nova-compute[72362]:       <nova:ports>
Aug 09 11:09:32 user nova-compute[72362]:         <nova:port uuid="35628821-d44d-4645-ab29-3fe27ab3589b">
Aug 09 11:09:32 user nova-compute[72362]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 11:09:32 user nova-compute[72362]:         </nova:port>
Aug 09 11:09:32 user nova-compute[72362]:       </nova:ports>
Aug 09 11:09:32 user nova-compute[72362]:     </nova:instance>
Aug 09 11:09:32 user nova-compute[72362]:   </metadata>
Aug 09 11:09:32 user nova-compute[72362]:   <sysinfo type="smbios">
Aug 09 11:09:32 user nova-compute[72362]:     <system>
Aug 09 11:09:32 user nova-compute[72362]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 11:09:32 user nova-compute[72362]:       <entry name="product">OpenStack Nova</entry>
Aug 09 11:09:32 user nova-compute[72362]:       <entry name="version">0.0.0</entry>
Aug 09 11:09:32 user nova-compute[72362]:       <entry name="serial">96100d9b-92e9-43d6-86bf-12d3fba7f036</entry>
Aug 09 11:09:32 user nova-compute[72362]:       <entry name="uuid">96100d9b-92e9-43d6-86bf-12d3fba7f036</entry>
Aug 09 11:09:32 user nova-compute[72362]:       <entry name="family">Virtual Machine</entry>
Aug 09 11:09:32 user nova-compute[72362]:     </system>
Aug 09 11:09:32 user nova-compute[72362]:   </sysinfo>
Aug 09 11:09:32 user nova-compute[72362]:   <os>
Aug 09 11:09:32 user nova-compute[72362]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 11:09:32 user nova-compute[72362]:     <boot dev="hd"/>
Aug 09 11:09:32 user nova-compute[72362]:     <smbios mode="sysinfo"/>
Aug 09 11:09:32 user nova-compute[72362]:   </os>
Aug 09 11:09:32 user nova-compute[72362]:   <features>
Aug 09 11:09:32 user nova-compute[72362]:     <acpi/>
Aug 09 11:09:32 user nova-compute[72362]:     <apic/>
Aug 09 11:09:32 user nova-compute[72362]:     <vmcoreinfo/>
Aug 09 11:09:32 user nova-compute[72362]:   </features>
Aug 09 11:09:32 user nova-compute[72362]:   <clock offset="utc">
Aug 09 11:09:32 user nova-compute[72362]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 11:09:32 user nova-compute[72362]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 11:09:32 user nova-compute[72362]:     <timer name="hpet" present="no"/>
Aug 09 11:09:32 user nova-compute[72362]:   </clock>
Aug 09 11:09:32 user nova-compute[72362]:   <cpu mode="custom" match="exact">
Aug 09 11:09:32 user nova-compute[72362]:     <model>Nehalem</model>
Aug 09 11:09:32 user nova-compute[72362]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 11:09:32 user nova-compute[72362]:   </cpu>
Aug 09 11:09:32 user nova-compute[72362]:   <devices>
Aug 09 11:09:32 user nova-compute[72362]:     <disk type="file" device="disk">
Aug 09 11:09:32 user nova-compute[72362]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 11:09:32 user nova-compute[72362]:       <source file="/opt/stack/data/nova/instances/96100d9b-92e9-43d6-86bf-12d3fba7f036/disk"/>
Aug 09 11:09:32 user nova-compute[72362]:       <target dev="vda" bus="virtio"/>
Aug 09 11:09:32 user nova-compute[72362]:     </disk>
Aug 09 11:09:32 user nova-compute[72362]:     <interface type="ethernet">
Aug 09 11:09:32 user nova-compute[72362]:       <mac address="fa:16:3e:5c:55:25"/>
Aug 09 11:09:32 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 11:09:32 user nova-compute[72362]:       <mtu size="1442"/>
Aug 09 11:09:32 user nova-compute[72362]:       <target dev="tap35628821-d4"/>
Aug 09 11:09:32 user nova-compute[72362]:     </interface>
Aug 09 11:09:32 user nova-compute[72362]:     <serial type="pty">
Aug 09 11:09:32 user nova-compute[72362]:       <log file="/opt/stack/data/nova/instances/96100d9b-92e9-43d6-86bf-12d3fba7f036/console.log" append="off"/>
Aug 09 11:09:32 user nova-compute[72362]:     </serial>
Aug 09 11:09:32 user nova-compute[72362]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 11:09:32 user nova-compute[72362]:     <video>
Aug 09 11:09:32 user nova-compute[72362]:       <model type="virtio"/>
Aug 09 11:09:32 user nova-compute[72362]:     </video>
Aug 09 11:09:32 user nova-compute[72362]:     <rng model="virtio">
Aug 09 11:09:32 user nova-compute[72362]:       <backend model="random">/dev/urandom</backend>
Aug 09 11:09:32 user nova-compute[72362]:     </rng>
Aug 09 11:09:32 user nova-compute[72362]:     <controller type="usb" index="0" model="none"/>
Aug 09 11:09:32 user nova-compute[72362]:     <memballoon model="virtio">
Aug 09 11:09:32 user nova-compute[72362]:       <stats period="10"/>
Aug 09 11:09:32 user nova-compute[72362]:     </memballoon>
Aug 09 11:09:32 user nova-compute[72362]:   </devices>
Aug 09 11:09:32 user nova-compute[72362]: </domain>
Aug 09 11:09:32 user nova-compute[72362]:  {{(pid=72362) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 11:09:32 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T11:09:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-919658178',display_name='tempest-SnapshotDataIntegrityTests-server-919658178',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-919658178',id=52,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3yAje+FJ1sUO27PRKYR14kwoBPGPmAXF+a/IxrspoqXOAMvx3eMyb+3YSq4lTOyxBEsY+sNv662AoaOl+g2UsbN4Mkc/51Bv9GUHCjWYj2+Pjy0JdUyTa8mTrL2osfwg==',key_name='tempest-keypair-927946981',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a11cb43c879f459bb99373fc7f43c7f1',ramdisk_id='',reservation_id='r-12mpkw8f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1670400890',owner_user_name='tempest-SnapshotDataIntegrityTests-1670400890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T11:09:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45d255c663cc43ee91eba0dfa719ac38',uuid=96100d9b-92e9-43d6-86bf-12d3fba7f036,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35628821-d44d-4645-ab29-3fe27ab3589b", "address": "fa:16:3e:5c:55:25", "network": {"id": "52302a78-20d7-448f-93aa-b0d865b6d0d5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1565698948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a11cb43c879f459bb99373fc7f43c7f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35628821-d4", "ovs_interfaceid": "35628821-d44d-4645-ab29-3fe27ab3589b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 11:09:32 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Converting VIF {"id": "35628821-d44d-4645-ab29-3fe27ab3589b", "address": "fa:16:3e:5c:55:25", "network": {"id": "52302a78-20d7-448f-93aa-b0d865b6d0d5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1565698948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a11cb43c879f459bb99373fc7f43c7f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35628821-d4", "ovs_interfaceid": "35628821-d44d-4645-ab29-3fe27ab3589b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 11:09:32 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:55:25,bridge_name='br-int',has_traffic_filtering=True,id=35628821-d44d-4645-ab29-3fe27ab3589b,network=Network(52302a78-20d7-448f-93aa-b0d865b6d0d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35628821-d4') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 11:09:32 user nova-compute[72362]: DEBUG os_vif [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:55:25,bridge_name='br-int',has_traffic_filtering=True,id=35628821-d44d-4645-ab29-3fe27ab3589b,network=Network(52302a78-20d7-448f-93aa-b0d865b6d0d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35628821-d4') {{(pid=72362) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 11:09:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:09:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 11:09:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 11:09:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:09:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap35628821-d4, may_exist=True, interface_attrs={}) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 11:09:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap35628821-d4, col_values=(('external_ids', {'iface-id': '35628821-d44d-4645-ab29-3fe27ab3589b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:55:25', 'vm-uuid': '96100d9b-92e9-43d6-86bf-12d3fba7f036'}),), if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 11:09:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:09:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:09:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:09:32 user nova-compute[72362]: INFO os_vif [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:55:25,bridge_name='br-int',has_traffic_filtering=True,id=35628821-d44d-4645-ab29-3fe27ab3589b,network=Network(52302a78-20d7-448f-93aa-b0d865b6d0d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35628821-d4')
Aug 09 11:09:32 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 11:09:32 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] No VIF found with MAC fa:16:3e:5c:55:25, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 11:09:33 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:09:33 user nova-compute[72362]: DEBUG nova.network.neutron [req-b7a8cbbc-ff25-4e36-8439-1fb710ab4da0 req-68ecbc56-dbf0-4e15-8c7f-d8c4a53ee740 service nova] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Updated VIF entry in instance network info cache for port 35628821-d44d-4645-ab29-3fe27ab3589b. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 11:09:33 user nova-compute[72362]: DEBUG nova.network.neutron [req-b7a8cbbc-ff25-4e36-8439-1fb710ab4da0 req-68ecbc56-dbf0-4e15-8c7f-d8c4a53ee740 service nova] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Updating instance_info_cache with network_info: [{"id": "35628821-d44d-4645-ab29-3fe27ab3589b", "address": "fa:16:3e:5c:55:25", "network": {"id": "52302a78-20d7-448f-93aa-b0d865b6d0d5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1565698948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a11cb43c879f459bb99373fc7f43c7f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35628821-d4", "ovs_interfaceid": "35628821-d44d-4645-ab29-3fe27ab3589b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 11:09:33 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-b7a8cbbc-ff25-4e36-8439-1fb710ab4da0 req-68ecbc56-dbf0-4e15-8c7f-d8c4a53ee740 service nova] Releasing lock "refresh_cache-96100d9b-92e9-43d6-86bf-12d3fba7f036" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 11:09:34 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:09:34 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:09:34 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:09:34 user nova-compute[72362]: DEBUG nova.compute.manager [req-e7401395-3e54-4f77-a5be-6e94176903b1 req-abf65e5b-5f08-439c-a632-8bf0b4b76cb2 service nova] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Received event network-vif-plugged-35628821-d44d-4645-ab29-3fe27ab3589b {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 11:09:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e7401395-3e54-4f77-a5be-6e94176903b1 req-abf65e5b-5f08-439c-a632-8bf0b4b76cb2 service nova] Acquiring lock "96100d9b-92e9-43d6-86bf-12d3fba7f036-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:09:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e7401395-3e54-4f77-a5be-6e94176903b1 req-abf65e5b-5f08-439c-a632-8bf0b4b76cb2 service nova] Lock "96100d9b-92e9-43d6-86bf-12d3fba7f036-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:09:34 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e7401395-3e54-4f77-a5be-6e94176903b1 req-abf65e5b-5f08-439c-a632-8bf0b4b76cb2 service nova] Lock "96100d9b-92e9-43d6-86bf-12d3fba7f036-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:09:34 user nova-compute[72362]: DEBUG nova.compute.manager [req-e7401395-3e54-4f77-a5be-6e94176903b1 req-abf65e5b-5f08-439c-a632-8bf0b4b76cb2 service nova] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] No waiting events found dispatching network-vif-plugged-35628821-d44d-4645-ab29-3fe27ab3589b {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 11:09:34 user nova-compute[72362]: WARNING nova.compute.manager [req-e7401395-3e54-4f77-a5be-6e94176903b1 req-abf65e5b-5f08-439c-a632-8bf0b4b76cb2 service nova] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Received unexpected event network-vif-plugged-35628821-d44d-4645-ab29-3fe27ab3589b for instance with vm_state building and task_state spawning.
Aug 09 11:09:34 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:09:34 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:09:34 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:09:34 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:09:34 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:09:35 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:09:35 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 11:09:35 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Rebuilding the list of instances to heal {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 11:09:36 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Skipping network cache update for instance because it is Building. {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 09 11:09:36 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Didn't find any instances for network info cache update. {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 11:09:36 user nova-compute[72362]: DEBUG nova.compute.manager [req-8df636bd-026b-4896-b209-3c3a00bd7643 req-86f23062-4363-4b73-a4c1-ae4507b95773 service nova] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Received event network-vif-plugged-35628821-d44d-4645-ab29-3fe27ab3589b {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 11:09:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8df636bd-026b-4896-b209-3c3a00bd7643 req-86f23062-4363-4b73-a4c1-ae4507b95773 service nova] Acquiring lock "96100d9b-92e9-43d6-86bf-12d3fba7f036-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:09:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8df636bd-026b-4896-b209-3c3a00bd7643 req-86f23062-4363-4b73-a4c1-ae4507b95773 service nova] Lock "96100d9b-92e9-43d6-86bf-12d3fba7f036-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:09:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-8df636bd-026b-4896-b209-3c3a00bd7643 req-86f23062-4363-4b73-a4c1-ae4507b95773 service nova] Lock "96100d9b-92e9-43d6-86bf-12d3fba7f036-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:09:36 user nova-compute[72362]: DEBUG nova.compute.manager [req-8df636bd-026b-4896-b209-3c3a00bd7643 req-86f23062-4363-4b73-a4c1-ae4507b95773 service nova] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] No waiting events found dispatching network-vif-plugged-35628821-d44d-4645-ab29-3fe27ab3589b {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 11:09:36 user nova-compute[72362]: WARNING nova.compute.manager [req-8df636bd-026b-4896-b209-3c3a00bd7643 req-86f23062-4363-4b73-a4c1-ae4507b95773 service nova] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Received unexpected event network-vif-plugged-35628821-d44d-4645-ab29-3fe27ab3589b for instance with vm_state building and task_state spawning.
Aug 09 11:09:36 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691579376.6198516, 96100d9b-92e9-43d6-86bf-12d3fba7f036 => Resumed> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 11:09:36 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] VM Resumed (Lifecycle Event)
Aug 09 11:09:36 user nova-compute[72362]: DEBUG nova.compute.manager [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Instance event wait completed in 0 seconds for  {{(pid=72362) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 11:09:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Guest created on hypervisor {{(pid=72362) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 11:09:36 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Instance spawned successfully.
Aug 09 11:09:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 11:09:36 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 11:09:36 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 11:09:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Found default for hw_cdrom_bus of ide {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 11:09:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Found default for hw_disk_bus of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 11:09:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Found default for hw_input_bus of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 11:09:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Found default for hw_pointer_model of None {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 11:09:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Found default for hw_video_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 11:09:36 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Found default for hw_vif_model of virtio {{(pid=72362) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 11:09:36 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 11:09:36 user nova-compute[72362]: DEBUG nova.virt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Emitting event <LifecycleEvent: 1691579376.6209078, 96100d9b-92e9-43d6-86bf-12d3fba7f036 => Started> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 11:09:36 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] VM Started (Lifecycle Event)
Aug 09 11:09:36 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 11:09:36 user nova-compute[72362]: DEBUG nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72362) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 11:09:36 user nova-compute[72362]: INFO nova.compute.manager [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 11:09:36 user nova-compute[72362]: INFO nova.compute.manager [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Took 6.66 seconds to spawn the instance on the hypervisor.
Aug 09 11:09:36 user nova-compute[72362]: DEBUG nova.compute.manager [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 11:09:36 user nova-compute[72362]: INFO nova.compute.manager [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Took 7.48 seconds to build instance.
Aug 09 11:09:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c1da6a84-2035-41c7-96ca-eb36a206a997 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "96100d9b-92e9-43d6-86bf-12d3fba7f036" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.606s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:09:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:09:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:09:37 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:09:40 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:09:40 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:09:40 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:09:40 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 11:09:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:09:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:09:44 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:09:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:09:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:09:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:09:45 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 11:09:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96100d9b-92e9-43d6-86bf-12d3fba7f036/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:09:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96100d9b-92e9-43d6-86bf-12d3fba7f036/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:09:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96100d9b-92e9-43d6-86bf-12d3fba7f036/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:09:45 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96100d9b-92e9-43d6-86bf-12d3fba7f036/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:09:45 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 11:09:45 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 11:09:45 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=8486MB free_disk=24.992603302001953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 11:09:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:09:45 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:09:46 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 96100d9b-92e9-43d6-86bf-12d3fba7f036 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 11:09:46 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 11:09:46 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 11:09:46 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 11:09:46 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 11:09:46 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 11:09:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.315s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:09:47 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:09:47 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:09:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:09:49 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:09:52 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:09:52 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:09:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:09:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:10:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:10:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:10:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:10:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:10:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:10:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:10:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 11:10:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:10:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:10:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:10:17 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:10:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:10:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:10:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:10:33 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:10:35 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:10:35 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 11:10:35 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Rebuilding the list of instances to heal {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 11:10:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "refresh_cache-96100d9b-92e9-43d6-86bf-12d3fba7f036" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 11:10:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquired lock "refresh_cache-96100d9b-92e9-43d6-86bf-12d3fba7f036" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 11:10:36 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Forcefully refreshing network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 11:10:36 user nova-compute[72362]: DEBUG nova.objects.instance [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lazy-loading 'info_cache' on Instance uuid 96100d9b-92e9-43d6-86bf-12d3fba7f036 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 11:10:36 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Updating instance_info_cache with network_info: [{"id": "35628821-d44d-4645-ab29-3fe27ab3589b", "address": "fa:16:3e:5c:55:25", "network": {"id": "52302a78-20d7-448f-93aa-b0d865b6d0d5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1565698948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a11cb43c879f459bb99373fc7f43c7f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35628821-d4", "ovs_interfaceid": "35628821-d44d-4645-ab29-3fe27ab3589b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 11:10:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Releasing lock "refresh_cache-96100d9b-92e9-43d6-86bf-12d3fba7f036" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 11:10:36 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Updated the network info_cache for instance {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 11:10:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:10:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:10:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 11:10:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:10:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:10:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:10:38 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:10:40 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:10:40 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 11:10:41 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:10:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:10:42 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:10:45 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:10:46 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:10:46 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:10:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:10:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:10:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:10:47 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 11:10:47 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96100d9b-92e9-43d6-86bf-12d3fba7f036/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:10:47 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96100d9b-92e9-43d6-86bf-12d3fba7f036/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:10:47 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96100d9b-92e9-43d6-86bf-12d3fba7f036/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:10:47 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96100d9b-92e9-43d6-86bf-12d3fba7f036/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:10:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:10:47 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 11:10:47 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 11:10:47 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=8791MB free_disk=24.955215454101562GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 11:10:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:10:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:10:47 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 96100d9b-92e9-43d6-86bf-12d3fba7f036 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 11:10:47 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 11:10:47 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 11:10:48 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 11:10:48 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 11:10:48 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 11:10:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.183s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:10:52 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:10:52 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:10:52 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 11:10:52 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:10:52 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:10:52 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:10:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:11:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:11:05 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:11:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:11:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:11:17 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:11:21 user nova-compute[72362]: DEBUG nova.compute.manager [req-802170fe-c754-4035-ac7a-14321ba66a7f req-3dec7b1f-6e67-4217-97db-349945be6416 service nova] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Received event network-changed-35628821-d44d-4645-ab29-3fe27ab3589b {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 11:11:21 user nova-compute[72362]: DEBUG nova.compute.manager [req-802170fe-c754-4035-ac7a-14321ba66a7f req-3dec7b1f-6e67-4217-97db-349945be6416 service nova] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Refreshing instance network info cache due to event network-changed-35628821-d44d-4645-ab29-3fe27ab3589b. {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 11:11:21 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-802170fe-c754-4035-ac7a-14321ba66a7f req-3dec7b1f-6e67-4217-97db-349945be6416 service nova] Acquiring lock "refresh_cache-96100d9b-92e9-43d6-86bf-12d3fba7f036" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 11:11:21 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-802170fe-c754-4035-ac7a-14321ba66a7f req-3dec7b1f-6e67-4217-97db-349945be6416 service nova] Acquired lock "refresh_cache-96100d9b-92e9-43d6-86bf-12d3fba7f036" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 11:11:21 user nova-compute[72362]: DEBUG nova.network.neutron [req-802170fe-c754-4035-ac7a-14321ba66a7f req-3dec7b1f-6e67-4217-97db-349945be6416 service nova] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Refreshing network info cache for port 35628821-d44d-4645-ab29-3fe27ab3589b {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 11:11:21 user nova-compute[72362]: DEBUG nova.network.neutron [req-802170fe-c754-4035-ac7a-14321ba66a7f req-3dec7b1f-6e67-4217-97db-349945be6416 service nova] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Updated VIF entry in instance network info cache for port 35628821-d44d-4645-ab29-3fe27ab3589b. {{(pid=72362) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 11:11:21 user nova-compute[72362]: DEBUG nova.network.neutron [req-802170fe-c754-4035-ac7a-14321ba66a7f req-3dec7b1f-6e67-4217-97db-349945be6416 service nova] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Updating instance_info_cache with network_info: [{"id": "35628821-d44d-4645-ab29-3fe27ab3589b", "address": "fa:16:3e:5c:55:25", "network": {"id": "52302a78-20d7-448f-93aa-b0d865b6d0d5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1565698948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a11cb43c879f459bb99373fc7f43c7f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35628821-d4", "ovs_interfaceid": "35628821-d44d-4645-ab29-3fe27ab3589b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 11:11:21 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-802170fe-c754-4035-ac7a-14321ba66a7f req-3dec7b1f-6e67-4217-97db-349945be6416 service nova] Releasing lock "refresh_cache-96100d9b-92e9-43d6-86bf-12d3fba7f036" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 11:11:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:11:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:11:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4a136d34-ae8a-4a09-9c1a-43862db04f1a tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Acquiring lock "96100d9b-92e9-43d6-86bf-12d3fba7f036" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:11:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4a136d34-ae8a-4a09-9c1a-43862db04f1a tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "96100d9b-92e9-43d6-86bf-12d3fba7f036" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:11:25 user nova-compute[72362]: DEBUG nova.objects.instance [None req-4a136d34-ae8a-4a09-9c1a-43862db04f1a tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lazy-loading 'flavor' on Instance uuid 96100d9b-92e9-43d6-86bf-12d3fba7f036 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 11:11:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4a136d34-ae8a-4a09-9c1a-43862db04f1a tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "96100d9b-92e9-43d6-86bf-12d3fba7f036" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:11:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4a136d34-ae8a-4a09-9c1a-43862db04f1a tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Acquiring lock "96100d9b-92e9-43d6-86bf-12d3fba7f036" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:11:25 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4a136d34-ae8a-4a09-9c1a-43862db04f1a tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "96100d9b-92e9-43d6-86bf-12d3fba7f036" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:11:25 user nova-compute[72362]: INFO nova.compute.manager [None req-4a136d34-ae8a-4a09-9c1a-43862db04f1a tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Attaching volume 977a0079-8884-479a-afd5-26070b077c5c to /dev/vdb
Aug 09 11:11:25 user nova-compute[72362]: DEBUG os_brick.utils [None req-4a136d34-ae8a-4a09-9c1a-43862db04f1a tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 11:11:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:11:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:11:25 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe31c58-9130-4315-b980-ba433f87bbf0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:11:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:11:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:11:25 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c841d233-f28c-44ec-a21f-ae1ce0a4205d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:11:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:11:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:11:25 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[83589ed4-132c-4223-8bf9-00fb48c4ee1c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:11:25 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc71f94d-4ff0-492d-b8c1-d89c87e861b0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:11:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-4a136d34-ae8a-4a09-9c1a-43862db04f1a tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:11:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-4a136d34-ae8a-4a09-9c1a-43862db04f1a tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 11:11:25 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4a136d34-ae8a-4a09-9c1a-43862db04f1a tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 11:11:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:11:25 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 11:11:25 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 11:11:25 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[930332ae-39e5-4d83-8f70-61b113124ddb]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:11:25 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-4a136d34-ae8a-4a09-9c1a-43862db04f1a tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 11:11:25 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-4a136d34-ae8a-4a09-9c1a-43862db04f1a tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 11:11:25 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-4a136d34-ae8a-4a09-9c1a-43862db04f1a tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 11:11:25 user nova-compute[72362]: DEBUG os_brick.utils [None req-4a136d34-ae8a-4a09-9c1a-43862db04f1a tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 11:11:25 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-4a136d34-ae8a-4a09-9c1a-43862db04f1a tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Updating existing volume attachment record: 1a686111-fe65-4d9e-8969-513fa61898b9 {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 11:11:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:11:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:11:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:11:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a136d34-ae8a-4a09-9c1a-43862db04f1a tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a136d34-ae8a-4a09-9c1a-43862db04f1a tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:977a0079-8884-479a-afd5-26070b077c5c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bNqRHnur', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 11:11:33 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-4a136d34-ae8a-4a09-9c1a-43862db04f1a tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 11:11:33 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-4a136d34-ae8a-4a09-9c1a-43862db04f1a tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-4a136d34-ae8a-4a09-9c1a-43862db04f1a tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 11:11:33 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-4a136d34-ae8a-4a09-9c1a-43862db04f1a tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 11:11:33 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-4a136d34-ae8a-4a09-9c1a-43862db04f1a tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:977a0079-8884-479a-afd5-26070b077c5c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-4a136d34-ae8a-4a09-9c1a-43862db04f1a tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:977a0079-8884-479a-afd5-26070b077c5c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 11:11:33 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-4a136d34-ae8a-4a09-9c1a-43862db04f1a tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 11:11:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:977a0079-8884-479a-afd5-26070b077c5c -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:977a0079-8884-479a-afd5-26070b077c5c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[39001d3c-20ce-4366-86a3-ab190b14f7f0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a136d34-ae8a-4a09-9c1a-43862db04f1a tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 11:11:33 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:977a0079-8884-479a-afd5-26070b077c5c -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:977a0079-8884-479a-afd5-26070b077c5c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[852f9308-7991-4dc3-bdb6-1ccb81f26e65]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:977a0079-8884-479a-afd5-26070b077c5c] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a136d34-ae8a-4a09-9c1a-43862db04f1a tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:977a0079-8884-479a-afd5-26070b077c5c] added
Aug 09 11:11:33 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:977a0079-8884-479a-afd5-26070b077c5c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:977a0079-8884-479a-afd5-26070b077c5c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[9941fa97-aca2-46a3-b640-7e226c178480]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a136d34-ae8a-4a09-9c1a-43862db04f1a tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:977a0079-8884-479a-afd5-26070b077c5c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:977a0079-8884-479a-afd5-26070b077c5c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b142af92-fc67-4533-8e3d-55e14cf22c5c]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a136d34-ae8a-4a09-9c1a-43862db04f1a tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:977a0079-8884-479a-afd5-26070b077c5c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bNqRHnur {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:977a0079-8884-479a-afd5-26070b077c5c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bNqRHnur" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4af600-012f-4e19-be3d-cbd1bd3542bd]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a136d34-ae8a-4a09-9c1a-43862db04f1a tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bNqRHnur'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:977a0079-8884-479a-afd5-26070b077c5c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:977a0079-8884-479a-afd5-26070b077c5c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[9285c2f0-2260-44c2-88ea-3517234e88b7]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a136d34-ae8a-4a09-9c1a-43862db04f1a tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[92293588-3f75-476b-9d25-ff79f7c00d8a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a136d34-ae8a-4a09-9c1a-43862db04f1a tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 11:11:33 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a136d34-ae8a-4a09-9c1a-43862db04f1a tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 11:11:33 user nova-compute[72362]:  {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 11:11:33 user nova-compute[72362]: WARNING os_brick.initiator.connectors.iscsi [None req-4a136d34-ae8a-4a09-9c1a-43862db04f1a tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 11:11:33 user nova-compute[72362]: 
Aug 09 11:11:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:977a0079-8884-479a-afd5-26070b077c5c -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:977a0079-8884-479a-afd5-26070b077c5c -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc91a06-d2f3-49c4-8576-8e16a965742c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:977a0079-8884-479a-afd5-26070b077c5c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:977a0079-8884-479a-afd5-26070b077c5c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a136d34-ae8a-4a09-9c1a-43862db04f1a tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:977a0079-8884-479a-afd5-26070b077c5c, portal: 172.16.0.220,3260]
Aug 09 11:11:33 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:977a0079-8884-479a-afd5-26070b077c5c, portal: 172.16.0.220,3260] successful.
Aug 09 11:11:33 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:977a0079-8884-479a-afd5-26070b077c5c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:977a0079-8884-479a-afd5-26070b077c5c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc303db0-cb46-4a15-bcfb-95295f8ff420]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a136d34-ae8a-4a09-9c1a-43862db04f1a tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ff411e-6b4b-4d86-8f7e-04893962b0f4]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:977a0079-8884-479a-afd5-26070b077c5c (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a136d34-ae8a-4a09-9c1a-43862db04f1a tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:977a0079-8884-479a-afd5-26070b077c5c (non-flash)
Aug 09 11:11:33 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a136d34-ae8a-4a09-9c1a-43862db04f1a tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:977a0079-8884-479a-afd5-26070b077c5c (non-flash)
Aug 09 11:11:33 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-4a136d34-ae8a-4a09-9c1a-43862db04f1a tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:977a0079-8884-479a-afd5-26070b077c5c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a136d34-ae8a-4a09-9c1a-43862db04f1a tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-4a136d34-ae8a-4a09-9c1a-43862db04f1a tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-4a136d34-ae8a-4a09-9c1a-43862db04f1a tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[141fa69d-509e-40d8-a45c-bbcdfead659d]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-4a136d34-ae8a-4a09-9c1a-43862db04f1a tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a136d34-ae8a-4a09-9c1a-43862db04f1a tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bNqRHnur', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 11:11:33 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:11:34 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-4a136d34-ae8a-4a09-9c1a-43862db04f1a tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 11:11:34 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a136d34-ae8a-4a09-9c1a-43862db04f1a tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '26236663863616562', 'path': '/dev/sdb'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 11:11:34 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a136d34-ae8a-4a09-9c1a-43862db04f1a tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236663863616562', 'path': '/dev/sdb'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 11:11:34 user nova-compute[72362]: DEBUG nova.objects.instance [None req-4a136d34-ae8a-4a09-9c1a-43862db04f1a tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lazy-loading 'flavor' on Instance uuid 96100d9b-92e9-43d6-86bf-12d3fba7f036 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 11:11:34 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-4a136d34-ae8a-4a09-9c1a-43862db04f1a tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 11:11:34 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 11:11:34 user nova-compute[72362]:   <source dev="/dev/sdb"/>
Aug 09 11:11:34 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 11:11:34 user nova-compute[72362]:   <serial>977a0079-8884-479a-afd5-26070b077c5c</serial>
Aug 09 11:11:34 user nova-compute[72362]: </disk>
Aug 09 11:11:34 user nova-compute[72362]:  {{(pid=72362) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 11:11:35 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4a136d34-ae8a-4a09-9c1a-43862db04f1a tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 11:11:35 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4a136d34-ae8a-4a09-9c1a-43862db04f1a tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 11:11:35 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-4a136d34-ae8a-4a09-9c1a-43862db04f1a tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] No VIF found with MAC fa:16:3e:5c:55:25, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 11:11:35 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-4a136d34-ae8a-4a09-9c1a-43862db04f1a tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "96100d9b-92e9-43d6-86bf-12d3fba7f036" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.630s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:11:35 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:11:35 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 11:11:35 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Rebuilding the list of instances to heal {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 11:11:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "refresh_cache-96100d9b-92e9-43d6-86bf-12d3fba7f036" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 11:11:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquired lock "refresh_cache-96100d9b-92e9-43d6-86bf-12d3fba7f036" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 11:11:36 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Forcefully refreshing network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 11:11:36 user nova-compute[72362]: DEBUG nova.objects.instance [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lazy-loading 'info_cache' on Instance uuid 96100d9b-92e9-43d6-86bf-12d3fba7f036 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 11:11:36 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Updating instance_info_cache with network_info: [{"id": "35628821-d44d-4645-ab29-3fe27ab3589b", "address": "fa:16:3e:5c:55:25", "network": {"id": "52302a78-20d7-448f-93aa-b0d865b6d0d5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1565698948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a11cb43c879f459bb99373fc7f43c7f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35628821-d4", "ovs_interfaceid": "35628821-d44d-4645-ab29-3fe27ab3589b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 11:11:36 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Releasing lock "refresh_cache-96100d9b-92e9-43d6-86bf-12d3fba7f036" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 11:11:36 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Updated the network info_cache for instance {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 11:11:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:11:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:11:39 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:11:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:11:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:11:42 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:11:42 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 11:11:43 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:11:44 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:11:45 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:11:45 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:11:46 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:11:46 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:11:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:11:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:11:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:11:47 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 11:11:47 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96100d9b-92e9-43d6-86bf-12d3fba7f036/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:11:47 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96100d9b-92e9-43d6-86bf-12d3fba7f036/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:11:47 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96100d9b-92e9-43d6-86bf-12d3fba7f036/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:11:47 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96100d9b-92e9-43d6-86bf-12d3fba7f036/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:11:47 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72362) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 11:11:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:11:47 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 11:11:47 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 11:11:47 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=8837MB free_disk=24.953990936279297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 11:11:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:11:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:11:47 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 96100d9b-92e9-43d6-86bf-12d3fba7f036 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 11:11:47 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 11:11:47 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 11:11:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:11:47 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 11:11:47 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 11:11:47 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 11:11:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.175s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:11:52 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:11:52 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:11:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:11:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b8b6e4e6-0b94-4d19-ac5d-37837e784980 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Acquiring lock "96100d9b-92e9-43d6-86bf-12d3fba7f036" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:11:58 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b8b6e4e6-0b94-4d19-ac5d-37837e784980 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "96100d9b-92e9-43d6-86bf-12d3fba7f036" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:11:58 user nova-compute[72362]: INFO nova.compute.manager [None req-b8b6e4e6-0b94-4d19-ac5d-37837e784980 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Detaching volume 977a0079-8884-479a-afd5-26070b077c5c
Aug 09 11:11:59 user nova-compute[72362]: INFO nova.virt.block_device [None req-b8b6e4e6-0b94-4d19-ac5d-37837e784980 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Attempting to driver detach volume 977a0079-8884-479a-afd5-26070b077c5c from mountpoint /dev/vdb
Aug 09 11:11:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-b8b6e4e6-0b94-4d19-ac5d-37837e784980 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Attempting to detach device vdb from instance 96100d9b-92e9-43d6-86bf-12d3fba7f036 from the persistent domain config. {{(pid=72362) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 11:11:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-b8b6e4e6-0b94-4d19-ac5d-37837e784980 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 11:11:59 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 11:11:59 user nova-compute[72362]:   <source dev="/dev/sdb"/>
Aug 09 11:11:59 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 11:11:59 user nova-compute[72362]:   <serial>977a0079-8884-479a-afd5-26070b077c5c</serial>
Aug 09 11:11:59 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 11:11:59 user nova-compute[72362]: </disk>
Aug 09 11:11:59 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 11:11:59 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-b8b6e4e6-0b94-4d19-ac5d-37837e784980 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Successfully detached device vdb from instance 96100d9b-92e9-43d6-86bf-12d3fba7f036 from the persistent domain config.
Aug 09 11:11:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-b8b6e4e6-0b94-4d19-ac5d-37837e784980 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 96100d9b-92e9-43d6-86bf-12d3fba7f036 from the live domain config. {{(pid=72362) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 11:11:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-b8b6e4e6-0b94-4d19-ac5d-37837e784980 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 11:11:59 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 11:11:59 user nova-compute[72362]:   <source dev="/dev/sdb"/>
Aug 09 11:11:59 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 11:11:59 user nova-compute[72362]:   <serial>977a0079-8884-479a-afd5-26070b077c5c</serial>
Aug 09 11:11:59 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 11:11:59 user nova-compute[72362]: </disk>
Aug 09 11:11:59 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 11:11:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Received event <DeviceRemovedEvent: 1691579519.5930688, 96100d9b-92e9-43d6-86bf-12d3fba7f036 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72362) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 11:11:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-b8b6e4e6-0b94-4d19-ac5d-37837e784980 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 96100d9b-92e9-43d6-86bf-12d3fba7f036 {{(pid=72362) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 11:11:59 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-b8b6e4e6-0b94-4d19-ac5d-37837e784980 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Successfully detached device vdb from instance 96100d9b-92e9-43d6-86bf-12d3fba7f036 from the live domain config.
Aug 09 11:11:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8b6e4e6-0b94-4d19-ac5d-37837e784980 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 11:11:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b6e4e6-0b94-4d19-ac5d-37837e784980 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:977a0079-8884-479a-afd5-26070b077c5c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bNqRHnur', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 11:11:59 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-b8b6e4e6-0b94-4d19-ac5d-37837e784980 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 11:11:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-b8b6e4e6-0b94-4d19-ac5d-37837e784980 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 11:11:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-b8b6e4e6-0b94-4d19-ac5d-37837e784980 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 11:11:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b6e4e6-0b94-4d19-ac5d-37837e784980 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:977a0079-8884-479a-afd5-26070b077c5c', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 11:11:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:11:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:11:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca40b561-3019-412d-89ea-ec1cd8d07642]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:977a0079-8884-479a-afd5-26070b077c5c\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:11:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:11:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:11:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8980f00-5311-4101-a8ed-c1f8ea21f166]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:977a0079-8884-479a-afd5-26070b077c5c (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:11:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b6e4e6-0b94-4d19-ac5d-37837e784980 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:977a0079-8884-479a-afd5-26070b077c5c (non-flash)
Aug 09 11:11:59 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 11:11:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b6e4e6-0b94-4d19-ac5d-37837e784980 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:977a0079-8884-479a-afd5-26070b077c5c (non-flash)
Aug 09 11:11:59 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 11:11:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b6e4e6-0b94-4d19-ac5d-37837e784980 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e424eb90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:977a0079-8884-479a-afd5-26070b077c5c'): ({'sdb'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 11:11:59 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-b8b6e4e6-0b94-4d19-ac5d-37837e784980 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Removing single pathed devices sdb {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 11:11:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:11:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:11:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd39bc9-2a93-4613-bb91-a1ba2959f930]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:11:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:11:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:11:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb76310-3ceb-46b5-9098-caaceaf0dc68]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:11:59 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-b8b6e4e6-0b94-4d19-ac5d-37837e784980 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Flushing IO for device /dev/sdb {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 11:11:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:11:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:11:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb59b37-08ed-4a4a-b4f2-7aafcfe5bf4a]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:11:59 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-b8b6e4e6-0b94-4d19-ac5d-37837e784980 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 11:11:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:11:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:11:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59b0ec8-a918-4af9-af70-204caf2e30e2]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:11:59 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-b8b6e4e6-0b94-4d19-ac5d-37837e784980 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 11:11:59 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-b8b6e4e6-0b94-4d19-ac5d-37837e784980 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] SCSI volumes sdb have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 11:11:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b6e4e6-0b94-4d19-ac5d-37837e784980 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:977a0079-8884-479a-afd5-26070b077c5c')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 11:11:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:977a0079-8884-479a-afd5-26070b077c5c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:11:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:977a0079-8884-479a-afd5-26070b077c5c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:11:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22c2a7d-e1bf-4fa2-93c9-99a9efdfd675]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:11:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b6e4e6-0b94-4d19-ac5d-37837e784980 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:11:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:977a0079-8884-479a-afd5-26070b077c5c -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:11:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:977a0079-8884-479a-afd5-26070b077c5c -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:11:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b91ec9-32c0-4558-9756-8c5c56c566f9]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:977a0079-8884-479a-afd5-26070b077c5c, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:977a0079-8884-479a-afd5-26070b077c5c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:11:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b6e4e6-0b94-4d19-ac5d-37837e784980 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:977a0079-8884-479a-afd5-26070b077c5c, portal: 172.16.0.220,3260]
Aug 09 11:11:59 user nova-compute[72362]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:977a0079-8884-479a-afd5-26070b077c5c, portal: 172.16.0.220,3260] successful.
Aug 09 11:11:59 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:11:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:977a0079-8884-479a-afd5-26070b077c5c -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:11:59 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:977a0079-8884-479a-afd5-26070b077c5c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:11:59 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b7b161-5093-48e5-b5f4-8bb3aa9658c1]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:11:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b6e4e6-0b94-4d19-ac5d-37837e784980 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:11:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-b8b6e4e6-0b94-4d19-ac5d-37837e784980 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.251s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 11:11:59 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b6e4e6-0b94-4d19-ac5d-37837e784980 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] <== disconnect_volume: return (252ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 11:11:59 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8b6e4e6-0b94-4d19-ac5d-37837e784980 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 11:12:00 user nova-compute[72362]: DEBUG nova.objects.instance [None req-b8b6e4e6-0b94-4d19-ac5d-37837e784980 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lazy-loading 'flavor' on Instance uuid 96100d9b-92e9-43d6-86bf-12d3fba7f036 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 11:12:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-b8b6e4e6-0b94-4d19-ac5d-37837e784980 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "96100d9b-92e9-43d6-86bf-12d3fba7f036" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.739s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:12:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:12:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:12:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 11:12:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:12:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:12:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:12:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:12:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:12:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:12:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 11:12:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:12:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:12:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:12:17 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:12:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:12:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:12:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:12:35 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:12:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:12:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:12:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 11:12:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:12:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:12:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:12:37 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:12:37 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 11:12:37 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Rebuilding the list of instances to heal {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 11:12:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "refresh_cache-96100d9b-92e9-43d6-86bf-12d3fba7f036" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 11:12:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquired lock "refresh_cache-96100d9b-92e9-43d6-86bf-12d3fba7f036" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 11:12:38 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Forcefully refreshing network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 11:12:38 user nova-compute[72362]: DEBUG nova.objects.instance [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lazy-loading 'info_cache' on Instance uuid 96100d9b-92e9-43d6-86bf-12d3fba7f036 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 11:12:38 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Updating instance_info_cache with network_info: [{"id": "35628821-d44d-4645-ab29-3fe27ab3589b", "address": "fa:16:3e:5c:55:25", "network": {"id": "52302a78-20d7-448f-93aa-b0d865b6d0d5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1565698948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a11cb43c879f459bb99373fc7f43c7f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35628821-d4", "ovs_interfaceid": "35628821-d44d-4645-ab29-3fe27ab3589b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 11:12:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Releasing lock "refresh_cache-96100d9b-92e9-43d6-86bf-12d3fba7f036" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 11:12:38 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Updated the network info_cache for instance {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 11:12:39 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:12:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:12:43 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:12:44 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:12:44 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 11:12:44 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:12:45 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:12:46 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:12:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:12:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:12:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 11:12:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:12:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:12:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:12:47 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:12:47 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:12:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:12:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:12:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:12:47 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 11:12:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96100d9b-92e9-43d6-86bf-12d3fba7f036/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:12:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96100d9b-92e9-43d6-86bf-12d3fba7f036/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:12:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96100d9b-92e9-43d6-86bf-12d3fba7f036/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:12:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96100d9b-92e9-43d6-86bf-12d3fba7f036/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:12:48 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 11:12:48 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 11:12:48 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=8866MB free_disk=24.94538116455078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 11:12:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:12:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:12:48 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 96100d9b-92e9-43d6-86bf-12d3fba7f036 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 11:12:48 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 11:12:48 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 11:12:48 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Refreshing inventories for resource provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 11:12:48 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Updating ProviderTree inventory for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 11:12:48 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Updating inventory in ProviderTree for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 11:12:48 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Refreshing aggregate associations for resource provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d, aggregates: None {{(pid=72362) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 11:12:48 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Refreshing trait associations for resource provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE41,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=72362) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 11:12:49 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 11:12:49 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 11:12:49 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 11:12:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.284s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:12:52 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:12:53 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c2e6efbf-f8ed-4a10-9073-9deba5c1f315 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Acquiring lock "96100d9b-92e9-43d6-86bf-12d3fba7f036" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:12:53 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c2e6efbf-f8ed-4a10-9073-9deba5c1f315 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "96100d9b-92e9-43d6-86bf-12d3fba7f036" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:12:53 user nova-compute[72362]: DEBUG nova.objects.instance [None req-c2e6efbf-f8ed-4a10-9073-9deba5c1f315 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lazy-loading 'flavor' on Instance uuid 96100d9b-92e9-43d6-86bf-12d3fba7f036 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 11:12:53 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c2e6efbf-f8ed-4a10-9073-9deba5c1f315 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "96100d9b-92e9-43d6-86bf-12d3fba7f036" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:12:53 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c2e6efbf-f8ed-4a10-9073-9deba5c1f315 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Acquiring lock "96100d9b-92e9-43d6-86bf-12d3fba7f036" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:12:53 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c2e6efbf-f8ed-4a10-9073-9deba5c1f315 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "96100d9b-92e9-43d6-86bf-12d3fba7f036" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:12:53 user nova-compute[72362]: INFO nova.compute.manager [None req-c2e6efbf-f8ed-4a10-9073-9deba5c1f315 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Attaching volume ab396886-ecce-47a0-82f9-206dd7e1c365 to /dev/vdb
Aug 09 11:12:53 user nova-compute[72362]: DEBUG os_brick.utils [None req-c2e6efbf-f8ed-4a10-9073-9deba5c1f315 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 11:12:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:12:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:12:53 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74c4aeb-b848-4f6a-853d-baace79f8359]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:12:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:12:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:12:53 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d2a3fd-34c6-4a72-b8a8-d5aa10f8bc02]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:12:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:12:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:12:53 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d894e3f-47c6-4dcc-b3c0-de0fcbd87d64]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:12:53 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[756273a0-8315-4691-88d4-775ff747f969]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:12:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-c2e6efbf-f8ed-4a10-9073-9deba5c1f315 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:12:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-c2e6efbf-f8ed-4a10-9073-9deba5c1f315 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 11:12:53 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c2e6efbf-f8ed-4a10-9073-9deba5c1f315 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 11:12:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:12:53 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 11:12:53 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 11:12:53 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a776dd-4c88-4fc6-ba4e-53c11b407272]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:12:53 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-c2e6efbf-f8ed-4a10-9073-9deba5c1f315 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 11:12:53 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-c2e6efbf-f8ed-4a10-9073-9deba5c1f315 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 11:12:53 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-c2e6efbf-f8ed-4a10-9073-9deba5c1f315 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 11:12:53 user nova-compute[72362]: DEBUG os_brick.utils [None req-c2e6efbf-f8ed-4a10-9073-9deba5c1f315 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 11:12:53 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-c2e6efbf-f8ed-4a10-9073-9deba5c1f315 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Updating existing volume attachment record: 480a8e26-7490-40b5-a57c-882d35bdc0e2 {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 11:12:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:12:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:13:01 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2e6efbf-f8ed-4a10-9073-9deba5c1f315 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 11:13:01 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2e6efbf-f8ed-4a10-9073-9deba5c1f315 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ab396886-ecce-47a0-82f9-206dd7e1c365'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mFcbzMRh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 11:13:01 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-c2e6efbf-f8ed-4a10-9073-9deba5c1f315 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 11:13:01 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-c2e6efbf-f8ed-4a10-9073-9deba5c1f315 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 11:13:01 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-c2e6efbf-f8ed-4a10-9073-9deba5c1f315 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 11:13:01 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-c2e6efbf-f8ed-4a10-9073-9deba5c1f315 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 11:13:01 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-c2e6efbf-f8ed-4a10-9073-9deba5c1f315 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab396886-ecce-47a0-82f9-206dd7e1c365" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 11:13:01 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-c2e6efbf-f8ed-4a10-9073-9deba5c1f315 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab396886-ecce-47a0-82f9-206dd7e1c365" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 11:13:01 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-c2e6efbf-f8ed-4a10-9073-9deba5c1f315 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 11:13:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab396886-ecce-47a0-82f9-206dd7e1c365 -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:13:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab396886-ecce-47a0-82f9-206dd7e1c365 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:13:01 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46aff8a-2377-47cc-a56c-d9fae34dcfd1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:13:01 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2e6efbf-f8ed-4a10-9073-9deba5c1f315 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 11:13:01 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:13:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab396886-ecce-47a0-82f9-206dd7e1c365 -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:13:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab396886-ecce-47a0-82f9-206dd7e1c365 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:13:01 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3978d5-2491-419a-b60a-648479856d9f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab396886-ecce-47a0-82f9-206dd7e1c365] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:13:01 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2e6efbf-f8ed-4a10-9073-9deba5c1f315 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab396886-ecce-47a0-82f9-206dd7e1c365] added
Aug 09 11:13:01 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:13:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab396886-ecce-47a0-82f9-206dd7e1c365 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:13:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab396886-ecce-47a0-82f9-206dd7e1c365 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:13:01 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d689e8b-153c-4119-aa26-a3e98aa7bc5a]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:13:01 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2e6efbf-f8ed-4a10-9073-9deba5c1f315 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:13:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab396886-ecce-47a0-82f9-206dd7e1c365 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:13:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab396886-ecce-47a0-82f9-206dd7e1c365 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:13:01 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b6559c-93e7-43a5-a0a0-1016fee7f598]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:13:01 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2e6efbf-f8ed-4a10-9073-9deba5c1f315 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:13:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab396886-ecce-47a0-82f9-206dd7e1c365 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mFcbzMRh {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:13:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab396886-ecce-47a0-82f9-206dd7e1c365 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mFcbzMRh" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:13:01 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c608b9-388e-4248-8c72-655c8596e234]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:13:01 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2e6efbf-f8ed-4a10-9073-9deba5c1f315 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mFcbzMRh'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:13:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab396886-ecce-47a0-82f9-206dd7e1c365 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:13:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab396886-ecce-47a0-82f9-206dd7e1c365 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:13:01 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67bd4b5-019b-48a1-b7b0-0663ceeb1ea1]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:13:01 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2e6efbf-f8ed-4a10-9073-9deba5c1f315 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:13:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:13:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:13:01 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5958ea1-254c-4463-9484-42938b02f16f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:13:01 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2e6efbf-f8ed-4a10-9073-9deba5c1f315 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 11:13:01 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 11:13:01 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2e6efbf-f8ed-4a10-9073-9deba5c1f315 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 11:13:01 user nova-compute[72362]:  {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 11:13:01 user nova-compute[72362]: WARNING os_brick.initiator.connectors.iscsi [None req-c2e6efbf-f8ed-4a10-9073-9deba5c1f315 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 11:13:01 user nova-compute[72362]: 
Aug 09 11:13:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab396886-ecce-47a0-82f9-206dd7e1c365 -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:13:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab396886-ecce-47a0-82f9-206dd7e1c365 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:13:01 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2224cc-c160-4a83-9396-7ef13ae2df26]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab396886-ecce-47a0-82f9-206dd7e1c365, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ab396886-ecce-47a0-82f9-206dd7e1c365, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:13:01 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2e6efbf-f8ed-4a10-9073-9deba5c1f315 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab396886-ecce-47a0-82f9-206dd7e1c365, portal: 172.16.0.220,3260]
Aug 09 11:13:01 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:ab396886-ecce-47a0-82f9-206dd7e1c365, portal: 172.16.0.220,3260] successful.
Aug 09 11:13:01 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:13:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab396886-ecce-47a0-82f9-206dd7e1c365 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:13:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab396886-ecce-47a0-82f9-206dd7e1c365 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:13:01 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[975b3be8-993d-4762-9d52-3729272fec1e]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:13:01 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2e6efbf-f8ed-4a10-9073-9deba5c1f315 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:13:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:13:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:13:01 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5debac1-4fbb-4dca-8544-a4b9a58fd67a]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab396886-ecce-47a0-82f9-206dd7e1c365 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:13:01 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2e6efbf-f8ed-4a10-9073-9deba5c1f315 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab396886-ecce-47a0-82f9-206dd7e1c365 (non-flash)
Aug 09 11:13:01 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 11:13:01 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2e6efbf-f8ed-4a10-9073-9deba5c1f315 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab396886-ecce-47a0-82f9-206dd7e1c365 (non-flash)
Aug 09 11:13:01 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 11:13:01 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-c2e6efbf-f8ed-4a10-9073-9deba5c1f315 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab396886-ecce-47a0-82f9-206dd7e1c365" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 11:13:01 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2e6efbf-f8ed-4a10-9073-9deba5c1f315 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 11:13:01 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-c2e6efbf-f8ed-4a10-9073-9deba5c1f315 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 11:13:01 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-c2e6efbf-f8ed-4a10-9073-9deba5c1f315 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 11:13:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:13:01 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:13:01 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabdd81e-3590-420d-89d8-eafc47f93802]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:13:01 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-c2e6efbf-f8ed-4a10-9073-9deba5c1f315 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 11:13:01 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2e6efbf-f8ed-4a10-9073-9deba5c1f315 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mFcbzMRh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 11:13:02 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-c2e6efbf-f8ed-4a10-9073-9deba5c1f315 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 11:13:02 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2e6efbf-f8ed-4a10-9073-9deba5c1f315 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '26435343934623534', 'path': '/dev/sdb'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 11:13:02 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2e6efbf-f8ed-4a10-9073-9deba5c1f315 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435343934623534', 'path': '/dev/sdb'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 11:13:02 user nova-compute[72362]: DEBUG nova.objects.instance [None req-c2e6efbf-f8ed-4a10-9073-9deba5c1f315 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lazy-loading 'flavor' on Instance uuid 96100d9b-92e9-43d6-86bf-12d3fba7f036 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 11:13:02 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-c2e6efbf-f8ed-4a10-9073-9deba5c1f315 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 11:13:02 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 11:13:02 user nova-compute[72362]:   <source dev="/dev/sdb"/>
Aug 09 11:13:02 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 11:13:02 user nova-compute[72362]:   <serial>ab396886-ecce-47a0-82f9-206dd7e1c365</serial>
Aug 09 11:13:02 user nova-compute[72362]: </disk>
Aug 09 11:13:02 user nova-compute[72362]:  {{(pid=72362) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 11:13:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:13:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:13:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 11:13:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:13:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:13:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:13:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-c2e6efbf-f8ed-4a10-9073-9deba5c1f315 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 11:13:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-c2e6efbf-f8ed-4a10-9073-9deba5c1f315 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 11:13:03 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-c2e6efbf-f8ed-4a10-9073-9deba5c1f315 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] No VIF found with MAC fa:16:3e:5c:55:25, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 11:13:03 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-c2e6efbf-f8ed-4a10-9073-9deba5c1f315 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "96100d9b-92e9-43d6-86bf-12d3fba7f036" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.843s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:13:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-59ed6b2c-79e1-4628-8520-2a48bcf51d4b tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Acquiring lock "96100d9b-92e9-43d6-86bf-12d3fba7f036" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:13:05 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-59ed6b2c-79e1-4628-8520-2a48bcf51d4b tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "96100d9b-92e9-43d6-86bf-12d3fba7f036" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:13:05 user nova-compute[72362]: INFO nova.compute.manager [None req-59ed6b2c-79e1-4628-8520-2a48bcf51d4b tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Detaching volume ab396886-ecce-47a0-82f9-206dd7e1c365
Aug 09 11:13:05 user nova-compute[72362]: INFO nova.virt.block_device [None req-59ed6b2c-79e1-4628-8520-2a48bcf51d4b tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Attempting to driver detach volume ab396886-ecce-47a0-82f9-206dd7e1c365 from mountpoint /dev/vdb
Aug 09 11:13:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-59ed6b2c-79e1-4628-8520-2a48bcf51d4b tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Attempting to detach device vdb from instance 96100d9b-92e9-43d6-86bf-12d3fba7f036 from the persistent domain config. {{(pid=72362) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 11:13:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-59ed6b2c-79e1-4628-8520-2a48bcf51d4b tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 11:13:05 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 11:13:05 user nova-compute[72362]:   <source dev="/dev/sdb"/>
Aug 09 11:13:05 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 11:13:05 user nova-compute[72362]:   <serial>ab396886-ecce-47a0-82f9-206dd7e1c365</serial>
Aug 09 11:13:05 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 11:13:05 user nova-compute[72362]: </disk>
Aug 09 11:13:05 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 11:13:05 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-59ed6b2c-79e1-4628-8520-2a48bcf51d4b tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Successfully detached device vdb from instance 96100d9b-92e9-43d6-86bf-12d3fba7f036 from the persistent domain config.
Aug 09 11:13:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-59ed6b2c-79e1-4628-8520-2a48bcf51d4b tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 96100d9b-92e9-43d6-86bf-12d3fba7f036 from the live domain config. {{(pid=72362) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 11:13:05 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-59ed6b2c-79e1-4628-8520-2a48bcf51d4b tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 11:13:05 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 11:13:05 user nova-compute[72362]:   <source dev="/dev/sdb"/>
Aug 09 11:13:05 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 11:13:05 user nova-compute[72362]:   <serial>ab396886-ecce-47a0-82f9-206dd7e1c365</serial>
Aug 09 11:13:05 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 11:13:05 user nova-compute[72362]: </disk>
Aug 09 11:13:05 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 11:13:06 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:13:06 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Received event <DeviceRemovedEvent: 1691579586.1184123, 96100d9b-92e9-43d6-86bf-12d3fba7f036 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72362) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 11:13:06 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-59ed6b2c-79e1-4628-8520-2a48bcf51d4b tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 96100d9b-92e9-43d6-86bf-12d3fba7f036 {{(pid=72362) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 11:13:06 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-59ed6b2c-79e1-4628-8520-2a48bcf51d4b tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Successfully detached device vdb from instance 96100d9b-92e9-43d6-86bf-12d3fba7f036 from the live domain config.
Aug 09 11:13:06 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59ed6b2c-79e1-4628-8520-2a48bcf51d4b tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 11:13:06 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ed6b2c-79e1-4628-8520-2a48bcf51d4b tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:ab396886-ecce-47a0-82f9-206dd7e1c365'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mFcbzMRh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 11:13:06 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-59ed6b2c-79e1-4628-8520-2a48bcf51d4b tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 11:13:06 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-59ed6b2c-79e1-4628-8520-2a48bcf51d4b tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 11:13:06 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-59ed6b2c-79e1-4628-8520-2a48bcf51d4b tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 11:13:06 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ed6b2c-79e1-4628-8520-2a48bcf51d4b tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab396886-ecce-47a0-82f9-206dd7e1c365', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 11:13:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:13:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:13:06 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[066aa537-b763-47c6-b467-188246170bf0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab396886-ecce-47a0-82f9-206dd7e1c365\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:13:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:13:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:13:06 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[028e15be-debe-4edd-a410-1d011b887a1a]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab396886-ecce-47a0-82f9-206dd7e1c365 (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:13:06 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ed6b2c-79e1-4628-8520-2a48bcf51d4b tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab396886-ecce-47a0-82f9-206dd7e1c365 (non-flash)
Aug 09 11:13:06 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 11:13:06 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ed6b2c-79e1-4628-8520-2a48bcf51d4b tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab396886-ecce-47a0-82f9-206dd7e1c365 (non-flash)
Aug 09 11:13:06 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 11:13:06 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ed6b2c-79e1-4628-8520-2a48bcf51d4b tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34dc2b35b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab396886-ecce-47a0-82f9-206dd7e1c365'): ({'sdb'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 11:13:06 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-59ed6b2c-79e1-4628-8520-2a48bcf51d4b tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Removing single pathed devices sdb {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 11:13:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:13:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:13:06 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d530570-39d6-4d0d-8d61-9aa89752b79b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:13:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:13:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:13:06 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1be236-f098-4aaa-8d69-84035d188f65]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:13:06 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-59ed6b2c-79e1-4628-8520-2a48bcf51d4b tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Flushing IO for device /dev/sdb {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 11:13:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:13:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:13:06 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f5f79a-d2ad-455c-a68e-57224b2db6e1]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:13:06 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-59ed6b2c-79e1-4628-8520-2a48bcf51d4b tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 11:13:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:13:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:13:06 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05fce94-ac61-4128-bd20-c300bdf46289]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:13:06 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-59ed6b2c-79e1-4628-8520-2a48bcf51d4b tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 11:13:06 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-59ed6b2c-79e1-4628-8520-2a48bcf51d4b tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] SCSI volumes sdb have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 11:13:06 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ed6b2c-79e1-4628-8520-2a48bcf51d4b tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab396886-ecce-47a0-82f9-206dd7e1c365')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 11:13:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab396886-ecce-47a0-82f9-206dd7e1c365 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:13:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab396886-ecce-47a0-82f9-206dd7e1c365 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:13:06 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0707a46e-efc1-453f-8c48-5e50537b7ca3]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:13:06 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ed6b2c-79e1-4628-8520-2a48bcf51d4b tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:13:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab396886-ecce-47a0-82f9-206dd7e1c365 -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:13:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab396886-ecce-47a0-82f9-206dd7e1c365 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:13:06 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[284c3a1f-f089-4eeb-9f21-0e54df646176]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:ab396886-ecce-47a0-82f9-206dd7e1c365, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:ab396886-ecce-47a0-82f9-206dd7e1c365, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:13:06 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ed6b2c-79e1-4628-8520-2a48bcf51d4b tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:ab396886-ecce-47a0-82f9-206dd7e1c365, portal: 172.16.0.220,3260]
Aug 09 11:13:06 user nova-compute[72362]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:ab396886-ecce-47a0-82f9-206dd7e1c365, portal: 172.16.0.220,3260] successful.
Aug 09 11:13:06 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:13:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab396886-ecce-47a0-82f9-206dd7e1c365 -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:13:06 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab396886-ecce-47a0-82f9-206dd7e1c365 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:13:06 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[39714de0-6d96-484c-9c7c-a31cf9054fb5]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:13:06 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ed6b2c-79e1-4628-8520-2a48bcf51d4b tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:13:06 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-59ed6b2c-79e1-4628-8520-2a48bcf51d4b tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.264s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 11:13:06 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ed6b2c-79e1-4628-8520-2a48bcf51d4b tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] <== disconnect_volume: return (266ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 11:13:06 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59ed6b2c-79e1-4628-8520-2a48bcf51d4b tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 11:13:06 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:13:06 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Cleaning up deleted instances {{(pid=72362) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 11:13:06 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] There are 0 instances to clean {{(pid=72362) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 11:13:07 user nova-compute[72362]: DEBUG nova.objects.instance [None req-59ed6b2c-79e1-4628-8520-2a48bcf51d4b tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lazy-loading 'flavor' on Instance uuid 96100d9b-92e9-43d6-86bf-12d3fba7f036 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 11:13:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-59ed6b2c-79e1-4628-8520-2a48bcf51d4b tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "96100d9b-92e9-43d6-86bf-12d3fba7f036" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.564s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:13:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:13:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:13:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:13:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:13:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 11:13:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:13:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:13:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:13:13 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:13:17 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:13:17 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:13:17 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72362) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 11:13:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:13:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:13:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 11:13:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:13:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:13:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:13:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:13:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:13:35 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:13:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:13:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:13:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 11:13:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:13:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:13:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:13:37 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:13:37 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 11:13:37 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Rebuilding the list of instances to heal {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 11:13:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "refresh_cache-96100d9b-92e9-43d6-86bf-12d3fba7f036" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 11:13:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquired lock "refresh_cache-96100d9b-92e9-43d6-86bf-12d3fba7f036" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 11:13:38 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Forcefully refreshing network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 11:13:38 user nova-compute[72362]: DEBUG nova.objects.instance [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lazy-loading 'info_cache' on Instance uuid 96100d9b-92e9-43d6-86bf-12d3fba7f036 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 11:13:38 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Updating instance_info_cache with network_info: [{"id": "35628821-d44d-4645-ab29-3fe27ab3589b", "address": "fa:16:3e:5c:55:25", "network": {"id": "52302a78-20d7-448f-93aa-b0d865b6d0d5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1565698948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a11cb43c879f459bb99373fc7f43c7f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35628821-d4", "ovs_interfaceid": "35628821-d44d-4645-ab29-3fe27ab3589b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 11:13:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Releasing lock "refresh_cache-96100d9b-92e9-43d6-86bf-12d3fba7f036" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 11:13:38 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Updated the network info_cache for instance {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 11:13:41 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:13:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:13:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:13:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 11:13:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:13:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:13:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:13:43 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:13:44 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:13:44 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Triggering sync for uuid 96100d9b-92e9-43d6-86bf-12d3fba7f036 {{(pid=72362) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 11:13:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "96100d9b-92e9-43d6-86bf-12d3fba7f036" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:13:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "96100d9b-92e9-43d6-86bf-12d3fba7f036" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:13:44 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "96100d9b-92e9-43d6-86bf-12d3fba7f036" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:13:45 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:13:45 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 11:13:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:13:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:13:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 11:13:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:13:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:13:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:13:47 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:13:47 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:13:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:13:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:13:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:13:48 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 11:13:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96100d9b-92e9-43d6-86bf-12d3fba7f036/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:13:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96100d9b-92e9-43d6-86bf-12d3fba7f036/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:13:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96100d9b-92e9-43d6-86bf-12d3fba7f036/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:13:48 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96100d9b-92e9-43d6-86bf-12d3fba7f036/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:13:48 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 11:13:48 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 11:13:48 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=8848MB free_disk=24.944366455078125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 11:13:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:13:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:13:48 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 96100d9b-92e9-43d6-86bf-12d3fba7f036 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 11:13:48 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 11:13:48 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 11:13:48 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 11:13:48 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 11:13:48 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 11:13:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.181s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:13:49 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:13:49 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:13:52 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:13:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:13:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:13:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 11:13:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:13:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:13:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:13:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-35e782e2-d8b5-4ad2-add5-07b2be366fcf tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Acquiring lock "96100d9b-92e9-43d6-86bf-12d3fba7f036" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:13:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-35e782e2-d8b5-4ad2-add5-07b2be366fcf tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "96100d9b-92e9-43d6-86bf-12d3fba7f036" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:13:59 user nova-compute[72362]: DEBUG nova.objects.instance [None req-35e782e2-d8b5-4ad2-add5-07b2be366fcf tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lazy-loading 'flavor' on Instance uuid 96100d9b-92e9-43d6-86bf-12d3fba7f036 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 11:13:59 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-35e782e2-d8b5-4ad2-add5-07b2be366fcf tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "96100d9b-92e9-43d6-86bf-12d3fba7f036" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:14:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-35e782e2-d8b5-4ad2-add5-07b2be366fcf tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Acquiring lock "96100d9b-92e9-43d6-86bf-12d3fba7f036" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:14:00 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-35e782e2-d8b5-4ad2-add5-07b2be366fcf tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "96100d9b-92e9-43d6-86bf-12d3fba7f036" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:14:00 user nova-compute[72362]: INFO nova.compute.manager [None req-35e782e2-d8b5-4ad2-add5-07b2be366fcf tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Attaching volume 88e6b461-77a7-4b2c-8f9a-dadb3f226c1a to /dev/vdb
Aug 09 11:14:00 user nova-compute[72362]: DEBUG os_brick.utils [None req-35e782e2-d8b5-4ad2-add5-07b2be366fcf tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 11:14:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:14:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:14:00 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af1a96a-1803-44be-8328-991525753420]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:14:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:14:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:14:00 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b70b11-dff1-4812-84d1-2abb036a3ab1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:14:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:14:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:14:00 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bf41e1-b2b3-47a6-9ed3-f6b077582295]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:14:00 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[7610e1ce-d9d3-4845-8423-f442d609ff28]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:14:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-35e782e2-d8b5-4ad2-add5-07b2be366fcf tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:14:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-35e782e2-d8b5-4ad2-add5-07b2be366fcf tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 11:14:00 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-35e782e2-d8b5-4ad2-add5-07b2be366fcf tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 11:14:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:14:00 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 11:14:00 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 11:14:00 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9db5ad-4577-402d-8da6-92e968f3b0ba]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:14:00 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-35e782e2-d8b5-4ad2-add5-07b2be366fcf tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 11:14:00 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-35e782e2-d8b5-4ad2-add5-07b2be366fcf tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 11:14:00 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-35e782e2-d8b5-4ad2-add5-07b2be366fcf tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 11:14:00 user nova-compute[72362]: DEBUG os_brick.utils [None req-35e782e2-d8b5-4ad2-add5-07b2be366fcf tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 11:14:00 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-35e782e2-d8b5-4ad2-add5-07b2be366fcf tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Updating existing volume attachment record: e6fd8014-d84a-430a-bdd0-e4b32ccc9df3 {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 11:14:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:14:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:14:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:14:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:14:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 11:14:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:14:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:14:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:14:08 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35e782e2-d8b5-4ad2-add5-07b2be366fcf tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 11:14:08 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e782e2-d8b5-4ad2-add5-07b2be366fcf tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:88e6b461-77a7-4b2c-8f9a-dadb3f226c1a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MBhQuYgS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 11:14:08 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-35e782e2-d8b5-4ad2-add5-07b2be366fcf tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 11:14:08 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-35e782e2-d8b5-4ad2-add5-07b2be366fcf tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 11:14:08 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-35e782e2-d8b5-4ad2-add5-07b2be366fcf tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 11:14:08 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-35e782e2-d8b5-4ad2-add5-07b2be366fcf tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 11:14:08 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-35e782e2-d8b5-4ad2-add5-07b2be366fcf tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88e6b461-77a7-4b2c-8f9a-dadb3f226c1a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 11:14:08 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-35e782e2-d8b5-4ad2-add5-07b2be366fcf tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88e6b461-77a7-4b2c-8f9a-dadb3f226c1a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 11:14:08 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-35e782e2-d8b5-4ad2-add5-07b2be366fcf tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 11:14:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88e6b461-77a7-4b2c-8f9a-dadb3f226c1a -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:14:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88e6b461-77a7-4b2c-8f9a-dadb3f226c1a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:14:08 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb37058a-8d48-40eb-b680-ee41e8835fda]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:14:08 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e782e2-d8b5-4ad2-add5-07b2be366fcf tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 11:14:08 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:14:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88e6b461-77a7-4b2c-8f9a-dadb3f226c1a -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:14:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88e6b461-77a7-4b2c-8f9a-dadb3f226c1a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:14:08 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[21267978-905a-4c28-89ea-b3aedb71e026]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88e6b461-77a7-4b2c-8f9a-dadb3f226c1a] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:14:08 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e782e2-d8b5-4ad2-add5-07b2be366fcf tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88e6b461-77a7-4b2c-8f9a-dadb3f226c1a] added
Aug 09 11:14:08 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:14:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88e6b461-77a7-4b2c-8f9a-dadb3f226c1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:14:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88e6b461-77a7-4b2c-8f9a-dadb3f226c1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:14:08 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ed3769-45d9-4f6f-ad15-4f60b073c30e]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:14:08 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e782e2-d8b5-4ad2-add5-07b2be366fcf tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:14:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88e6b461-77a7-4b2c-8f9a-dadb3f226c1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:14:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88e6b461-77a7-4b2c-8f9a-dadb3f226c1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:14:08 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d2500e-160a-4869-9b13-0c490395737b]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:14:08 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e782e2-d8b5-4ad2-add5-07b2be366fcf tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:14:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88e6b461-77a7-4b2c-8f9a-dadb3f226c1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MBhQuYgS {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:14:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88e6b461-77a7-4b2c-8f9a-dadb3f226c1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MBhQuYgS" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:14:08 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23f01e8-73ba-4d16-89ae-38e91fa99b87]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:14:08 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e782e2-d8b5-4ad2-add5-07b2be366fcf tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MBhQuYgS'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:14:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88e6b461-77a7-4b2c-8f9a-dadb3f226c1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:14:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88e6b461-77a7-4b2c-8f9a-dadb3f226c1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:14:08 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[239794f5-f1d5-4eac-9a20-16f83a000700]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:14:08 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e782e2-d8b5-4ad2-add5-07b2be366fcf tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:14:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:14:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:14:08 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf16e70-df39-431f-8ce8-0cc86055c7f6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:14:08 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e782e2-d8b5-4ad2-add5-07b2be366fcf tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 11:14:08 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 11:14:08 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e782e2-d8b5-4ad2-add5-07b2be366fcf tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 11:14:08 user nova-compute[72362]:  {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 11:14:08 user nova-compute[72362]: WARNING os_brick.initiator.connectors.iscsi [None req-35e782e2-d8b5-4ad2-add5-07b2be366fcf tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 11:14:08 user nova-compute[72362]: 
Aug 09 11:14:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88e6b461-77a7-4b2c-8f9a-dadb3f226c1a -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:14:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88e6b461-77a7-4b2c-8f9a-dadb3f226c1a -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:14:08 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4b6a53-4200-4456-8d48-8832d40e7b22]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:88e6b461-77a7-4b2c-8f9a-dadb3f226c1a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:88e6b461-77a7-4b2c-8f9a-dadb3f226c1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:14:08 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e782e2-d8b5-4ad2-add5-07b2be366fcf tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:88e6b461-77a7-4b2c-8f9a-dadb3f226c1a, portal: 172.16.0.220,3260]
Aug 09 11:14:08 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:88e6b461-77a7-4b2c-8f9a-dadb3f226c1a, portal: 172.16.0.220,3260] successful.
Aug 09 11:14:08 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:14:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88e6b461-77a7-4b2c-8f9a-dadb3f226c1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:14:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88e6b461-77a7-4b2c-8f9a-dadb3f226c1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:14:08 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[705a795d-3876-4aa4-ba33-fa463776a198]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:14:08 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e782e2-d8b5-4ad2-add5-07b2be366fcf tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:14:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:14:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:14:08 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34aa97a-85ac-4b2a-815e-d40dbddaca21]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88e6b461-77a7-4b2c-8f9a-dadb3f226c1a (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:14:08 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e782e2-d8b5-4ad2-add5-07b2be366fcf tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88e6b461-77a7-4b2c-8f9a-dadb3f226c1a (non-flash)
Aug 09 11:14:08 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 11:14:08 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e782e2-d8b5-4ad2-add5-07b2be366fcf tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88e6b461-77a7-4b2c-8f9a-dadb3f226c1a (non-flash)
Aug 09 11:14:08 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 11:14:08 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-35e782e2-d8b5-4ad2-add5-07b2be366fcf tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88e6b461-77a7-4b2c-8f9a-dadb3f226c1a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 11:14:08 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e782e2-d8b5-4ad2-add5-07b2be366fcf tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 11:14:08 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-35e782e2-d8b5-4ad2-add5-07b2be366fcf tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 11:14:08 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-35e782e2-d8b5-4ad2-add5-07b2be366fcf tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 11:14:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:14:08 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.073s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:14:08 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[1971bc45-b289-4764-842f-ec84867d1a7b]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:14:08 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-35e782e2-d8b5-4ad2-add5-07b2be366fcf tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 11:14:08 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e782e2-d8b5-4ad2-add5-07b2be366fcf tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MBhQuYgS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 11:14:09 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-35e782e2-d8b5-4ad2-add5-07b2be366fcf tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 11:14:09 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e782e2-d8b5-4ad2-add5-07b2be366fcf tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23234626564363633', 'path': '/dev/sdb'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 11:14:09 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35e782e2-d8b5-4ad2-add5-07b2be366fcf tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234626564363633', 'path': '/dev/sdb'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 11:14:09 user nova-compute[72362]: DEBUG nova.objects.instance [None req-35e782e2-d8b5-4ad2-add5-07b2be366fcf tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lazy-loading 'flavor' on Instance uuid 96100d9b-92e9-43d6-86bf-12d3fba7f036 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 11:14:09 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-35e782e2-d8b5-4ad2-add5-07b2be366fcf tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 11:14:09 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 11:14:09 user nova-compute[72362]:   <source dev="/dev/sdb"/>
Aug 09 11:14:09 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 11:14:09 user nova-compute[72362]:   <serial>88e6b461-77a7-4b2c-8f9a-dadb3f226c1a</serial>
Aug 09 11:14:09 user nova-compute[72362]: </disk>
Aug 09 11:14:09 user nova-compute[72362]:  {{(pid=72362) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 11:14:09 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-35e782e2-d8b5-4ad2-add5-07b2be366fcf tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 11:14:09 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-35e782e2-d8b5-4ad2-add5-07b2be366fcf tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 11:14:09 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-35e782e2-d8b5-4ad2-add5-07b2be366fcf tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] No VIF found with MAC fa:16:3e:5c:55:25, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 11:14:09 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-35e782e2-d8b5-4ad2-add5-07b2be366fcf tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "96100d9b-92e9-43d6-86bf-12d3fba7f036" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.936s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:14:12 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6acc5cb0-2e0a-41db-9ebd-b4a4e500a839 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Acquiring lock "96100d9b-92e9-43d6-86bf-12d3fba7f036" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:14:12 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6acc5cb0-2e0a-41db-9ebd-b4a4e500a839 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "96100d9b-92e9-43d6-86bf-12d3fba7f036" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:14:12 user nova-compute[72362]: INFO nova.compute.manager [None req-6acc5cb0-2e0a-41db-9ebd-b4a4e500a839 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Detaching volume 88e6b461-77a7-4b2c-8f9a-dadb3f226c1a
Aug 09 11:14:12 user nova-compute[72362]: INFO nova.virt.block_device [None req-6acc5cb0-2e0a-41db-9ebd-b4a4e500a839 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Attempting to driver detach volume 88e6b461-77a7-4b2c-8f9a-dadb3f226c1a from mountpoint /dev/vdb
Aug 09 11:14:12 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-6acc5cb0-2e0a-41db-9ebd-b4a4e500a839 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Attempting to detach device vdb from instance 96100d9b-92e9-43d6-86bf-12d3fba7f036 from the persistent domain config. {{(pid=72362) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 11:14:12 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-6acc5cb0-2e0a-41db-9ebd-b4a4e500a839 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 11:14:12 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 11:14:12 user nova-compute[72362]:   <source dev="/dev/sdb"/>
Aug 09 11:14:12 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 11:14:12 user nova-compute[72362]:   <serial>88e6b461-77a7-4b2c-8f9a-dadb3f226c1a</serial>
Aug 09 11:14:12 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 11:14:12 user nova-compute[72362]: </disk>
Aug 09 11:14:12 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 11:14:12 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-6acc5cb0-2e0a-41db-9ebd-b4a4e500a839 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Successfully detached device vdb from instance 96100d9b-92e9-43d6-86bf-12d3fba7f036 from the persistent domain config.
Aug 09 11:14:12 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-6acc5cb0-2e0a-41db-9ebd-b4a4e500a839 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 96100d9b-92e9-43d6-86bf-12d3fba7f036 from the live domain config. {{(pid=72362) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 11:14:12 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-6acc5cb0-2e0a-41db-9ebd-b4a4e500a839 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 11:14:12 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 11:14:12 user nova-compute[72362]:   <source dev="/dev/sdb"/>
Aug 09 11:14:12 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 11:14:12 user nova-compute[72362]:   <serial>88e6b461-77a7-4b2c-8f9a-dadb3f226c1a</serial>
Aug 09 11:14:12 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 11:14:12 user nova-compute[72362]: </disk>
Aug 09 11:14:12 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 11:14:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:14:12 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:14:12 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Received event <DeviceRemovedEvent: 1691579652.9809873, 96100d9b-92e9-43d6-86bf-12d3fba7f036 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72362) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 11:14:12 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-6acc5cb0-2e0a-41db-9ebd-b4a4e500a839 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 96100d9b-92e9-43d6-86bf-12d3fba7f036 {{(pid=72362) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 11:14:12 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-6acc5cb0-2e0a-41db-9ebd-b4a4e500a839 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Successfully detached device vdb from instance 96100d9b-92e9-43d6-86bf-12d3fba7f036 from the live domain config.
Aug 09 11:14:12 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6acc5cb0-2e0a-41db-9ebd-b4a4e500a839 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 11:14:12 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acc5cb0-2e0a-41db-9ebd-b4a4e500a839 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:88e6b461-77a7-4b2c-8f9a-dadb3f226c1a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MBhQuYgS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 11:14:12 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-6acc5cb0-2e0a-41db-9ebd-b4a4e500a839 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 11:14:12 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-6acc5cb0-2e0a-41db-9ebd-b4a4e500a839 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 11:14:12 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-6acc5cb0-2e0a-41db-9ebd-b4a4e500a839 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 11:14:12 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acc5cb0-2e0a-41db-9ebd-b4a4e500a839 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88e6b461-77a7-4b2c-8f9a-dadb3f226c1a', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 11:14:12 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:14:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:14:13 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eafb142-8414-442e-b5bc-696decdc4e8e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88e6b461-77a7-4b2c-8f9a-dadb3f226c1a\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:14:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:14:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:14:13 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b9478f-a8d5-46dd-9d4b-cf04ba207292]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88e6b461-77a7-4b2c-8f9a-dadb3f226c1a (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:14:13 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acc5cb0-2e0a-41db-9ebd-b4a4e500a839 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88e6b461-77a7-4b2c-8f9a-dadb3f226c1a (non-flash)
Aug 09 11:14:13 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 11:14:13 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acc5cb0-2e0a-41db-9ebd-b4a4e500a839 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88e6b461-77a7-4b2c-8f9a-dadb3f226c1a (non-flash)
Aug 09 11:14:13 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 11:14:13 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acc5cb0-2e0a-41db-9ebd-b4a4e500a839 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34dc10b6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88e6b461-77a7-4b2c-8f9a-dadb3f226c1a'): ({'sdb'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 11:14:13 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-6acc5cb0-2e0a-41db-9ebd-b4a4e500a839 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Removing single pathed devices sdb {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 11:14:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:14:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:14:13 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91149aa-4d07-4832-876b-86c57b27039b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:14:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:14:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:14:13 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[57cb069f-8785-489e-81f6-eaf18eaff0a4]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:14:13 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-6acc5cb0-2e0a-41db-9ebd-b4a4e500a839 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Flushing IO for device /dev/sdb {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 11:14:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:14:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:14:13 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[094b27aa-410c-4e26-83ae-d8f408e7e53c]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:14:13 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-6acc5cb0-2e0a-41db-9ebd-b4a4e500a839 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 11:14:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:14:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.065s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:14:13 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[26be3d39-77cb-4f4c-99a1-9d9076359639]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:14:13 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-6acc5cb0-2e0a-41db-9ebd-b4a4e500a839 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 11:14:13 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-6acc5cb0-2e0a-41db-9ebd-b4a4e500a839 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] SCSI volumes sdb have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 11:14:13 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acc5cb0-2e0a-41db-9ebd-b4a4e500a839 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88e6b461-77a7-4b2c-8f9a-dadb3f226c1a')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 11:14:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88e6b461-77a7-4b2c-8f9a-dadb3f226c1a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:14:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88e6b461-77a7-4b2c-8f9a-dadb3f226c1a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:14:13 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c439650-ccde-41a1-8717-d8c117fe6f2b]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:14:13 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acc5cb0-2e0a-41db-9ebd-b4a4e500a839 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:14:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88e6b461-77a7-4b2c-8f9a-dadb3f226c1a -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:14:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88e6b461-77a7-4b2c-8f9a-dadb3f226c1a -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:14:13 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[9631f11f-466d-4a90-8dac-9b47f97d1036]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:88e6b461-77a7-4b2c-8f9a-dadb3f226c1a, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:88e6b461-77a7-4b2c-8f9a-dadb3f226c1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:14:13 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acc5cb0-2e0a-41db-9ebd-b4a4e500a839 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:88e6b461-77a7-4b2c-8f9a-dadb3f226c1a, portal: 172.16.0.220,3260]
Aug 09 11:14:13 user nova-compute[72362]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:88e6b461-77a7-4b2c-8f9a-dadb3f226c1a, portal: 172.16.0.220,3260] successful.
Aug 09 11:14:13 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:14:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88e6b461-77a7-4b2c-8f9a-dadb3f226c1a -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:14:13 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88e6b461-77a7-4b2c-8f9a-dadb3f226c1a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:14:13 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfccb173-77bf-4ce1-96b4-71c5f3d8808b]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:14:13 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acc5cb0-2e0a-41db-9ebd-b4a4e500a839 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:14:13 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-6acc5cb0-2e0a-41db-9ebd-b4a4e500a839 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 11:14:13 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acc5cb0-2e0a-41db-9ebd-b4a4e500a839 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] <== disconnect_volume: return (303ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 11:14:13 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6acc5cb0-2e0a-41db-9ebd-b4a4e500a839 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 11:14:14 user nova-compute[72362]: DEBUG nova.objects.instance [None req-6acc5cb0-2e0a-41db-9ebd-b4a4e500a839 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lazy-loading 'flavor' on Instance uuid 96100d9b-92e9-43d6-86bf-12d3fba7f036 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 11:14:14 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-6acc5cb0-2e0a-41db-9ebd-b4a4e500a839 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "96100d9b-92e9-43d6-86bf-12d3fba7f036" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.814s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:14:17 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:14:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:14:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:14:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:14:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 11:14:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:14:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:14:27 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:14:32 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:14:37 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:14:37 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 11:14:37 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Rebuilding the list of instances to heal {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 11:14:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:14:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:14:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 11:14:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:14:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:14:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:14:37 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:14:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "refresh_cache-96100d9b-92e9-43d6-86bf-12d3fba7f036" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 11:14:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquired lock "refresh_cache-96100d9b-92e9-43d6-86bf-12d3fba7f036" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 11:14:38 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Forcefully refreshing network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 11:14:38 user nova-compute[72362]: DEBUG nova.objects.instance [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lazy-loading 'info_cache' on Instance uuid 96100d9b-92e9-43d6-86bf-12d3fba7f036 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 11:14:39 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Updating instance_info_cache with network_info: [{"id": "35628821-d44d-4645-ab29-3fe27ab3589b", "address": "fa:16:3e:5c:55:25", "network": {"id": "52302a78-20d7-448f-93aa-b0d865b6d0d5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1565698948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a11cb43c879f459bb99373fc7f43c7f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35628821-d4", "ovs_interfaceid": "35628821-d44d-4645-ab29-3fe27ab3589b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 11:14:39 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Releasing lock "refresh_cache-96100d9b-92e9-43d6-86bf-12d3fba7f036" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 11:14:39 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Updated the network info_cache for instance {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 11:14:39 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:14:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:14:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:14:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 11:14:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:14:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:14:42 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:14:43 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:14:44 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:14:46 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:14:46 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 11:14:47 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:14:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:14:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:14:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 11:14:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:14:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:14:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:14:48 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:14:48 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:14:49 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:14:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:14:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:14:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:14:50 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 11:14:50 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96100d9b-92e9-43d6-86bf-12d3fba7f036/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:14:50 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96100d9b-92e9-43d6-86bf-12d3fba7f036/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:14:50 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96100d9b-92e9-43d6-86bf-12d3fba7f036/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:14:50 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96100d9b-92e9-43d6-86bf-12d3fba7f036/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:14:50 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 11:14:50 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 11:14:50 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=8826MB free_disk=24.943374633789062GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 11:14:50 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:14:50 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:14:51 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 96100d9b-92e9-43d6-86bf-12d3fba7f036 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 11:14:51 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 11:14:51 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 11:14:51 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 11:14:51 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 11:14:51 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 11:14:51 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.382s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:14:52 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:14:57 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:15:02 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:15:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-bb197078-c921-4e0e-9a2d-fb67f7cb1744 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Acquiring lock "96100d9b-92e9-43d6-86bf-12d3fba7f036" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:15:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-bb197078-c921-4e0e-9a2d-fb67f7cb1744 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "96100d9b-92e9-43d6-86bf-12d3fba7f036" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:15:06 user nova-compute[72362]: DEBUG nova.objects.instance [None req-bb197078-c921-4e0e-9a2d-fb67f7cb1744 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lazy-loading 'flavor' on Instance uuid 96100d9b-92e9-43d6-86bf-12d3fba7f036 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 11:15:06 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-bb197078-c921-4e0e-9a2d-fb67f7cb1744 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "96100d9b-92e9-43d6-86bf-12d3fba7f036" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:15:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:15:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-bb197078-c921-4e0e-9a2d-fb67f7cb1744 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Acquiring lock "96100d9b-92e9-43d6-86bf-12d3fba7f036" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:15:07 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-bb197078-c921-4e0e-9a2d-fb67f7cb1744 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "96100d9b-92e9-43d6-86bf-12d3fba7f036" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:15:07 user nova-compute[72362]: INFO nova.compute.manager [None req-bb197078-c921-4e0e-9a2d-fb67f7cb1744 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Attaching volume c4ee7894-ebe7-4877-87e1-59d91b46e05f to /dev/vdb
Aug 09 11:15:07 user nova-compute[72362]: DEBUG os_brick.utils [None req-bb197078-c921-4e0e-9a2d-fb67f7cb1744 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 11:15:07 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:15:07 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:15:07 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[7869e24c-403c-42a8-a9cd-a3130edfcf6c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51403b32e14\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:15:07 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:15:07 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:15:07 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[875386d9-5244-4fc7-93cc-5f2e7538b5d0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:15:07 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:15:07 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:15:07 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ae319c-ebc6-4505-a682-79988af62d5a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:15:07 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d761267b-0279-4dd9-8ce4-b24fabb23c0e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:15:07 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-bb197078-c921-4e0e-9a2d-fb67f7cb1744 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Running cmd (subprocess): nvme version {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:15:07 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-bb197078-c921-4e0e-9a2d-fb67f7cb1744 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] 'nvme version' failed. Not Retrying. {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 11:15:07 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bb197078-c921-4e0e-9a2d-fb67f7cb1744 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] nvme not present on system {{(pid=72362) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 11:15:07 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:15:07 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 11:15:07 user nova-compute[72362]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 11:15:07 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[790177df-dae6-4171-a674-cbea03a62896]: (4, '') {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:15:07 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-bb197078-c921-4e0e-9a2d-fb67f7cb1744 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72362) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 11:15:07 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-bb197078-c921-4e0e-9a2d-fb67f7cb1744 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 11:15:07 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.lightos [None req-bb197078-c921-4e0e-9a2d-fb67f7cb1744 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] LIGHTOS: no hostnqn found. {{(pid=72362) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 11:15:07 user nova-compute[72362]: DEBUG os_brick.utils [None req-bb197078-c921-4e0e-9a2d-fb67f7cb1744 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51403b32e14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 11:15:07 user nova-compute[72362]: DEBUG nova.virt.block_device [None req-bb197078-c921-4e0e-9a2d-fb67f7cb1744 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Updating existing volume attachment record: 6940d014-de75-4feb-be23-d0b60f2b6cce {{(pid=72362) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 11:15:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:15:08 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:15:13 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:15:13 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:15:13 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 11:15:13 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:15:13 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:15:13 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:15:15 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb197078-c921-4e0e-9a2d-fb67f7cb1744 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Calling os-brick to attach iSCSI Volume {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 11:15:15 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb197078-c921-4e0e-9a2d-fb67f7cb1744 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c4ee7894-ebe7-4877-87e1-59d91b46e05f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BURIaMSQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 11:15:15 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-bb197078-c921-4e0e-9a2d-fb67f7cb1744 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 11:15:15 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-bb197078-c921-4e0e-9a2d-fb67f7cb1744 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 11:15:15 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-bb197078-c921-4e0e-9a2d-fb67f7cb1744 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 11:15:15 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-bb197078-c921-4e0e-9a2d-fb67f7cb1744 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 11:15:15 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-bb197078-c921-4e0e-9a2d-fb67f7cb1744 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4ee7894-ebe7-4877-87e1-59d91b46e05f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 11:15:15 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-bb197078-c921-4e0e-9a2d-fb67f7cb1744 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4ee7894-ebe7-4877-87e1-59d91b46e05f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 11:15:15 user nova-compute[72362]: INFO os_brick.initiator.connectors.iscsi [None req-bb197078-c921-4e0e-9a2d-fb67f7cb1744 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 11:15:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4ee7894-ebe7-4877-87e1-59d91b46e05f -p 172.16.0.220:3260 {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:15:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4ee7894-ebe7-4877-87e1-59d91b46e05f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:15:15 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a69f3f3-1c19-4ae7-b1b9-59d621258655]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:15:15 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb197078-c921-4e0e-9a2d-fb67f7cb1744 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 11:15:15 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:15:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4ee7894-ebe7-4877-87e1-59d91b46e05f -p 172.16.0.220:3260 --interface default --op new {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:15:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4ee7894-ebe7-4877-87e1-59d91b46e05f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:15:15 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[338cc6aa-e68b-4d22-9471-d0fb74430389]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4ee7894-ebe7-4877-87e1-59d91b46e05f] added\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:15:15 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb197078-c921-4e0e-9a2d-fb67f7cb1744 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4ee7894-ebe7-4877-87e1-59d91b46e05f] added
Aug 09 11:15:15 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:15:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4ee7894-ebe7-4877-87e1-59d91b46e05f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:15:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4ee7894-ebe7-4877-87e1-59d91b46e05f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:15:15 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[53036493-65c1-46f8-b592-3fa56cdfe206]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:15:15 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb197078-c921-4e0e-9a2d-fb67f7cb1744 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:15:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4ee7894-ebe7-4877-87e1-59d91b46e05f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:15:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4ee7894-ebe7-4877-87e1-59d91b46e05f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:15:15 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[796050eb-f6a9-4cd8-9ae4-152196896d1e]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:15:15 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb197078-c921-4e0e-9a2d-fb67f7cb1744 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:15:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4ee7894-ebe7-4877-87e1-59d91b46e05f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BURIaMSQ {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:15:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4ee7894-ebe7-4877-87e1-59d91b46e05f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BURIaMSQ" returned: 0 in 0.025s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:15:15 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c94c02b-6050-4a55-81dd-d779667f32bc]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:15:15 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb197078-c921-4e0e-9a2d-fb67f7cb1744 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BURIaMSQ'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:15:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4ee7894-ebe7-4877-87e1-59d91b46e05f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:15:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4ee7894-ebe7-4877-87e1-59d91b46e05f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:15:15 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e48a21-d084-4cb1-a318-185f2adb0189]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:15:15 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb197078-c921-4e0e-9a2d-fb67f7cb1744 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:15:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:15:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:15:15 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dcc5349-c976-45a4-8551-049cef7f6d70]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:15:15 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb197078-c921-4e0e-9a2d-fb67f7cb1744 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 11:15:15 user nova-compute[72362]:  {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 11:15:15 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb197078-c921-4e0e-9a2d-fb67f7cb1744 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 11:15:15 user nova-compute[72362]:  {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 11:15:15 user nova-compute[72362]: WARNING os_brick.initiator.connectors.iscsi [None req-bb197078-c921-4e0e-9a2d-fb67f7cb1744 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 11:15:15 user nova-compute[72362]: 
Aug 09 11:15:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4ee7894-ebe7-4877-87e1-59d91b46e05f -p 172.16.0.220:3260 --login {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:15:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4ee7894-ebe7-4877-87e1-59d91b46e05f -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:15:15 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b4f021-472b-41f4-9445-42b4415963fb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4ee7894-ebe7-4877-87e1-59d91b46e05f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c4ee7894-ebe7-4877-87e1-59d91b46e05f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:15:15 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb197078-c921-4e0e-9a2d-fb67f7cb1744 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4ee7894-ebe7-4877-87e1-59d91b46e05f, portal: 172.16.0.220,3260]
Aug 09 11:15:15 user nova-compute[72362]: Login to [iface: default, target: iqn.2010-10.org.openstack:c4ee7894-ebe7-4877-87e1-59d91b46e05f, portal: 172.16.0.220,3260] successful.
Aug 09 11:15:15 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:15:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4ee7894-ebe7-4877-87e1-59d91b46e05f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:15:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4ee7894-ebe7-4877-87e1-59d91b46e05f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:15:15 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5d7e86-d59f-4c1f-8b92-371cf8904fdd]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:15:15 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb197078-c921-4e0e-9a2d-fb67f7cb1744 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:15:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:15:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:15:15 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b47ac3f-6e81-49d4-b926-a85d4a96b3a7]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ee7894-ebe7-4877-87e1-59d91b46e05f (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:15:15 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb197078-c921-4e0e-9a2d-fb67f7cb1744 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ee7894-ebe7-4877-87e1-59d91b46e05f (non-flash)
Aug 09 11:15:15 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 11:15:15 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb197078-c921-4e0e-9a2d-fb67f7cb1744 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ee7894-ebe7-4877-87e1-59d91b46e05f (non-flash)
Aug 09 11:15:15 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 11:15:15 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-bb197078-c921-4e0e-9a2d-fb67f7cb1744 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4ee7894-ebe7-4877-87e1-59d91b46e05f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 11:15:15 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb197078-c921-4e0e-9a2d-fb67f7cb1744 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Connected to 172.16.0.220:3260 {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 11:15:15 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-bb197078-c921-4e0e-9a2d-fb67f7cb1744 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=72362) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 11:15:15 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-bb197078-c921-4e0e-9a2d-fb67f7cb1744 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72362) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 11:15:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:15:15 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:15:15 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c45af2-72b1-4214-8436-222b8b1176ec]: (4, ('- - 0', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:15:15 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-bb197078-c921-4e0e-9a2d-fb67f7cb1744 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72362) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 11:15:15 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb197078-c921-4e0e-9a2d-fb67f7cb1744 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BURIaMSQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72362) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 11:15:16 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-bb197078-c921-4e0e-9a2d-fb67f7cb1744 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 11:15:16 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb197078-c921-4e0e-9a2d-fb67f7cb1744 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '26631663262393862', 'path': '/dev/sdb'} {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 11:15:16 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb197078-c921-4e0e-9a2d-fb67f7cb1744 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631663262393862', 'path': '/dev/sdb'} {{(pid=72362) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 11:15:16 user nova-compute[72362]: DEBUG nova.objects.instance [None req-bb197078-c921-4e0e-9a2d-fb67f7cb1744 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lazy-loading 'flavor' on Instance uuid 96100d9b-92e9-43d6-86bf-12d3fba7f036 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 11:15:16 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-bb197078-c921-4e0e-9a2d-fb67f7cb1744 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 11:15:16 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 11:15:16 user nova-compute[72362]:   <source dev="/dev/sdb"/>
Aug 09 11:15:16 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 11:15:16 user nova-compute[72362]:   <serial>c4ee7894-ebe7-4877-87e1-59d91b46e05f</serial>
Aug 09 11:15:16 user nova-compute[72362]: </disk>
Aug 09 11:15:16 user nova-compute[72362]:  {{(pid=72362) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 11:15:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-bb197078-c921-4e0e-9a2d-fb67f7cb1744 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] No BDM found with device name vda, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 11:15:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-bb197078-c921-4e0e-9a2d-fb67f7cb1744 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72362) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 11:15:17 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-bb197078-c921-4e0e-9a2d-fb67f7cb1744 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] No VIF found with MAC fa:16:3e:5c:55:25, not building metadata {{(pid=72362) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 11:15:17 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-bb197078-c921-4e0e-9a2d-fb67f7cb1744 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "96100d9b-92e9-43d6-86bf-12d3fba7f036" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.829s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:15:18 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:15:18 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:15:18 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 11:15:18 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:15:18 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:15:18 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:15:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-dc280fe5-4377-4a2a-b09c-38c1206b30e6 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Acquiring lock "96100d9b-92e9-43d6-86bf-12d3fba7f036" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:15:20 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-dc280fe5-4377-4a2a-b09c-38c1206b30e6 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "96100d9b-92e9-43d6-86bf-12d3fba7f036" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:15:20 user nova-compute[72362]: INFO nova.compute.manager [None req-dc280fe5-4377-4a2a-b09c-38c1206b30e6 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Detaching volume c4ee7894-ebe7-4877-87e1-59d91b46e05f
Aug 09 11:15:20 user nova-compute[72362]: INFO nova.virt.block_device [None req-dc280fe5-4377-4a2a-b09c-38c1206b30e6 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Attempting to driver detach volume c4ee7894-ebe7-4877-87e1-59d91b46e05f from mountpoint /dev/vdb
Aug 09 11:15:20 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-dc280fe5-4377-4a2a-b09c-38c1206b30e6 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Attempting to detach device vdb from instance 96100d9b-92e9-43d6-86bf-12d3fba7f036 from the persistent domain config. {{(pid=72362) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 11:15:20 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-dc280fe5-4377-4a2a-b09c-38c1206b30e6 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 11:15:20 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 11:15:20 user nova-compute[72362]:   <source dev="/dev/sdb"/>
Aug 09 11:15:20 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 11:15:20 user nova-compute[72362]:   <serial>c4ee7894-ebe7-4877-87e1-59d91b46e05f</serial>
Aug 09 11:15:20 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 11:15:20 user nova-compute[72362]: </disk>
Aug 09 11:15:20 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 11:15:20 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-dc280fe5-4377-4a2a-b09c-38c1206b30e6 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Successfully detached device vdb from instance 96100d9b-92e9-43d6-86bf-12d3fba7f036 from the persistent domain config.
Aug 09 11:15:20 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-dc280fe5-4377-4a2a-b09c-38c1206b30e6 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 96100d9b-92e9-43d6-86bf-12d3fba7f036 from the live domain config. {{(pid=72362) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 11:15:20 user nova-compute[72362]: DEBUG nova.virt.libvirt.guest [None req-dc280fe5-4377-4a2a-b09c-38c1206b30e6 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 11:15:20 user nova-compute[72362]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 11:15:20 user nova-compute[72362]:   <source dev="/dev/sdb"/>
Aug 09 11:15:20 user nova-compute[72362]:   <target dev="vdb" bus="virtio"/>
Aug 09 11:15:20 user nova-compute[72362]:   <serial>c4ee7894-ebe7-4877-87e1-59d91b46e05f</serial>
Aug 09 11:15:20 user nova-compute[72362]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 11:15:20 user nova-compute[72362]: </disk>
Aug 09 11:15:20 user nova-compute[72362]:  {{(pid=72362) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 11:15:20 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-7f525a33-735b-410a-a6b6-c42a34a6c084 None None] Received event <DeviceRemovedEvent: 1691579720.624442, 96100d9b-92e9-43d6-86bf-12d3fba7f036 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72362) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 11:15:20 user nova-compute[72362]: DEBUG nova.virt.libvirt.driver [None req-dc280fe5-4377-4a2a-b09c-38c1206b30e6 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 96100d9b-92e9-43d6-86bf-12d3fba7f036 {{(pid=72362) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 11:15:20 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-dc280fe5-4377-4a2a-b09c-38c1206b30e6 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Successfully detached device vdb from instance 96100d9b-92e9-43d6-86bf-12d3fba7f036 from the live domain config.
Aug 09 11:15:20 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc280fe5-4377-4a2a-b09c-38c1206b30e6 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] calling os-brick to detach iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 11:15:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc280fe5-4377-4a2a-b09c-38c1206b30e6 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e4347700>, {'target_iqns': ['iqn.2010-10.org.openstack:c4ee7894-ebe7-4877-87e1-59d91b46e05f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BURIaMSQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 11:15:20 user nova-compute[72362]: WARNING os_brick.initiator.connectors.base [None req-dc280fe5-4377-4a2a-b09c-38c1206b30e6 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 11:15:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-dc280fe5-4377-4a2a-b09c-38c1206b30e6 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 11:15:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-dc280fe5-4377-4a2a-b09c-38c1206b30e6 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 11:15:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc280fe5-4377-4a2a-b09c-38c1206b30e6 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4ee7894-ebe7-4877-87e1-59d91b46e05f', 0)] {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 11:15:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:15:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:15:20 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66b5703-f462-4f44-97c2-2b598a69fcba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4ee7894-ebe7-4877-87e1-59d91b46e05f\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:15:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:15:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:15:20 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c4b0de-351a-4466-ac74-f89f2567e81d]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ee7894-ebe7-4877-87e1-59d91b46e05f (non-flash)\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:15:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc280fe5-4377-4a2a-b09c-38c1206b30e6 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ee7894-ebe7-4877-87e1-59d91b46e05f (non-flash)
Aug 09 11:15:20 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 11:15:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc280fe5-4377-4a2a-b09c-38c1206b30e6 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ee7894-ebe7-4877-87e1-59d91b46e05f (non-flash)
Aug 09 11:15:20 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 11:15:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc280fe5-4377-4a2a-b09c-38c1206b30e6 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e41bc700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4ee7894-ebe7-4877-87e1-59d91b46e05f'): ({'sdb'}, set())}) {{(pid=72362) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 11:15:20 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-dc280fe5-4377-4a2a-b09c-38c1206b30e6 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Removing single pathed devices sdb {{(pid=72362) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 11:15:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:15:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:15:20 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7e1b4b-17d1-4dc6-98e1-ede879eec440]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:15:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:15:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:15:20 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[be522653-5b12-476b-ab7d-01f1a4be3e9f]: (4, ('ok\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:15:20 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-dc280fe5-4377-4a2a-b09c-38c1206b30e6 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Flushing IO for device /dev/sdb {{(pid=72362) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 11:15:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:15:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:15:20 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd449dab-4abe-477f-9a0f-be7c82f5b636]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:15:20 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-dc280fe5-4377-4a2a-b09c-38c1206b30e6 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72362) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 11:15:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:15:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:15:20 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9dd1b9-b592-4097-8232-b92895ad02de]: (4, ('1', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:15:20 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-dc280fe5-4377-4a2a-b09c-38c1206b30e6 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 11:15:20 user nova-compute[72362]: DEBUG os_brick.initiator.linuxscsi [None req-dc280fe5-4377-4a2a-b09c-38c1206b30e6 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] SCSI volumes sdb have been removed. {{(pid=72362) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 11:15:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc280fe5-4377-4a2a-b09c-38c1206b30e6 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4ee7894-ebe7-4877-87e1-59d91b46e05f')] {{(pid=72362) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 11:15:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4ee7894-ebe7-4877-87e1-59d91b46e05f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:15:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4ee7894-ebe7-4877-87e1-59d91b46e05f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:15:20 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6548ed-2be5-4687-887c-0fbddaf48965]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:15:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc280fe5-4377-4a2a-b09c-38c1206b30e6 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:15:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4ee7894-ebe7-4877-87e1-59d91b46e05f -p 172.16.0.220:3260 --logout {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:15:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4ee7894-ebe7-4877-87e1-59d91b46e05f -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:15:20 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6374fd0-490f-47e9-a170-46e0a4d747d8]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:c4ee7894-ebe7-4877-87e1-59d91b46e05f, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:c4ee7894-ebe7-4877-87e1-59d91b46e05f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:15:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc280fe5-4377-4a2a-b09c-38c1206b30e6 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:c4ee7894-ebe7-4877-87e1-59d91b46e05f, portal: 172.16.0.220,3260]
Aug 09 11:15:20 user nova-compute[72362]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:c4ee7894-ebe7-4877-87e1-59d91b46e05f, portal: 172.16.0.220,3260] successful.
Aug 09 11:15:20 user nova-compute[72362]:  stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:15:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4ee7894-ebe7-4877-87e1-59d91b46e05f -p 172.16.0.220:3260 --op delete {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:15:20 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4ee7894-ebe7-4877-87e1-59d91b46e05f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84003) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:15:20 user nova-compute[72362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f9d478-3385-40e3-9a36-68053cbdf486]: (4, ('', '')) {{(pid=84003) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 11:15:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc280fe5-4377-4a2a-b09c-38c1206b30e6 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72362) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 11:15:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.base [None req-dc280fe5-4377-4a2a-b09c-38c1206b30e6 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.251s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 11:15:20 user nova-compute[72362]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc280fe5-4377-4a2a-b09c-38c1206b30e6 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] <== disconnect_volume: return (252ms) None {{(pid=72362) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 11:15:20 user nova-compute[72362]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc280fe5-4377-4a2a-b09c-38c1206b30e6 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Disconnected iSCSI Volume {{(pid=72362) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 11:15:21 user nova-compute[72362]: DEBUG nova.objects.instance [None req-dc280fe5-4377-4a2a-b09c-38c1206b30e6 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lazy-loading 'flavor' on Instance uuid 96100d9b-92e9-43d6-86bf-12d3fba7f036 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 11:15:21 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-dc280fe5-4377-4a2a-b09c-38c1206b30e6 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "96100d9b-92e9-43d6-86bf-12d3fba7f036" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.599s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:15:22 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:15:23 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:15:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:15:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:15:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 11:15:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:15:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:15:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:15:33 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:15:37 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:15:37 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 11:15:37 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Rebuilding the list of instances to heal {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 11:15:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:15:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:15:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 11:15:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:15:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:15:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:15:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "refresh_cache-96100d9b-92e9-43d6-86bf-12d3fba7f036" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 11:15:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquired lock "refresh_cache-96100d9b-92e9-43d6-86bf-12d3fba7f036" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 11:15:38 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Forcefully refreshing network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 11:15:38 user nova-compute[72362]: DEBUG nova.objects.instance [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lazy-loading 'info_cache' on Instance uuid 96100d9b-92e9-43d6-86bf-12d3fba7f036 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 11:15:38 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Updating instance_info_cache with network_info: [{"id": "35628821-d44d-4645-ab29-3fe27ab3589b", "address": "fa:16:3e:5c:55:25", "network": {"id": "52302a78-20d7-448f-93aa-b0d865b6d0d5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1565698948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a11cb43c879f459bb99373fc7f43c7f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35628821-d4", "ovs_interfaceid": "35628821-d44d-4645-ab29-3fe27ab3589b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 11:15:38 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Releasing lock "refresh_cache-96100d9b-92e9-43d6-86bf-12d3fba7f036" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 11:15:38 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Updated the network info_cache for instance {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 11:15:39 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:15:43 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:15:43 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:15:43 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 11:15:43 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:15:43 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:15:43 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:15:44 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:15:44 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:15:46 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:15:46 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 11:15:47 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:15:48 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:15:48 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:15:48 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:15:49 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:15:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:15:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:15:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:15:50 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 11:15:50 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96100d9b-92e9-43d6-86bf-12d3fba7f036/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:15:50 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96100d9b-92e9-43d6-86bf-12d3fba7f036/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:15:50 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96100d9b-92e9-43d6-86bf-12d3fba7f036/disk --force-share --output=json {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 11:15:50 user nova-compute[72362]: DEBUG oslo_concurrency.processutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96100d9b-92e9-43d6-86bf-12d3fba7f036/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72362) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 11:15:50 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 11:15:50 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 11:15:50 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=8813MB free_disk=24.942352294921875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 11:15:50 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:15:50 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:15:50 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Instance 96100d9b-92e9-43d6-86bf-12d3fba7f036 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72362) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 11:15:50 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 11:15:50 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 11:15:50 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 11:15:50 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 11:15:50 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 11:15:50 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.165s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:15:53 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:15:58 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:16:03 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:16:03 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:16:03 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 11:16:03 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:16:03 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:16:03 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:16:08 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:16:08 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:16:08 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 11:16:08 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:16:08 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:16:08 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:16:13 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:16:18 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:16:18 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:16:18 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 11:16:18 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:16:18 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:16:18 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:16:23 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:16:23 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:16:23 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 11:16:23 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:16:23 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:16:23 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:16:28 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:16:33 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:16:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:16:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:16:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 11:16:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:16:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:16:38 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:16:38 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:16:38 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 11:16:38 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Rebuilding the list of instances to heal {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 11:16:39 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "refresh_cache-96100d9b-92e9-43d6-86bf-12d3fba7f036" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 11:16:39 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquired lock "refresh_cache-96100d9b-92e9-43d6-86bf-12d3fba7f036" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 11:16:39 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Forcefully refreshing network info cache for instance {{(pid=72362) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 11:16:39 user nova-compute[72362]: DEBUG nova.objects.instance [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lazy-loading 'info_cache' on Instance uuid 96100d9b-92e9-43d6-86bf-12d3fba7f036 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 11:16:39 user nova-compute[72362]: DEBUG nova.network.neutron [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Updating instance_info_cache with network_info: [{"id": "35628821-d44d-4645-ab29-3fe27ab3589b", "address": "fa:16:3e:5c:55:25", "network": {"id": "52302a78-20d7-448f-93aa-b0d865b6d0d5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1565698948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a11cb43c879f459bb99373fc7f43c7f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35628821-d4", "ovs_interfaceid": "35628821-d44d-4645-ab29-3fe27ab3589b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 11:16:39 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Releasing lock "refresh_cache-96100d9b-92e9-43d6-86bf-12d3fba7f036" {{(pid=72362) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 11:16:39 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Updated the network info_cache for instance {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 11:16:39 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:16:43 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:16:44 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:16:45 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:16:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d34f3fff-ff51-453d-a3c9-5c0fd82a27d9 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Acquiring lock "96100d9b-92e9-43d6-86bf-12d3fba7f036" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:16:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d34f3fff-ff51-453d-a3c9-5c0fd82a27d9 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "96100d9b-92e9-43d6-86bf-12d3fba7f036" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:16:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d34f3fff-ff51-453d-a3c9-5c0fd82a27d9 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Acquiring lock "96100d9b-92e9-43d6-86bf-12d3fba7f036-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:16:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d34f3fff-ff51-453d-a3c9-5c0fd82a27d9 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "96100d9b-92e9-43d6-86bf-12d3fba7f036-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:16:46 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d34f3fff-ff51-453d-a3c9-5c0fd82a27d9 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "96100d9b-92e9-43d6-86bf-12d3fba7f036-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:16:46 user nova-compute[72362]: INFO nova.compute.manager [None req-d34f3fff-ff51-453d-a3c9-5c0fd82a27d9 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Terminating instance
Aug 09 11:16:46 user nova-compute[72362]: DEBUG nova.compute.manager [None req-d34f3fff-ff51-453d-a3c9-5c0fd82a27d9 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Start destroying the instance on the hypervisor. {{(pid=72362) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 11:16:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:16:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:16:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:16:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:16:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:16:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:16:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:16:46 user nova-compute[72362]: INFO nova.virt.libvirt.driver [-] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Instance destroyed successfully.
Aug 09 11:16:46 user nova-compute[72362]: DEBUG nova.objects.instance [None req-d34f3fff-ff51-453d-a3c9-5c0fd82a27d9 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lazy-loading 'resources' on Instance uuid 96100d9b-92e9-43d6-86bf-12d3fba7f036 {{(pid=72362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 11:16:46 user nova-compute[72362]: DEBUG nova.virt.libvirt.vif [None req-d34f3fff-ff51-453d-a3c9-5c0fd82a27d9 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T11:09:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-919658178',display_name='tempest-SnapshotDataIntegrityTests-server-919658178',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-919658178',id=52,image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3yAje+FJ1sUO27PRKYR14kwoBPGPmAXF+a/IxrspoqXOAMvx3eMyb+3YSq4lTOyxBEsY+sNv662AoaOl+g2UsbN4Mkc/51Bv9GUHCjWYj2+Pjy0JdUyTa8mTrL2osfwg==',key_name='tempest-keypair-927946981',keypairs=<?>,launch_index=0,launched_at=2023-08-09T11:09:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a11cb43c879f459bb99373fc7f43c7f1',ramdisk_id='',reservation_id='r-12mpkw8f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a08d1a11-49eb-4212-a351-e11ee9553b95',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1670400890',owner_user_name='tempest-SnapshotDataIntegrityTests-1670400890-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T11:09:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45d255c663cc43ee91eba0dfa719ac38',uuid=96100d9b-92e9-43d6-86bf-12d3fba7f036,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "35628821-d44d-4645-ab29-3fe27ab3589b", "address": "fa:16:3e:5c:55:25", "network": {"id": "52302a78-20d7-448f-93aa-b0d865b6d0d5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1565698948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a11cb43c879f459bb99373fc7f43c7f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35628821-d4", "ovs_interfaceid": "35628821-d44d-4645-ab29-3fe27ab3589b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 11:16:46 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-d34f3fff-ff51-453d-a3c9-5c0fd82a27d9 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Converting VIF {"id": "35628821-d44d-4645-ab29-3fe27ab3589b", "address": "fa:16:3e:5c:55:25", "network": {"id": "52302a78-20d7-448f-93aa-b0d865b6d0d5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1565698948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a11cb43c879f459bb99373fc7f43c7f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35628821-d4", "ovs_interfaceid": "35628821-d44d-4645-ab29-3fe27ab3589b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 11:16:46 user nova-compute[72362]: DEBUG nova.network.os_vif_util [None req-d34f3fff-ff51-453d-a3c9-5c0fd82a27d9 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:55:25,bridge_name='br-int',has_traffic_filtering=True,id=35628821-d44d-4645-ab29-3fe27ab3589b,network=Network(52302a78-20d7-448f-93aa-b0d865b6d0d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35628821-d4') {{(pid=72362) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 11:16:46 user nova-compute[72362]: DEBUG os_vif [None req-d34f3fff-ff51-453d-a3c9-5c0fd82a27d9 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:55:25,bridge_name='br-int',has_traffic_filtering=True,id=35628821-d44d-4645-ab29-3fe27ab3589b,network=Network(52302a78-20d7-448f-93aa-b0d865b6d0d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35628821-d4') {{(pid=72362) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 11:16:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:16:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap35628821-d4, bridge=br-int, if_exists=True) {{(pid=72362) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 11:16:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:16:46 user nova-compute[72362]: INFO os_vif [None req-d34f3fff-ff51-453d-a3c9-5c0fd82a27d9 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:55:25,bridge_name='br-int',has_traffic_filtering=True,id=35628821-d44d-4645-ab29-3fe27ab3589b,network=Network(52302a78-20d7-448f-93aa-b0d865b6d0d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35628821-d4')
Aug 09 11:16:46 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-d34f3fff-ff51-453d-a3c9-5c0fd82a27d9 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Deleting instance files /opt/stack/data/nova/instances/96100d9b-92e9-43d6-86bf-12d3fba7f036_del
Aug 09 11:16:46 user nova-compute[72362]: INFO nova.virt.libvirt.driver [None req-d34f3fff-ff51-453d-a3c9-5c0fd82a27d9 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Deletion of /opt/stack/data/nova/instances/96100d9b-92e9-43d6-86bf-12d3fba7f036_del complete
Aug 09 11:16:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:16:47 user nova-compute[72362]: INFO nova.compute.manager [None req-d34f3fff-ff51-453d-a3c9-5c0fd82a27d9 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 09 11:16:47 user nova-compute[72362]: DEBUG oslo.service.loopingcall [None req-d34f3fff-ff51-453d-a3c9-5c0fd82a27d9 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72362) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 11:16:47 user nova-compute[72362]: DEBUG nova.compute.manager [-] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Deallocating network for instance {{(pid=72362) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 11:16:47 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] deallocate_for_instance() {{(pid=72362) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 11:16:47 user nova-compute[72362]: DEBUG nova.compute.manager [req-7b6b9d03-57c7-4c8d-933b-0928b94431b1 req-9670d612-3156-4448-a1c4-e66b18441e8d service nova] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Received event network-vif-unplugged-35628821-d44d-4645-ab29-3fe27ab3589b {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 11:16:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-7b6b9d03-57c7-4c8d-933b-0928b94431b1 req-9670d612-3156-4448-a1c4-e66b18441e8d service nova] Acquiring lock "96100d9b-92e9-43d6-86bf-12d3fba7f036-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:16:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-7b6b9d03-57c7-4c8d-933b-0928b94431b1 req-9670d612-3156-4448-a1c4-e66b18441e8d service nova] Lock "96100d9b-92e9-43d6-86bf-12d3fba7f036-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:16:47 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-7b6b9d03-57c7-4c8d-933b-0928b94431b1 req-9670d612-3156-4448-a1c4-e66b18441e8d service nova] Lock "96100d9b-92e9-43d6-86bf-12d3fba7f036-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:16:47 user nova-compute[72362]: DEBUG nova.compute.manager [req-7b6b9d03-57c7-4c8d-933b-0928b94431b1 req-9670d612-3156-4448-a1c4-e66b18441e8d service nova] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] No waiting events found dispatching network-vif-unplugged-35628821-d44d-4645-ab29-3fe27ab3589b {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 11:16:47 user nova-compute[72362]: DEBUG nova.compute.manager [req-7b6b9d03-57c7-4c8d-933b-0928b94431b1 req-9670d612-3156-4448-a1c4-e66b18441e8d service nova] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Received event network-vif-unplugged-35628821-d44d-4645-ab29-3fe27ab3589b for instance with task_state deleting. {{(pid=72362) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 11:16:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:16:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:16:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:16:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:16:47 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:16:47 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:16:47 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 11:16:48 user nova-compute[72362]: DEBUG nova.network.neutron [-] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Updating instance_info_cache with network_info: [] {{(pid=72362) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 11:16:48 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Took 1.19 seconds to deallocate network for instance.
Aug 09 11:16:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d34f3fff-ff51-453d-a3c9-5c0fd82a27d9 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:16:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d34f3fff-ff51-453d-a3c9-5c0fd82a27d9 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:16:48 user nova-compute[72362]: DEBUG nova.compute.manager [req-dead27fb-7733-4e7f-8d88-3a09d1678c8c req-103b899e-7dae-401e-9202-d76119282fa3 service nova] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Received event network-vif-deleted-35628821-d44d-4645-ab29-3fe27ab3589b {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 11:16:48 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-d34f3fff-ff51-453d-a3c9-5c0fd82a27d9 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 11:16:48 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-d34f3fff-ff51-453d-a3c9-5c0fd82a27d9 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 11:16:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d34f3fff-ff51-453d-a3c9-5c0fd82a27d9 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.113s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:16:48 user nova-compute[72362]: INFO nova.scheduler.client.report [None req-d34f3fff-ff51-453d-a3c9-5c0fd82a27d9 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Deleted allocations for instance 96100d9b-92e9-43d6-86bf-12d3fba7f036
Aug 09 11:16:48 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-d34f3fff-ff51-453d-a3c9-5c0fd82a27d9 tempest-SnapshotDataIntegrityTests-1670400890 tempest-SnapshotDataIntegrityTests-1670400890-project-member] Lock "96100d9b-92e9-43d6-86bf-12d3fba7f036" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.407s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:16:48 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:16:49 user nova-compute[72362]: DEBUG nova.compute.manager [req-e9615cdc-7e72-4182-9e48-8efc76a311c1 req-83169207-94eb-4e28-87f6-dc4f45e8d9d0 service nova] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Received event network-vif-plugged-35628821-d44d-4645-ab29-3fe27ab3589b {{(pid=72362) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 11:16:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e9615cdc-7e72-4182-9e48-8efc76a311c1 req-83169207-94eb-4e28-87f6-dc4f45e8d9d0 service nova] Acquiring lock "96100d9b-92e9-43d6-86bf-12d3fba7f036-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:16:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e9615cdc-7e72-4182-9e48-8efc76a311c1 req-83169207-94eb-4e28-87f6-dc4f45e8d9d0 service nova] Lock "96100d9b-92e9-43d6-86bf-12d3fba7f036-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:16:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [req-e9615cdc-7e72-4182-9e48-8efc76a311c1 req-83169207-94eb-4e28-87f6-dc4f45e8d9d0 service nova] Lock "96100d9b-92e9-43d6-86bf-12d3fba7f036-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:16:49 user nova-compute[72362]: DEBUG nova.compute.manager [req-e9615cdc-7e72-4182-9e48-8efc76a311c1 req-83169207-94eb-4e28-87f6-dc4f45e8d9d0 service nova] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] No waiting events found dispatching network-vif-plugged-35628821-d44d-4645-ab29-3fe27ab3589b {{(pid=72362) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 11:16:49 user nova-compute[72362]: WARNING nova.compute.manager [req-e9615cdc-7e72-4182-9e48-8efc76a311c1 req-83169207-94eb-4e28-87f6-dc4f45e8d9d0 service nova] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Received unexpected event network-vif-plugged-35628821-d44d-4645-ab29-3fe27ab3589b for instance with vm_state deleted and task_state None.
Aug 09 11:16:49 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:16:49 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:16:49 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:16:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:16:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:16:49 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:16:50 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 11:16:50 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 11:16:50 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 11:16:50 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=8923MB free_disk=24.96936798095703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 11:16:50 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:16:50 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:16:50 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 11:16:50 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 11:16:50 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 11:16:50 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 11:16:50 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 11:16:50 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.132s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:16:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:16:56 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:17:01 user nova-compute[72362]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691579806.9191167, 96100d9b-92e9-43d6-86bf-12d3fba7f036 => Stopped> {{(pid=72362) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 11:17:01 user nova-compute[72362]: INFO nova.compute.manager [-] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] VM Stopped (Lifecycle Event)
Aug 09 11:17:01 user nova-compute[72362]: DEBUG nova.compute.manager [None req-e44fc383-6a4b-42b0-91c4-4c71f4d66fd3 None None] [instance: 96100d9b-92e9-43d6-86bf-12d3fba7f036] Checking state {{(pid=72362) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 11:17:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:17:06 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:17:09 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:17:11 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:17:16 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:17:21 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:17:26 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:17:31 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:17:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:17:36 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:17:38 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:17:38 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Starting heal instance info cache {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 11:17:38 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Rebuilding the list of instances to heal {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 11:17:38 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Didn't find any instances for network info cache update. {{(pid=72362) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 11:17:40 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:17:40 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:17:41 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:17:44 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:17:44 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:17:46 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:17:47 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:17:48 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:17:48 user nova-compute[72362]: DEBUG nova.compute.manager [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72362) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 11:17:49 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:17:49 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:17:50 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:17:51 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:17:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:17:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:17:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72362) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 11:17:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:17:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72362) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 11:17:51 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:17:52 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:17:52 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:17:52 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:17:52 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Auditing locally available compute resources for user (node: user) {{(pid=72362) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 11:17:52 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 11:17:52 user nova-compute[72362]: WARNING nova.virt.libvirt.driver [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 11:17:52 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Hypervisor/Node resource view: name=user free_ram=9077MB free_disk=24.968162536621094GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72362) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 11:17:52 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 11:17:52 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 11:17:52 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 11:17:52 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72362) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 11:17:52 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Refreshing inventories for resource provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 11:17:52 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Updating ProviderTree inventory for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 11:17:52 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Updating inventory in ProviderTree for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 11:17:52 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Refreshing aggregate associations for resource provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d, aggregates: None {{(pid=72362) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 11:17:52 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Refreshing trait associations for resource provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE41,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=72362) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 11:17:52 user nova-compute[72362]: DEBUG nova.compute.provider_tree [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed in ProviderTree for provider: 6a678ae9-d474-4dd0-a246-9ae5a9a7108d {{(pid=72362) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 11:17:52 user nova-compute[72362]: DEBUG nova.scheduler.client.report [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Inventory has not changed for provider 6a678ae9-d474-4dd0-a246-9ae5a9a7108d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72362) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 11:17:52 user nova-compute[72362]: DEBUG nova.compute.resource_tracker [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Compute_service record updated for user:user {{(pid=72362) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 11:17:52 user nova-compute[72362]: DEBUG oslo_concurrency.lockutils [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.245s {{(pid=72362) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 11:17:53 user nova-compute[72362]: DEBUG oslo_service.periodic_task [None req-1dbf4878-0d16-47db-92c3-7561143c1005 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72362) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 11:17:56 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 11:18:01 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 11:18:07 user nova-compute[72362]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72362) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}